visualization the attention map

[yancx8]

Thank you for your work!
I want visualization the result of cross attention in BasicTransformerBlock, how can i do? I tried get the attention map, but there is no parameter "need_weights" .
Looking forward for your answer!

[flymin]

You may check xformers to acquire the attention map. xformers adopts a block-wise calculation where no explicit "map" is stored in the memory.

[github-actions]

This issue is stale because it has been open for 7 days with no activity. If you do not have any follow-ups, the issue will be closed soon.