Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Try retrieval-augmented diffusion #14

Open
PaulScotti opened this issue May 31, 2023 · 0 comments
Open

Try retrieval-augmented diffusion #14

PaulScotti opened this issue May 31, 2023 · 0 comments
Labels
enhancement New feature or request hard-difficulty help wanted Extra attention is needed

Comments

@PaulScotti
Copy link
Collaborator

The idea behind this is that, generally speaking, retrieval is a lot easier than reconstruction. And MindEye's retrieval results are astounding (in my opinion)! Whereas MindEye's reconstructions are only a little bit better than Brain-Diffuser.

To get working results using retrieval-augmented diffusion, see the following repos:

https://github.com/CompVis/retrieval-augmented-diffusion-models

https://github.com/afiaka87/retrieval-augmented-diffusion

You don't need to outperform the current MindEye's reconstructions, just implement retrieval-augmented diffusion and get results that look coherent to test the possibility of using this approach.

@PaulScotti PaulScotti added enhancement New feature or request help wanted Extra attention is needed hard-difficulty labels May 31, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request hard-difficulty help wanted Extra attention is needed
Projects
None yet
Development

No branches or pull requests

1 participant