Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

How to train the vqvae? #114

Open
Longhzzz opened this issue Dec 20, 2024 · 4 comments
Open

How to train the vqvae? #114

Longhzzz opened this issue Dec 20, 2024 · 4 comments

Comments

@Longhzzz
Copy link

Could you release the code for training VQVAE?

@iFighting
Copy link
Contributor

@Longhzzz
please refer to https://github.com/FoundationVision/vaex

@vxlot
Copy link

vxlot commented Jan 6, 2025

@Longhzzz please refer to https://github.com/FoundationVision/vaex

I downloaded the code from the link and found that I need some local weights to run it. In utils/arg_utils.py lines 270-272, could you make the weight files C:\Users\16333\Desktop\PyCharm\vgpt_vae\lpips_with_vgg.pth and C:\Users\16333\Desktop\PyCharm\vgpt_vae\vit_small_patch16_224.pth publicly available, as well as any other weight files needed to run the training VAE code?

@iFighting
Copy link
Contributor

@Neesky
Copy link

Neesky commented Jan 12, 2025

@vxlot please refer to : vit_small_patch16_224.pth : https://huggingface.co/timm/vit_small_patch16_224.dino lpips_with_vgg.pth: https://huggingface.co/spaces/multimodalart/vqgan/blob/dec38285640c45fc3f8377a9726daf6e0de08d6a/taming/modules/autoencoder/lpips/vgg.pth

"Hello, in the code from the VAE repository: dd.heads.load_state_dict(heads.state_dict()) Are the weights of the 'heads' initialized by default, or do the 'heads' need to be loaded, but the corresponding files are currently not provided? Meanwhile, the results I generated are very different from what is shown in o: 50.266475677, 91.698143005 Could you help answer this question?"

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

4 participants