Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Retrain system with larger SignWriting #1

Open
AmitMY opened this issue Jan 17, 2024 · 1 comment
Open

Retrain system with larger SignWriting #1

AmitMY opened this issue Jan 17, 2024 · 1 comment

Comments

@AmitMY
Copy link
Contributor

AmitMY commented Jan 17, 2024

Currently, we represent SignWriting as 512x512 images, but we have a lot of whitespace, and the model does not follow correctly.

image

Instead, I would like to try with 2x images

Original New
image 2d023720375547d590f1a2e1e0830091
@bigbraindump
Copy link
Contributor

training res: 512x512

Results:
Normal Pipeline
illustration_scaled_normal

Img2Img Pipeline
illustration_scaled_img2img

notes:

  • model follows seed more than control image, line art style maintained
  • similar behavior to previous pr (addressing issue #7, results and next steps #8) when validating 256 trained model incorrectly with 512 images
  • loss monitoring and lr adjustments didn't improve results
  • subjectively, 256 res training showed better control/learning

question:
Any suggestions or comments?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants