Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

LoRA训练时间大概是多久呢？ #36

Open
realcarlos opened this issue Apr 27, 2023 · 3 comments
Open

LoRA训练时间大概是多久呢？ #36

realcarlos opened this issue Apr 27, 2023 · 3 comments

Comments

@realcarlos
Copy link

LoRA训练时间大概是多久呢？
@lich99
Copy link
Owner

lich99 commented Apr 27, 2023 •
edited
Loading

V100 1s大概6-7个steps. 所以如果跑50k steps大概2.3h

@realcarlos
Copy link
Author

还有个疑问，得到LORA权重后，使用的时候是要与原权重做一个合并吗？还是可以分开存放？
另外，如果权重合并后，权重文件大小是否会变化，还是保持不变，只是参数变了？

@lich99
Copy link
Owner

lich99 commented Apr 28, 2023

相当于补丁, 是额外的权重, 可以分开存放.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
2 participants
@realcarlos @lich99