AttributeError: 'QuantLinear' object has no attribute 'weight' #31
Comments
n1ck-guo
changed the title
|
Hey @n1ck-guo , I've already faced the same issue. Check out this one: https://huggingface.co/OPEA/deepseek-vl2-int4-sym-gptq-inc/discussions/3 |
We uploaded the OPEA/deepseek-vl2-int4-sym-gptq-inc model and found this problem. We hope DeepSeek-VL2 could solve this in the future version so that we do not have to use the specific version for quantized model. |
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
The commit faf1802 introduce a bug for quantized deepseek-vl2 model.
AttributeError: 'QuantLinear' object has no attribute 'weight'.
It point to modeling_deepseek.py Line 888.
Old version does not have any problem.
test model address: https://huggingface.co/OPEA/deepseek-vl2-int4-sym-gptq-inc
The text was updated successfully, but these errors were encountered: