You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
I notice that in deepseek (llama) vocab, there is no Chinese chars in that, instead of something like åIJ¦, and that can be decoded to Chinese 否. I wonder how this happened. I have checked the source code in transformers and did not find the implementation about this.
I notice that in deepseek (llama) vocab, there is no Chinese chars in that, instead of something like
åIJ¦
, and that can be decoded to Chinese否
. I wonder how this happened. I have checked the source code in transformers and did not find the implementation about this.The text was updated successfully, but these errors were encountered: