Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

json.decoder.JSONDecodeError: Unterminated string starting at: line 1 column 687651 (char 687650) #275

Open
MCCY0001 opened this issue Oct 1, 2023 · 1 comment

Comments

@MCCY0001
Copy link

MCCY0001 commented Oct 1, 2023

PS C:\Docs\projects\git_projects\ChatPaper> python chat_arxiv.py --query "chatgpt robots" --page_num 2 --max_results 3 --days 20
Traceback (most recent call last):
File "C:\Docs\projects\git_projects\ChatPaper\chat_arxiv.py", line 753, in
chat_arxiv_main(args=arxiv_args)
File "C:\Docs\projects\git_projects\ChatPaper\chat_arxiv.py", line 726, in chat_arxiv_main
reader1 = Reader(key_word=args.key_word,
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "C:\Docs\projects\git_projects\ChatPaper\chat_arxiv.py", line 339, in init
self.encoding = tiktoken.get_encoding("gpt2")
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "C:\Application\anaconda\Lib\site-packages\tiktoken\registry.py", line 63, in get_encoding
File "C:\Application\anaconda\Lib\site-packages\tiktoken_ext\openai_public.py", line 11, in gpt2
mergeable_ranks = data_gym_to_mergeable_bpe_ranks(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "C:\Application\anaconda\Lib\site-packages\tiktoken\load.py", line 85, in data_gym_to_mergeable_bpe_ranks
encoder_json = json.loads(read_file_cached(encoder_json_file))
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "C:\Application\anaconda\Lib\json_init_.py", line 346, in loads
return _default_decoder.decode(s)
^^^^^^^^^^^^^^^^^^^^^^^^^^
File "C:\Application\anaconda\Lib\json\decoder.py", line 337, in decode
obj, end = self.raw_decode(s, idx=_w(s, 0).end())
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "C:\Application\anaconda\Lib\json\decoder.py", line 353, in raw_decode
obj, end = self.scan_once(s, idx)
^^^^^^^^^^^^^^^^^^^^^^
json.decoder.JSONDecodeError: Unterminated string starting at: line 1 column 687651 (char 687650)

这是什么原因,前面的都按照教程配置好了

@kingbeam
Copy link

请问你解决了吗

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants