Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Support <think /> tags from R1 #3832

Open
3 tasks
Patrick-Erichsen opened this issue Jan 23, 2025 · 2 comments
Open
3 tasks

Support <think /> tags from R1 #3832

Patrick-Erichsen opened this issue Jan 23, 2025 · 2 comments
Assignees
Labels
area:chat Relates to chat interface good-first-issue Suggested issue for new contributors kind:enhancement Indicates a new feature request, imrovement, or extension

Comments

@Patrick-Erichsen
Copy link
Collaborator

Before submitting your bug report

Relevant environment info

Description

DeepSeek-R1 model produces <think /> tags that we can parse and render in a nicer UI than the default Think... text that we use for reasoning models like o1 that don't expose their reasoning steps.

Example implementation from chat.deepseek.com

Image

Image

To reproduce

No response

Log output

@sestinj sestinj self-assigned this Jan 23, 2025
@Patrick-Erichsen Patrick-Erichsen added good-first-issue Suggested issue for new contributors and removed "needs-triage" labels Jan 23, 2025
@dosubot dosubot bot added area:chat Relates to chat interface kind:enhancement Indicates a new feature request, imrovement, or extension labels Jan 23, 2025
@getfit-us
Copy link

Is this already being worked on, to remove the think from the chat window, (show hide) also make sure its not being sent back into the regular context window for follow up messages?

@germankrause
Copy link
Contributor

#3840 Waiting for review

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
area:chat Relates to chat interface good-first-issue Suggested issue for new contributors kind:enhancement Indicates a new feature request, imrovement, or extension
Projects
None yet
Development

No branches or pull requests

4 participants