Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

feat(ollama): add setup to use NVIDIA GPU within ollama container #227

Open
3 tasks done
psyray opened this issue Nov 9, 2024 · 0 comments · May be fixed by #229
Open
3 tasks done

feat(ollama): add setup to use NVIDIA GPU within ollama container #227

psyray opened this issue Nov 9, 2024 · 0 comments · May be fixed by #229
Assignees
@psyray
Labels
enhancement New feature or request
Milestone
v2.2.0 release

Comments

@psyray
Copy link
Contributor

psyray commented Nov 9, 2024

Expected feature

Run ollama with GPU to leverage GPU acceleration for Ollama LLM processing.

Alternative solutions

No response

Anything else?

No response

Acknowledgements

  • This issue is not a duplicate of an existing bug report.
  • I have chosen an appropriate title.
  • All requested information has been provided properly.
@psyray psyray added the enhancement New feature or request label Nov 9, 2024
@psyray psyray self-assigned this Nov 9, 2024
@psyray psyray changed the title feat(ollama): add setup to use AMD & NVIDIA GPU within ollama container feat(ollama): add setup to use NVIDIA GPU within ollama container Nov 10, 2024
@psyray psyray linked a pull request Nov 10, 2024 that will close this issue
Open
2 tasks
@psyray psyray linked a pull request Nov 10, 2024 that will close this issue
feat: add GPU support for NVIDIA & AMD GPUs in installation and Docker setup (ollama) #229
Open
2 tasks
@psyray psyray added this to the v2.2.0 release milestone Nov 10, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@psyray psyray

Labels
enhancement New feature or request
Projects
None yet
Milestone
v2.2.0 release
1 participant
@psyray