Skip to content
Change the repository type filter

All

    Repositories list

    • ollama

      Public
      Get up and running with Llama 3, Mistral, Gemma, and other large language models.
      Go
      MIT License
      8.6k000Updated Jan 10, 2025Jan 10, 2025
    • Stable Diffusion and Flux in pure C/C++
      C++
      MIT License
      326000Updated Dec 27, 2024Dec 27, 2024
    • exo

      Public
      Run your own AI cluster at home with everyday devices 📱💻 🖥️⌚
      Python
      GNU General Public License v3.0
      1k000Updated Nov 28, 2024Nov 28, 2024
    • llama.cpp

      Public
      LLM inference in C/C++
      C++
      MIT License
      10k300Updated Nov 26, 2024Nov 26, 2024
    • Python bindings for llama.cpp
      Python
      MIT License
      1k000Updated Nov 26, 2024Nov 26, 2024
    • fastfetch

      Public
      Like neofetch, but much faster because written mostly in C.
      C
      MIT License
      451000Updated Nov 19, 2024Nov 19, 2024
    • gpustack

      Public
      Manage GPU clusters for running LLMs
      Python
      Apache License 2.0
      92000Updated Nov 17, 2024Nov 17, 2024
    • vllm

      Public
      A high-throughput and memory-efficient inference and serving engine for LLMs
      Python
      Apache License 2.0
      5.1k000Updated Oct 16, 2024Oct 16, 2024
    • k8sgpt

      Public
      Giving Kubernetes Superpowers to everyone
      Go
      Apache License 2.0
      704000Updated Sep 24, 2024Sep 24, 2024
    • Automatic SRE Superpowers within your Kubernetes cluster
      Go
      Apache License 2.0
      95000Updated Jul 31, 2024Jul 31, 2024
    • llama-box

      Public
      LLM inference server implementation based on llama.cpp.
      C++
      MIT License
      9000Updated Jul 30, 2024Jul 30, 2024
    • llm.c

      Public
      LLM training in simple, raw C/CUDA
      Cuda
      MIT License
      2.9k000Updated Jul 22, 2024Jul 22, 2024
    • A proxy that allows you to host ollama images in your local environment
      Go
      MIT License
      1000Updated Jul 2, 2024Jul 2, 2024
    • LLM Benchmark for Throughput via Ollama (Local LLMs)
      Python
      MIT License
      20000Updated Jun 11, 2024Jun 11, 2024
    • makllama

      Public
      MaK(Mac+Kubernetes)llama - Running and orchestrating large language models (LLMs) on Kubernetes with macOS nodes.
      Go
      Apache License 2.0
      33300Updated May 22, 2024May 22, 2024
    • An open and reliable container runtime
      Go
      Apache License 2.0
      3.5k100Updated May 22, 2024May 22, 2024
    • .github

      Public
      0000Updated May 21, 2024May 21, 2024
    • cri

      Public
      Go
      17100Updated May 21, 2024May 21, 2024