From 35f3d870c05a60de3f202b263f6c966e5915e32e Mon Sep 17 00:00:00 2001
From: LinaLam <65078897+LinaLam@users.noreply.github.com>
Date: Mon, 5 Aug 2024 14:12:30 -0700
Subject: [PATCH] Update llm-tools.md

Added an observability section and Helicone AI
---
 llm-tools.md | 4 ++++
 1 file changed, 4 insertions(+)

diff --git a/llm-tools.md b/llm-tools.md
index 63a14f1..f999f86 100644
--- a/llm-tools.md
+++ b/llm-tools.md
@@ -447,6 +447,10 @@
 - [xtuner](https://github.com/InternLM/xtuner) fine tuning supporting llm, vlm pre training and fine tuning. deepspeed, ZeRO optimization, various architectures, QLoRA and LoRA support
 - [Mergoo](https://github.com/Leeroo-AI/mergoo) merge multiple LLM experts and fine-tune them. Support for MoE, MoA for Llama1-3, Mistral, Phi3 and BERT models
 
+## Observability
+- [Helicone AI](https://github.com/Helicone/helicone) Open-source LLM observability platform for logging, monitoring, and debugging AI applications. Simple 1-line integration to get started.
+
+
 ## Merging & Quantization
 
 - [mergekit](https://github.com/cg123/mergekit) Tools for merging pretrained large language models.