Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Added Accelerators and Examples for Integrating Snowflake Cortex Services as Custom LLM Providers #219

Open
wants to merge 1 commit into
base: main
Choose a base branch
from

Conversation

seaniannuzzi-blend360
Copy link

Summary of Changes:

This PR introduces several helper classes for seamless integration with Snowflake Cortex services within the Crew AI examples library, along with examples demonstrating how to use these classes with both custom-deployed Snowflake Cortex services and the Snowflake Inference Completion Service.

  • Snowflake Cortex Custom Service Class: This class enables integration with custom-created Cortex services associated with Snowflake databases, allowing Crew AI agents to interact with Snowflake’s data as part of agent tasks.

  • Snowflake Cortex Inference Service Class: This class facilitates the use of Snowflake's built-in foundation models (e.g., Mistral, Llama3, etc.) through the Cortex Inference Service API, streamlining the interaction with pre-deployed models and enhancing AI-driven workflows within Crew AI using Snowflake’s already deployed LLMs.

The example classes demonstrate how to use Snowflake Cortex as a custom LLM provider and how to add it to the custom provider map for LiteLLM. Once added, this makes it easy to integrate both custom and standard Snowflake Cortex services as LLMs into agents, tasks, and crews.

@seaniannuzzi-blend360 seaniannuzzi-blend360 changed the title Add Snowflake Cortex Helpers for Custom and Foundation Models Integration Add Examples to Support Snowflake Cortex Custom Services and Inference LLMs in Crew AI Jan 15, 2025
@seaniannuzzi-blend360 seaniannuzzi-blend360 changed the title Add Examples to Support Snowflake Cortex Custom Services and Inference LLMs in Crew AI Added Accelerators and Examples for Integrating Snowflake Cortex Services as Custom LLM Providers Jan 15, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

1 participant