Added Accelerators and Examples for Integrating Snowflake Cortex Services as Custom LLM Providers #219
+1,253
−0
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
Summary of Changes:
This PR introduces several helper classes for seamless integration with Snowflake Cortex services within the Crew AI examples library, along with examples demonstrating how to use these classes with both custom-deployed Snowflake Cortex services and the Snowflake Inference Completion Service.
Snowflake Cortex Custom Service Class: This class enables integration with custom-created Cortex services associated with Snowflake databases, allowing Crew AI agents to interact with Snowflake’s data as part of agent tasks.
Snowflake Cortex Inference Service Class: This class facilitates the use of Snowflake's built-in foundation models (e.g., Mistral, Llama3, etc.) through the Cortex Inference Service API, streamlining the interaction with pre-deployed models and enhancing AI-driven workflows within Crew AI using Snowflake’s already deployed LLMs.
The example classes demonstrate how to use Snowflake Cortex as a custom LLM provider and how to add it to the custom provider map for LiteLLM. Once added, this makes it easy to integrate both custom and standard Snowflake Cortex services as LLMs into agents, tasks, and crews.