Headline Feature: Prompt Caching!
The big change for this version is the addition of prompt caching! This update requires one additional argument to be passed to the append message functions: appendUserMessage
, appendSystemMessage
, and appendAssistantMessage
.
The new argument is a record containing an optional field cached
, which defaults to false. Simply adding an empty record will suffice to migrate existing code.
What's Changed
- Code cleanup by @imclerran in #22
- Fixed module exports in main.roc by @imclerran in #23
- Add Roc tool by @imclerran in #24
- Add support for prompt caching by @imclerran in #25
- Improvements to tool description for rocStart tool. by @imclerran in #26
Full Changelog: v0.6.1...v0.7.0