You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Need to add cronjob or whatever so batches get logged into the database. When the Claude batch was working in early November, it took up to 24 hours for it to complete. The batch is only accessible via the Anthropic console - so I went and checked, downloaded it and then added the results to our Google sheet. Instead what is needed is for batches to get logged into the database.
Eventually we want to actually use the Evaluations systems built around the models - like this one https://platform.openai.com/docs/guides/evals or this one (yes this should be a new issue - we can make it into one when this issue is complete. )
The text was updated successfully, but these errors were encountered:
Need to add cronjob or whatever so batches get logged into the database. When the Claude batch was working in early November, it took up to 24 hours for it to complete. The batch is only accessible via the Anthropic console - so I went and checked, downloaded it and then added the results to our Google sheet. Instead what is needed is for batches to get logged into the database.
Eventually we want to actually use the Evaluations systems built around the models - like this one https://platform.openai.com/docs/guides/evals or this one (yes this should be a new issue - we can make it into one when this issue is complete. )
The text was updated successfully, but these errors were encountered: