Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Can we depreciate sous-chef-recipes, and move to aws for recipe storage? #16

Open
pgulley opened this issue Mar 3, 2024 · 1 comment
Labels
enhancement New feature or request

Comments

@pgulley
Copy link
Member

pgulley commented Mar 3, 2024

Implementing this versioning system makes me feel that this stack is slightly over-convoluted as it stands- especially having a whole separate deployment for each job.
A simpler way to do it would be to have a single deployment for each entry point (conceivably in a single prefect.yaml), and store recipe configuration stuff in S3 or another external storage. This is a significant refactor of the approach I've been using so far, but I think it's a preferable separation of concerns.

@pgulley pgulley added the enhancement New feature or request label Mar 3, 2024
@pgulley pgulley changed the title Can we depreciate sous-chef-recipes? Can we depreciate sous-chef-recipes, and move to aws for recipe storage? Mar 4, 2024
@pgulley
Copy link
Member Author

pgulley commented Mar 5, 2024

First steps in a recent commit- we CAN load a recipe directory directly from S3 via a new entry point.
That entry point could use some massaging.
Next step would be to create a sous-chef prefect deployment file that's JUST sous-chef.
Then, we might want a script to make uploading recipes to s3 more straightforward.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request
Projects
None yet
Development

No branches or pull requests

1 participant