You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Presently we determine the packing method of a model's image using this utility function, which looks at the history of the docker image and determines how the image was created based on the kinds of commands that were run in the image layers during its creation.
This is turning out to be an unreliable solution as on some users' machines, the image's history appears to be different, despite the image being entirely the same (as we can verify from its SHA256 value). Therefore, we have decided to add another metadata field to models called Docker Pack Method which we intend to utilise instead of reading the image's history to resolve the image's pack method.
This information can be easily collected and stored in our metadata stores as part of our workflows. And utilising this would make ersilia a lot more reliable and not cause perfectly working models to randomly break every now and then.
Objective(s)
Update the Docker Pack Method column in the Airtable database for all models.
Update the referenced function to read the metadata. In fact the function can be deleted, and we can potentially add a method in the BaseInformation class.
Update the model build workflows to capture this information.
Update airtableops.py module to add this information into Airtable, which will then be naturally serialized to the S3 JSON as well.
Documentation
No response
The text was updated successfully, but these errors were encountered:
Summary
Presently we determine the packing method of a model's image using this utility function, which looks at the history of the docker image and determines how the image was created based on the kinds of commands that were run in the image layers during its creation.
This is turning out to be an unreliable solution as on some users' machines, the image's history appears to be different, despite the image being entirely the same (as we can verify from its SHA256 value). Therefore, we have decided to add another metadata field to models called
Docker Pack Method
which we intend to utilise instead of reading the image's history to resolve the image's pack method.This information can be easily collected and stored in our metadata stores as part of our workflows. And utilising this would make ersilia a lot more reliable and not cause perfectly working models to randomly break every now and then.
Objective(s)
Docker Pack Method
column in the Airtable database for all models.BaseInformation
class.airtableops.py
module to add this information into Airtable, which will then be naturally serialized to the S3 JSON as well.Documentation
No response
The text was updated successfully, but these errors were encountered: