Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Minor updates to Materials CSV Source #14

Conversation

nikitabarskov
Copy link
Contributor

This PR includes minor changes to Materials CSV source

  • Updating type annotation so mypy passes,
  • Re-arrange classes in volur.sdk.sources folder,
  • Add a delimiter to a CSV Source, because we expect customers to use different delimiters in theirs CSV,
  • Handle a CSV file more strictly (for example we do not read a file if it does not contain a required column),
  • Update tests,
  • Update dependencies using poetry.lock.

@nikitabarskov nikitabarskov enabled auto-merge (rebase) April 8, 2024 22:43
@nikitabarskov nikitabarskov force-pushed the nikita.barskov-20240408T231713-update-asynchronous-csv-source branch 2 times, most recently from e2bf74a to b38d1f4 Compare April 8, 2024 22:45
- Move `MaterialsSource` to `csv/base.py` because we don't have any others implementations so far,
- Update types in annotations,
- Add `delimiter` field to CSV Source (we can expect a customer using tabs, commas and etc),
- Add additional validation logic when reading a file (a read will fail if a file does not contain a required column),
- Minor improvements and test changes.
@nikitabarskov nikitabarskov force-pushed the nikita.barskov-20240408T231713-update-asynchronous-csv-source branch from b38d1f4 to aafceb9 Compare April 8, 2024 22:49
@nikitabarskov nikitabarskov merged commit 4a28d64 into main Apr 9, 2024
1 check passed
@nikitabarskov nikitabarskov deleted the nikita.barskov-20240408T231713-update-asynchronous-csv-source branch April 9, 2024 06:51
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants