Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Extract base pipeline code for reuse in other projects #1351

Closed
pombredanne opened this issue Aug 7, 2024 · 1 comment · Fixed by #1359
Closed

Extract base pipeline code for reuse in other projects #1351

pombredanne opened this issue Aug 7, 2024 · 1 comment · Fixed by #1359
Assignees
@tdruez
Labels
1-next

Comments

@pombredanne
Copy link
Member

pombredanne commented Aug 7, 2024 •
edited
Loading

I would like to reuse the pipeline approach in VulnerableCode and possibly PurlDB as a common way to structure code that imports, improves, collects, visits and maps package and vulnerability data in these tools.

Reusing the pipeline approach will help structure similar code the same way and enable more reuse and easier switch coding between each projects.

See also these related issues:
@pombredanne pombredanne mentioned this issue Aug 7, 2024
Closed
tdruez added a commit that referenced this issue Aug 8, 2024
@tdruez
Move the BasePipeline class to a new aboutcode.pipeline module #1351
f67bef2 
Signed-off-by: tdruez <[email protected]>
tdruez added a commit that referenced this issue Aug 8, 2024
@tdruez
Make the local modules available in the path for building the docs #1351
2a5676b 


Signed-off-by: tdruez <[email protected]>
tdruez added a commit that referenced this issue Aug 8, 2024
@tdruez
Move the BasePipeline class to a new aboutcode.pipeline module #1351 (
c83f677 
#1357)

Signed-off-by: tdruez <[email protected]>
tdruez added a commit that referenced this issue Aug 8, 2024
@tdruez
Move the LoopProgress class to the pipeline module #1351
4c5aed3 
Signed-off-by: tdruez <[email protected]>
tdruez added a commit that referenced this issue Aug 8, 2024
@tdruez
Remove the previous LoopProgress class location #1351
572d556 
Signed-off-by: tdruez <[email protected]>
tdruez added a commit that referenced this issue Aug 8, 2024
@tdruez
Refactor the BasePipeline into 2 subclasses #1351
7616f91 
Signed-off-by: tdruez <[email protected]>
tdruez added a commit that referenced this issue Aug 8, 2024
@tdruez
Move the documentation in a README file #1351
2b28424 
Signed-off-by: tdruez <[email protected]>
tdruez added a commit that referenced this issue Aug 8, 2024
@tdruez
Add unit test for the get_initial_steps function #1351
efcef50 
Signed-off-by: tdruez <[email protected]>
tdruez added a commit that referenced this issue Aug 8, 2024
@tdruez
Refactor the BasePipeline, move out all Project related logic #1351 (#…
eeff642 
…1358)

Signed-off-by: tdruez <[email protected]>
tdruez added a commit that referenced this issue Aug 8, 2024
@tdruez
Add pyproject.toml for packaging aboutcode.pipeline module #1351
9efb4ba 
Signed-off-by: tdruez <[email protected]>
tdruez added a commit that referenced this issue Aug 9, 2024
@tdruez
Refine workflow and add documentation and changelog #1351
8c0d368 
Signed-off-by: tdruez <[email protected]>
tdruez added a commit that referenced this issue Aug 9, 2024
@tdruez @keshav-space
Add pyproject.toml for packaging aboutcode.pipeline module #1351 (#1359)
ceb345e 
* Add pyproject.toml for packaging aboutcode.pipeline module #1351

Signed-off-by: tdruez <[email protected]>

* Add GitHub action to publish aboutcode.pipeline

Signed-off-by: Keshav Priyadarshi <[email protected]>

* Enable GitHub release

Signed-off-by: Keshav Priyadarshi <[email protected]>

* Refine workflow and add documentation and changelog #1351

Signed-off-by: tdruez <[email protected]>

---------

Signed-off-by: tdruez <[email protected]>
Signed-off-by: Keshav Priyadarshi <[email protected]>
Co-authored-by: Keshav Priyadarshi <[email protected]>
tdruez added a commit that referenced this issue Aug 12, 2024
@tdruez
Use a different token name for the pypi auth #1351
5cfe74f 
Signed-off-by: tdruez <[email protected]>
@tdruez
Copy link
Contributor

tdruez commented Aug 12, 2024

@pombredanne @keshav-space @TG1999

aboutcode.pipeline 0.1 published to PyPI at https://pypi.org/project/aboutcode.pipeline/

@tdruez tdruez closed this as completed Aug 12, 2024
@pombredanne pombredanne mentioned this issue Sep 29, 2024
Merged
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@tdruez tdruez

Labels
1-next
Projects
04-VulnerableCode Data Quality and next
Status: Validated
Milestone
No milestone
Development

Successfully merging a pull request may close this issue.

Add pyproject.toml for packaging aboutcode.pipeline module #1351 aboutcode-org/scancode.io
2 participants
@tdruez @pombredanne