Skip to content

Parallelize your data-processing pipelines with just a decorator.

License

Notifications You must be signed in to change notification settings

JLeutloff/generatorpipeline

 
 

Repository files navigation

generatorpipeline

Parallelize your data-processing pipelines with just a decorator.

Tutorial

Please see the tutorial notebook for an overview of the functionality.

Installation

Python 2 is NOT supported. You must use python version 3.6 or higher!

  1. The recommended way is to create a python venv and install it into the venv. Create a new virtualenv by
python -m venv --system-site-packages ~/.venv/defaultpyvenv
  1. activate the environment using source ~/.venv/defaultpyvenv/bin/activate.

  2. Install into the venv

pip install generatorpipeline[full]@git+https://github.com/skuschel/generatorpipeline.git

Installation for developers

Follow steps 1 and 2 of the normal installation to create and activate a venv.

  1. git clone this repository
git clone [email protected]:skuschel/generatorpipeline.git
  1. Install in editable mode using
pip install -e .

Contributing

... is always welcome! Development and issue tracker can be found on github. Please report bugs to https://github.com/skuschel/generatorpipeline/issues

About

Parallelize your data-processing pipelines with just a decorator.

Resources

License

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages

  • Python 57.8%
  • Jupyter Notebook 41.2%
  • Shell 1.0%