README.md

Hugging Face Transformers

Overview

• Log various Hugging Face models for different tasks as MLflow runs and register them as a model.
• The transformers flavor attributes are logged as run and model versions tags (staring with hf_). See example.
• Sample UC and non-UC models: Conversational_Task - JSON and markdown report.

Transformer model notebooks

Notebook	Hugging Face Task	Hugging Face Model	Model GB
Text_to_Text_Generation_Task	text2text-generation	declare-lab/flan-alpaca-base	1.092
Translation_Task	translation_en_to_fr	t5-small	0.245
Conversational_Task	conversational	microsoft/DialoGPT-medium	1.654
Feature_Extraction_Task	feature-extraction	sentence-transformers/all-MiniLM-L12-v2	0.134
Speech_Recognition_Task	automatic-speech-recognition	openai/whisper-tiny	0.154

Other notebooks

• Run_Task_Notebooks - Run all transformer notebooks.
• Common
• Template - template for new transformer notebooks.

Originally from

• https://github.com/mlflow/mlflow/blob/master/examples/transformers

Last updated: 2023-12-12