sharing cleaning links

[wassname]

Thanks for doing this, I don't have a question or issue. I just wanted to share links to some similar cleaning efforts. I hope this is interesting or helpful.

• https://github.com/gururise/AlpacaDataCleaned (note they also removed the "As a large language model" but don't want to call attention to that part)
  • nomic does clustering here
• https://github.com/LAION-AI/riverbed (as part of https://laion.ai/blog/oig-dataset/)

Out of general interest you might like

• https://github.com/orhonovich/unnatural-instructions (use LLM's to augment tasks)
• https://huggingface.co/datasets/stanfordnlp/SHP (instructions from good subreddits)

[anderse77]

How do I use this?