Skip to content
This repository has been archived by the owner on Dec 20, 2018. It is now read-only.

Add support for reading Avro from RDD #211

Open
adamblev opened this issue Feb 2, 2017 · 1 comment
Open

Add support for reading Avro from RDD #211

adamblev opened this issue Feb 2, 2017 · 1 comment

Comments

@adamblev
Copy link

adamblev commented Feb 2, 2017

Currently it is only possible to parse avro from a file - spark.read.avro(filepath). We want to be able to parse avro from an RDD since our data is in a nested format. Currently this is supported with json format - spark.read.json(RDD[String]), we would want similar functionality for Avro but with binary.

If its possible to do this now with some other mechanism, would love to hear about it too :)

@cbyn
Copy link

cbyn commented Feb 9, 2017

#216

Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants