ETL data pipeline to analyze real time data from Smart Energy Meter to analyze and optimize electricity consumption in residential contexts.
In particular, I'm working with an energy meter that uses the NB-IoT wireless communication standard and I'll do also some security-related considerations on it.
- Narrowband IoT wireless communication standard
- Apache NiFi (Data Ingestion)
- Apache Kafka (Data Streaming)
- Apache Spark (Real Time Data Processing)
- Apache Airflow (Batch Analysis)
- Elasticsearch (Data Indexing)
- Kibana (Data Visualization)
- PostgreSQL (Persistence)
