This repo is to demonstrate rag data processing pipeline using dataflow flex templates

This project demonstrates how to read data from JDBC and write it to BigQuery with encryption using Google Tink and KMS. It also provides an example of how to customize the encryption by specifying the PII columns.

google dataflow model implement

Automatically generate job parameter options from GCP Dataflow Templates