From 745fedeaf71219cb1ada655f4fd8d7d0c85f887a Mon Sep 17 00:00:00 2001 From: Pat Heard Date: Tue, 19 Nov 2024 15:35:52 -0500 Subject: [PATCH] docs: update graph to show source data --- .../pipelines/operations/aws/cost-and-usage-report.md | 10 +++++----- 1 file changed, 5 insertions(+), 5 deletions(-) diff --git a/docs/data/pipelines/operations/aws/cost-and-usage-report.md b/docs/data/pipelines/operations/aws/cost-and-usage-report.md index 4888ef8..9eff839 100644 --- a/docs/data/pipelines/operations/aws/cost-and-usage-report.md +++ b/docs/data/pipelines/operations/aws/cost-and-usage-report.md @@ -13,16 +13,16 @@ LIMIT 10; ``` ## Data pipeline -A high level view of the data pipeline is shown below: +A high level view is shown below with more details about each step following the diagram. ```mermaid graph TD %% Source Systems CUR[AWS CUR 2.0 Export] - Lambda[Account Tags Lambda] + Lambda["`**Lambda**
Extract account tags`"] %% Storage - OrgS3["`**Organization S3 Bucket**
cds-cost-usage-report`"] + OrgS3["`**S3 Bucket**
cds-cost-usage-report`"] RawS3["`**Raw S3 Bucket**
cds-data-lake-raw-production`"] TransS3["`**Transformed S3 Bucket**
cds-data-lake-transformed-production`"] @@ -33,7 +33,7 @@ graph TD ETL["ETL Job (Daily)"] %% Flow - subgraph org[Organization] + subgraph org[AWS Organization account] CUR --> OrgS3 Lambda end @@ -41,7 +41,7 @@ graph TD Lambda --> |account-tags.json|RawS3 OrgS3 --> |S3 Replication|RawS3 - subgraph datalake[Data Lake] + subgraph datalake[Data Lake account] RawS3 --> Crawlers Crawlers --> |Updates Schema|CatalogRaw CatalogRaw --> ETL