Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add global Lakehouse Schemas for Managing Batch Diagnostic Information #1918

Open
shonesadler opened this issue Dec 19, 2024 · 0 comments
Open

Comments

@shonesadler
Copy link
Contributor

What are the schemas that are affected by the issue

No existing schemas are impacted.
New schemas created are:

  1. aep-lakehouse-batch-input-files-timeseries.schema.json
  2. aep-lakehouse-batch-errors-timeseries.schema.json

What are examples of products that are impacted by the issue

AEP Foundation/Data Landing
Relevant Documentation - https://experienceleague.adobe.com/en/docs/experience-platform/ingestion/quality/error-diagnostics
Internal JIRA - https://jira.corp.adobe.com/browse/PLAT-214882

Context

We are deprecating the Data Access API service. which is provides access to Batch Diagnostic data. The need for this deprecation has been accelerated due to support in AWS where the Data Access API is unavailable. The Lakehouse team is providing alternative access to this data through system datasets that reference these global schemas.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant