Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Send UGI information over to catalogs #126

Open
javsanbel2 opened this issue Dec 23, 2024 · 1 comment
Open

Send UGI information over to catalogs #126

javsanbel2 opened this issue Dec 23, 2024 · 1 comment

Comments

@javsanbel2
Copy link

javsanbel2 commented Dec 23, 2024

Hello all,

I have setup a REST catalog using Hive Metastore catalog. When a spark pipeline run and connect to the REST Catalog, the user (UGI) who ran the pipeline doesn't get reflected in the Hive Metastore, it takes the docker container username (iceberg).

How possible could be to send this information? Could it be common between catalogs? Sending this information to Hive Metastore will it be similar to Glue Catalog? Or does it need custom code for each extension?

If I get some advice, I could try to help 👍

@danielcweeks
Copy link
Collaborator

Hey @javsanbel2, Identity propagation is different between REST and HMS, so I'm not sure we want to just push the HMS approach into the REST spec.

With REST, implementations typically use the AUTHORIZATION header to provide/interpret identity (e.g. OAuth/OIDC token). This image is a simple implementation and it's possible you could use something like basic header to provide username information, but other than that, it would require a more complicated implementation.

Just adding fields to pass through leads to non-standard solutions, so I don't think extending the HMS approach is a good idea here.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants