Skip to content

Feat/add support kerberize hivemetastore#1634

Merged
kevinjqliu merged 9 commits into
apache:mainfrom
Fokko:feat/add-support-kerberize-hivemetastore
Feb 12, 2025
Merged

Feat/add support kerberize hivemetastore#1634
kevinjqliu merged 9 commits into
apache:mainfrom
Fokko:feat/add-support-kerberize-hivemetastore

Conversation

@Fokko

@Fokko Fokko commented Feb 10, 2025

Copy link
Copy Markdown
Contributor

Took #766 and addressed the comments, to make sure that it gets into 0.9.0

@Fokko Fokko added this to the PyIceberg 0.9.0 release milestone Feb 10, 2025
@Fokko Fokko force-pushed the feat/add-support-kerberize-hivemetastore branch from e6610b1 to 3ab287f Compare February 10, 2025 10:04
@Fokko Fokko force-pushed the feat/add-support-kerberize-hivemetastore branch from 3ab287f to 38d9c2c Compare February 10, 2025 10:06
@Fokko

Fokko commented Feb 10, 2025

Copy link
Copy Markdown
Contributor Author

It is not maintained anymore: https://github.com/apple/ccs-pykerberos

@kevinjqliu

Copy link
Copy Markdown
Contributor

i think to get around this, we need to install some packages on the github runner os

apple/ccs-pykerberos#66

@kevinjqliu kevinjqliu left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I realized that we dont really have a way to verify that this implementation is correct

Comment thread pyproject.toml Outdated
cachetools = "^5.5.0"
pyiceberg-core = { version = "^0.4.0", optional = true }
thrift-sasl = { version = ">=0.4.3", optional = true }
kerberos = { version = "1.3.1", optional = true }

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

this is causing the CI issue. Im not sure if we really require this dependency

@Fokko Fokko Feb 12, 2025

Copy link
Copy Markdown
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Good call, let me check! I was surprised by how little there was as an alternative to this dependency, it is pretty likely that it is not needed at all.

Comment thread pyiceberg/catalog/hive.py
return _HiveClient(
uri,
properties.get("ugi"),
property_as_bool(properties, HIVE_KERBEROS_AUTH, HIVE_KERBEROS_AUTH_DEFAULT),

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Copy link
Copy Markdown
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@kevinjqliu all green :)

@kevinjqliu kevinjqliu left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM! Let's merge this and iterate if necessary

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants