Skip to content

feat: support Iceberg v3 unknown type#662

Open
manuzhang wants to merge 1 commit into
apache:mainfrom
manuzhang:codex/support-unknown-v3-type
Open

feat: support Iceberg v3 unknown type#662
manuzhang wants to merge 1 commit into
apache:mainfrom
manuzhang:codex/support-unknown-v3-type

Conversation

@manuzhang
Copy link
Copy Markdown
Member

@manuzhang manuzhang commented May 20, 2026

Closes #665


Summary

  • Add Iceberg v3 unknown primitive type and JSON serialization/deserialization support.
  • Support unknown as null-only data across Arrow, Avro, Parquet, schema projection, and nested fields.
  • Enforce required-field invariants for unknown/null-only projections and Arrow null imports.

Validation

  • ctest --test-dir build --output-on-failure

Co-authored-by: @codex

Add an Iceberg unknown primitive type and JSON, Arrow, Avro, Parquet, projection, and data path support for null-only unknown fields. Enforce optionality invariants so required projections cannot be materialized from unknown/null-only fields.

Co-authored-by: Codex <codex@openai.com>
@manuzhang manuzhang marked this pull request as ready for review May 20, 2026 11:10
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

Support v3 unknown data type

1 participant