Add schema-aware CastColumnExpr with owned cast/format options for safe struct casting - #20202

Closed

kosiew wants to merge 24 commits into

apache:mainfrom

kosiew:castcolumnexpr-20162

Commits on Feb 8, 2026

feat(physical-expr): Implement CastColumnExpr with schema-aware validation and proto support
kosiew
committed
25c2355
feat(format): derive Default for OwnedCastOptions and simplify implementation
kosiew
committed
cbcc097
fix(cast): improve input schema creation in CastColumnExpr
kosiew
committed
c4cdd6f
fix(cast): unwrap CastColumnExpr in test cases for better error handling
kosiew
committed
3e145d0
feat(cast): add PhysicalCastColumnNode and PhysicalCastOptions with serialization support
kosiew
committed
decb088
fix(tests): update table schema to allow nullable fields in parquet tests
kosiew
committed
a19ffcb
fix(schema): update column index lookup for physical schema to ensure correctness
kosiew
committed
caa7d2b
fix(row_filter): align nullability with file schema to prevent narrowing of nullable data
kosiew
committed
8fd19d2
fix(cast): improve error messages for incompatible field casts in CastColumnExpr tests
kosiew
committed
cb44506
refactor(spill_pool): simplify writer and reader task handling in examples
kosiew
committed
b0470bb
fix(custom_file_casts): update logical schema to allow nullable Int32 column
kosiew
committed
408904e
Refactor cast validation into focused helper functions
kosiew
committed
ae66e0d
refactor validate_cast_compatibility
kosiew
committed
a23c3eb
feat: add validate_field_compatibility function and update imports
kosiew
committed
52c0436
fix(cast_column): update Hash implementation to include input_schema
kosiew
committed
26ed320
fix(physical_cast_column): update backward compatibility comment for DataFusion version
kosiew
committed
d67cad7
style: format prost.rs
kosiew
committed
c2f2bea
Updated the test expectations to match the new error text.
kosiew
committed
2087e49
revert to main's spill_pool.rs
kosiew
committed
96b4614

Navigation Menu

Add schema-aware CastColumnExpr with owned cast/format options for safe struct casting - #20202

Add schema-aware CastColumnExpr with owned cast/format options for safe struct casting#20202
kosiew wants to merge 24 commits into
apache:mainfrom
kosiew:castcolumnexpr-20162

Commits on Feb 8, 2026

feat(physical-expr): Implement CastColumnExpr with schema-aware validation and proto support

feat(format): derive Default for OwnedCastOptions and simplify implementation

fix(cast): improve input schema creation in CastColumnExpr

fix(cast): unwrap CastColumnExpr in test cases for better error handling

feat(cast): add PhysicalCastColumnNode and PhysicalCastOptions with serialization support

fix(tests): update table schema to allow nullable fields in parquet tests

fix(schema): update column index lookup for physical schema to ensure correctness

fix(row_filter): align nullability with file schema to prevent narrowing of nullable data

fix(cast): improve error messages for incompatible field casts in CastColumnExpr tests

refactor(spill_pool): simplify writer and reader task handling in examples

fix(custom_file_casts): update logical schema to allow nullable Int32 column

Refactor cast validation into focused helper functions

refactor validate_cast_compatibility

feat: add validate_field_compatibility function and update imports

fix(cast_column): update Hash implementation to include input_schema

fix(physical_cast_column): update backward compatibility comment for DataFusion version

style: format prost.rs

Updated the test expectations to match the new error text.

revert to main's spill_pool.rs

Commits on Feb 23, 2026

Update documentation for OwnedCastOptions to clarify lifetime handling

Clarify documentation for OwnedCastOptions regarding lifetime handling

Refactor format and casting options handling

Update function signatures to use named lifetimes

Replaced both unwrap_or_else(FormatOptions::new) with unwrap_or_default() in from_proto.rs.