Repository navigation
Commit d6e1c86
authored
fix(datafusion): preserve list element field metadata in physical schema (#10285)
## What
`calculate_physical_schema` reattaches each field's reference metadata
for struct
children and map key/value entries, but the List, FixedSizeList, and
ListView
branches built their element field without it. Any element metadata — an
`ARROW:extension:name`, a `PARQUET:field_id` — was dropped, so the
physical schema
disagreed with the reference schema on list elements.
## Fix
Carry `logical_elem.metadata()` onto the element field in all three
branches, as
the struct and map branches already do. Added a regression test covering
list,
fixed-size list, and list-view element metadata.
## AI assistance
Prepared with AI assistance; I have reviewed and verified the change.
Signed-off-by: jackylee-ch <qcsd2011@gmail.com>1 parent 9a08b82 commit d6e1c86
1 file changed
Lines changed: 51 additions & 3 deletions
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
148 | 148 | | |
149 | 149 | | |
150 | 150 | | |
151 | | - | |
| 151 | + | |
| 152 | + | |
152 | 153 | | |
153 | 154 | | |
154 | 155 | | |
| |||
173 | 174 | | |
174 | 175 | | |
175 | 176 | | |
176 | | - | |
| 177 | + | |
| 178 | + | |
177 | 179 | | |
178 | 180 | | |
179 | 181 | | |
| |||
240 | 242 | | |
241 | 243 | | |
242 | 244 | | |
243 | | - | |
| 245 | + | |
| 246 | + | |
244 | 247 | | |
245 | 248 | | |
246 | 249 | | |
| |||
646 | 649 | | |
647 | 650 | | |
648 | 651 | | |
| 652 | + | |
| 653 | + | |
| 654 | + | |
| 655 | + | |
| 656 | + | |
| 657 | + | |
| 658 | + | |
| 659 | + | |
| 660 | + | |
| 661 | + | |
| 662 | + | |
| 663 | + | |
| 664 | + | |
| 665 | + | |
| 666 | + | |
| 667 | + | |
| 668 | + | |
| 669 | + | |
| 670 | + | |
| 671 | + | |
| 672 | + | |
| 673 | + | |
| 674 | + | |
| 675 | + | |
| 676 | + | |
| 677 | + | |
| 678 | + | |
| 679 | + | |
| 680 | + | |
| 681 | + | |
| 682 | + | |
| 683 | + | |
| 684 | + | |
| 685 | + | |
| 686 | + | |
| 687 | + | |
| 688 | + | |
| 689 | + | |
| 690 | + | |
| 691 | + | |
| 692 | + | |
| 693 | + | |
| 694 | + | |
| 695 | + | |
| 696 | + | |
649 | 697 | | |
0 commit comments