Commit cb844f2
feat(reader): aggregate null_count across chunks in columnStats
Per-chunk null_count now flows into columnStats(): aggregateStats sums
counts across flats, reporting the total only when every chunk carries
one (a single missing count makes the column total unknown -> null).
Also fixes the early-return guard, which dropped null_count for all-null
columns that have no min/max.
Co-Authored-By: Claude Opus 4.8 <noreply@anthropic.com>1 parent 2799bdd commit cb844f2
2 files changed
Lines changed: 28 additions & 2 deletions
File tree
- reader/src/main/java/io/github/dfa1/vortex/reader
- writer/src/test/java/io/github/dfa1/vortex/writer
Lines changed: 12 additions & 2 deletions
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
181 | 181 | | |
182 | 182 | | |
183 | 183 | | |
| 184 | + | |
| 185 | + | |
| 186 | + | |
| 187 | + | |
184 | 188 | | |
185 | 189 | | |
186 | 190 | | |
| |||
189 | 193 | | |
190 | 194 | | |
191 | 195 | | |
| 196 | + | |
| 197 | + | |
| 198 | + | |
| 199 | + | |
| 200 | + | |
192 | 201 | | |
193 | | - | |
| 202 | + | |
| 203 | + | |
194 | 204 | | |
195 | 205 | | |
196 | | - | |
| 206 | + | |
197 | 207 | | |
198 | 208 | | |
199 | 209 | | |
| |||
Lines changed: 16 additions & 0 deletions
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
78 | 78 | | |
79 | 79 | | |
80 | 80 | | |
| 81 | + | |
| 82 | + | |
| 83 | + | |
| 84 | + | |
| 85 | + | |
| 86 | + | |
| 87 | + | |
| 88 | + | |
| 89 | + | |
| 90 | + | |
| 91 | + | |
| 92 | + | |
| 93 | + | |
| 94 | + | |
| 95 | + | |
| 96 | + | |
81 | 97 | | |
0 commit comments