Commit 7f4a736
committed
store: Add parquet module with Arrow schema mapping
Create the foundation for Parquet-based dump/restore: a schema mapping
module that converts relational Table definitions to Arrow Schema objects.
- arrow_schema() maps Table -> Arrow Schema with system columns (vid,
block tracking, causality_region) followed by data columns
- data_sources_arrow_schema() provides fixed schema for data_sources$ table
- All ColumnType variants mapped (TSVector skipped, Enum -> Utf8)
- List columns wrapped in Arrow List type based on Column.is_list()1 parent 8dc6a48 commit 7f4a736
6 files changed
Lines changed: 494 additions & 8 deletions
Some generated files are not rendered by default. Learn more about customizing how changed files appear on GitHub.
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
116 | 116 | | |
117 | 117 | | |
118 | 118 | | |
| 119 | + | |
119 | 120 | | |
120 | 121 | | |
121 | 122 | | |
| |||
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
38 | 38 | | |
39 | 39 | | |
40 | 40 | | |
| 41 | + | |
| 42 | + | |
41 | 43 | | |
42 | 44 | | |
43 | 45 | | |
| |||
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
24 | 24 | | |
25 | 25 | | |
26 | 26 | | |
| 27 | + | |
27 | 28 | | |
28 | 29 | | |
29 | 30 | | |
| |||
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
| 1 | + | |
| 2 | + | |
0 commit comments