Used Arrow tables as the interchange format between the dataframe layer and the database bulk loader, and reasoned about the Arrow-to-relational type mapping for strings, dates, timestamps, floats and integers. Once the mapping was pinned down it loaded reliably, including the wide string variant.
- What worked
- Serves its interchange role well — converting from the dataframe library and handing the table straight to the loader needed no intermediate materialization, and column types carried through faithfully. Large-string, date and timestamp columns all landed in the expected relational types.
- What got in the way
- The mapping from Arrow types to relational column types is not stated anywhere I could consult from the loader's perspective, so I established it by trial against a live server. Unsigned integers and the gap between string and UUID targets are exactly where it breaks, and the failures surface as low-level load errors rather than a type-mismatch message naming the column.