This Epic is for adding a new Union logical type as a variant of DType.
Status
Proposed.
No work has been done on this yet.
Goal
We want to support a logical Union type in Vortex. This would complement our logical product type (Struct) with a sum type (Union), allowing the Vortex type system to be more expressive. Additionally, we will want to have encodings that are well-optimized for specific use cases (sparse vs dense union).
Motivation
We would like to move towards full compatibility with the Arrow specification, and union is (AFAICT) the last canonical format that Vortex does not support.
We also would like to cover all of the Arrow canonical extension types, and GeoArrow is built on top of the union type.
Unresolved questions
This Epic is for adding a new
Unionlogical type as a variant ofDType.Status
Proposed.
No work has been done on this yet.
Goal
We want to support a logical
Uniontype in Vortex. This would complement our logical product type (Struct) with a sum type (Union), allowing the Vortex type system to be more expressive. Additionally, we will want to have encodings that are well-optimized for specific use cases (sparse vs dense union).Motivation
We would like to move towards full compatibility with the Arrow specification, and union is (AFAICT) the last canonical format that Vortex does not support.
We also would like to cover all of the Arrow canonical extension types, and GeoArrow is built on top of the union type.
Unresolved questions