Skip to content

[connectors] RecordFormat is used for both encoding and decoding #6516

Description

@mihaibudiu

catalog.rs has a RecordFormat which carries configuration, e.g. Csv(CsvParserConfig)
However, the RecordFormat is used for both input and output, as the doc says:

/// Descriptor that specifies the format in which records are received
/// or into which they should be encoded before sending.
#[derive(Clone)]
pub enum RecordFormat {

But CsvParserConfig is a parser configuration, it does not apply fully to the output side.
It should be called CsvConfig, or there should be separate configurations for Decoding and Encoding.

It is not clear that this can be easily changed without breaking backwards compatibility.

Metadata

Metadata

Assignees

No one assigned

    Labels

    connectorsIssues related to the adapters/connectors crate

    Type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions