FilesExpand file tree

main

/

TODOs.md

Copy path

Blame

More file actions

Blame

More file actions

Latest commit

 

History

History

History

7 lines (6 loc) · 398 Bytes

main

/

TODOs.md

Copy path

Top

File metadata and controls

• Preview
• Code
• Blame

7 lines (6 loc) · 398 Bytes

Raw

Copy raw file

Download raw file

Edit and raw actions

TODOs

• Add the possibility to change sources and sinks
• PartitionsConfiguration should allow for optional columns
• PartitionsConfiguration should have an optional parameter force that should force the use of repartition instead of coalesce in the FileDataSink
• Move to Spark 3.3 and cross compile
• Move TypesafeConfigBuilder to spark-utils-io-pureconfig