You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
HADOOP-19654. Upgrade AWS SDK to 2.35.4 (apache#7882)
AWS SDK upgraded to 2.35.4.
This SDK has changed checksum/checksum headers handling significantly,
causing problems with third party stores, and, in some combinations
AWS S3 itself.
The S3A connector has retained old behavior; options to change
these settings are now available.
The default settings are chosen for maximum compatiblity and performance.
fs.s3a.request.md5.header: true
fs.s3a.checksum.generation: false
fs.s3a.create.checksum.algorithm: ""
Consult the documentation for more details.
Contributed by Steve Loughran
HADOOP-19291. RawLocalFileSystem to allow overlapping ranges (apache#……7101)
ChecksumFileSystem creates the chunked ranges based on the checksum chunk size and then calls
readVectored on Raw Local which may lead to overlapping ranges in some cases.
Contributed by: Mukund Thakur