2018-12-20 (GCS 1.9.11, BQ 0.13.11)
Changelog
Cloud Storage connector:
-
Changed the default value of
fs.gs.path.encodingto 'uri-path', the new codec introduced in 1.4.5. The old behavior can be restored by settingfs.gs.path.encodingto 'legacy'. -
Update all dependencies to latest versions.
-
Don't use
fs.gs.performance.cache.dir.metadata.prefetch.limitproperty to prefetch metadata inPerformanceCachingGoogleCloudStorage- always use single objects list request, because prefetching metadata with multiple list requests (when directory contains a lot of files) could introduce performance penalties when using performance cache. -
Add an option to lazily initialize
GoogleHadoopFileSysteminstances:fs.gs.lazy.init.enable (default: false) -
Add ability to unset
fs.gs.system.bucketwith an empty string value:fs.gs.system.bucket= -
Set default value for
fs.gs.working.dirproperty to/.
BigQuery connector:
- POM updates for GCS connector 1.9.11.
- Update all dependencies to latest versions.