Skip to content

n5, imglib2, multiview-reconstruction bumps#306

Draft
bogovicj wants to merge 8 commits into
scijava:masterfrom
bogovicj:bdv-n5-mvrecon-Jun2026
Draft

n5, imglib2, multiview-reconstruction bumps#306
bogovicj wants to merge 8 commits into
scijava:masterfrom
bogovicj:bdv-n5-mvrecon-Jun2026

Conversation

@bogovicj

@bogovicj bogovicj commented Jun 17, 2026

Copy link
Copy Markdown
Contributor

Still waiting on JaneliaSciComp/multiview-reconstruction#98

But update n5 artifacts with tests that fail during smelt (due to unmet prerequisites), these tests are now skipped.

  • Updated imglib2-realtransform and imglib2-algororithm (suggested by @tpietzsch )
  • Updated multiview-simulation (suggested by @StephanPreibisch )
  • Updated imglib2-labelmultisets (suggested by @cmhulbert )

@ctrueden

ctrueden commented Jun 17, 2026

Copy link
Copy Markdown
Member

@bogovicj Thanks. I rolled these version bumps into the pombast branch I'm working on as 0b2c9bc. Running a fresh mega-melt now...

@ctrueden

ctrueden commented Jun 18, 2026

Copy link
Copy Markdown
Member

@bogovicj Still waiting for the n5-universe smelt to finish, but already I've seen how the tests are behaving now:

n5-universe test log
[INFO] -------------------------------------------------------
[INFO]  T E S T S
[INFO] -------------------------------------------------------
[INFO] Running org.janelia.saalfeldlab.n5.universe.translation.TranslatedN5Tests
[INFO] Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.022 s -- in org.janelia.saalfeldlab.n5.universe.translation.TranslatedN5Tests
[INFO] Running org.janelia.saalfeldlab.n5.universe.metadata.MetadataUtilsTest
[INFO] Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.001 s -- in org.janelia.saalfeldlab.n5.universe.metadata.MetadataUtilsTest
[INFO] Running org.janelia.saalfeldlab.n5.universe.metadata.AxisMetadataTests
Optional[org.janelia.saalfeldlab.n5.universe.metadata.canonical.CanonicalMultiscaleMetadata@360fe828]
org.janelia.saalfeldlab.n5.universe.metadata.canonical.CanonicalSpatialMetadata@52c3f893
[INFO] Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.010 s -- in org.janelia.saalfeldlab.n5.universe.metadata.AxisMetadataTests
[INFO] Running org.janelia.saalfeldlab.n5.universe.metadata.GenericMetadataParserTest
[INFO] Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.047 s -- in org.janelia.saalfeldlab.n5.universe.metadata.GenericMetadataParserTest
[INFO] Running org.janelia.saalfeldlab.n5.universe.metadata.TransformTests
[INFO] Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.049 s -- in org.janelia.saalfeldlab.n5.universe.metadata.TransformTests
[INFO] Running org.janelia.saalfeldlab.n5.universe.metadata.ome.ngff.v04.NgffAxisTests
[INFO] Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.139 s -- in org.janelia.saalfeldlab.n5.universe.metadata.ome.ngff.v04.NgffAxisTests
[INFO] Running org.janelia.saalfeldlab.n5.universe.metadata.ome.ngff.v04.BuildMultiscaleTest
[INFO] Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.006 s -- in org.janelia.saalfeldlab.n5.universe.metadata.ome.ngff.v04.BuildMultiscaleTest
[INFO] Running org.janelia.saalfeldlab.n5.universe.metadata.ome.ngff.v04.UnitTest
[INFO] Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0 s -- in org.janelia.saalfeldlab.n5.universe.metadata.ome.ngff.v04.UnitTest
[INFO] Running org.janelia.saalfeldlab.n5.universe.metadata.ome.ngff.v04.CoordinateTransformParsingTest
[INFO] Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.007 s -- in org.janelia.saalfeldlab.n5.universe.metadata.ome.ngff.v04.CoordinateTransformParsingTest
[INFO] Running org.janelia.saalfeldlab.n5.universe.metadata.MetadataTests
[WARNING] Tests run: 7, Failures: 0, Errors: 0, Skipped: 7, Time elapsed: 0 s -- in org.janelia.saalfeldlab.n5.universe.metadata.MetadataTests
[INFO] Running org.janelia.saalfeldlab.n5.universe.metadata.NgffTests
[INFO] Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0 s -- in org.janelia.saalfeldlab.n5.universe.metadata.NgffTests
[INFO] Running org.janelia.saalfeldlab.n5.universe.metadata.TranslationTests
[INFO] Tests run: 8, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.201 s -- in org.janelia.saalfeldlab.n5.universe.metadata.TranslationTests
[INFO] Running org.janelia.saalfeldlab.n5.universe.IdentityTranslatedN5Tests
[INFO] Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.033 s -- in org.janelia.saalfeldlab.n5.universe.IdentityTranslatedN5Tests
[INFO] Running org.janelia.saalfeldlab.n5.universe.storage.n5.N5StorageTests
[WARNING] Tests run: 115, Failures: 0, Errors: 0, Skipped: 4, Time elapsed: 843.5 s -- in org.janelia.saalfeldlab.n5.universe.storage.n5.N5StorageTests
[INFO] Running org.janelia.saalfeldlab.n5.universe.storage.n5.N5FileSystemTest
[WARNING] Tests run: 38, Failures: 0, Errors: 0, Skipped: 1, Time elapsed: 0.578 s -- in org.janelia.saalfeldlab.n5.universe.storage.n5.N5FileSystemTest
[INFO] Running org.janelia.saalfeldlab.n5.universe.storage.n5.N5HttpFactoryTest
[WARNING] Tests run: 38, Failures: 0, Errors: 0, Skipped: 1, Time elapsed: 832.3 s -- in org.janelia.saalfeldlab.n5.universe.storage.n5.N5HttpFactoryTest
[INFO] Running org.janelia.saalfeldlab.n5.universe.storage.n5.N5AmazonS3FactoryTest$N5AmazonS3MockTest
[WARNING] Tests run: 1, Failures: 0, Errors: 0, Skipped: 1, Time elapsed: 6.756 s -- in org.janelia.saalfeldlab.n5.universe.storage.n5.N5AmazonS3FactoryTest$N5AmazonS3MockTest
[INFO] Running org.janelia.saalfeldlab.n5.universe.storage.n5.N5GoogleCloudFactoryTest$N5GoogleCloudMockTest
[WARNING] Tests run: 38, Failures: 0, Errors: 0, Skipped: 1, Time elapsed: 2.207 s -- in org.janelia.saalfeldlab.n5.universe.storage.n5.N5GoogleCloudFactoryTest$N5GoogleCloudMockTest
[INFO] Running org.janelia.saalfeldlab.n5.universe.storage.zarr.ZarrStorageTests
[WARNING] Tests run: 293, Failures: 0, Errors: 0, Skipped: 61, Time elapsed: 1753 s -- in org.janelia.saalfeldlab.n5.universe.storage.zarr.ZarrStorageTests
[INFO] Running org.janelia.saalfeldlab.n5.universe.storage.zarr.zarr3.Zarr3GoogleCloudFactoryTest$ZarrGoogleCloudMockTest
[WARNING] Tests run: 47, Failures: 0, Errors: 0, Skipped: 12, Time elapsed: 2.412 s -- in org.janelia.saalfeldlab.n5.universe.storage.zarr.zarr3.Zarr3GoogleCloudFactoryTest$ZarrGoogleCloudMockTest
[INFO] Running org.janelia.saalfeldlab.n5.universe.storage.zarr.zarr3.Zarr3AmazonS3FactoryTest$ZarrAmazonS3MockTest
[WARNING] Tests run: 1, Failures: 0, Errors: 0, Skipped: 1, Time elapsed: 6.757 s -- in org.janelia.saalfeldlab.n5.universe.storage.zarr.zarr3.Zarr3AmazonS3FactoryTest$ZarrAmazonS3MockTest
[INFO] Running org.janelia.saalfeldlab.n5.universe.storage.zarr.zarr3.Zarr3FileSystemTest
[WARNING] Tests run: 47, Failures: 0, Errors: 0, Skipped: 12, Time elapsed: 0.246 s -- in org.janelia.saalfeldlab.n5.universe.storage.zarr.zarr3.Zarr3FileSystemTest
[INFO] Running org.janelia.saalfeldlab.n5.universe.storage.zarr.zarr3.Zarr3HttpFactoryTest
[WARNING] Tests run: 47, Failures: 0, Errors: 0, Skipped: 11, Time elapsed: 785.5 s -- in org.janelia.saalfeldlab.n5.universe.storage.zarr.zarr3.Zarr3HttpFactoryTest
[INFO] Running org.janelia.saalfeldlab.n5.universe.storage.zarr.zarr2.Zarr2GoogleCloudFactoryTest$ZarrGoogleCloudMockTest
[WARNING] Tests run: 50, Failures: 0, Errors: 0, Skipped: 8, Time elapsed: 3.473 s -- in org.janelia.saalfeldlab.n5.universe.storage.zarr.zarr2.Zarr2GoogleCloudFactoryTest$ZarrGoogleCloudMockTest
[INFO] Running org.janelia.saalfeldlab.n5.universe.storage.zarr.zarr2.Zarr2FileSystemTest
[WARNING] Tests run: 50, Failures: 0, Errors: 0, Skipped: 8, Time elapsed: 0.295 s -- in org.janelia.saalfeldlab.n5.universe.storage.zarr.zarr2.Zarr2FileSystemTest
[INFO] Running org.janelia.saalfeldlab.n5.universe.storage.zarr.zarr2.Zarr2HttpFactoryTest
[WARNING] Tests run: 50, Failures: 0, Errors: 0, Skipped: 8, Time elapsed: 947.2 s -- in org.janelia.saalfeldlab.n5.universe.storage.zarr.zarr2.Zarr2HttpFactoryTest
[INFO] Running org.janelia.saalfeldlab.n5.universe.storage.zarr.zarr2.Zarr2AmazonS3FactoryTest$ZarrAmazonS3MockTest
[WARNING] Tests run: 1, Failures: 0, Errors: 0, Skipped: 1, Time elapsed: 6.756 s -- in org.janelia.saalfeldlab.n5.universe.storage.zarr.zarr2.Zarr2AmazonS3FactoryTest$ZarrAmazonS3MockTest
[INFO] Running org.janelia.saalfeldlab.n5.universe.N5TreeNodeTest
[INFO] Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.001 s -- in org.janelia.saalfeldlab.n5.universe.N5TreeNodeTest
[INFO] Running org.janelia.saalfeldlab.n5.universe.options.N5FactoryOptionsTest
[INFO] Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0 s -- in org.janelia.saalfeldlab.n5.universe.options.N5FactoryOptionsTest
[INFO] Running org.janelia.saalfeldlab.n5.universe.N5FactoryTests
[INFO] Tests run: 11, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.332 s -- in org.janelia.saalfeldlab.n5.universe.N5FactoryTests
[INFO] 
[INFO] Results:
[INFO] 
[WARNING] Tests run: 803, Failures: 0, Errors: 0, Skipped: 72

The TL;DR is that even with the new test skipping logic, some of the tests take an extremely long time to finish. Here are they ones >10s, sorted by time taken:

[WARNING] Tests run: 293, Failures: 0, Errors: 0, Skipped: 61, Time elapsed: 1753 s -- in org.janelia.saalfeldlab.n5.universe.storage.zarr.ZarrStorageTests
[WARNING] Tests run: 50, Failures: 0, Errors: 0, Skipped: 8, Time elapsed: 947.2 s -- in org.janelia.saalfeldlab.n5.universe.storage.zarr.zarr2.Zarr2HttpFactoryTest
[WARNING] Tests run: 115, Failures: 0, Errors: 0, Skipped: 4, Time elapsed: 843.5 s -- in org.janelia.saalfeldlab.n5.universe.storage.n5.N5StorageTests
[WARNING] Tests run: 38, Failures: 0, Errors: 0, Skipped: 1, Time elapsed: 832.3 s -- in org.janelia.saalfeldlab.n5.universe.storage.n5.N5HttpFactoryTest
[WARNING] Tests run: 47, Failures: 0, Errors: 0, Skipped: 11, Time elapsed: 785.5 s -- in org.janelia.saalfeldlab.n5.universe.storage.zarr.zarr3.Zarr3HttpFactoryTest

So the timeouts must be happening before the test-skipping decision is made...

For now, I will configure pombast to skip the above problematic tests. If you later improve things further, we can re-enable any adjusted tests then.

@bogovicj

Copy link
Copy Markdown
Contributor Author

@ctrueden , thanks for trying it out and the update

Comment thread pom.xml Outdated

<!-- Amazon S3 - https://aws.amazon.com/sdkforjava -->
<aws.version>1.12.791</aws.version>
<aws.version>2.30.10</aws.version>

@ctrueden ctrueden Jun 22, 2026

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@bogovicj The groupId changed from com.amazon to software.amazon.awssdk, and artifactId from aws-java-sdk-core and aws-java-sdk-s3 to simply s3, so this version bump does not work as written. I am changing it on the pombast branch, so don't worry about it.

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

It looks like Amazon advises consumers to import the AWS SDK BOM, so I am going to do that in pom-scijava.

@ctrueden ctrueden Jun 22, 2026

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@bogovicj Is there some specific reason why 2.30.10 and not 2.46.15 (newest release as of this writing)?

Copy link
Copy Markdown
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

nope, I'll try the latest locally. thanks @ctrueden

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks for testing the latest, @bogovicj. Note that after importing the AWS SDK BOM, the pom-scijava managed component count goes from 657 to 1103 (446 AWS components!) 😱 I'll take steps to suppress those from the https://status.scijava.org/ view because it's a bit overwhelming otherwise.

Copy link
Copy Markdown
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

😱

Copy link
Copy Markdown
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

2.46.15 looks good for n5-aws-s3. I'll bump the version

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Too slow @bogovicj, 2.46.16 is the latest now 🤣

* newest release at this time
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants