23–25 Oct 2024
Milan, Italy
Europe/Rome timezone

Lazy parallel processing and visualization of large data with ImgLib2, BigDataViewer, the N5-API, and Spark

25 Oct 2024, 09:45
1h 30m
Upper Egg Room - Big (Human Technopole)

Upper Egg Room - Big

Human Technopole

Speakers

Stephan Saalfeld (HHMI Janelia) Tobias Pietzsch (HHMI Janelia)

Description

Modern microscopy and other scientific data acquisition methods generate large high-dimensional datasets exceeding the size of computer main memory and often local storage
space. In this workshop, you will learn to create lazy processing workflows with ImgLib2, using the N5 API for storing and loading large n-dimensional datasets, and how to use Spark to parallelize such workflows on compute clusters. You will use BigDataViewer to visualize and test processing results. Participants will perform practical exercises, and learn skills applicable to a high performance / cluster computing.

Target audience Intermediate developers, Advanced developers
Keywords BigDataViewer, Imglib2, Big data, Fiji, Visualization, HDF5, N5, Zarr, Spark

Presentation materials

There are no materials yet.