The seafloor is dark. It doesn't have to be.

ApertureLab is a synthetic aperture sonar simulation and beamforming workbench; built to accelerate the AI systems that will map and understand the ocean floor at scale.

Beamformed sonar image showing a dense multi-object scene across mixed seafloor zones Hover for labels  ·  click for full hi-res  →

Isaac D. Gerg, Ph.D.

AI Scientist, ClimateAI  ·  gergltd.com

Most underwater AI projects fail at the same seam: the ML team does not understand the acoustics, and the sonar team does not understand deep learning. I work at both ends. Twenty years of research spanning the complete signal chain (acoustic wave scattering and IQ time-series recording, through beamforming and image formation, to deep embeddings for ATR, segmentation, image compression, and making each stage robust to domain shift) means I can follow the signal from the seafloor to a model embedding and identify exactly where it breaks.

ApertureLab is what that understanding looks like as a piece of software.

Wave Scattering Physics IQ Time-Series Processing TDBP & ω-k Beamforming Image Formation Deep Embeddings ATR Segmentation Image Compression Physics-Based AI/ML Domain Robustness

What ApertureLab unlocks.

SAR foundation models exist because satellite imagery was cheap, abundant, and labeled. Sonar data requires ships, dive operations, and classified access. ApertureLab generates physics-accurate labeled sonar data at satellite-imagery scale; the missing precondition that makes the following possible for the first time.

Synthetic Datasets

Million-image labeled datasets from a single workstation

Every simulated image carries ground-truth labels derived automatically from the scene: object class, position, orientation, burial depth, seafloor type, shadow mask. A dataset that would require decades of ship time to collect in the field can be generated overnight.

  • Object detection and segmentation labels
  • Pixel-accurate shadow and highlight masks
  • Full domain variation: depth, range, bottom type, aspect, burial
  • Rare-event coverage impossible to collect in the field

The data problem for underwater AI is a logistics problem. ApertureLab is the logistics solution.

Foundation Models

No general-purpose foundation model has been trained on SAS imagery. Yet.

Not because the architecture does not exist (ViT, MAE, and contrastive pretraining are all mature), but because training data at the necessary scale never existed. ApertureLab closes that gap with parametric scenes spanning the full space of acoustic environments.

  • Sim-to-real transfer for autonomous underwater vehicle perception
  • Environment-agnostic feature representations across seabed types
  • Edge-case and rare-target coverage unavailable in field collections
  • The sonar analogue to ImageNet-scale pretraining

This is the next rung. The ladder already exists.

Vision-Language Models

VLMs already respond to sonar. Fine-tuning is the obvious next step.

The 2026 IGARSS work shows VLMs classify SAS targets at 0.946 AUC using only a text prompt describing highlight-shadow geometry, with zero domain-specific training. Scene captions generated at render time make the fine-tuning step on a million labeled ApertureLab images straightforward.

  • Auto-generated natural-language captions paired with every image
  • Query sonar archives by English phrase
  • Caption imagery for non-expert operators and analysts
  • A path to zero-shot object recognition across unseen target types

The zero-shot baseline is 0.946 AUC. Domain fine-tuning is the straightforward next step.

Evidence

From one English sentence to a labeled dataset.

A single English prompt to ApertureLab, written through Claude Code: “create a 60 by 100 m scene with a grid of different seafloor backgrounds and a target in the middle of each one, so I can crop 256 by 256 chips of the same object on different bottoms for ML training.” The image above is what came back, rendered overnight on one workstation; physics through the entire chain. Sixty seafloor targets, ten varied bottom classes — clean sand, mud, rock, gravel, coarse gravel, silt, rippled sand, two rocky-sediment variants, and shelly sand hash — with roughness and reflectivity jittered per cell so no two cells match. Every green box, name, and seafloor zone outline is generated automatically from the scene file at simulation time, not hand-annotated. The three insets along the right show the same target lifted off three of those backgrounds.

The same physics that renders a labeled scene forward is what trains the model that reads one backward.

Simulate

Scene editor for sonar geometry, seafloor types, objects, and platform motion. GPU ray-trace physics backend for accurate acoustic scattering and shadow geometry.

Beamform

Integrated TDBP and ω-k pipelines produce georeferenced SLC imagery directly in the tool.

Inspect

Interactive viewer with physical-coordinate cursor readout, three output variants, pan/zoom.

Why synthetic aperture

The same seafloor, imaged two ways.

Side-scan sonar forms each image from a single physical array, so its along-track resolution spreads with range. Synthetic aperture sonar coherently combines hundreds of pings into one long virtual array, holding fine resolution across the entire swath. It is the same step that carried radar from real aperture to SAR.

One simulated scene, rendered through both imaging chains. Top: real-aperture side-scan at 400 kHz. Bottom: synthetic aperture at 100 kHz, 32 channels, focused with GPU time-domain back-projection. The crops are matched 9 m windows on three objects; a cargo container, a cylinder, and a boat hull. The side-scan smears edges and internal structure along-track as range grows; the synthetic aperture resolves them at every range.

Both modalities fall out of the same physics engine, from the same scene file; a model can be trained, and cross-modality transfer studied, on either.

From idea to image in one tool.

1

Scene Design

Place objects, paint seafloor zones, configure sonar array geometry and platform motion in the visual editor. No scripting required.

2

Simulation

GPU ray-trace computes physics-based acoustic propagation ping by ping. Output is a complex IQ time series — 36 channels, 75 kHz sample rate — written in three industry-interchange formats: POSSM-compatible HDF5 (lossless complex IQ, the format used with real sonar hardware), XTF (eXtended Triton Format, the de-facto standard for survey-industry sonar tooling), and MSHDF (an open, publicly released sonar-data HDF5 interchange standard, so the output drops straight into existing sonar processing pipelines).

3

Beamforming

Time-Domain Back-Projection (TDBP) processes each ping of the raw time series, compensating for platform motion and applying matched filtering to produce a focused, georeferenced sonar image.

4

Output

SLC: Single Look Complex The full complex-valued beamformed image. Preserves phase; required for coherent change detection, micronavigation, and interferometry. The raw material for advanced processing.
DRC: Dynamic Range Compressed Tone-mapped magnitude image that renders fine seafloor texture and bright targets simultaneously visible. The format that humans and vision models interpret directly.

From scene to image

The scene on the left, defined entirely in the ApertureLab editor, is simulated and beamformed through the TDBP pipeline to produce the image on the right. No external data — physics all the way through.

Research that makes this possible.

ApertureLab's physics engine is grounded in peer-reviewed sonar science: GPU-accelerated TDBP beamforming, precision interpolation kernels for sub-wavelength micronavigation, and validated sub-bottom acoustic simulation.

AI & Machine Learning

Physics-accurate synthetic data is the missing ingredient for underwater AI; ApertureLab generates it. The research arc below runs from synthesizing scarce training data with a physics-coupled GAN, to few-shot classifiers trained on synthetic augmentation, to zero-shot VLMs that classify sonar imagery with only a text prompt.

Synthetic aperture sonar is to the ocean what satellite imagery is to the land; except the ocean floor remains almost entirely unmapped at the resolution needed for autonomous systems to act on it. The tools to change that are only now becoming mature enough to pair with modern AI.

ApertureLab was built to close that gap: a simulation environment where researchers can prototype sonar missions, generate training data for underwater object recognition models, and validate beamforming algorithms; without access to a ship.

Isaac D. Gerg, Ph.D.

AI Scientist, ClimateAI

If you're building AI systems that need to understand the physical world, I'd like to talk.

isaac.gerg@gergltd.com

More at gergltd.com · see the software in detail →