DINOv2, SALAD, SuperGlue, and the Dustbin Question
January 17, 2024

Visual place recognition and feature matching must decide which observations correspond and which have no partner. DINOv2-SALAD, SuperGlue, and LightGlue expose two architectural answers to that unmatched-feature problem.

Brian Greenforest asks whether removing the optimal-transport dustbin can improve the next generation of Transformer-based visual retrieval and matching.

The Dustbin Gives Unmatched Features a Destination

SuperGlue augments its assignment matrix with dustbin rows and columns, then uses Sinkhorn optimal transport to allocate features that lack a credible match.

SALAD applies optimal-transport aggregation to DINOv2 features for single-stage visual place recognition, carrying the dustbin idea into image retrieval.

LightGlue Opens Another Path

LightGlue uses adaptive computation and confidence-based pruning without the same dustbin construction. That design raises a direct research question about matching quality, speed, calibration, and failure behavior.

Vision researchers can compare both mechanisms on repeated textures, occlusion, viewpoint change, and scenes with many unmatched features. The resulting ablation could guide a stronger retriever-matcher architecture.

Connect Vision Matching to a Complete Model Run

The four-layer run exposes training end to end, while the linked DINOv2, SALAD, and SuperGlue sources carry representation learning into visual place recognition and matching.

Four-Layer Tiny Transformer Training Run · https://lnkd.in/gvgwd4dz · https://lnkd.in/giTDQBtA · https://lnkd.in/gzsjuvyq · https://arxiv.org/abs/2311.15937

Originally posted on LinkedIn

Brian Greenforest · (2024-01-17 03:41:27 UTC)

Open the original LinkedIn post · LinkedIn activity 7153229812667453442

LinkedIn status when archived: Visible to anyone on or off LinkedIn.

DINOv2 SALAD is the SOTA single-stage VPR (Extractor-Retriever-Matcher for images). It uses Optimal Transport DUSTBIN, just as SuperGlue did in the late 2019. What if we go away with DUSTBIN, just as it was done in LightGlue? Can the Transformer be improved even further? Philipp Lindenberger | Paul-Edouard Sarlin | Marc Pollefeys | Javier Civera | Tomasz Malisiewicz | Daniel DeTone | Andrew Rabinovich 🤔 Links: * DIVOv2 SALAD (the cover): https://lnkd.in/gvgwd4dz * SuperGlue: https://lnkd.in/giTDQBtA * LightGlue: https://lnkd.in/gzsjuvyq

Original LinkedIn media