How ScaNN Got Good at Billion-Scale MIPS: AVQ and SOAR
Two papers from the same Google research line — AVQ (ICML 2020) and SOAR (NeurIPS 2023) — that reuse one geometric trick about parallel and orthogonal residuals, first to train a single quantizer and then to train redundant assignments that fail differently.
ann mips quantization retrieval scann