Smaller, faster pathology AI models that keep most of the original performance
Researchers introduce GigaPath-Flash and GigaTIME-Flash, two compact foundation models for pathology that aim to make whole-slide image analysis and tumor microenvironment prediction much cheaper to run. Foundation models are large models pretrained on lots of data so they can be adapted to many tasks. These new models shrink the expensive components so they can be applied to entire microscope slides without the huge compute cost of earlier systems.
GigaPath-Flash turns a gigapixel pathology slide into a single, slide-aware representation. It uses a 22‑million‑parameter ViT‑S (vision transformer) tile encoder that maps each 224×224 pixel tile to a 384‑dimensional vector, and a 21‑million‑parameter LongNet slide encoder that combines those tile vectors across the whole slide using dilated attention. The tile encoder was distilled from a much larger GigaPath ViT‑g teacher model (1 billion parameters) using a self‑supervised learning objective (DINOv2). The slide encoder was then trained with a masked autoencoding objective that teaches the model to predict a tile’s representation from the rest of the slide. GigaTIME‑Flash reuses this compact tile encoder and pairs it with a small decoder to predict spatial protein maps (multiplex immunofluorescence) directly from routine H&E images, replacing the previous convolutional U‑Net++ backbone.
On public slide‑level benchmarks the compact model keeps most of the original performance while cutting compute dramatically. GigaPath‑Flash retains about 97% of the original GigaPath model’s average slide‑level score while using about 49.5× fewer floating‑point operations per slide (the paper reports 290.31 TFLOPs/slide for GigaPath‑Flash versus 14,367.349 TFLOPs/slide for GigaPath). In the paper’s controlled comparisons it outperformed all tile‑level‑only baselines on PANDA (prostate biopsy grading) and EBRAINS (brain tumor subtyping) while being the lowest‑cost whole‑slide model tested. For spatial proteomics, GigaTIME‑Flash improved prediction quality over the prior CNN‑based GigaTIME, while running about 6× faster and using about 8× less GPU memory.