a privacy-first shield for clinical VLMs

MANN-Engram

A single patient session can carry a diagnosis, a billing complaint, and an unrelated photo. Feed that noise to a vision-language model and it drifts or hallucinates. MANN-Engram filters it: distill the intent in the cloud, route the right evidence at the edge, pass only what is verified.

Qwen 2.5 · cloud distillation SiGLIP · edge tensor routing relative-margin pruning no raw data to the cloud

The two hemispheres

Cloud intelligence for language; edge intelligence for perception. Meeting in a shared latent space.

☁ cloud · phase 1

Distill the intent

A messy narrative goes to Qwen-2.5-72B, which returns two purified fields: the Clinical Intent, and an image-recognition-style Visual Query — nouns and modalities only, no abstract symptoms.

▸
▣ edge · phase 2

Route the evidence

The visual query and every candidate scan are embedded by a skew-Gaussian-optimized SiGLIP engine and scored by sigmoid-matching probability — all locally, on the edge.

▸
✓ edge · phase 3

Prune to truth

Relative-margin thresholding keeps only candidates within a dynamic window of the best match. Irrelevant scans never reach the model’s context window.

Live routing demo

This reproduces the router’s exact pruning rule. Drag each candidate’s match probability, and the routing tolerance — watch which scans survive.

candidate scansP(match)
0.15
dynamic_threshold = max(max_prob × (1 − margin), 0.10) keep ⇔ P(candidate) ≥ dynamic_threshold
telemetry
Lower tolerance = sniper mode (extreme precision). Higher = cluster mode (recalls related views). The anchor is always the strongest match.

Why it matters

A model is only as honest as the context you hand it. Prune irrelevant evidence and you remove the raw material of hallucination — and you do it at the edge, so the patient’s data never leaves the device to be filtered.

Educational explainer & demo — not a medical device, not clinical advice. The routing rule above mirrors the open reference app; the real embeddings come from SiGLIP. Verified: the live Space is up and its /execute_pipeline mirrors these inputs and metrics.