Grounding Dino

Grounding DINO is a state-of-the-art open-set object detector — combining the transformer-based detection of DINO (DETR variant) with grounded pre-training to detect arbitrary objects specified by text inputs.

What Is Grounding DINO?

• Definition: A fusion of DINO detector + GLIP-style language pre-training.
• Input: Image + Text Prompt (e.g., "person wearing red shirt").
• Output: Bounding boxes for the entities mentioned in the text.
• Performance: Achieves top-tier results on ODinW (Object Detection in the Wild) benchmarks.

Architecture

• Dual Encoders: Image backbone (Swin/ViT) and Text backbone (BERT/RoBERTa).
• Feature Fusion: Deep early fusion of language and vision features in the encoder.
• Query Selection: Language-guided query selection to focus on relevant regions.

Why It Matters

• REC (Referring Expression Comprehension): Can distinguish "cat on left" vs "cat on right".
• Zero-Shot Power: Strongest performance for detecting novel categories without fine-tuning.
• Pipeline Component: Widely used as the "eyes" for agents (checking if an action was completed).

Grounding DINO is the standard for text-guided detection — serving as a critical module in modern multimodal AI systems and robotic perception pipelines.