Multinli

MultiNLI (Multi-Genre Natural Language Inference) is a large-scale NLI benchmark with diverse text genres — testing whether models can determine if a hypothesis is entailed, contradicted, or neutral given a premise, across fiction, government, telephone, and more.

What Is MultiNLI?

• Type: Natural Language Inference (NLI) benchmark.
• Task: Classify premise-hypothesis pairs as entailment/contradiction/neutral.
• Size: 433K sentence pairs across 10 genres.
• Diversity: Fiction, letters, government, telephone, travel, etc.
• Split: Matched (same genres) and mismatched (different genres) test sets.

Why MultiNLI Matters

• Genre Diversity: Tests generalization across writing styles.
• Scale: Large enough for deep learning training.
• Standard: Used for BERT, RoBERTa, GPT evaluations.
• Transfer Learning: Pre-train on MultiNLI, fine-tune for other tasks.
• Challenging: Requires genuine language understanding.

Example

Premise: "The old man sat quietly in the garden."
Hypothesis: "Someone was outdoors."
Label: Entailment

Premise: "She never visited Paris."
Hypothesis: "She traveled to France."
Label: Contradiction

MultiNLI is the standard benchmark for natural language understanding — testing reasoning across diverse text types.