Koala

Koala is an instruction-following language model developed by Berkeley AI Research (BAIR) that demonstrated the critical importance of training data quality over quantity — fine-tuned from LLaMA on carefully curated dialogue data primarily from ShareGPT conversations, Koala showed that a model trained on high-quality human-AI dialogues could match or exceed models trained on much larger but lower-quality datasets, influencing the data curation strategies of subsequent models like Vicuna and Orca.

What Is Koala?

• Definition: A fine-tuned LLaMA model (April 2023) from UC Berkeley's BAIR lab — trained on a curated mix of dialogue data from ShareGPT (user-shared ChatGPT conversations), HC3 (human-ChatGPT comparison dataset), and other high-quality conversational sources.
• Data Quality Focus: Koala's key contribution was demonstrating that carefully curated dialogue data produces better models than larger volumes of lower-quality instruction data — a finding that influenced the entire field's approach to training data.
• ShareGPT Foundation: Like Vicuna, Koala relied heavily on ShareGPT conversations — real user interactions with ChatGPT that captured the diversity and complexity of actual chatbot use cases.
• Early ChatGPT Clone: Koala was one of the first wave of "ChatGPT clones" (alongside Alpaca, Vicuna, Dolly) that convinced the community that LLaMA fine-tunes were a viable path to creating useful chat assistants.

Why Koala Matters

• Data Quality Thesis: Koala's experiments showed that models trained on high-quality dialogue data (ShareGPT conversations) significantly outperformed models trained on larger volumes of synthetic instruction data (Self-Instruct style) — establishing data quality as the primary driver of model capability.
• Helpfulness Focus: The training data was curated to emphasize helpfulness and reduce refusals — Koala was designed to actually answer questions rather than deflecting with safety disclaimers, a design choice that influenced subsequent uncensored model development.
• BAIR Credibility: As a product of UC Berkeley's prestigious AI research lab, Koala's findings carried significant weight in the research community — the data quality insights were widely cited and adopted.
• Methodology Influence: Koala's approach to data curation (prioritizing real human-AI conversations over synthetic data) directly influenced Vicuna's training strategy and the broader community's shift toward high-quality conversational training data.

Koala is the Berkeley model that established data quality as the key to open-source chat model performance — by demonstrating that carefully curated dialogue data from real ChatGPT conversations produces better models than larger synthetic datasets, Koala influenced the training strategies of Vicuna, Orca, and the entire open-source LLM ecosystem.