Idefics3

Available · Language, Multimodal · Milestone

Idefics3 is an 8B open-weight multimodal model from Hugging Face that takes interleaved images and text and produces text, built on Meta's Llama 3.1 8B Instruct and Google's SigLIP-SO400M and released under Apache 2.0. Hugging Face says it improves on Idefics2 in OCR, document understanding and visual reasoning, and released the Docmatix dataset with it. [1] [2] Primary source

Timeline of Idefics3 →

Claims and evidence

  • Released No dated announcement. The month follows from the Hub repository (created 2024-08-05; first public community discussion 2024-08-08) and the technical report (arXiv v1, 2024-08-22). Primary source[1]Hub commit history: repository created 2024-08-05; community tab: first discussion 2024-08-08 [2]arXiv v1 of 22 Aug 2024; Introduction: model released alongside the training datasets
  • Status Available Primary source[1]model repository (weights hosted on the Hub)
  • Successor of Idefics2 Primary source[1]introduction: improves upon Idefics1 and Idefics2 [2]Introduction: its predecessor, Idefics2-8B
  • Derived from (other) Llama 3.1 (Meta) Primary source[1]parent model: Llama 3.1 8B Instruct
  • Change · Architecture Uses Llama 3.1 Instruct instead of Mistral-7B as the language model.Compared with Idefics2 Primary source[2]
  • Change · Architecture Encodes each image tile of up to 364x364 pixels with 169 visual tokens; larger images are split into tiles that are encoded separately.Compared with Idefics2 Primary source[1]
  • Change · Training data Fine-tuning data extends The Cauldron with further datasets, including Docmatix.Compared with Idefics2 Primary source[1]
  • Change · Other Hugging Face reports a large improvement over Idefics2 in document understanding.Compared with Idefics2 Primary source[1]
  • Input text, image Primary source[1]introduction; Model Summary: Model type
  • Output text Primary source[1]introduction
  • Open weights Yes Primary source[1]introduction; License: checkpoints released under Apache 2.0
  • Parameters 8B Primary source[2]Introduction: Idefics3-8B [1]Uses: Idefics3-8B
  • Access Open-weights download Primary source[1]How to Get Started

Lineage

Predecessors

Successors

No known successor.

Based on

  • Llama 3.1 · Meta · 23 July 2024 · derived (other)

Variants and derived

None recorded.

Siblings

None recorded.

All ancestors

All descendants

None.

Variants

No variants recorded in this record.

Related AI Radar coverage

AI Radar coverage starts in June 2026; no coverage linked yet.

All model releases from Hugging Face on AI Radar →