Idefics2

Available · Language, Multimodal · Milestone

Idefics2 is an 8B multimodal model from Hugging Face that takes interleaved text and images and generates text, published as open weights under Apache 2.0 in base, instruction-tuned and chatty checkpoints. It is built on Mistral-7B-v0.1 and SigLIP, handles images at native resolution up to 980 x 980 pixels, and Hugging Face says it has enhanced OCR compared with Idefics1. [1] [2]first paragraph Primary source

Timeline of Idefics2 →

Claims and evidence

  • Released Primary source[1]Published April 15, 2024
  • Status AvailableWeights of the base, instruct and chatty checkpoints are downloadable from the HuggingFaceM4 organisation on the Hub. Hugging Face publishes no deprecation page for its models. Primary source[2]Hub repository HuggingFaceM4/idefics2-8b, Files and versions
  • Successor of IDEFICS Primary source[1]second paragraph; Improvements over Idefics1 [2]first paragraph
  • Derived from (other) Mistral 7B (Mistral AI) Primary source[1]language backbone
  • Change · Size A single 8B size instead of 9B and 80B; Hugging Face calls it 10x smaller than the 80B model.Compared with IDEFICS Primary source[1]
  • Change · Architecture Replaces gated cross-attention with Perceiver pooling and an MLP projection, and uses Mistral-7B-v0.1 and SigLIP so400m as backbones.Compared with IDEFICS Primary source[1]
  • Change · Training data Adds OCR, document and image-to-code training data, plus The Cauldron, a new instruction dataset compiled from 50 curated datasets.Compared with IDEFICS Primary source[1]
  • Change · Licensing Released under Apache 2.0; Hugging Face lists the open licence as one of the improvements over Idefics1.Compared with IDEFICS Primary source[1]License
  • Input text, image Primary source[1]first paragraph [2]Model Summary, Model type
  • Output textThe model card says the models do not generate images. Primary source[1]first paragraph [2]first paragraph; Uses
  • Open weights YesApache 2.0 licence. Primary source[1]License [2]first paragraph; License
  • Parameters 8B Primary source[1]second paragraph [3]abstract
  • Access Open-weights download Primary source[1]Getting Started with Idefics2

Lineage

Predecessors

Successors

Based on

  • Mistral 7B · Mistral AI · 27 September 2023 · derived (other)

Variants and derived

None recorded.

Siblings

None recorded.

All ancestors

All descendants

Variants

No variants recorded in this record.

Related AI Radar coverage

AI Radar coverage starts in June 2026; no coverage linked yet.

All model releases from Hugging Face on AI Radar →