AI Radar

PaLM

Research only · Language · Milestone

PaLM (Pathways Language Model) is a Google research language model, introduced in April 2022 as a 540-billion-parameter dense decoder-only Transformer trained with Google's Pathways system on 6,144 TPU v4 chips. The paper also describes 8B and 62B versions, and its model card says PaLM is designed for research. [1] [2] Primary source

Timeline of PaLM →

Claims and evidence

  • Announced Google Research blog post; the first arXiv version of the paper is dated 2022-04-05. Primary source[1]
  • ReleasedRelease date unknown
  • Status Research only Primary source[2]Appendix E, Table 30 (PaLM Model Card): Known Limitations
      • Output text Primary source[2]Table 30 (PaLM Model Card): Output(s)
      • Context window 2048 tokensTraining sequence length, used for all PaLM models. Primary source[2]section 5, Sequence length
      • Parameters 540BPaLM 540B, the model presented in the announcement; Table 1 lists 540.35 billion parameters. The 8B and 62B models are variants. Primary source[1] [2]Table 1
      • Access research only Primary source[2]Table 30 (PaLM Model Card): Application; Known Limitations

      Lineage

      Predecessors

      No known predecessor.

      Successors

      Based on

      Not derived from another model.

      Variants and derived

      None recorded.

      Siblings

      None recorded.

      All ancestors

      None.

      All descendants

      Variants

      PaLM 8B

      Same dates as PaLM.

      • Variant Inline variant in this record. Primary source[2]section 2.1, Table 1

      Differs in:

      • Parameters: 8B Evidence not assessed [2]Table 1

      PaLM 62B

      Same dates as PaLM.

      • Variant Inline variant in this record. Primary source[2]section 2.1, Table 1

      Differs in:

      • Parameters: 62B Evidence not assessed [2]Table 1

      PaLM 540B

      Same dates as PaLM.

      • Variant Inline variant in this record.The model presented in the announcement; the record-level parameter count applies. Primary source[2]section 2.1, Table 1 [1]

      Related AI Radar coverage

      AI Radar coverage starts in June 2026; no coverage linked yet.

      All model releases from Google on AI Radar →