The AI Museum
AI Analytics1,072 recordsRecounted 23 September 2026

Language models in 2022

Weightsopenclosedunknownfrontier only
Year20262025202420232022202120202019201820172016
2 filters active, showing 41 of 1,072 recordsClear all

41

Models

19 organisations

37%

Open weights

15 open, 26 closed

5

Frontier

By Epoch's flag

540B

Largest traceable

PaLM (540B)

2022

Span

28 with a traceable size

Releases

by month
Jan
Feb
Mar
Apr
May
Jun
Jul
Aug
Sept
Oct
Nov
Dec

Organisation

Country

Domain

Records

41
Language models in 2022, newest first. Each row links to the source Epoch AI records for it.
ModelOrganisationReleasedParametersWeights
Hybrid H3-2.7BStanford University2022-123B *Open
Vega v2Wuhan University2022-126BClosed
ALM 1.0Beijing Academy of Artificial Intelligence / BAAI2022-11335M *Closed
Fusion in EncoderSamsung2022-11330M *Closed
GalacticaMeta AI2022-11120B *Open
Mogrifier RLSTM (WT2)DeepMind2022-1135MClosed
mT0-13BHugging Face2022-1113BOpen
Flan-PaLM 540BGoogle2022-10540BClosed
LMSI-PalmGoogle2022-10540BClosed
U-PaLM (540B)Google2022-10540BClosed
PaLIGoogle2022-0917B *Closed
AlexaTM 20BAmazon2022-0820BClosed
BlenderBot 3McGill University2022-08175B *Open
GLM-130BTsinghua University2022-08130BOpen
BLOOM-176BHugging Face2022-07176BOpen
CodeT5-largeSalesforce2022-07770M *Open
NLLBMeta AI2022-0755BOpen
DITTOTsinghua University2022-06750MClosed
Minerva (540B)Google2022-06540BClosed
DeBERTaV3large + KEARMicrosoft2022-05418MClosed
GPT-2 Medium (FlashAttention)Stanford University2022-05355MOpen
OPT-175BMeta AI2022-05175BOpen
SimCSEPrinceton University2022-05—Open
UL2Google Research2022-0520BOpen
PaLM (540B)Google Research2022-04540BClosed
Sparse all-MLPMeta AI2022-049BClosed
ChinchillaDeepMind2022-0370BClosed
DeepNetMicrosoft Research2022-033BClosed
GPT-3.5 (davinci-002)OpenAI2022-03—Closed
Segatron-XL large, M=384 + HCPMicrosoft Research2022-03257MClosed
Statement Curriculum LearningOpenAI2022-03774M *Closed
AlphaCodeDeepMind2022-0241BClosed
GPT-NeoX-20BEleutherAI2022-0220BOpen
LaMDAGoogle2022-02137BClosed
PolyCoderCarnegie Mellon University (CMU)2022-023B *Open
RETRO-7BDeepMind2022-028BClosed
ST-MoEGoogle2022-02269B *Closed
data2vec (language)Meta AI2022-01705M *Open
InstructGPT 1.3BOpenAI2022-011BClosed
InstructGPT 175BOpenAI2022-01175BClosed
InstructGPT 6BOpenAI2022-016BClosed

An asterisk marks a parameter figure the source does not consider traceable to the people who built the model. That judgement is the source’s and it has false negatives: Kimi K3 is marked speculative at 2.8T while Moonshot’s own model card states the figure. Why that distinction carries the whole exhibit.

Counts are of models Epoch AI records as notable, not of every model released. The most recent month is always incomplete, because a model enters the dataset when it is reviewed rather than when it ships.

Epoch AI, 'Data on AI Models'. Published online at epoch.ai. Retrieved from 'https://epoch.ai/data/ai-models-documentation' Used under CC BY 4.0.

How this museum is made