The AI Museum
AI Analytics1,072 recordsRecounted 23 September 2026

Language models from United States of America in 2020

Weightsopenclosedunknownfrontier only
Year20262025202420232022202120202019201820172016
3 filters active, showing 17 of 1,072 recordsClear all

17

Models

13 organisations

53%

Open weights

9 open, 8 closed

4

Frontier

By Epoch's flag

175B

Largest traceable

GPT-3 175B (davinci)

2020

Span

11 with a traceable size

Releases

by month
Jan
Feb
Mar
Apr
May
Jun
Jul
Aug
Sept
Oct
Nov
Dec

Organisation

Country

Domain

Records

17
Language models from United States of America in 2020, newest first. Each row links to the source Epoch AI records for it.
ModelOrganisationReleasedParametersWeights
CT-MoS (WT2)Google2020-1245MClosed
LUKEUniversity of Washington2020-10483M *Open
mT5-XXLGoogle2020-1013BOpen
DeLighTUniversity of Washington2020-0899M *Closed
GShard (dense)Google2020-062BClosed
GPT-3 175B (davinci)OpenAI2020-05175BClosed
Retrieval-Augmented GeneratorFacebook2020-05626MOpen
UnifiedQAAllen Institute for AI2020-0511BOpen
ELECTRAStanford University2020-03335M *Open
Routing Transformer (WT-103)Google Research2020-0380MOpen
Tensor-Transformer(1core)+PN (WT103)University of California (UC) Berkeley2020-0385MOpen
TransformerXL + spectrum controlUniversity of California Los Angeles (UCLA)2020-03151M *Closed
ALBERT-xxlargeToyota Technological Institute at Chicago2020-02235M *Open
FFN SwiGLUGoogle2020-02220MClosed
Theseus 6/768University of California San Diego2020-0266MOpen
Turing-NLGMicrosoft2020-0217B *Closed
MeenaGoogle Brain2020-013BClosed

An asterisk marks a parameter figure the source does not consider traceable to the people who built the model. That judgement is the source’s and it has false negatives: Kimi K3 is marked speculative at 2.8T while Moonshot’s own model card states the figure. Why that distinction carries the whole exhibit.

Counts are of models Epoch AI records as notable, not of every model released. The most recent month is always incomplete, because a model enters the dataset when it is reviewed rather than when it ships.

Epoch AI, 'Data on AI Models'. Published online at epoch.ai. Retrieved from 'https://epoch.ai/data/ai-models-documentation' Used under CC BY 4.0.

How this museum is made