The AI Museum
AI Analytics1,072 recordsRecounted 23 September 2026

Models in 2020

Weightsopenclosedunknownfrontier only
Year20262025202420232022202120202019201820172016
1 filter active, showing 50 of 1,072 recordsClear all

50

Models

29 organisations

56%

Open weights

28 open, 22 closed

4

Frontier

By Epoch's flag

175B

Largest traceable

GPT-3 175B (davinci)

2020

Span

26 with a traceable size

Releases

by month
Jan
Feb
Mar
Apr
May
Jun
Jul
Aug
Sept
Oct
Nov
Dec

Organisation

Country

Domain

Records

50
Models in 2020, newest first. Each row links to the source Epoch AI records for it.
ModelOrganisationReleasedParametersWeights
CPM-LargeTsinghua University2020-123BOpen
CT-MoS (WT2)Google2020-1245MClosed
DensePhrasesKorea University2020-12—Open
ERNIE-Doc (247M)Baidu2020-12247MOpen
ESM1bFacebook AI Research2020-12652MOpen
VQGAN + CLIPHeidelberg University2020-12—Open
AlphaFold 2DeepMind2020-1193M *Open
KEPLERTsinghua University2020-11125MClosed
Conformer + Wav2vec 2.0 + Noisy StudentGoogle2020-101BClosed
German ELECTRA Largedeepset2020-10335MOpen
LUKEUniversity of Washington2020-10483M *Open
mT5-XXLGoogle2020-1013BOpen
ViT-Base/32Google Brain2020-1086M *Open
ViT-Huge/14Google Brain2020-10632MOpen
wave2vec 2.0 LARGEFacebook2020-10317MOpen
ProBERTaUniversity of Illinois Urbana-Champaign (UIUC)2020-0944MOpen
DeLighTUniversity of Washington2020-0899M *Closed
ERNIE-GEN (large)Baidu2020-08340M *Open
EfficientDetGoogle Brain2020-0777M *Open
Hopfield Networks (2020)Johannes Kepler University Linz2020-07—Open
SemExpCarnegie Mellon University (CMU)2020-07—Open
GShard (dense)Google2020-062BClosed
ConformerGoogle2020-05119MClosed
ContextNetGoogle2020-05113M *Closed
DETRFacebook2020-0560MOpen
GPT-3 175B (davinci)OpenAI2020-05175BClosed
NAS+ESS (23M)Northeastern University (China)2020-0523MClosed
Retrieval-Augmented GeneratorFacebook2020-05626MOpen
UnifiedQAAllen Institute for AI2020-0511BOpen
CURLUniversity of California (UC) Berkeley2020-04907,264 *Open
Go-exploreUber AI2020-04—Closed
Once for AllMIT-IBM Watson AI Lab2020-048MOpen
Agent57DeepMind2020-03—Closed
ELECTRAStanford University2020-03335M *Open
MetNetGoogle2020-03225M *Closed
Routing Transformer (WT-103)Google Research2020-0380MOpen
Tensor-Transformer(1core)+PN (WT103)University of California (UC) Berkeley2020-0385MOpen
TransformerXL + spectrum controlUniversity of California Los Angeles (UCLA)2020-03151M *Closed
ALBERT-xxlargeToyota Technological Institute at Chicago2020-02235M *Open
Feedback TransformerLORIA2020-02126M *Closed
FFN SwiGLUGoogle2020-02220MClosed
Perceiver IO (optical flow)DeepMind2020-0228MClosed
SimCLRGoogle Brain2020-02375M *Open
TaLK ConvolutionCarleton University2020-02240M *Closed
TCAN (WT2)Nanjing University2020-0233MClosed
Theseus 6/768University of California San Diego2020-0266MOpen
Turing-NLGMicrosoft2020-0217B *Closed
AlphaFoldDeepMind2020-0116M *Closed
ContextNet + Noisy StudentGoogle2020-01—Closed
MeenaGoogle Brain2020-013BClosed

An asterisk marks a parameter figure the source does not consider traceable to the people who built the model. That judgement is the source’s and it has false negatives: Kimi K3 is marked speculative at 2.8T while Moonshot’s own model card states the figure. Why that distinction carries the whole exhibit.

Counts are of models Epoch AI records as notable, not of every model released. The most recent month is always incomplete, because a model enters the dataset when it is reviewed rather than when it ships.

Epoch AI, 'Data on AI Models'. Published online at epoch.ai. Retrieved from 'https://epoch.ai/data/ai-models-documentation' Used under CC BY 4.0.

How this museum is made