The AI Museum
AI Analytics1,072 recordsRecounted 23 September 2026

Open-weight models in 2020

Weightsopenclosedunknownfrontier only
Year20262025202420232022202120202019201820172016
2 filters active, showing 28 of 1,072 recordsClear all

28

Models

21 organisations

100%

Open weights

28 open, 0 closed

1

Frontier

By Epoch's flag

13B

Largest traceable

mT5-XXL

2020

Span

15 with a traceable size

Releases

by month
Jan
Feb
Mar
Apr
May
Jun
Jul
Aug
Sept
Oct
Nov
Dec

Organisation

Country

Domain

Records

28
Open-weight models in 2020, newest first. Each row links to the source Epoch AI records for it.
ModelOrganisationReleasedParametersWeights
CPM-LargeTsinghua University2020-123BOpen
DensePhrasesKorea University2020-12—Open
ERNIE-Doc (247M)Baidu2020-12247MOpen
ESM1bFacebook AI Research2020-12652MOpen
VQGAN + CLIPHeidelberg University2020-12—Open
AlphaFold 2DeepMind2020-1193M *Open
German ELECTRA Largedeepset2020-10335MOpen
LUKEUniversity of Washington2020-10483M *Open
mT5-XXLGoogle2020-1013BOpen
ViT-Base/32Google Brain2020-1086M *Open
ViT-Huge/14Google Brain2020-10632MOpen
wave2vec 2.0 LARGEFacebook2020-10317MOpen
ProBERTaUniversity of Illinois Urbana-Champaign (UIUC)2020-0944MOpen
ERNIE-GEN (large)Baidu2020-08340M *Open
EfficientDetGoogle Brain2020-0777M *Open
Hopfield Networks (2020)Johannes Kepler University Linz2020-07—Open
SemExpCarnegie Mellon University (CMU)2020-07—Open
DETRFacebook2020-0560MOpen
Retrieval-Augmented GeneratorFacebook2020-05626MOpen
UnifiedQAAllen Institute for AI2020-0511BOpen
CURLUniversity of California (UC) Berkeley2020-04907,264 *Open
Once for AllMIT-IBM Watson AI Lab2020-048MOpen
ELECTRAStanford University2020-03335M *Open
Routing Transformer (WT-103)Google Research2020-0380MOpen
Tensor-Transformer(1core)+PN (WT103)University of California (UC) Berkeley2020-0385MOpen
ALBERT-xxlargeToyota Technological Institute at Chicago2020-02235M *Open
SimCLRGoogle Brain2020-02375M *Open
Theseus 6/768University of California San Diego2020-0266MOpen

An asterisk marks a parameter figure the source does not consider traceable to the people who built the model. That judgement is the source’s and it has false negatives: Kimi K3 is marked speculative at 2.8T while Moonshot’s own model card states the figure. Why that distinction carries the whole exhibit.

Counts are of models Epoch AI records as notable, not of every model released. The most recent month is always incomplete, because a model enters the dataset when it is reviewed rather than when it ships.

Epoch AI, 'Data on AI Models'. Published online at epoch.ai. Retrieved from 'https://epoch.ai/data/ai-models-documentation' Used under CC BY 4.0.

How this museum is made