The AI Museum
AI Analytics1,072 recordsRecounted 23 September 2026

Open-weight models in 2019

Weightsopenclosedunknownfrontier only
Year20262025202420232022202120202019201820172016
2 filters active, showing 31 of 1,072 recordsClear all

31

Models

20 organisations

100%

Open weights

31 open, 0 closed

5

Frontier

By Epoch's flag

11B

Largest traceable

T5-11B

2019

Span

15 with a traceable size

Releases

by month
Jan
Feb
Mar
Apr
May
Jun
Jul
Aug
Sept
Oct
Nov
Dec

Organisation

Country

Domain

Records

31
Open-weight models in 2019, newest first. Each row links to the source Epoch AI records for it.
ModelOrganisationReleasedParametersWeights
StarGAN v2NAVER2019-12—Open
StyleGAN2NVIDIA2019-1230MOpen
CamemBERTFacebook2019-11335MOpen
MoCoFacebook AI2019-11375M *Open
Photo-Geometric AutoencoderUniversity of Oxford2019-11—Open
Transformer - LibriVox + Decoding/RescoringFacebook2019-11296MOpen
XLM-RoBERTaFacebook AI2019-11550MOpen
BART-largeFacebook AI2019-10406M *Open
DistilBERTHugging Face2019-1066MOpen
T5-11BGoogle2019-1011BOpen
T5-3BGoogle2019-103BOpen
Adaptive Inputs + LayerDropFacebook AI Research2019-09423MOpen
ALBERTToyota Technological Institute at Chicago2019-0918MOpen
UDSMProtFraunhofer Heinrich Hertz Institute2019-0928M *Open
trRosettaNankai University2019-08—Open
BigBiGANGoogle2019-0786M *Open
RoBERTa LargeFacebook2019-07355MOpen
AWD-LSTM + MoS + Partial ShuffledUniversity of Texas at Austin2019-0635MOpen
FixRes ResNeXt-101 WSLFacebook AI2019-06829M *Open
LaNet-L (CIFAR-10)Brown University2019-0644MOpen
XLMFacebook2019-06665M *Open
XLNetCarnegie Mellon University (CMU)2019-06340MOpen
AWD-LSTM-DRILL + dynamic evaluation† (WT2)IDIAP2019-0534M *Open
EfficientNet-L2Google2019-05480M *Open
ResNeXt-101 Billion-scaleFacebook AI2019-05193M *Open
Cross-lingual alignmentTel Aviv University2019-04—Open
SciBERTAllen Institute for AI2019-03110MOpen
GPT-2 (1.5B)OpenAI2019-022B *Open
KataGoJane Street2019-023M *Open
MT-DNNMicrosoft2019-01330MOpen
Transformer-XL (257M)Carnegie Mellon University (CMU)2019-01257M *Open

An asterisk marks a parameter figure the source does not consider traceable to the people who built the model. That judgement is the source’s and it has false negatives: Kimi K3 is marked speculative at 2.8T while Moonshot’s own model card states the figure. Why that distinction carries the whole exhibit.

Counts are of models Epoch AI records as notable, not of every model released. The most recent month is always incomplete, because a model enters the dataset when it is reviewed rather than when it ships.

Epoch AI, 'Data on AI Models'. Published online at epoch.ai. Retrieved from 'https://epoch.ai/data/ai-models-documentation' Used under CC BY 4.0.

How this museum is made