Open-weight models from Facebook AI Research
13
Models
1 organisations
100%
Open weights
13 open, 0 closed
0
Frontier
By Epoch's flag
11B
Largest traceable
XLMR-XXL
2018–2023
Span
9 with a traceable size
Organisation
Country
Records
13| Model | Organisation | Released | Parameters | Weights |
|---|---|---|---|---|
| DINOv2 | Facebook AI Research | 2023-04 | 1B | Open |
| Incoder-6.7B | Facebook AI Research | 2023-04 | 7B | Open |
| Masked Autoencoders ViT-H | Facebook AI Research | 2021-11 | 632M * | Open |
| 6-Act Tether | Facebook AI Research | 2021-08 | 5M | Open |
| XLMR-XXL | Facebook AI Research | 2021-08 | 11B | Open |
| HuBERT | Facebook AI Research | 2021-07 | 1B * | Open |
| SEER | Facebook AI Research | 2021-07 | 1B | Open |
| Generative BST | Facebook AI Research | 2021-03 | 9B | Open |
| MSA Transformer | Facebook AI Research | 2021-02 | 100M * | Open |
| ESM1b | Facebook AI Research | 2020-12 | 652M | Open |
| Adaptive Inputs + LayerDrop | Facebook AI Research | 2019-09 | 423M | Open |
| Transformer (Adaptive Input Embeddings) WT103 | Facebook AI Research | 2018-09 | 247M | Open |
| Big Transformer for Back-Translation | Facebook AI Research | 2018-08 | — | Open |
An asterisk marks a parameter figure the source does not consider traceable to the people who built the model. That judgement is the source’s and it has false negatives: Kimi K3 is marked speculative at 2.8T while Moonshot’s own model card states the figure. Why that distinction carries the whole exhibit.
Counts are of models Epoch AI records as notable, not of every model released. The most recent month is always incomplete, because a model enters the dataset when it is reviewed rather than when it ships.
Epoch AI, 'Data on AI Models'. Published online at epoch.ai. Retrieved from 'https://epoch.ai/data/ai-models-documentation' Used under CC BY 4.0.