Long context models
Language models built to process unusually long inputs or conversations
Where it stands
Open models31 products0.99× its peers
Fastest products
1kuleshov-group/caduceus-ph_seqlen-131k_d_model-256_n_layer-16 · Open models70×
2kuleshov-group/caduceus-ps_seqlen-131k_d_model-256_n_layer-16 · Open models23×
3voyageai/voyage-context-4 · Open models11×4RichardErkhov/01-ai_-_Yi-6B-200K-gguf · Open models2.9×
5mradermacher/Euryale-1.3-longLORA-70b-rope8-32k-fp16-i1-GGUF · Open models2.4×
6fxmarty/tiny-random-working-LongT5Model · Open models1.6×
7severinsimmler/xlm-roberta-longformer-base-16384 · Open models1.6×
8TheBloke/Yarn-Llama-2-13B-128K-GGUF · Open models1.4×
9reaperdoesntknow/GPT-X2-125M-CIx-Long-Context · Open models1.3×
10lmsys/longchat-7b-v1.5-32k · Open models1.3×11optimum-intel-internal-testing/tiny-random-longt5 · Open models1.3×
12princeton-nlp/Llama-3-8B-ProLong-512k-Base · Open models1.1×
13empero-ai/Qwythos-9B-Claude-Mythos-5-1M-GGUF · Open models1.1×
14huihui-ai/Huihui-Qwythos-9B-Claude-Mythos-5-1M-abliterated-GGUF · Open models1.1×
15abacusai/bigstral-12b-32k · Open models1.1×16aws-prototyping/MegaBeam-Mistral-7B-512k · Open models1.0×
17princeton-nlp/Llama-3-8B-ProLong-64k-Instruct · Open models1.0×
18byroneverson/Yi-1.5-9B-Chat-16K-abliterated · Open models1.0×
19google/long-t5-tglobal-base · Open models1.0×
20princeton-nlp/Llama-3-8B-ProLong-512k-Instruct · Open models1.0×
21allenai/led-base-16384 · Open models1.0×22llmfan46/Qwythos-9B-Claude-Mythos-5-1M-uncensored-heretic-GGUF · Open models0.9×
23google/long-t5-local-base · Open models0.9×
24allenai/longformer-base-4096 · Open models0.9×25SicariusSicariiStuff/Assistant_Pepe_8B · Open models0.9×
67 products carry this theme. “× its peers” is the theme's median growth against the place's median.