Skip to content

FrenchLLM

ENFR
Sections
Back to stories
Models/

Mistral NeMo: Prioritizing Hardware Efficiency Over Raw Scale

Mistral AI has launched Mistral NeMo, a 12-billion parameter open-source model developed in collaboration with NVIDIA. Designed to replace the Mistral 7B, the model features a 128k context window and is optimized to run on a single consumer-grade RTX 4090 GPU.

ORIGINAL SOURCE

Mistral NeMo: Prioritizing Hardware Efficiency Over Raw Scale

Mistral AI has launched Mistral NeMo, a 12-billion parameter open-source model developed in collaboration with NVIDIA. Designed to replace the Mistral 7B, the model features a 128k context window and is optimized to run on a single consumer-grade RTX 4090 GPU.

View at Decrypt