Liquid AI releases LFM2.5-24B-A2B, a reasoning model for on-device agents
Liquid AI introduced LFM2.5-24B-A2B, a 24B-parameter reasoning model with just 2B active parameters, built to run fast, private agents on local hardware.
AI Desk1 min read
Tag
#Local Ai
Every The Latent Daily story, tool, model and resource tagged “Local Ai”.
6 items
Open-source alternatives to popular AI tools
Free and open-source options for chat, image generation, transcription, automation and coding assistance — what they are, what you need to run them, and the trade-offs.
AI Desk3 min read
Local & On-device AIGuide
How to run a local LLM with Ollama: installation to first chat
Install Ollama, download an open model, chat in the terminal or a web interface, pick a model that fits your memory and use the local API from your own code.
AI Desk3 min read
Local & On-device AIGuide
Quantization explained: how big AI models run on small hardware
Quantization shrinks AI models by storing weights with fewer bits. How 8-bit and 4-bit formats work, GGUF, GPTQ and AWQ, and the quality trade-offs to expect.
AI Desk3 min read