M

Magnitude

SHA-256
2.1k stars·AI Productivity·SHA-256 checksum verified

An open source inference server that profiles your hardware, picks the best local models, and plugs into agents like Pi, OpenCode, Claude Code, and more.

Smart Download

Download Download Version

v@magnitudedev/cli@0.0.11 · 614.9 MB

Run your existing AI agents on local models automatically profiled and tuned for your hardware—free, private, and offline.

Core Features

  • Hardware profiling and model recommendations with estimated tokens/sec
  • One-prompt onboarding: your agent can set itself up
  • On-demand model loading and automatic unloading when idle
  • Fully private and offline: prompts, files, and models stay local
  • End-to-end tuning: speculative decoding, concurrency, etc.

What It Can't Do

  • •Windows is supported only through WSL, not natively
  • •No fixed minimum hardware, but more memory allows larger models
  • •Internet is needed only for initial installation and model download
  • •The catalog is smaller than some rivals like Ollama, but you can add any GGUF model from Hugging Face
  • •The project is evolving quickly; CLI and API may change between updates

Use Cases

  • Developers who want to cut API costs and keep data private by using local models
  • Users who already rely on agent harnesses and want to seamlessly switch them to a local backend

Magnitude is an open source inference server that runs the best local models for your hardware and plugs directly into the agent you already use (Pi, OpenCode, Hermes, OpenClaw, Codex, Claude Code, Oh My Pi, and Cline). Unlike generic model runners like Ollama, Magnitude does not rely on guesswork: it profiles your chip, memory, and bandwidth, then recommends models with estimated tokens/sec, auto-downloads and tunes them (speculative decoding, concurrency) for your specific machine. Models are loaded on demand and unloaded when idle or memory is tight, keeping prompts and files completely private and offline. Setup is agent-first: just tell your agent to install the CLI and run `magnitude docs onboarding`, and it walks you through everything. Magnitude supports macOS, Linux, and Windows via WSL, and is licensed under Apache 2.0.

Tags

local AIinference serveroffline modelsagent harnessLLM

Getting Started

1

Download installer

Click the button above to download the installer for your system

2

Install the software

Double-click the downloaded installer and follow the prompts

3

Install the Magnitude CLI: `npm i -g @magnitudedev/cli` (macOS/Linux, Windows via WSL)

4

Run `magnitude setup` to start the interactive setup, or paste the onboarding prompt into your agent to let it manage the process

5

Pick a recommended model; Magnitude downloads and tunes it, then switches your agent to the local backend

Install Guide
  1. Install the Magnitude CLI: `npm i -g @magnitudedev/cli` (macOS/Linux, Windows via WSL)
  2. Run `magnitude setup` to start the interactive setup, or paste the onboarding prompt into your agent to let it manage the process
  3. Pick a recommended model; Magnitude downloads and tunes it, then switches your agent to the local backend
File Integrity

SHA-256 checksum verified

Checksum extracted from GitHub official Release page

SHA256 Checksum

98f2a0afd5b1adf464fbfd093372899eed9cca48361514d73c49922fbf82ecd9

This checksum is extracted from the GitHub Release page. Verify file integrity after download.

All SHA-256 checksums on this platform are extracted from the project's official GitHub Release page, without any modification. You can independently verify them on the GitHub Releases page.

Open Source Transparency

View GitHub Source
Environment Guide

Uninstall Info

Remove the CLI with `npm uninstall -g @magnitudedev/cli`; for a clean sweep delete the Magnitude data directory (usually ~/.magnitude) and restore any agent backend config you changed.

No Extra Dependencies

Ready to use after download. No additional runtime required.

Project Info
LicenseApache-2.0
Last Updated2026-10-15 08:30:33
GitHub RepositoryOfficial Website

Having issues? Check the FAQ below

5 FAQs

Similar Projects