OpenSource-Hub
DiscoverTrendingCode LibraryCategories
/Llm

Llm

22 open source tools found

O
AI Productivity

ollama

Run any open-source LLM locally with a single command. Insanely simple.

Ollama lets you download, run, and manage large language models locally. One command, multiple platforms, endless possibilities.

macOS: Delete /Applications/Ollama.app; Linux: sudo rm /usr/local/bin/ollama; Windows: Uninstall via Add/Remove Programs.
171.3kChecksum
L
AI Productivity

llama.cpp

Lightweight, pure C/C++ LLM inference with minimal setup and top performance on any hardware.

High-performance LLM inference engine in C/C++ with minimal dependencies, supporting quantized models (1.5–8 bit) and diverse hardware (Apple Silicon, CUDA, Vulkan, etc.).

If installed via brew: `brew uninstall llama.cpp`. Via nix: `nix profile remove llama.cpp`. For manual install, delete the executable and `~/.cache/llama.cpp`.
111.2kChecksum

OpenSource-Hub

Quality Open Source Within Reach

Powered by Cloudflare D1 & DeepSeek

Discover

AI ProductivityDev ToolsSystem TuningPrivacyVideo & AudioOffice

Resources

SitemapGitHub Repo

Legal

Privacy PolicyAbout Us

© 2026 OpenSource-Hub

GitHub
M
Video & Audio Download

MoneyPrinterTurbo

One keyword, one click: AI generates a complete short video automatically.

An open-source tool that uses AI LLMs to automatically generate high-quality short videos from a topic or keyword.

For Docker: run `docker compose down` and delete the project folder. For Python: stop the server, remove the project directory and virtual environment. For Windows package: simply delete the extracted folder.
93.4kChecksum
L
AI Productivity

LocalAI

Run any AI model on any hardware locally. No GPU needed, drop-in API replacement for OpenAI.

LocalAI is the open-source AI engine to run any model - LLMs, vision, voice, image, video - on any hardware. No GPU required. Drop-in API compatibility with OpenAI, Anthropic, and ElevenLabs.

macOS: Move LocalAI.app to Trash and empty it. Docker: docker stop local-ai; docker rm local-ai; docker rmi localai/localai:latest and related tags.
46.2kChecksum
K
Developer Tools

Kong

A versatile cloud-native gateway that handles APIs, LLMs, and MCP traffic with rich plugins and native Kubernetes support.

Cloud-native, platform-agnostic API gateway with built-in AI/LLM and MCP traffic management, extensible via plugins.

Stop Docker containers and remove volumes with `docker-compose down -v`, then delete the docker-kong directory.
43.3k
C
AI Productivity

Chatbox

Desktop AI copilot with multi-LLM support, local-only storage, and full cross-platform availability.

Chatbox Community Edition is an open-source desktop client for interacting with multiple large language models. It supports OpenAI (ChatGPT), Azure OpenAI, Claude, Google Gemini Pro, Ollama (local models like Llama 2, Mistral), and ChatGLM-6B. All your chat data is stored locally on your device, ensuring privacy and preventing data loss. The app features a clean, ergonomic UI with dark mode, keyboard shortcuts, streaming replies, and full Markdown/LaTeX rendering with code highlighting. It also includes a prompt library, message quoting, and team collaboration for sharing API resources. Available on Windows, macOS, Linux, Web, iOS, and Android. The community edition is fully functional but may lack some advanced features from the pro version.

Windows: Uninstall from Control Panel. macOS: Drag app to Trash. Linux: Delete the extracted folder. Mobile: Standard app uninstall.
39.8k
D
AI Productivity

daily_stock_analysis

Zero-cost AI stock analysis that pushes daily buy/sell signals to your phone—no server required.

An open-source AI stock analysis system for A/H/US markets that generates daily decision dashboards and pushes them to WeChat Work, Feishu, Telegram, Discord, Slack, or email. Deploy via GitHub Actions for free.

Delete the forked GitHub repository, stop the Docker container, or remove the local project directory to fully uninstall.
37.4kChecksum
N
AI Productivity

next-ai-draw-io

One-sentence AI-powered diagram tool: describe what you want, AI draws it with draw.io.

An AI-powered diagram creation tool that integrates with draw.io, allowing users to create, modify, and enhance diagrams through natural language commands.

If deployed via Docker: docker rm -f container-name; if via source: delete project directory; desktop app: uninstall via OS app manager.
33.3kChecksum
L
Developer Tools

llmfit

Scans your hardware and tells you which LLMs will run well — no downloading, no guessing.

A terminal tool that detects your hardware and right-sizes hundreds of LLM models to your RAM, CPU, and GPU. One command to find what runs on your machine. Supports multi-GPU, MoE architectures, and local providers. More practical than running benchmarks manually.

Uninstall depends on method: `scoop uninstall llmfit`, `brew uninstall llmfit`, or delete the binary and `~/.local/bin/llmfit` if installed manually.
30.3kChecksum
D
AI Productivity

DeepSeek-TUI

A keyboard-driven terminal agent for DeepSeek models with auto mode and streaming reasoning.

DeepSeek TUI is a terminal-based coding agent that brings DeepSeek V4's reasoning power to your command line, with auto mode, tool suite, and session persistence.

If installed via npm: npm uninstall -g deepseek-tui. Via Cargo: cargo uninstall deepseek-tui-cli && cargo uninstall deepseek-tui. Via Homebrew: brew uninstall deepseek-tui.
26.1kChecksum
O
Developer Tools

Opik

Open-source AI observability, evaluation & optimization platform for LLM apps.

Open-source platform for AI observability, evaluation, and optimization. Trace LLM calls, run experiments, monitor production, and optimize prompts with built-in guardrails.

Uninstall Python SDK: pip uninstall opik. For self-hosted server, stop Docker containers and remove volumes.
19.2k
A
Developer Tools

aisuite

Unified Python library for multi-provider LLM chat and agents, plus a desktop AI coworker.

aisuite is a lightweight Python library providing a unified Chat Completions API across multiple AI providers (OpenAI, Anthropic, Google, etc.), plus an Agents API with toolkits and MCP support. It also powers OpenCoworker, a desktop AI coworker.

Uninstall aisuite: run pip uninstall aisuite. For OpenCoworker desktop app, remove from Applications folder (macOS) or Control Panel (Windows).
14.2kChecksum
O
AI Productivity

omlx

Run local LLMs on Mac effortlessly from the menu bar, with smart caching and multi-model support.

Local LLM inference server optimized for Mac with continuous batching and tiered hotspot/cold KV cache. Manage everything from the menu bar.

Delete oMLX.app from Applications, then remove ~/.omlx folder to erase models and settings.
13.8kChecksum
G
AI Productivity

GenericAgent

A 3K-line seed agent that evolves its own skill tree, achieving full system control with 6x less token consumption than comparable frameworks.

A minimal, self-evolving autonomous agent framework with ~3K lines of seed code, 9 atomic tools, and a ~100-line agent loop. Grows a skill tree automatically from every task, consuming 6x less tokens than comparable systems.

Delete the GenericAgent installation folder. If a virtual environment was created, remove it manually. No system-level changes unless you modified environment variables.
12.7kChecksum
L
Developer Tools

liteparse

Fast, local PDF parser with markdown/JSON output and OCR — a lighter alternative to cloud-based document parsers.

A fast, open-source document parser that extracts text, markdown, and structured JSON from PDFs with optional OCR support, running entirely locally with zero cloud dependencies.

Node: npm uninstall -g @llamaindex/liteparse; Python: pip uninstall liteparse; Rust: cargo uninstall liteparse.
11.8kChecksum
O
Developer Tools

open-code-review

Alibaba's battle-tested AI code review CLI with hybrid pipelines, low token cost, and high precision.

AI code review CLI combining deterministic pipelines with LLM agents. Proven at Alibaba scale, provides precise line-level comments, built-in security rules, and supports OpenAI/Anthropic.

Run 'npm uninstall -g @alibaba-group/open-code-review' to remove the tool globally.
11.8kChecksum
F
AI Productivity

freellmapi

One endpoint for all free LLMs: aggregate tiers, smart routing, failover, encrypted keys.

OpenAI-compatible proxy that aggregates free tiers of 16+ LLM providers behind a single /v1 endpoint, with smart routing, automatic failover, and encrypted key storage. Personal experimentation only.

Delete the ~/freellmapi directory (contains SQLite database and config). If using Docker, stop and remove the container and its associated data volume.
11.4kChecksum
L
AI Productivity

LMCache

A vendor-neutral KV cache layer that makes LLM caches persistent, reusable, and observable, speeding up inference across engines.

A vendor-neutral KV cache management layer that accelerates LLM inference by making KV caches persistent, reusable, and observable across engines, reducing TTFT and improving throughput.

Run pip uninstall lmcache. Manually remove any configuration files if present.
8.7kChecksum
H
AI Productivity

headroom

Compress everything your AI agent reads: 60-95% fewer tokens, same answers. Library, proxy, MCP, reversible.

Headroom compresses tool outputs, logs, RAG chunks, files, and conversation history before they reach the LLM. 60-95% fewer tokens with identical answers. Integrates as a library, proxy, MCP server, or agent wrapper.

Uninstall the package: pip uninstall headroom-ai or npm uninstall headroom-ai. If you used `wrap`, remove ~/.headroom directory and any injected environment variables.
7.4kChecksum
M
AI Productivity

Manifest

Smart model router cuts AI costs by 70%, mixes providers and local models.

A smart model router for AI apps that cuts costs up to 70% by routing queries to the best model.

For Docker: docker rm -f manifest and remove volumes; for cloud: just delete your account.
6.2k
H
AI Productivity

Harbor

One command to launch a full local LLM stack with zero config.

A CLI and app to effortlessly spin up a complete local LLM stack with one command.

Remove the Harbor directory (default ~/.harbor) and run `docker compose down` to clean up containers. For a full cleanup including images, run `docker system prune -a`.
2.9kChecksum
B
Developer Tools

Beelzebub

An LLM-powered deception framework that engages attackers with realistic decoys and extracts high-fidelity threat intel.

Beelzebub deploys adaptive, LLM-driven decoy services across SSH, HTTP, TCP, TELNET, and MCP. It actively engages attackers, collects TTPs, and detects AI prompt injections. Low-code YAML config, plugin system, full observability, and production-ready.

Run `docker compose down` to stop containers. Delete the project folder for complete removal.
2.0k
Browse All Categories