local-ai

Mintplex-Labs/anything-llm

A local-first LLM workspace that turns documents into working agents — AnythingLLM bundles RAG chat, multi-user support, and configurable AI agents into one self-hosted app, aimed at people who want to run document-grounded chat and agentic workflows locally instead of relying on hosted AI services. It targets self-hosters and teams needing private, multimodal, agent-capable LLM tooling without complex setup.

Stop renting your intelligence. Own it with AnythingLLM. Everything you need for a powerful local-first agent experience

Zackriya-Solutions/meetily

Rust-powered meeting assistant transcribes and summarizes fully offline — Meetily now runs 4x faster transcription via Parakeet/Whisper with speaker diarization and Ollama-based summarization, built in Rust for macOS and Windows. All processing stays local with no cloud dependency, making it suited for privacy-conscious teams and enterprises needing self-hosted meeting notes.

Privacy first AI meeting note taker. Download Free and open source granola, otter ai, fireflies alternative. Parakeet / Whisper live transcription, on-device speaker diarization, built on Rust. 100% local processing. Meetily (Meetly Ai - https://meetily.ai) is the #1 Self-hosted, Open-source Ai meeting note taker & Assistant for macOS & Windows

MakazhanAlpamys/Soup

One-command LLM fine-tuning that fits an 8B model into 4GB VRAM — Soup is a CLI that fine-tunes and post-trains LLMs from a single YAML config, using layer streaming to run 8B-parameter training on a consumer laptop GPU with just 4GB VRAM. It targets developers who want LoRA/QLoRA/DPO/SFT workflows without SSH setup or config complexity, with exports to GGUF and Ollama.

Fine-tune LLMs from one YAML. Layer streaming trains an 8B model on a 4 GB laptop GPU.

raullenchai/Rapid-MLX

A faster local inference server for coding agents on Apple Silicon — Rapid-MLX is an Apache 2.0, OpenAI/Anthropic-compatible inference server built on MLX, aimed at coding agents needing reliable tool calling. Benchmarks show it decoding faster than Apple's mlx-lm, oMLX, and LM Studio on the same Qwen weights, making it worth a look for local-LLM Mac users.

Rapid-MLX is an open-source (Apache 2.0) OpenAI- and Anthropic-compatible LLM inference server for Apple Silicon, built on MLX, focused on reliable tool calling for coding agents. Up to 4× faster than Apple's MLX (mlx-lm) on the same weights.

PurpleDoubleD/locally-uncensored

A single desktop app for local chat, image, video, and coding AI — Locally Uncensored bundles chat, image/video generation and a coding agent into one free desktop app for Windows and Linux. It runs fully locally with no Docker, terminal or cloud, aiming at users who want private, uncensored AI without juggling separate tools or config files.

The all-in-one local AI studio for your desktop: chat, image and video generation and a coding agent in one free, open source app. Windows and Linux. No Docker, no terminal, no cloud required.

youssofal/MTPLX

Native MTP speculative decoding speeds up local LLMs on Apple Silicon — MTPLX runs Qwen 3.8 Flash Next, Qwen 3.8 27B and Ternary Bonsai 2 27B on Macs using the models' own multi-token prediction heads for exact, batched speculative decoding. It reports roughly 2x decode speed over plain decoding, with a 27B model fitting on 16 GB Macs, via an OpenAI/Anthropic-compatible local server for tools like OpenCode.

The fastest way to run Qwen 3.8 Flash Next, Qwen 3.8 27B and Ternary Bonsai 2 27B on a Mac: 125 tok/s in OpenCode on an M5 Max, and a 27B model on 16 GB Macs. Native MTP speculative decoding on Apple Silicon, exact at any temperature. OpenAI and Anthropic compatible local server.

isair/jarvis

A voice-first AI companion that stays entirely on your machine — Jarvis is a desktop assistant that listens for its name mid-conversation, keeps a rolling transcript, and replies with voice or text using local models via Ollama or OpenAI-compatible servers. It redacts sensitive data before saving to its local diary and knowledge graph, appealing to privacy-conscious users wanting a subscription-free alternative to cloud assistants.

Private local AI assistant for your desktop. Voice and text chat, personal memory, dictation and MCP tools. Runs offline with Ollama or OpenAI-compatible servers on macOS, Windows and Linux.

AtomicBot-ai/Atomic-Chat

A Tauri-based desktop app for running open-weight LLMs offline — Atomic Chat is a desktop inference engine that runs open-weight models like Qwen, Gemma, DeepSeek and GPT-OSS fully offline, with Apple Silicon (MLX) and GGUF/llama.cpp support. Built with Tauri and Node.js, it targets users who want private, self-hosted AI chat and agent tooling without cloud dependency.

Local AI app and inference engine for agents. Run open-weight LLMs locally — private, 100% offline on your computer. Join our Discord: https://discord.com/invite/8wGSsvmg4V

FrigadeHQ/hob

Local AI desktop app that auto-picks the right open-weight model for your Mac — Hob is a free, open-source desktop app that runs open-weight models like Gemma and gpt-oss locally via llama.cpp, offering offline, private alternative to Claude and ChatGPT. It automatically selects the best frontier model that fits your hardware and sets up everything, letting you fill PDFs, analyze documents, and chat without sending data to the cloud.

An easier way to use AI on your own computer. A free, open-source alternative to Claude and ChatGPT that runs open-weight models like Gemma and gpt-oss locally on Mac, Windows and Linux. Private, and works offline.

amurgola/LumaBrowser

Local AI desktop app: a Chromium browser with a GPU-aware llama.cpp runtime, OpenAI-compatible API, AI chat and agents, Stable Diffusion image/video, TTS and music, plus an MCP server so Claude Code, Codex and Cline can drive your browser. Windows, macOS, Linux.

47thtechcorner/RayCodes_AIJobSearch

A local career agent that hunts jobs and shields against prompt injection — An autonomous, local-first pipeline for Claude Code/Antigravity that discovers live job postings, sanitizes them against prompt-injection traps, scores fit 0-100, and runs a dual-agent drafter/reviewer loop to produce tailored ATS-ready applications. Built for senior job hunters who want targeted outreach instead of mass applications.

AI Job Search Github: This Local AI Agent Applies to Jobs For You! (Claude Code / Antigravity) - Local-first autonomous career agent discovering live vacancies, blocking injection traps, scoring fit matrices, and tailoring ATS applications.

simplynadaf/unpile-read-later-triage

A local two-model pipeline that triages your read-later backlog — Unpile pairs TabPFN-v2 for keep/skim/drop prediction with Gemma 3 for a morning digest, running fully offline on your own laptop. It learns from your reopen history to rank saved articles by actual likelihood you'll read them, turning a pile of 1,000+ into a handful with plain-language reasons. Useful for anyone drowning in read-later apps who wants privacy and zero API cost.

A 100% local agent that triages your read-later backlog with TabPFN-v2 and Gemma 3, keeping only the few articles worth your morning. Open-weight, offline, $0. Hacktoberfest 2026 Week 3.