mozilla-ai/otari

★751PythonApache-2.0⑂ 97Issue 205Updated Oct 29, 2026

View on GitHub ↗Website ↗

Open-source, OpenAI-compatible LLM gateway you run yourself. One endpoint for 40+ providers, with virtual keys, budgets, and usage tracking.

A self-hosted gateway that unifies 40+ LLM providers behind one API — Otari is a Mozilla AI project that lets you run your own OpenAI/Anthropic-compatible gateway in front of 40+ model providers. It adds virtual API keys, pre-spend budget checks, usage tracking, and local routing policies for failover, useful for teams wanting to own their AI infrastructure instead of relying on a hosted proxy.

Metrics

Retention can be computed 30 days after a repository first trends (it isn't shown until then). See About for how each metric is defined.

Star growth and Trending appearances (last 30 days)

Created Apr 2, 2026 · First on trending Oct 19, 2026

Other notable repositories in the same category (LLMs & ML)

• pst2154/nemotron-deciffusionStructured decisions from an 8B diffusion model in a single GPU pass
• todesking/slopsamplerCataloging the telltale phrases of AI-generated Japanese text
• datalab-to/indraA 1M-parameter OCR model that beats PaddleOCR and Tesseract on CPU
• fudan-generative-vision/RemorySoft memory that survives context compaction for LLM agents
• google-pytorch/torch_tpuA PyTorch Backend That Runs Models Directly on Google TPUs

See all LLMs & ML repositories →

Rank within ai

See all ai repositories →