LLM inference router

Save 40-70% on LLM inference without quality regression

Monk Router is a plug-and-play proxy that routes every request to the cheapest model that meets your quality bar. Drop-in for Anthropic, OpenAI, and Gemini wire formats. No code changes.

No code changes BYOK or managed Pay only for savings
Monk Router — live routing Running
$247.38
Saved this session
2,847
Requests routed
63%
Avg savings
ToolRequestedRoutedSaveQStatus

See your savings

Pick a quality preset and your monthly LLM spend. Monk Router routes each request to the cheapest model that clears your quality floor — typically 40-70% less cost, no quality regression.

$ /mo
Thrifty
α 0.25
~70% savings
Balanced
α 0.50
~55% savings
Premium
α 0.75
~40% savings
$6,600
estimated monthly savings
$79,200
annualized savings
$5,400
monthly spend after routing
$1,650
Monk's share (you keep the rest)
Projected model mix

Estimates use a 40-70% savings range depending on quality preset and traffic mix. Actual savings vary by workload. No savings = $0. You only pay when Monk saves you money.

Why Monk Router

A router, not a gateway. Quality-aware routing, not just provider failover. Built for teams that refuse to overpay for inference.

40-70% savings, guaranteed floor

Every request is scored and routed to the cheapest model that clears your quality floor. If no cheaper model meets the bar, it stays on the requested model — zero quality regression, zero risk.

40-70% typical cost reduction

No code changes

Drop-in proxy speaks Anthropic, OpenAI, and Gemini wire formats. Point your base URL at Monk Router and start saving.

# Before
ANTHROPIC_BASE_URL=https://api.anthropic.com
# After
ANTHROPIC_BASE_URL=http://localhost:8080

Quality floor

Every routed response is scored against the original. If quality would regress below your floor, Monk Router keeps the requested model. No degradation, ever.

PASSquality ≥ floor → route to cheaper model
FLOORquality < floor → keep requested model
CACHEcache hit → zero cost, instant

Privacy-first

Customer-hosted data plane. Prompts and API keys never leave your infrastructure.

BYOK or managed

Bring your own keys, or let Monk Cloud resell OpenRouter's 100+ models at cost.

Cost-vs-value regulators

Dial savings up or down per org, team, or user. Spend caps, deny lists, tier ceilings.

Enterprise-ready

VPC deployment (ECS Fargate), SSO, admin controls, audit log, RBAC. Built for compliance-sensitive environments.

VPC SSO / SAML Audit log RBAC Spend caps SLA

How it works

Three steps from install to savings. No code changes, no infra to manage.

01

Install

Run one command. The Systray app installs on your laptop, detects your coding tools, and points them at the router. Add your API keys (BYOK) or use Monk Cloud's managed models.

$ npx @themonk-ai/install
Monk Router — onboarding
✓ Detect tools (Claude Code, Cursor, Copilot)
✓ Add API keys
✓ Pick preset
→ Start routing
02

Route

Each request is embedded, matched to a cluster, and scored against every candidate model. The router picks the cheapest model whose quality score clears your floor — in under 40ms.

Request
Embed
Score
Cheapest model ≥ floor
Routing decision
Requested claude-sonnet-4
Cluster coding · centroid-09
Floor 0.50
Routed gpt-4o-mini · q 0.65
Savings $0.012 · 96%
Status PASS
03

Save

Pay only for savings. Monk takes a percentage of what you save — if there are no savings, you pay $0. Track everything in the dashboard: per-request savings, model mix, quality scores, routing health.

$7,318
net savings / 30d
26.9%
of gross spend
Dashboard — savings
MonTueWedThuFriSatSun

Three products, one universal client

Whether you're an individual dev or an enterprise team, there's a Monk Router deployment for you.

Monk Cloud Coming soon
30% of savings

Managed SaaS. Monk resells OpenRouter (100+ models). $500/mo min.

  • Systray app connects to router.monk.ai
  • 100+ models via OpenRouter pass-through
  • 30% of savings or $500/mo minimum
  • Best for teams who don't want infra
Get Monk Cloud
Monk Enterprise Coming soon
25% of savings

Runs in your VPC. BYOK, SSO, admin controls. Negotiable.

  • Data plane in your VPC (ECS Fargate)
  • BYOK + SSO + admin controls + audit log
  • 25% of savings (negotiable)
  • Best for enterprise teams with compliance
Contact sales

How Monk Router compares

Gateways route by price. Monk Router routes by quality-per-dollar — and keeps your data in your infrastructure.

Capability Monk Router OpenRouter Portkey Not Diamond
Quality-aware routing (per-prompt scoring)
Quality floor (no regression guarantee)
Customer-hosted data plane (VPC) partial
BYOK (your keys never leave)
Cost-vs-value regulators (per-org/user dials)
Drop-in proxy (Anthropic / OpenAI / Gemini wire formats)
Spend caps + deny lists + tier ceilings partial
Percentage-of-savings pricing
SSO / SAML / audit log

Percentage-of-savings pricing

You only pay when Monk Router saves you money. No upfront costs, no per-seat licenses. If there are no savings, you pay nothing.

Product Monk's share Minimum Usage pass-through
Monk Edge 25% of savings $0 (no minimum) BYOK — your keys, your costs
Monk Cloud 30% of savings $500/mo minimum OpenRouter pass-through at cost
Monk Enterprise 25% of savings (negotiable) Custom BYOK — your keys, your costs

Savings = (requested cost) − (actual cost). Monk's share is calculated per-request and aggregated monthly. No savings = $0.

Built for your whole team

Monk Router speaks to every stakeholder in the LLM spend conversation.

Platform / DevEx lead
Priya

"I want cost control without a developer revolt."

Drop-in proxy, no code changes, per-user presets. Developers don't feel it; the bill goes down.

FinOps
Frank

"I want forecastable spend and demonstrable savings."

Spend caps, per-org regulators, monthly savings reports. Percentage-of-savings means aligned incentives.

CISO
Sana

"No prompt exfiltration. Full auditability."

Customer-hosted data plane, BYOK, SSO, audit log. Prompts and keys never leave your network.

Senior engineer
Dev

"Don't add latency. Don't drop quality."

Sub-40ms routing overhead. Quality floor guarantees no regression. Cache hits are instant and free.

SRE / Infra
Omar

"Operable, HA, clear on-call story."

Containerized data plane, health endpoints, failover, provider 503 handling. Runs in ECS Fargate or on a laptop.

Your team
Ready?

Start saving in 5 minutes. No code changes, no infra to manage.

Start for free

Built for enterprise

Deploy in your VPC with full control over keys, access, and audit.

Monk Enterprise

The data plane runs as a container in your VPC (ECS Fargate or EC2). Your API keys never leave your network. SSO, admin controls, and audit logs for compliance-sensitive environments.

Contact sales
  • VPC deployment (ECS Fargate or EC2)
  • BYOK — keys never leave your network
  • SSO (SAML / OIDC)
  • Admin controls & role-based access
  • Audit log of all routing decisions
  • Custom contracts & negotiable pricing
  • Dedicated support & SLA

Trusted by teams cutting LLM spend

From individual developers to enterprise platform teams.

Start saving in 5 minutes

Install Monk Router, add your keys, and start cutting LLM costs today. No code changes required. No savings, no charge.