What is an AI cost control proxy?

An AI cost control proxy sits between your application and LLM providers like OpenAI or Anthropic. It enforces spend caps, rate limits, and security filters on every request, and can actively reduce costs through smart routing and semantic caching.

How do I reduce my OpenAI API costs?

Leashly reduces OpenAI costs through smart routing (automatically using cheaper models for simple tasks), semantic caching (returning cached responses for similar prompts at zero cost), and prompt compression (shrinking system prompts before they reach the model). Average savings are 60%.

How do I add rate limiting to my OpenAI API calls?

With Leashly, add one line of code — change your OpenAI base URL to https://www.leashly.dev/api/proxy and your API key to your Leashly proxy key. Then configure rate limiting rules in the dashboard with no additional code changes.

What is prompt injection and how do I prevent it?

Prompt injection is an attack where malicious users insert instructions into prompts to hijack AI behavior. Leashly scans every request against 50+ known attack patterns and blocks them before they reach the model.

Does Leashly work with Anthropic Claude?

Yes. Leashly supports OpenAI, Anthropic Claude, Google Gemini, and any OpenAI-compatible endpoint.

How much latency does an LLM proxy add?

Leashly adds less than 5ms of overhead in typical operation. Rule evaluation happens in-memory with no additional database round-trips on the hot path.

← leashly.dev

Terms of Service

Last updated: April 2025

1. Acceptance

By using Leashly, you agree to these terms. If you don't agree, don't use the service.

2. What Leashly does

Leashly is a proxy service that sits between your application and LLM providers. It enforces spend caps, rate limits, and injection protection. We do not store your prompt content.

3. Your responsibilities

You are responsible for maintaining the security of your Leashly API keys. You must not use Leashly for illegal purposes, to violate LLM providers' terms of service, or to generate harmful content.

4. Billing

Free plan is free forever with limits. Pro plan is $9 CAD/month billed monthly. You can cancel anytime. Refunds are issued at our discretion within 7 days of a charge.

5. Uptime

We aim for 99.9% uptime but do not guarantee it. We are not liable for losses caused by downtime.

6. Limitation of liability

Leashly is provided 'as is'. We are not liable for any indirect, incidental, or consequential damages arising from your use of the service, including unexpected LLM provider charges.

7. Termination

We may suspend or terminate accounts that violate these terms. You may delete your account at any time from Dashboard → Settings.

8. Contact

Questions? Email support@leashly.dev