DEV Community

Pranay Batta profile picture

Pranay Batta

Agentic Systems | AI Observability | LLMs

Location Bay Area, SF Joined Joined on 
Semantic Caching in a Production LLM Gateway: Three Design Decisions That Mattered

Semantic Caching in a Production LLM Gateway: Three Design Decisions That Mattered

Comments
4 min read

Want to connect with Pranay Batta?

Create an account to connect with Pranay Batta. You can also sign in below to proceed if you already have an account.

Already have an account? Sign in
Building Hierarchical Budget Controls for Multi-Tenant LLM Gateways

Building Hierarchical Budget Controls for Multi-Tenant LLM Gateways

4
Comments
5 min read
Building an MCP Gateway: Lessons from Production

Building an MCP Gateway: Lessons from Production

6
Comments
5 min read
LiteLLM Has 1,000+ Open GitHub Issues. Here's What Three of Them Reveal.

LiteLLM Has 1,000+ Open GitHub Issues. Here's What Three of Them Reveal.

1
Comments
4 min read
We Just Shipped Responses API Support in Bifrost (And It's Cleaner Than Chat Completions)

We Just Shipped Responses API Support in Bifrost (And It's Cleaner Than Chat Completions)

Comments
5 min read
How We Built MCP Support in Bifrost (And What We Learned About Agent Security)

How We Built MCP Support in Bifrost (And What We Learned About Agent Security)

5
Comments 2
5 min read
How We Benchmarked Bifrost against LiteLLM(And What We Learned About Performance)

How We Benchmarked Bifrost against LiteLLM(And What We Learned About Performance)

6
Comments
5 min read
Why We Built Another LLM Gateway (And Made It 50x Faster than every available one)

Why We Built Another LLM Gateway (And Made It 50x Faster than every available one)

6
Comments
4 min read
We Built AI Governance That Stops Cost Explosions (Here's How)

We Built AI Governance That Stops Cost Explosions (Here's How)

2
Comments
4 min read
Building a RAG-Powered Documentation Assistant: Why I Used Bifrost LLM Gateway Instead of Direct API Calls

Building a RAG-Powered Documentation Assistant: Why I Used Bifrost LLM Gateway Instead of Direct API Calls

6
Comments
5 min read
How I Cut My AI App Costs by 52% Without Changing a Single Line of Code

How I Cut My AI App Costs by 52% Without Changing a Single Line of Code

6
Comments 1
6 min read
Building a High-Performance Open-Source LLM Gateway: Bifrost (54x Faster than LiteLLM)

Building a High-Performance Open-Source LLM Gateway: Bifrost (54x Faster than LiteLLM)

Comments
2 min read
Bifrost: An LLM Gateway built for enterprise-grade reliability, governance, and scale(50x Faster than LiteLLM)

Bifrost: An LLM Gateway built for enterprise-grade reliability, governance, and scale(50x Faster than LiteLLM)

Comments
2 min read
loading...