Skip to content

A reproducible benchmarking suite for measuring LiteLLM latency, throughput, and scalability under real-world workloads.

Notifications You must be signed in to change notification settings

BerriAI/litellm-performance-benchmarks

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

11 Commits
 
 
 
 

Repository files navigation

litellm-performance-benchmarks

A reproducible benchmarking suite for measuring LiteLLM latency, throughput, and scalability under real-world workloads.

About

A reproducible benchmarking suite for measuring LiteLLM latency, throughput, and scalability under real-world workloads.

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

 
 
 

Contributors

Languages