Skip to content

Mattbusel/llm-cache

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

10 Commits
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

llm-cache

LRU cache for LLM responses. Sin


Part of the llm-cpp toolkit -- 26 single-header C++ libraries for LLM infrastructure. Drop in what you need.

About

Zero-dependency single-header C++ semantic cache for LLM API responses. Skip redundant calls, save money.

Topics

Resources

License

Stars

Watchers

Forks

Releases

No releases published

Packages

 
 
 

Contributors