Skip to content
@truefoundry

TrueFoundry

Build fast, secure and cost-efficient ML/LLM Apps
README.md

TrueFoundryTrueFoundry

TrueFoundry - Reduce time to value on Gen AI & ML initiatives

Twitter Follow Artifact Hub YouTube Slack Signup

What is TrueFoundry?

  • A low-latency enterprise AI Gateway with MCP server integrations, guardrails, observability, latency-based routing, model fallback, caching, quota and access control (on-premise, VPC or cloud).
  • A cloud-agnostic PaaS running on Kubernetes that standardizes AI applications development, deployment and observability using developer-friendly APIs. Plugs and play with your existing stack without vendor lock-in bringing state of the art industry standards.

Govern, Deploy, Scale & Trace Agentic AI in One Unified Platform

  • NEW 🔥 Free Sign Up - Sign Up for Free and Deploy on your cloud in under 10 minutes
  • AI Gateway - Enterprise-Ready AI Gateway for secure, high-performance proxy to 1000+ models with observability, governance, rate limits, budgets, guardrails, fallbacks, and load balancing.
  • NEW 🔥 MCP Gateway - Secure Access to MCP Servers and Agent Orchestration
  • NEW 🔥 Tracing - End-to-End Observability for AI Agents and Applications
  • AI Engineering - One platform to deploy services, jobs, notebooks, track experiments, train/serve models, and ship DAG workflows.
  • TrueFoundry SDK & CLI - Python/TypeScript SDKs & CLI for programmatic control
    • Track Experiments, register and versions models, artifacts and prompts
    • Deploy Services, Jobs, Notebooks, SSH Servers, Helm applications
    • Build and Deploy DAG workflows
    • Enable CI/CD for your deployments
    • Programmatically access TrueFoundry APIs
  • TrueFoundry Docs - Guides and API Reference for the platform

OpenSource

  • KubeElasti - Kubernetes-native scale-to-zero with zero traffic loss, no code changes, and direct integration with kubernetes resources
  • LLM Locust - LLM Locust combines the simplicity of Locust with deep support for LLM-specific benchmarking
  • Cognita - RAG Framework for Building Grounded Applications

Get in touch 💬

👉 Join our Slack community!

🐦 Follow the latest from TrueFoundry team on Twitter @truefoundry

Pinned Loading

  1. KubeElasti KubeElasti Public

    Kubernetes-native scale-to-zero with zero traffic loss, no code changes, and direct integration with kubernetes resources

    Go 218 11

  2. llm-locust llm-locust Public

    LLM Locust combines the simplicity of Locust with deep support for LLM-specific benchmarking

    TypeScript 23 8

  3. cognita cognita Public

    RAG (Retrieval Augmented Generation) Framework for building modular, open source applications for production by TrueFoundry

    Python 4.3k 364

  4. infra-charts infra-charts Public

    Helm Repo for TrueFoundry Platform Charts

    Go Template 4 5

  5. truefoundry-python-sdk truefoundry-python-sdk Public

    TrueFoundry Python SDK for convenient interaction with TrueFoundry API.

    Python 1

  6. truefoundry-typescript-sdk truefoundry-typescript-sdk Public

    TrueFoundry Typescript SDK for convenient interaction with TrueFoundry API.

    TypeScript

Repositories

Showing 10 of 108 repositories
  • awesome-mcp-servers Public
    truefoundry/awesome-mcp-servers’s past year of commit activity
    TypeScript 0 0 0 1 Updated Mar 2, 2026
  • models Public

    Community-maintained registry of AI/LLM model configurations - pricing, features, and limits across 19 providers and 1000+ models

    truefoundry/models’s past year of commit activity
    TypeScript 4 MIT 0 0 6 Updated Mar 2, 2026
  • CruiseKube Public

    CruiseKube is an intelligent Kubernetes resource optimization controller that automatically monitors, analyzes, and applies resource recommendations to improve cluster efficiency and reduce costs.

    truefoundry/CruiseKube’s past year of commit activity
    Go 64 1 5 4 Updated Mar 2, 2026
  • infra-charts Public

    Helm Repo for TrueFoundry Platform Charts

    truefoundry/infra-charts’s past year of commit activity
    Go Template 4 5 0 4 Updated Mar 2, 2026
  • cruiseKube-frontend Public
    truefoundry/cruiseKube-frontend’s past year of commit activity
    TypeScript 0 0 0 4 Updated Mar 2, 2026
  • mcp-gdrive Public Forked from isaacphi/mcp-gdrive

    Model Context Protocol (MCP) Server for reading from Google Drive and editing Google Sheets

    truefoundry/mcp-gdrive’s past year of commit activity
    TypeScript 0 MIT 101 0 2 Updated Mar 2, 2026
  • playwright-mcp Public Forked from microsoft/playwright

    Playwright is a framework for Web Testing and Automation. It allows testing Chromium, Firefox and WebKit with a single API.

    truefoundry/playwright-mcp’s past year of commit activity
    TypeScript 0 Apache-2.0 5,595 0 9 Updated Mar 2, 2026
  • comcast-cluster-management Public
    truefoundry/comcast-cluster-management’s past year of commit activity
    TypeScript 0 0 0 11 Updated Mar 2, 2026
  • mcp-google-map Public Forked from cablate/mcp-google-map

    A powerful Model Context Protocol (MCP) server providing comprehensive Google Maps API integration with LLM processing capabilities.

    truefoundry/mcp-google-map’s past year of commit activity
    TypeScript 0 MIT 59 0 5 Updated Mar 2, 2026
  • mcp-servers-api Public Forked from truefoundry/mcp-servers

    Create a deployed server that dynamically chooses which mcp server to use with the selected tools.

    truefoundry/mcp-servers-api’s past year of commit activity
    Python 0 2 0 11 Updated Mar 1, 2026
View all repositories

Top languages

Loading…