Skip to content
@basetenlabs

Baseten

Machine learning infrastructure for developers

Welcome to Baseten

Baseten is an AI infrastructure platform. We combine applied performance research, distributed multi-cloud infrastructure, and developer tooling to run models of all modalities in production.

Get started:

  • Deploy an open-source model in two clicks from the model library.
  • Read our docs to package and serve a fine-tuned or custom model.

Pinned Loading

  1. truss truss Public

    The simplest way to serve AI/ML models in production

    Python 1.2k 109

  2. truss-examples truss-examples Public

    Examples of models deployable with Truss

    Python 227 62

Repositories

Showing 10 of 106 repositories
  • baseten-go Public

    Go SDK for Baseten

    basetenlabs/baseten-go’s past year of commit activity
    Go 1 MIT 0 1 0 Updated Jun 8, 2026
  • baseten-cli Public

    CLI for Baseten

    basetenlabs/baseten-cli’s past year of commit activity
    Go 15 MIT 0 0 1 Updated Jun 8, 2026
  • baseten-python Public

    Python SDK for Baseten

    basetenlabs/baseten-python’s past year of commit activity
    Python 1 MIT 0 1 3 Updated Jun 8, 2026
  • basetenlabs/Megatron-Bridge’s past year of commit activity
    Python 0 Apache-2.0 0 0 1 Updated Jun 8, 2026
  • Model-Optimizer Public Forked from NVIDIA/Model-Optimizer

    A unified library of SOTA model optimization techniques like quantization, pruning, distillation, speculative decoding, etc. It compresses deep learning models for downstream deployment frameworks like TensorRT-LLM, TensorRT, vLLM, etc. to optimize inference speed.

    basetenlabs/Model-Optimizer’s past year of commit activity
    Python 1 Apache-2.0 434 0 13 Updated Jun 8, 2026
  • compact-rl Public Forked from PrimeIntellect-ai/prime-rl

    Agentic RL Training at Scale w/ Compaction in the Loop

    basetenlabs/compact-rl’s past year of commit activity
    Python 5 Apache-2.0 308 0 0 Updated Jun 7, 2026
  • truss-examples Public

    Examples of models deployable with Truss

    basetenlabs/truss-examples’s past year of commit activity
    Python 227 MIT 62 15 62 Updated Jun 5, 2026
  • truss Public

    The simplest way to serve AI/ML models in production

    basetenlabs/truss’s past year of commit activity
    Python 1,160 MIT 109 9 66 Updated Jun 5, 2026
  • Megatron-LM Public Forked from NVIDIA/Megatron-LM

    Ongoing research training transformer models at scale

    basetenlabs/Megatron-LM’s past year of commit activity
    Python 1 4,128 0 0 Updated Jun 5, 2026
  • basetenlabs/langchain-baseten’s past year of commit activity
    Python 0 MIT 1 0 0 Updated Jun 5, 2026

Top languages

Loading…

Most used topics

Loading…