Oven logo

Oven

Published

Efficient, Flexible and Portable Structured Generation

pip install xgrammar

Package Downloads

Weekly DownloadsMonthly Downloads

Authors

Project URLs

Requires Python

<4,>=3.8

XGrammar

Documentation License

Efficient, Flexible and Portable Structured Generation

Get Started | Documentation | Blogpost | Technical Report

Overview

XGrammar is an open-source library for efficient, flexible, and portable structured generation. It supports general context-free grammar to enable a broad range of structures while bringing careful system optimizations to enable fast executions. XGrammar features a minimal and portable C++ backend that can be easily integrated into multiple environments and frameworks, and is co-designed with the LLM inference engine and enables zero-overhead structured generation in LLM inference.

Get Started

Please visit our documentation to get started with XGrammar.