Stay free if you only need basic features. Upgrade if you need advanced features. Most solo builders can start free.
Traditional prompting sends text to a model and hopes it formats the response correctly, then parses the output with error-prone string manipulation. Guidance programs specify exactly where the model generates text and what constraints apply, with template text guaranteed verbatim and generation happening only in specified slots. This eliminates format parsing issues entirely.
The Rust-based llguidance grammar engine replaced the Python implementation with faster constraint processing and bug fixes. Other updates include expanded JSON schema coverage with oneOf/allOf support, rewritten Jupyter notebook visualization with token probabilities and backtracking, Python 3.14 compatibility, and support for Phi-4 models.
Yes, Guidance supports OpenAI's chat and completion APIs, Anthropic Claude, and Azure OpenAI through optimized prompting strategies. True constrained generation with logit masking only works with local models, but API models use intelligent prompting and output validation while maintaining the same programming interface.
Guidance provides a full programming language for generation control with conditional logic, loops, and multi-step composition. Instructor focuses specifically on structured output via Pydantic models. Outlines specializes in grammar-constrained generation but has narrower model support. Marvin emphasizes simplicity but lacks Guidance's performance optimizations and advanced control flow.
Token healing corrects tokenization artifacts that occur when template text ends mid-token. Standard LLM approaches often produce garbled output in these situations. Guidance automatically detects and heals these boundary issues, ensuring clean transitions between fixed template text and generated content - a critical feature for production reliability.
Start with the free plan — upgrade when you need more.
Get Started Free →Still not sure? Read our full verdict →
Last verified March 2026