How To Use Dspy

What DSPy actually is

The result: the same Python code can target GPT-4o, Claude, Llama, or a local model, and each gets its own tuned prompt. You never hand-edit a prompt string.

Installing

Python 3.9+. DSPy uses LiteLLM under the hood so any model LiteLLM supports works out of the box.

First working example

DSPy treats eval as a first-class citizen. If you’re not evaluating numerically, you’re just hand-waving at prompts.

A real workflow — compile with an optimizer

Evaluation

Gotchas

When NOT to use it