Connect Braintrust to your AI agent
Braintrust is an AI engineering platform for managing prompts, datasets, experiments, evaluations, observability, and production AI applications.
We set up the connection using your own Braintrust account, with keys you control, and keep it running. Your agent picks it up and starts doing the work.
What your agent can do in Braintrust
Each one is a real action the agent can take on its own, the same things a person clicking around Braintrust could do. Read-only by default; write actions are confirmed against your policy.
- Create Dataset Create a named dataset under a Braintrust project, or return the existing dataset unchanged when its name already exists in that project.
- Create Experiment Create an experiment under a Braintrust project. When its name already exists, Braintrust returns the existing experiment unchanged unless ensure_new is true, which creates an experiment with a unique name.
- Create Project Create a Braintrust project, or return the existing project unchanged when its name already exists.
- Create Prompt Upsert a versioned prompt configuration under a Braintrust project without invoking it. The same project and slug reuse the prompt ID but create a new version that replaces the stored prompt configuration with the submi…
- Delete Project Soft-delete a Braintrust project and return its deletion state.
- Delete Experiment, Dataset, or Prompt Delete one Braintrust experiment, dataset, or prompt by UUID for explicit lifecycle cleanup.
- Fetch Events Fetch one newest-to-oldest page of project log, experiment, or dataset events.
- Get Braintrust Resource Get one project, experiment, dataset, prompt, or function by UUID.
- Insert Dataset Events Upsert a batch of examples into an existing Braintrust dataset. New or omitted IDs insert events; an existing supplied ID replaces that event's current values.
- Insert Experiment Events Upsert a batch of result events into an existing Braintrust experiment. New or omitted IDs insert events; an existing supplied ID replaces that event's current values.
- List Braintrust Resources List and filter one page of projects, experiments, datasets, prompts, or functions visible to the connected Braintrust API key.
- Query Braintrust Data Run one bounded synchronous read-only BTQL query over Braintrust project logs, an experiment, or a dataset. The first-page query must end with a positive LIMIT; continue later pages by passing the returned next_cursor u…
- Summarize Experiment or Dataset Return metadata and optional aggregate summaries for one Braintrust experiment or dataset.
- Update Dataset Update the name, description, tags, or metadata of a Braintrust dataset. At least one non-null mutable field is required.
- Update Experiment Update selected metadata and linkage fields on a Braintrust experiment. At least one non-null mutable field is required.
- Update Project Update selected fields of a Braintrust project. At least one non-null mutable field is required: name, description, or settings.
- Update Prompt Update a Braintrust prompt's metadata or configuration without invoking it. At least one non-null mutable field is required.
How we connect it
- 1
Connect your account
You create a key in Braintrust, a key you create and control, and paste it in once. It lives in a secrets store on your server, not with us.
- 2
Set the guardrails
Read-only by default. You choose which write actions the agent may take, and anything outside that policy gets confirmed with you first.
- 3
We keep it running
Health checks on every connection, updates handled for you, and we watch the first week of activity to make sure the work lands.
FAQ
Braintrust questions, answered.
Ready to put Braintrust to work?
Tell us what your team runs on. We set up the connection, secure it, and your agent takes it from there.
All product names, logos, and brands are property of their respective owners; used for identification only. ZeroToClaw is not affiliated with or endorsed by Braintrust.