Connect Braintrust to your AI agent

AI Tools 17 actions available

Braintrust is an AI engineering platform for managing prompts, datasets, experiments, evaluations, observability, and production AI applications.

We set up the connection using your own Braintrust account, with keys you control, and keep it running. Your agent picks it up and starts doing the work.

What your agent can do in Braintrust

Each one is a real action the agent can take on its own, the same things a person clicking around Braintrust could do. Read-only by default; write actions are confirmed against your policy.

  • Create Dataset Create a named dataset under a Braintrust project, or return the existing dataset unchanged when its name already exists in that project.
  • Create Experiment Create an experiment under a Braintrust project. When its name already exists, Braintrust returns the existing experiment unchanged unless ensure_new is true, which creates an experiment with a unique name.
  • Create Project Create a Braintrust project, or return the existing project unchanged when its name already exists.
  • Create Prompt Upsert a versioned prompt configuration under a Braintrust project without invoking it. The same project and slug reuse the prompt ID but create a new version that replaces the stored prompt configuration with the submi…
  • Delete Project Soft-delete a Braintrust project and return its deletion state.
  • Delete Experiment, Dataset, or Prompt Delete one Braintrust experiment, dataset, or prompt by UUID for explicit lifecycle cleanup.
  • Fetch Events Fetch one newest-to-oldest page of project log, experiment, or dataset events.
  • Get Braintrust Resource Get one project, experiment, dataset, prompt, or function by UUID.
  • Insert Dataset Events Upsert a batch of examples into an existing Braintrust dataset. New or omitted IDs insert events; an existing supplied ID replaces that event's current values.
  • Insert Experiment Events Upsert a batch of result events into an existing Braintrust experiment. New or omitted IDs insert events; an existing supplied ID replaces that event's current values.
  • List Braintrust Resources List and filter one page of projects, experiments, datasets, prompts, or functions visible to the connected Braintrust API key.
  • Query Braintrust Data Run one bounded synchronous read-only BTQL query over Braintrust project logs, an experiment, or a dataset. The first-page query must end with a positive LIMIT; continue later pages by passing the returned next_cursor u…
  • Summarize Experiment or Dataset Return metadata and optional aggregate summaries for one Braintrust experiment or dataset.
  • Update Dataset Update the name, description, tags, or metadata of a Braintrust dataset. At least one non-null mutable field is required.
  • Update Experiment Update selected metadata and linkage fields on a Braintrust experiment. At least one non-null mutable field is required.
  • Update Project Update selected fields of a Braintrust project. At least one non-null mutable field is required: name, description, or settings.
  • Update Prompt Update a Braintrust prompt's metadata or configuration without invoking it. At least one non-null mutable field is required.

How we connect it

  1. 1

    Connect your account

    You create a key in Braintrust, a key you create and control, and paste it in once. It lives in a secrets store on your server, not with us.

  2. 2

    Set the guardrails

    Read-only by default. You choose which write actions the agent may take, and anything outside that policy gets confirmed with you first.

  3. 3

    We keep it running

    Health checks on every connection, updates handled for you, and we watch the first week of activity to make sure the work lands.

Braintrust questions, answered.

With a key you create and control. You paste it in once, it is stored in a secrets store on your server, permissions are scoped to the minimum the agent needs, and you can revoke it at any time.
The actions Braintrust's API allows, the same things a person clicking around the app could do. Connections start read-only by default; write actions are confirmed against the policy you set before the agent takes them.
Connections are priced per tool on top of the base plan. Some are included, some are premium. See pricing for how connection charges work.
Standard tools are ready inside 7 business days of the setup call. We test the connection end to end, walk you through how the agent uses it, and watch the first week of activity.

Ready to put Braintrust to work?

Tell us what your team runs on. We set up the connection, secure it, and your agent takes it from there.

All product names, logos, and brands are property of their respective owners; used for identification only. ZeroToClaw is not affiliated with or endorsed by Braintrust.