Open software

Sentinel

Test your AI agents by dragging boxes on a canvas, the way Postman made testing APIs simple. Every test you build saves as clean, shareable text.

  • Visual canvas
  • Desktop app
  • YAML export
  • Well tested
Sentinel
Type
Desktop app
Build tests
By dragging boxes
Saves as
Clean YAML
Cost
Free and open

Sentinel

Sponsor

Sentinel makes testing an AI agent as simple as Postman made testing an API. You build a test by dragging boxes onto a canvas and joining them, no code needed. Behind the scenes it writes a clean text file, so your tests are easy to read, share, and track in version control.

What you can do

Start from one of 16 ready-made templates across 12 kinds of tests, from simple question and answer to safety checks and code generation. Drag in the pieces you need, set what a good answer looks like, then run the test and watch it pass or fail. Prefer to type? Edit the same test as plain YAML, and the canvas and the text stay in sync both ways.

How it checks answers

You pick from clear rules: the answer must contain a word, must not contain another, must match a pattern, must call a tool, or must come back fast enough. Because every test is the same text every time, results are steady and easy to repeat.

Who it is for

Researchers, product managers, and safety teams who need to check that an agent behaves, without writing test code. It runs as a desktop app, so your tests stay on your own machine.

A closer look

Build a test by dragging boxes and joining them, no code required.

Install

git clone https://github.com/navam-io/sentinel.git
cd sentinel/frontend
npm install
npm run tauri:dev   # opens the visual canvas

Use it

# The canvas writes this for you, but you can edit it by hand too.
name: "Geography Quiz"
category: "qa"
model:
  provider: "openai"
  model: "gpt-5.1"
inputs:
  - query: "What is the capital of France?"
assertions:
  - type: "must_contain"
    value: "Paris"
  - type: "max_latency_ms"
    value: 2000

Specs

Type
Desktop app (Tauri) and browser
Build tests
A visual canvas or plain YAML
Works with
Claude and OpenAI
Built with
React, FastAPI, Python
License
MIT (free to use)

Keep exploring

AI Native Business cover
Book

AI Native Business

A book on running a business with AI agents (software helpers that do the work for you). Fourteen short chapters in four parts take you from the first idea to a working system. About a two hour read, open to all.

Resources

Codesentinel on GitHub