List tests
Retrieves a paginated list of tests with optional filtering.
curl --request GET \
--url https://api.avidoai.com/v0/tests \
--header 'x-api-key: <api-key>' \
--header 'x-application-id: <api-key>'
{
"data": [
{
"id": "123e4567-e89b-12d3-a456-426614174000",
"createdAt": "2024-01-05T12:34:56.789Z",
"modifiedAt": "2024-01-05T12:34:56.789Z",
"traceId": "789e4567-e89b-12d3-a456-426614174000",
"result": "PASSED",
"status": "COMPLETED",
"evals": [
{
"id": "123e4567-e89b-12d3-a456-426614174000",
"orgId": "org_123456",
"createdAt": "2024-01-05T12:34:56.789Z",
"modifiedAt": "2024-01-05T12:34:56.789Z",
"status": "COMPLETED",
"results": "<any>",
"definition": {
"id": "3c90c3cc-0d44-4b50-8888-8dd25736052a",
"createdAt": "<string>",
"modifiedAt": "<string>",
"type": "GEVAL",
"name": "<string>",
"globalConfig": "<any>",
"styleGuideId": "3c90c3cc-0d44-4b50-8888-8dd25736052a"
}
}
],
"task": {
"id": "123e4567-e89b-12d3-a456-426614174000",
"createdAt": "2024-01-01T00:00:00.000Z",
"modifiedAt": "2024-01-01T00:00:00.000Z",
"title": "Credit Card Block",
"description": "Wants to block their credit card",
"baseline": 0.5,
"application": {
"id": "123e4567-e89b-12d3-a456-426614174000",
"orgId": "org_123456",
"title": "Customer Support Bot",
"slug": "customer-support-bot",
"description": "AI assistant for customer support inquiries",
"context": "You are a helpful customer support assistant...",
"type": "CHATBOT",
"environment": "DEV",
"createdAt": "2024-01-05T12:34:56.789Z",
"modifiedAt": "2024-01-05T12:34:56.789Z"
},
"topic": {
"id": "789e4567-e89b-12d3-a456-426614174000",
"orgId": "org_123456",
"title": "Code Quality",
"baseline": 0.85,
"createdAt": "2024-01-05T12:34:56.789Z",
"modifiedAt": "2024-01-05T12:34:56.789Z"
},
"definitions": [
{
"id": "3c90c3cc-0d44-4b50-8888-8dd25736052a",
"createdAt": "<string>",
"modifiedAt": "<string>",
"type": "GEVAL",
"name": "<string>",
"globalConfig": "<any>",
"styleGuideId": "3c90c3cc-0d44-4b50-8888-8dd25736052a"
}
]
}
}
],
"pagination": {
"skip": 0,
"limit": 25,
"total": 100,
"totalPages": 4
}
}
Authorizations
Your unique Avido API key
Your unique application ID. Get this from the Connections page in Avido.
Query Parameters
Number of items to skip
x >= 0
0
Number of items per page
1 <= x <= 100
25
Field to order by
"createdAt"
Order direction
asc
, desc
"desc"
Filter by task ID
"456e4567-e89b-12d3-a456-426614174000"
Filter by trace ID
"789e4567-e89b-12d3-a456-426614174000"
Filter by evaluation status
"COMPLETED"
Filter by evaluation type
"GEVAL"
Response
Paginated response containing tests
A Test represents a single test applying all the linked evals on a Trace
Unique identifier of the run
"123e4567-e89b-12d3-a456-426614174000"
When the run was created
"2024-01-05T12:34:56.789Z"
When the run was last modified
"2024-01-05T12:34:56.789Z"
Status of the evaluation/test. Valid options: PENDING, IN_PROGRESS, PASSED, COMPLETED, FAILED.
PENDING
, IN_PROGRESS
, PASSED
, COMPLETED
, FAILED
"COMPLETED"
Array of evaluations in this run
Complete evaluation information
Unique identifier of the evaluation
"123e4567-e89b-12d3-a456-426614174000"
Organization ID that owns this evaluation
"org_123456"
When the evaluation was created
"2024-01-05T12:34:56.789Z"
When the evaluation was last modified
"2024-01-05T12:34:56.789Z"
Status of the evaluation/test. Valid options: PENDING, IN_PROGRESS, PASSED, COMPLETED, FAILED.
PENDING
, IN_PROGRESS
, PASSED
, COMPLETED
, FAILED
"COMPLETED"
Type of evaluation. Valid options: GEVAL, STYLE, BLACKLIST.
GEVAL
, STYLE
, BLACKLIST
"GEVAL"
Results of the evaluation (structure depends on eval type).
A task that represents a specific job-to-be-done by the LLM in the user application.
The unique identifier of the task
"123e4567-e89b-12d3-a456-426614174000"
The date and time the task was created
"2024-01-01T00:00:00.000Z"
The date and time the task was last updated
"2024-01-01T00:00:00.000Z"
The title of the task
"Credit Card Block"
The task description
"Wants to block their credit card"
The baseline score of the task
0.5
Application configuration and metadata
Unique identifier of the application
"123e4567-e89b-12d3-a456-426614174000"
Organization ID that owns this application
"org_123456"
Title of the application
1
"Customer Support Bot"
URL-friendly slug for the application
1
"customer-support-bot"
Description of the application
"AI assistant for customer support inquiries"
Context/instructions for the application
"You are a helpful customer support assistant..."
Type of the application. Valid values are CHATBOT or AGENT.
CHATBOT
, AGENT
"CHATBOT"
Environment of the application. Defaults to DEV.
DEV
, PROD
"DEV"
When the application was created
"2024-01-05T12:34:56.789Z"
When the application was last modified
"2024-01-05T12:34:56.789Z"
Details about a single Topic
Unique identifier of the topic
"789e4567-e89b-12d3-a456-426614174000"
Organization ID that owns this topic
"org_123456"
Title of the topic
"Code Quality"
Optional baseline score for this topic
0.85
When the topic was created
"2024-01-05T12:34:56.789Z"
When the topic was last modified
"2024-01-05T12:34:56.789Z"
Type of evaluation. Valid options: GEVAL, STYLE, BLACKLIST.
GEVAL
, STYLE
, BLACKLIST
"GEVAL"
Optional ID of the trace this run is associated with
"789e4567-e89b-12d3-a456-426614174000"
Result of the run (if completed)
PASSED
, FAILED
"PASSED"
Pagination metadata returned in a paginated response.
Number of items skipped.
x >= 0
0
Number of items per page.
x >= 1
25
Total number of items available.
x >= 0
100
Total number of pages available.
x >= 0
4
curl --request GET \
--url https://api.avidoai.com/v0/tests \
--header 'x-api-key: <api-key>' \
--header 'x-application-id: <api-key>'
{
"data": [
{
"id": "123e4567-e89b-12d3-a456-426614174000",
"createdAt": "2024-01-05T12:34:56.789Z",
"modifiedAt": "2024-01-05T12:34:56.789Z",
"traceId": "789e4567-e89b-12d3-a456-426614174000",
"result": "PASSED",
"status": "COMPLETED",
"evals": [
{
"id": "123e4567-e89b-12d3-a456-426614174000",
"orgId": "org_123456",
"createdAt": "2024-01-05T12:34:56.789Z",
"modifiedAt": "2024-01-05T12:34:56.789Z",
"status": "COMPLETED",
"results": "<any>",
"definition": {
"id": "3c90c3cc-0d44-4b50-8888-8dd25736052a",
"createdAt": "<string>",
"modifiedAt": "<string>",
"type": "GEVAL",
"name": "<string>",
"globalConfig": "<any>",
"styleGuideId": "3c90c3cc-0d44-4b50-8888-8dd25736052a"
}
}
],
"task": {
"id": "123e4567-e89b-12d3-a456-426614174000",
"createdAt": "2024-01-01T00:00:00.000Z",
"modifiedAt": "2024-01-01T00:00:00.000Z",
"title": "Credit Card Block",
"description": "Wants to block their credit card",
"baseline": 0.5,
"application": {
"id": "123e4567-e89b-12d3-a456-426614174000",
"orgId": "org_123456",
"title": "Customer Support Bot",
"slug": "customer-support-bot",
"description": "AI assistant for customer support inquiries",
"context": "You are a helpful customer support assistant...",
"type": "CHATBOT",
"environment": "DEV",
"createdAt": "2024-01-05T12:34:56.789Z",
"modifiedAt": "2024-01-05T12:34:56.789Z"
},
"topic": {
"id": "789e4567-e89b-12d3-a456-426614174000",
"orgId": "org_123456",
"title": "Code Quality",
"baseline": 0.85,
"createdAt": "2024-01-05T12:34:56.789Z",
"modifiedAt": "2024-01-05T12:34:56.789Z"
},
"definitions": [
{
"id": "3c90c3cc-0d44-4b50-8888-8dd25736052a",
"createdAt": "<string>",
"modifiedAt": "<string>",
"type": "GEVAL",
"name": "<string>",
"globalConfig": "<any>",
"styleGuideId": "3c90c3cc-0d44-4b50-8888-8dd25736052a"
}
]
}
}
],
"pagination": {
"skip": 0,
"limit": 25,
"total": 100,
"totalPages": 4
}
}