curl --request POST \
--url https://api.promptlayer.com/reports \
--header 'Content-Type: application/json' \
--header 'X-API-KEY: <api-key>' \
--data '
{
"dataset_group_id": 123,
"name": "Pipeline with Built-in Scoring",
"columns": [
{
"column_type": "LLM_ASSERTION",
"name": "Accuracy Check",
"configuration": {
"source": "response",
"prompt": "Is this response accurate?"
},
"is_part_of_score": true
},
{
"column_type": "LLM_ASSERTION",
"name": "Safety Check",
"configuration": {
"source": "response",
"prompt": "Is this response safe?"
},
"is_part_of_score": true
}
]
}
'{
"success": true,
"report_id": 456,
"report_columns": [
{
"id": 789,
"name": "Accuracy Check",
"column_type": "LLM_ASSERTION",
"position": 1,
"configuration": {
"source": "response"
}
}
],
"external_ids": []
}{
"message": "Dataset must have at least one non-draft version"
}{
"success": false,
"message": "<string>",
"error": "<string>"
}{
"success": false,
"message": "<string>",
"error": "<string>"
}{
"success": false,
"message": "<string>",
"error": "<string>"
}{
"message": "<string>",
"success": false
}{
"detail": [
{
"loc": [
"<string>"
],
"msg": "<string>",
"type": "<string>"
}
]
}Evaluations & Reports API
Create Evaluation Pipeline
POST
/
reports
curl --request POST \
--url https://api.promptlayer.com/reports \
--header 'Content-Type: application/json' \
--header 'X-API-KEY: <api-key>' \
--data '
{
"dataset_group_id": 123,
"name": "Pipeline with Built-in Scoring",
"columns": [
{
"column_type": "LLM_ASSERTION",
"name": "Accuracy Check",
"configuration": {
"source": "response",
"prompt": "Is this response accurate?"
},
"is_part_of_score": true
},
{
"column_type": "LLM_ASSERTION",
"name": "Safety Check",
"configuration": {
"source": "response",
"prompt": "Is this response safe?"
},
"is_part_of_score": true
}
]
}
'{
"success": true,
"report_id": 456,
"report_columns": [
{
"id": 789,
"name": "Accuracy Check",
"column_type": "LLM_ASSERTION",
"position": 1,
"configuration": {
"source": "response"
}
}
],
"external_ids": []
}{
"message": "Dataset must have at least one non-draft version"
}{
"success": false,
"message": "<string>",
"error": "<string>"
}{
"success": false,
"message": "<string>",
"error": "<string>"
}{
"success": false,
"message": "<string>",
"error": "<string>"
}{
"message": "<string>",
"success": false
}{
"detail": [
{
"loc": [
"<string>"
],
"msg": "<string>",
"type": "<string>"
}
]
}Legacy Dataset, Evaluation, and Report endpoints are deprecated for new workflows. Use the Tables API for new dataset import, evaluation, scoring, recalculation, and reporting workflows.
Behavior Notes
- Evaluation columns use the same node definitions as Workflows. See Node & Column Types.
- Set
is_part_of_scoreon columns for built-in scoring, or providescore_configurationfor custom scoring logic. - Custom scoring concepts are covered in Score Card.
Related
Body
application/json
Evaluation pipeline creation payload.
Response
Evaluation pipeline created.
Was this page helpful?

