# PromptLayer

## Docs

- [CLAUDE](https://docs.promptlayer.com/CLAUDE.md)
- [DOCS UPDATER SETUP TODO](https://docs.promptlayer.com/DOCS_UPDATER_SETUP_TODO.md)
- [TESTING INSTRUCTIONS](https://docs.promptlayer.com/TESTING_INSTRUCTIONS.md)
- [MCP](https://docs.promptlayer.com/agents/mcp.md)
- [Changelog](https://docs.promptlayer.com/changelog.md): Daily updates on new features and improvements to PromptLayer.
- [Custom Providers](https://docs.promptlayer.com/features/custom-providers.md)
- [Getting Started](https://docs.promptlayer.com/features/evaluations/building-pipelines.md)
- [Node & Column Types](https://docs.promptlayer.com/features/evaluations/column-types.md): Complete reference for all node types used in Workflows and evaluation pipelines
- [Continuous Integration](https://docs.promptlayer.com/features/evaluations/continuous-integration.md)
- [Datasets](https://docs.promptlayer.com/features/evaluations/datasets.md)
- [Create from File](https://docs.promptlayer.com/features/evaluations/datasets-create-from-file.md)
- [Create from History](https://docs.promptlayer.com/features/evaluations/datasets-create-from-history.md)
- [Overview](https://docs.promptlayer.com/features/evaluations/datasets-overview.md): Use Datasets as the versioned system of record for evaluation inputs, backtests, and batch workflows.
- [Eval Types](https://docs.promptlayer.com/features/evaluations/eval-types.md)
- [Eval Examples](https://docs.promptlayer.com/features/evaluations/examples.md)
- [Overview](https://docs.promptlayer.com/features/evaluations/overview.md)
- [Online or Programmatic Evals](https://docs.promptlayer.com/features/evaluations/programmatic.md)
- [Score Card](https://docs.promptlayer.com/features/evaluations/score-card.md)
- [Exa](https://docs.promptlayer.com/features/exa-integration.md)
- [FAQ](https://docs.promptlayer.com/features/faq.md)
- [Image Generation](https://docs.promptlayer.com/features/image-generation.md)
- [Integrations](https://docs.promptlayer.com/features/integrations.md)
- [Overview](https://docs.promptlayer.com/features/observability.md): Use Observability to analyze app behavior, review PromptLayer usage, and turn useful history into datasets.
- [OpenRouter](https://docs.promptlayer.com/features/openrouter-integration.md)
- [OpenTelemetry](https://docs.promptlayer.com/features/opentelemetry.md)
- [Custom Logging](https://docs.promptlayer.com/features/prompt-history/custom-logging.md)
- [Metadata](https://docs.promptlayer.com/features/prompt-history/metadata.md)
- [Request IDs](https://docs.promptlayer.com/features/prompt-history/request-id.md)
- [Score Requests](https://docs.promptlayer.com/features/prompt-history/scoring-requests.md)
- [Search Data Model](https://docs.promptlayer.com/features/prompt-history/search-data-model.md)
- [Sharing Requests](https://docs.promptlayer.com/features/prompt-history/sharing-prompts.md)
- [Logging Structured Outputs](https://docs.promptlayer.com/features/prompt-history/structured-output-logging.md)
- [Tags](https://docs.promptlayer.com/features/prompt-history/tagging-requests.md)
- [Tracking Templates](https://docs.promptlayer.com/features/prompt-history/tracking-templates.md)
- [Dynamic Release Labels](https://docs.promptlayer.com/features/prompt-registry/dynamic-release-labels.md)
- [Input Variable Sets](https://docs.promptlayer.com/features/prompt-registry/input-variable-sets.md)
- [Overview](https://docs.promptlayer.com/features/prompt-registry/new-overview.md): Use Prompt Registry as the system of record for prompt versions, testing, releases, and observability.
- [Placeholder Messages](https://docs.promptlayer.com/features/prompt-registry/placeholder-messages.md)
- [Release Labels](https://docs.promptlayer.com/features/prompt-registry/release-labels.md)
- [Snippets](https://docs.promptlayer.com/features/prompt-registry/snippets.md)
- [Structured Outputs](https://docs.promptlayer.com/features/prompt-registry/structured-outputs.md)
- [Template Variables](https://docs.promptlayer.com/features/prompt-registry/template-variables.md)
- [Tool Calling](https://docs.promptlayer.com/features/prompt-registry/tool-calling.md)
- [Webhooks](https://docs.promptlayer.com/features/prompt-registry/webhooks.md)
- [Zero Downtime Releases](https://docs.promptlayer.com/features/prompt-registry/zero-downtime-releases.md)
- [Editing with Wrangler AI](https://docs.promptlayer.com/features/skill-collections/editing-with-wrangler.md): Use PromptLayer's in-dashboard assistant to create, edit, rename, and migrate Skill Collections without learning SKILL.md conventions yourself.
- [Overview](https://docs.promptlayer.com/features/skill-collections/overview.md): Versioned folders of agent instructions (SKILL.md files) you can share, remix, and pull into Claude Code, OpenAI/Codex, or OpenClaw.
- [Pulling skills into your agent](https://docs.promptlayer.com/features/skill-collections/pulling-skills.md): Download a Skill Collection with the PromptLayer SDK or public REST API so Claude Code, Codex, Cursor, or OpenClaw can load it from disk.
- [Sharing and remixing collections](https://docs.promptlayer.com/features/skill-collections/sharing-and-remixing.md): Publish a read-only link to a Skill Collection so others can view, remix, or pull it into their own workspace.
- [Tune skills for your team](https://docs.promptlayer.com/features/skill-collections/tuning-skills.md): Edit Skill Collections you own in the dashboard: provider layout, folder names, frontmatter, size limits, and SDK pull pins.
- [Supported Providers](https://docs.promptlayer.com/features/supported-providers.md)
- [Overview](https://docs.promptlayer.com/features/tool-registry/overview.md)
- [Save Inline to Registry](https://docs.promptlayer.com/features/tool-registry/save-inline-to-registry.md)
- [Using Tools in Prompts](https://docs.promptlayer.com/features/tool-registry/using-in-prompts.md)
- [xAI (Grok)](https://docs.promptlayer.com/features/xai-integration.md)
- [Migration Guide](https://docs.promptlayer.com/migration.md)
- [Deployment Strategies](https://docs.promptlayer.com/onboarding-guides/deployment-strategies.md): Choose from four integration patterns. Direct SDK calls, webhook caching, GitOps with CI/CD, or managed workflows.
- [PromptLayer Documentation](https://docs.promptlayer.com/overview.md): Version, test, and monitor every prompt and workflow with evals, tracing, and datasets.
- [Quickstart](https://docs.promptlayer.com/quickstart.md)
- [Quickstart - Pt 2](https://docs.promptlayer.com/quickstart-part-two.md)
- [Add Column to Evaluation Pipeline](https://docs.promptlayer.com/reference/add-report-columns.md): Adds a new evaluation step (column) to an existing evaluation pipeline. Columns execute sequentially from left to right and can reference data from previous columns.
- [Add Request Log to Dataset](https://docs.promptlayer.com/reference/add-request-log-to-dataset.md)
- [Create Dataset Group](https://docs.promptlayer.com/reference/create-dataset-group.md)
- [Create Dataset Version from File](https://docs.promptlayer.com/reference/create-dataset-version-from-file.md)
- [Create Dataset Version from Request History](https://docs.promptlayer.com/reference/create-dataset-version-from-filter-params.md)
- [Create Draft Dataset Version](https://docs.promptlayer.com/reference/create-draft-dataset-version.md)
- [Create Folder](https://docs.promptlayer.com/reference/create-folder.md): Creates a new folder in the workspace. Folders can be nested within other folders by providing a parent_id. The folder name must be unique within its parent folder (or at the root level if no parent is specified).
- [Create Evaluation Pipeline](https://docs.promptlayer.com/reference/create-reports.md): Creates a new evaluation pipeline (report) with optional evaluation columns and custom scoring.
- [Create Skill Collection](https://docs.promptlayer.com/reference/create-skill-collection.md)
- [Create Workflow](https://docs.promptlayer.com/reference/create-workflow.md)
- [Delete Folder Entities](https://docs.promptlayer.com/reference/delete-folder-entities.md): Deletes one or more entities from the workspace. Supports deleting folders, prompts, snippets, workflows, datasets, evaluations, AB tests, and input variable sets. Use cascade=true to recursively delete all contents of a folder. Without cascade, deleting a non-empty folder returns an error. Entities…
- [Delete Evaluation Pipeline](https://docs.promptlayer.com/reference/delete-report.md): Archive a single evaluation pipeline by ID. Prefer this over deleteReportsByName when you have the report's ID, since names can collide.
- [Delete Evaluation Pipeline Column](https://docs.promptlayer.com/reference/delete-report-column.md): Delete a single column from an evaluation pipeline. Surrounding columns shift left to fill the gap. Cannot delete DATASET columns. Cells in columns to the right of the deleted column are re-queued.
- [Delete Reports by Name](https://docs.promptlayer.com/reference/delete-reports-by-name.md)
- [Edit Evaluation Pipeline Column](https://docs.promptlayer.com/reference/edit-report-column.md): Update an existing column on an evaluation pipeline. Use this to fix a bug in a CODE_EXECUTION script, change a column's configuration, rename it, or reorder it — without recreating the whole pipeline. Cannot edit DATASET columns. Editing a column re-queues the affected cells.
- [Get Dataset Rows](https://docs.promptlayer.com/reference/get-dataset-rows.md): Retrieve paginated rows from a dataset.
- [Get Evaluation Rows](https://docs.promptlayer.com/reference/get-evaluation-rows.md): Retrieve paginated evaluation results with dataset inputs and evaluation outcomes.
- [Get Evaluation](https://docs.promptlayer.com/reference/get-report.md): Retrieve the info about a report.
- [Get Evaluation Score](https://docs.promptlayer.com/reference/get-report-score.md): Retrieve the score of a specific report.
- [Get Request](https://docs.promptlayer.com/reference/get-request.md): Retrieve a request's payload as a prompt blueprint, along with token usage and timing data.
- [Get Skill Collection](https://docs.promptlayer.com/reference/get-skill-collection.md)
- [Get Snippet Usage](https://docs.promptlayer.com/reference/get-snippet-usage.md): Get all prompts that use a given snippet (prompt template). Returns a list of prompts and their version numbers that reference this snippet.
- [Get Trace](https://docs.promptlayer.com/reference/get-trace.md)
- [Get Workflow](https://docs.promptlayer.com/reference/get-workflow.md)
- [Get Workflow Labels](https://docs.promptlayer.com/reference/get-workflow-labels.md)
- [Introduction](https://docs.promptlayer.com/reference/introduction.md): Use the PromptLayer REST API to manage prompts, workflows, evaluations, datasets, request logs, traces, and other workspace resources programmatically.
- [List Datasets](https://docs.promptlayer.com/reference/list-datasets.md)
- [List Evaluations](https://docs.promptlayer.com/reference/list-evaluations.md)
- [List Folder Entities](https://docs.promptlayer.com/reference/list-folder-entities.md): Lists entities within a folder or at the workspace root. Returns folders, prompts, snippets, workflows, datasets, evaluations, AB tests, and input variable sets. Supports filtering by entity type, searching by name, flattening the folder hierarchy, and optionally including entity metadata.
- [List Prompt Templates](https://docs.promptlayer.com/reference/list-prompt-templates.md)
- [List Skill Collections](https://docs.promptlayer.com/reference/list-skill-collections.md)
- [List Workflows](https://docs.promptlayer.com/reference/list-workflows.md)
- [Log Request](https://docs.promptlayer.com/reference/log-request.md)
- [Move Folder Entities](https://docs.promptlayer.com/reference/move-folder-entities.md): Moves one or more entities into a target folder, or to the workspace root if no folder_id is provided. Supports moving folders, prompts, snippets, workflows, datasets, evaluations, AB tests, and input variable sets. Requires appropriate edit permissions for each entity type.
- [Ingest Traces (OTLP)](https://docs.promptlayer.com/reference/otlp-ingest-traces.md): Ingest OpenTelemetry traces using the standard OTLP/HTTP protocol.
- [Update Workflow (PATCH)](https://docs.promptlayer.com/reference/patch-workflow.md)
- [Create a Prompt Template Label](https://docs.promptlayer.com/reference/prompt-labels-create.md)
- [Delete a Prompt Template Label](https://docs.promptlayer.com/reference/prompt-labels-delete.md)
- [Move Prompt Template Labels](https://docs.promptlayer.com/reference/prompt-labels-patch.md)
- [Rename Evaluation Pipeline](https://docs.promptlayer.com/reference/rename-report.md): Rename or retag an evaluation pipeline. Provide name, tags, or both. Use this instead of recreating a misnamed pipeline.
- [Resolve Folder ID by Path](https://docs.promptlayer.com/reference/resolve-folder-id.md): Resolves a folder's ID from its path. The path uses dot-separated folder names representing the hierarchy (e.g., "My Folder.Subfolder").
- [Run Full Evaluation](https://docs.promptlayer.com/reference/run-report.md): Run an evaluation pipeline
- [Run Workflow](https://docs.promptlayer.com/reference/run-workflow.md)
- [Save Draft Dataset Version](https://docs.promptlayer.com/reference/save-draft-dataset-version.md)
- [Save Skill Collection Version](https://docs.promptlayer.com/reference/save-skill-collection-version.md)
- [Search Request Logs](https://docs.promptlayer.com/reference/search-request-logs.md): Search and filter your request logs using structured filters, free-text search, and sorting.
- [Search Request Suggestions](https://docs.promptlayer.com/reference/search-request-suggestions.md): Get autocomplete suggestions for request log search fields.
- [Create Spans Bulk](https://docs.promptlayer.com/reference/spans-bulk.md)
- [Get Prompt Template](https://docs.promptlayer.com/reference/templates-get.md)
- [Get Prompt Template (Raw)](https://docs.promptlayer.com/reference/templates-get-raw.md): Retrieve raw prompt template data without applying input variables. Designed for GitHub sync, local caching, and template inspection. By default, snippets are resolved (expanded). Use resolve_snippets=false to get the raw template with snippet references intact.
- [List Prompt Template Labels](https://docs.promptlayer.com/reference/templates-labels-get.md)
- [Patch Prompt Template Version](https://docs.promptlayer.com/reference/templates-patch.md): Partially update a prompt template by creating a new version with merged changes. This endpoint fetches a base version (latest by default), applies your patches, validates the result, and creates a new version.
- [Publish Prompt Template](https://docs.promptlayer.com/reference/templates-publish.md)
- [Create Tool Registry](https://docs.promptlayer.com/reference/tool-registry-create.md): Create a new tool in the Tool Registry with an initial version.
- [Get Tool Registry](https://docs.promptlayer.com/reference/tool-registry-get.md): Get a tool from the Tool Registry by ID or name. Optionally resolve a specific version by label or version number.
- [List Tool Registries](https://docs.promptlayer.com/reference/tool-registry-list.md): List all tools in the Tool Registry for the workspace.
- [Track Metadata](https://docs.promptlayer.com/reference/track-metadata.md)
- [Track Prompt](https://docs.promptlayer.com/reference/track-prompt.md)
- [Track Score](https://docs.promptlayer.com/reference/track-score.md)
- [Update Folder](https://docs.promptlayer.com/reference/update-folder.md): Renames an existing folder. The new name must be unique within the folder's parent (or at root level). The folder must belong to a workspace accessible by the authenticated user.
- [Configure Custom Scoring](https://docs.promptlayer.com/reference/update-report-score-card.md): Configure custom scoring logic for an evaluation pipeline
- [Update Skill Collection](https://docs.promptlayer.com/reference/update-skill-collection.md)
- [Get Workflow Version Execution Results](https://docs.promptlayer.com/reference/workflow-version-execution-results.md)
- [Prompt Blueprints](https://docs.promptlayer.com/running-requests/prompt-blueprints.md)
- [Run](https://docs.promptlayer.com/running-requests/promptlayer-run.md)
- [Run Workflow](https://docs.promptlayer.com/running-requests/promptlayer-run-workflow.md)
- [Traces](https://docs.promptlayer.com/running-requests/traces.md)
- [JavaScript](https://docs.promptlayer.com/sdks/javascript.md)
- [Python](https://docs.promptlayer.com/sdks/python.md)
- [Self-Hosted PromptLayer](https://docs.promptlayer.com/self-hosted.md): Deploy PromptLayer in your own infrastructure for complete data control and compliance
- [Tutorial Videos](https://docs.promptlayer.com/tutorial-videos.md)
- [A/B Testing](https://docs.promptlayer.com/why-promptlayer/ab-releases.md)
- [Advanced Search](https://docs.promptlayer.com/why-promptlayer/advanced-search.md)
- [Analytics](https://docs.promptlayer.com/why-promptlayer/analytics.md)
- [Fine-Tuning](https://docs.promptlayer.com/why-promptlayer/fine-tuning.md)
- [Multi-Turn Chat](https://docs.promptlayer.com/why-promptlayer/multi-turn-chat.md)
- [Organizations](https://docs.promptlayer.com/why-promptlayer/organizations.md): Manage company-level members, roles, billing, settings, and usage across PromptLayer workspaces.
- [Playground](https://docs.promptlayer.com/why-promptlayer/playground.md)
- [RBAC](https://docs.promptlayer.com/why-promptlayer/rbac.md): Define reusable roles and assign fine-grained permissions to workspace members.
- [Overview](https://docs.promptlayer.com/why-promptlayer/shared-workspaces.md): Use organizations and workspaces to manage teams, environments, access, billing, and shared resources in PromptLayer.
- [Voice Agents](https://docs.promptlayer.com/why-promptlayer/voice-agents.md)
- [Workflows](https://docs.promptlayer.com/why-promptlayer/workflows.md)
- [Workspaces](https://docs.promptlayer.com/why-promptlayer/workspaces.md): Create shared environments for teams, projects, and deployment stages in PromptLayer.

## OpenAPI Specs

- [openapi](https://docs.promptlayer.com/openapi.json)