# PromptLayer

## Docs

- [CLAUDE](https://docs.promptlayer.com/CLAUDE.md)
- [DOCS UPDATER SETUP TODO](https://docs.promptlayer.com/DOCS_UPDATER_SETUP_TODO.md)
- [TESTING INSTRUCTIONS](https://docs.promptlayer.com/TESTING_INSTRUCTIONS.md)
- [MCP & Skills](https://docs.promptlayer.com/agents/overview.md): Use PromptLayer with AI tools.
- [Changelog](https://docs.promptlayer.com/changelog.md): Daily updates on new features and improvements to PromptLayer.
- [Concentrate AI](https://docs.promptlayer.com/features/concentrate-integration.md)
- [Configure Providers](https://docs.promptlayer.com/features/custom-providers.md): Connect OpenAI-compatible providers and custom models to PromptLayer.
- [Getting Started](https://docs.promptlayer.com/features/evaluations/building-pipelines.md)
- [Node & Column Types](https://docs.promptlayer.com/features/evaluations/column-types.md): Complete reference for all node types used in Workflows and evaluation pipelines
- [Continuous Integration](https://docs.promptlayer.com/features/evaluations/continuous-integration.md)
- [Datasets](https://docs.promptlayer.com/features/evaluations/datasets.md)
- [Create from File](https://docs.promptlayer.com/features/evaluations/datasets-create-from-file.md)
- [Create from History](https://docs.promptlayer.com/features/evaluations/datasets-create-from-history.md)
- [Overview](https://docs.promptlayer.com/features/evaluations/datasets-overview.md): Use Datasets as the versioned system of record for evaluation inputs, backtests, and batch workflows.
- [Eval Types](https://docs.promptlayer.com/features/evaluations/eval-types.md)
- [Eval Examples](https://docs.promptlayer.com/features/evaluations/examples.md)
- [Overview](https://docs.promptlayer.com/features/evaluations/overview.md)
- [Online or Programmatic Evals](https://docs.promptlayer.com/features/evaluations/programmatic.md)
- [Score Card](https://docs.promptlayer.com/features/evaluations/score-card.md)
- [Exa](https://docs.promptlayer.com/features/exa-integration.md): Set up Exa as a custom provider in PromptLayer.
- [FAQ](https://docs.promptlayer.com/features/faq.md)
- [Image Generation](https://docs.promptlayer.com/features/image-generation.md)
- [Telemetry Integrations](https://docs.promptlayer.com/features/integrations.md): Send traces, spans, LLM calls, tool calls, and agent telemetry into PromptLayer.
- [Overview](https://docs.promptlayer.com/features/observability.md): Use Observability to analyze app behavior, review PromptLayer usage, and turn useful history into datasets.
- [OpenRouter](https://docs.promptlayer.com/features/openrouter-integration.md): Set up OpenRouter as a custom provider in PromptLayer.
- [OpenTelemetry](https://docs.promptlayer.com/features/opentelemetry.md)
- [Custom Logging](https://docs.promptlayer.com/features/prompt-history/custom-logging.md)
- [Metadata](https://docs.promptlayer.com/features/prompt-history/metadata.md)
- [Request IDs](https://docs.promptlayer.com/features/prompt-history/request-id.md)
- [Score Requests](https://docs.promptlayer.com/features/prompt-history/scoring-requests.md)
- [Search Data Model](https://docs.promptlayer.com/features/prompt-history/search-data-model.md)
- [Sharing Requests](https://docs.promptlayer.com/features/prompt-history/sharing-prompts.md)
- [Logging Structured Outputs](https://docs.promptlayer.com/features/prompt-history/structured-output-logging.md)
- [Tags](https://docs.promptlayer.com/features/prompt-history/tagging-requests.md)
- [Tracking Templates](https://docs.promptlayer.com/features/prompt-history/tracking-templates.md)
- [Dynamic Release Labels](https://docs.promptlayer.com/features/prompt-registry/dynamic-release-labels.md)
- [Input Variable Sets](https://docs.promptlayer.com/features/prompt-registry/input-variable-sets.md)
- [Overview](https://docs.promptlayer.com/features/prompt-registry/new-overview.md): Use Prompt Registry as the system of record for prompt versions, testing, releases, and observability.
- [Placeholder Messages](https://docs.promptlayer.com/features/prompt-registry/placeholder-messages.md)
- [Editor and Versioning](https://docs.promptlayer.com/features/prompt-registry/prompt-editor-versioning.md): Create prompts, edit messages, test changes, and review version history in the Prompt Registry.
- [Release Labels](https://docs.promptlayer.com/features/prompt-registry/release-labels.md)
- [Snippets](https://docs.promptlayer.com/features/prompt-registry/snippets.md)
- [Structured Outputs](https://docs.promptlayer.com/features/prompt-registry/structured-outputs.md)
- [Template Variables](https://docs.promptlayer.com/features/prompt-registry/template-variables.md)
- [Tool Calling](https://docs.promptlayer.com/features/prompt-registry/tool-calling.md)
- [Events](https://docs.promptlayer.com/features/prompt-registry/webhook-events.md)
- [Introduction](https://docs.promptlayer.com/features/prompt-registry/webhooks.md): Use webhooks to receive notifications about prompt, dataset, evaluation, workflow, and skill collection events in your workspace.
- [Zero Downtime Releases](https://docs.promptlayer.com/features/prompt-registry/zero-downtime-releases.md)
- [Editing with Wrangler AI](https://docs.promptlayer.com/features/skill-collections/editing-with-wrangler.md): Use PromptLayer's in-dashboard assistant to create, edit, rename, and migrate Skill Collections without learning SKILL.md conventions yourself.
- [Overview](https://docs.promptlayer.com/features/skill-collections/overview.md): Versioned folders of agent instructions (SKILL.md files) you can share, remix, and pull into Claude Code, OpenAI/Codex, or OpenClaw.
- [Pulling skills into your agent](https://docs.promptlayer.com/features/skill-collections/pulling-skills.md): Download a Skill Collection with the PromptLayer SDK or public REST API so Claude Code, Codex, Cursor, or OpenClaw can load it from disk.
- [Sharing and remixing collections](https://docs.promptlayer.com/features/skill-collections/sharing-and-remixing.md): Publish a read-only link to a Skill Collection so others can view, remix, or pull it into their own workspace.
- [Tune skills for your team](https://docs.promptlayer.com/features/skill-collections/tuning-skills.md): Edit Skill Collections you own in the dashboard: provider layout, folder names, frontmatter, size limits, and SDK pull pins.
- [Supported Providers](https://docs.promptlayer.com/features/supported-providers.md): Review the LLM providers and model capabilities PromptLayer supports.
- [Overview](https://docs.promptlayer.com/features/tool-registry/overview.md)
- [Save Inline to Registry](https://docs.promptlayer.com/features/tool-registry/save-inline-to-registry.md)
- [Using Tools in Prompts](https://docs.promptlayer.com/features/tool-registry/using-in-prompts.md)
- [xAI (Grok)](https://docs.promptlayer.com/features/xai-integration.md): Set up xAI Grok models as a custom provider in PromptLayer.
- [Backtest Prompt Changes](https://docs.promptlayer.com/onboarding-guides/backtesting-prompt-changes.md): Test a new prompt version against historical request data before releasing it.
- [Run Batch Jobs](https://docs.promptlayer.com/onboarding-guides/batch-runs.md): Use evaluations as spreadsheet-style batch runs for labeling, research, generation, and enrichment.
- [Compare Models](https://docs.promptlayer.com/onboarding-guides/compare-models.md): Compare prompt outputs across providers and models with an evaluation pipeline.
- [Choose a Deployment Strategy](https://docs.promptlayer.com/onboarding-guides/deployment-strategies.md): Choose from four integration patterns. Direct SDK calls, webhook caching, GitOps with CI/CD, or managed workflows.
- [PromptLayer Documentation](https://docs.promptlayer.com/overview.md): Version, test, and monitor every prompt and workflow.
- [Quickstart](https://docs.promptlayer.com/quickstart.md): Create, run, and evaluate your first prompt.
- [Add Column to Evaluation Pipeline](https://docs.promptlayer.com/reference/add-report-columns.md)
- [Add Request Log to Dataset](https://docs.promptlayer.com/reference/add-request-log-to-dataset.md)
- [Create Dataset Group](https://docs.promptlayer.com/reference/create-dataset-group.md)
- [Create Dataset Version from File](https://docs.promptlayer.com/reference/create-dataset-version-from-file.md)
- [Create Dataset Version from Request History](https://docs.promptlayer.com/reference/create-dataset-version-from-filter-params.md)
- [Create Draft Dataset Version](https://docs.promptlayer.com/reference/create-draft-dataset-version.md)
- [Create Folder](https://docs.promptlayer.com/reference/create-folder.md)
- [Create Evaluation Pipeline](https://docs.promptlayer.com/reference/create-reports.md)
- [Create Skill Collection](https://docs.promptlayer.com/reference/create-skill-collection.md)
- [Create Workflow](https://docs.promptlayer.com/reference/create-workflow.md)
- [Delete Folder Entities](https://docs.promptlayer.com/reference/delete-folder-entities.md)
- [Delete Evaluation Pipeline](https://docs.promptlayer.com/reference/delete-report.md)
- [Delete Evaluation Pipeline Column](https://docs.promptlayer.com/reference/delete-report-column.md)
- [Delete Reports by Name](https://docs.promptlayer.com/reference/delete-reports-by-name.md)
- [Edit Evaluation Pipeline Column](https://docs.promptlayer.com/reference/edit-report-column.md)
- [Attach Dataset Group External ID](https://docs.promptlayer.com/reference/external-ids-dataset-groups-attach.md)
- [Delete Dataset Group External ID](https://docs.promptlayer.com/reference/external-ids-dataset-groups-delete.md)
- [List Dataset Group External IDs](https://docs.promptlayer.com/reference/external-ids-dataset-groups-list.md)
- [Attach Folder External ID](https://docs.promptlayer.com/reference/external-ids-folders-attach.md)
- [Delete Folder External ID](https://docs.promptlayer.com/reference/external-ids-folders-delete.md)
- [List Folder External IDs](https://docs.promptlayer.com/reference/external-ids-folders-list.md)
- [External IDs](https://docs.promptlayer.com/reference/external-ids-overview.md): Attach identifiers from your own systems to PromptLayer resources so your integrations can easily find and sync resources.
- [Attach Prompt Template External ID](https://docs.promptlayer.com/reference/external-ids-prompt-templates-attach.md)
- [Delete Prompt Template External ID](https://docs.promptlayer.com/reference/external-ids-prompt-templates-delete.md)
- [List Prompt Template External IDs](https://docs.promptlayer.com/reference/external-ids-prompt-templates-list.md)
- [Upsert Prompt Template by External ID](https://docs.promptlayer.com/reference/external-ids-prompt-templates-upsert.md)
- [Attach Report External ID](https://docs.promptlayer.com/reference/external-ids-reports-attach.md)
- [Delete Report External ID](https://docs.promptlayer.com/reference/external-ids-reports-delete.md)
- [List Report External IDs](https://docs.promptlayer.com/reference/external-ids-reports-list.md)
- [Attach Skill Collection External ID](https://docs.promptlayer.com/reference/external-ids-skill-collections-attach.md)
- [Delete Skill Collection External ID](https://docs.promptlayer.com/reference/external-ids-skill-collections-delete.md)
- [List Skill Collection External IDs](https://docs.promptlayer.com/reference/external-ids-skill-collections-list.md)
- [Attach Tool Registry External ID](https://docs.promptlayer.com/reference/external-ids-tool-registry-attach.md)
- [Delete Tool Registry External ID](https://docs.promptlayer.com/reference/external-ids-tool-registry-delete.md)
- [List Tool Registry External IDs](https://docs.promptlayer.com/reference/external-ids-tool-registry-list.md)
- [Attach Workflow External ID](https://docs.promptlayer.com/reference/external-ids-workflows-attach.md)
- [Delete Workflow External ID](https://docs.promptlayer.com/reference/external-ids-workflows-delete.md)
- [List Workflow External IDs](https://docs.promptlayer.com/reference/external-ids-workflows-list.md)
- [Get Dataset Rows](https://docs.promptlayer.com/reference/get-dataset-rows.md)
- [Get Evaluation Rows](https://docs.promptlayer.com/reference/get-evaluation-rows.md)
- [Get Evaluation](https://docs.promptlayer.com/reference/get-report.md)
- [Get Evaluation Score](https://docs.promptlayer.com/reference/get-report-score.md)
- [Get Request](https://docs.promptlayer.com/reference/get-request.md)
- [Get Skill Collection](https://docs.promptlayer.com/reference/get-skill-collection.md)
- [Get Snippet Usage](https://docs.promptlayer.com/reference/get-snippet-usage.md)
- [Get Trace](https://docs.promptlayer.com/reference/get-trace.md)
- [Get Workflow](https://docs.promptlayer.com/reference/get-workflow.md)
- [Get Workflow Labels](https://docs.promptlayer.com/reference/get-workflow-labels.md)
- [Introduction](https://docs.promptlayer.com/reference/introduction.md): Use the PromptLayer REST API to manage prompts, workflows, evaluations, datasets, request logs, traces, and other workspace resources programmatically.
- [List Datasets](https://docs.promptlayer.com/reference/list-datasets.md)
- [List Evaluations](https://docs.promptlayer.com/reference/list-evaluations.md)
- [List Folder Entities](https://docs.promptlayer.com/reference/list-folder-entities.md)
- [List Prompt Templates](https://docs.promptlayer.com/reference/list-prompt-templates.md)
- [List Skill Collections](https://docs.promptlayer.com/reference/list-skill-collections.md)
- [List Workflows](https://docs.promptlayer.com/reference/list-workflows.md)
- [Log Request](https://docs.promptlayer.com/reference/log-request.md)
- [Move Folder Entities](https://docs.promptlayer.com/reference/move-folder-entities.md)
- [Ingest Traces (OTLP)](https://docs.promptlayer.com/reference/otlp-ingest-traces.md)
- [Update Workflow (PATCH)](https://docs.promptlayer.com/reference/patch-workflow.md)
- [Create a Prompt Template Label](https://docs.promptlayer.com/reference/prompt-labels-create.md)
- [Delete a Prompt Template Label](https://docs.promptlayer.com/reference/prompt-labels-delete.md)
- [Move Prompt Template Labels](https://docs.promptlayer.com/reference/prompt-labels-patch.md)
- [Rename Evaluation Pipeline](https://docs.promptlayer.com/reference/rename-report.md)
- [Request Analytics](https://docs.promptlayer.com/reference/request-analytics.md)
- [Resolve Folder ID by Path](https://docs.promptlayer.com/reference/resolve-folder-id.md)
- [Run Full Evaluation](https://docs.promptlayer.com/reference/run-report.md)
- [Run Workflow](https://docs.promptlayer.com/reference/run-workflow.md)
- [Save Draft Dataset Version](https://docs.promptlayer.com/reference/save-draft-dataset-version.md)
- [Save Skill Collection Version](https://docs.promptlayer.com/reference/save-skill-collection-version.md)
- [Search Request Logs](https://docs.promptlayer.com/reference/search-request-logs.md)
- [Search Request Suggestions](https://docs.promptlayer.com/reference/search-request-suggestions.md)
- [Create Spans Bulk](https://docs.promptlayer.com/reference/spans-bulk.md)
- [Get Prompt Template](https://docs.promptlayer.com/reference/templates-get.md)
- [Get Prompt Template (Raw)](https://docs.promptlayer.com/reference/templates-get-raw.md)
- [List Prompt Template Labels](https://docs.promptlayer.com/reference/templates-labels-get.md)
- [Patch Prompt Template Version](https://docs.promptlayer.com/reference/templates-patch.md)
- [Publish Prompt Template](https://docs.promptlayer.com/reference/templates-publish.md)
- [Create Tool Registry](https://docs.promptlayer.com/reference/tool-registry-create.md)
- [Get Tool Registry](https://docs.promptlayer.com/reference/tool-registry-get.md)
- [List Tool Registries](https://docs.promptlayer.com/reference/tool-registry-list.md)
- [Track Metadata](https://docs.promptlayer.com/reference/track-metadata.md)
- [Track Prompt](https://docs.promptlayer.com/reference/track-prompt.md)
- [Track Score](https://docs.promptlayer.com/reference/track-score.md)
- [Update Folder](https://docs.promptlayer.com/reference/update-folder.md)
- [Configure Custom Scoring](https://docs.promptlayer.com/reference/update-report-score-card.md)
- [Update Skill Collection](https://docs.promptlayer.com/reference/update-skill-collection.md)
- [Get Workflow Version Execution Results](https://docs.promptlayer.com/reference/workflow-version-execution-results.md)
- [Prompt Blueprints](https://docs.promptlayer.com/running-requests/prompt-blueprints.md)
- [Run](https://docs.promptlayer.com/running-requests/promptlayer-run.md)
- [Run Workflow](https://docs.promptlayer.com/running-requests/promptlayer-run-workflow.md)
- [Traces](https://docs.promptlayer.com/running-requests/traces.md)
- [JavaScript](https://docs.promptlayer.com/sdks/javascript.md)
- [Python](https://docs.promptlayer.com/sdks/python.md)
- [Self-Hosted PromptLayer](https://docs.promptlayer.com/self-hosted.md): Deploy PromptLayer in your own infrastructure for complete data control and compliance
- [Tutorial Videos](https://docs.promptlayer.com/tutorial-videos.md)
- [A/B Testing](https://docs.promptlayer.com/why-promptlayer/ab-releases.md)
- [Advanced Search](https://docs.promptlayer.com/why-promptlayer/advanced-search.md)
- [Analytics](https://docs.promptlayer.com/why-promptlayer/analytics.md)
- [Fine-Tuning](https://docs.promptlayer.com/why-promptlayer/fine-tuning.md)
- [Multi-Turn Chat](https://docs.promptlayer.com/why-promptlayer/multi-turn-chat.md)
- [Organizations](https://docs.promptlayer.com/why-promptlayer/organizations.md): Manage company-level members, roles, billing, settings, and usage across PromptLayer workspaces.
- [Playground](https://docs.promptlayer.com/why-promptlayer/playground.md)
- [RBAC](https://docs.promptlayer.com/why-promptlayer/rbac.md): Define reusable roles and assign fine-grained permissions to workspace members.
- [Overview](https://docs.promptlayer.com/why-promptlayer/shared-workspaces.md): Use organizations and workspaces to manage teams, environments, access, billing, and shared resources in PromptLayer.
- [Voice Agents](https://docs.promptlayer.com/why-promptlayer/voice-agents.md)
- [Workflows](https://docs.promptlayer.com/why-promptlayer/workflows.md)
- [Workspaces](https://docs.promptlayer.com/why-promptlayer/workspaces.md): Create shared environments for teams, projects, and deployment stages in PromptLayer.

## OpenAPI Specs

- [openapi](https://docs.promptlayer.com/openapi.json)