Tutorial Videos

These tutorial videos will walk you through key features and help you get up and running quickly. Let’s start with a quick tour of PromptLayer in action: prompt management, testing, deployment, agents, and evaluations all in one workflow. Read more about the Bakery Demo on our blog to learn how we built Artificial Indulgence and how it showcases PromptLayer’s features in action.

​

Prompt Management

​

Creating Your First Prompt

Learn how to create structured templates with variables that you can reuse across your applications.

​

Deploying Prompts to Production

Learn how to safely deploy prompt versions to production and staging environments.

​

Evaluation & Testing

​

Building Your First Evaluation

Create evaluations that are use-case specific and help prevent prompt regression.

​

Choosing the Best AI Model

Learn how to test your use cases across multiple models to find the best fit.

​

Testing With Production Data

Build comprehensive test sets from your historical data for effective evaluation.

​

Conversation Simulation Evals

Learn how to evaluate conversational AI systems using simulated user interactions.

​

Agents & Workflows

​

Building Multi-Step Agents

Chain multiple LLM calls together to tackle complex problems.

​

Logging and Optimization

​

Monitoring LLM Requests

Track and analyze your LLM requests in real-time to understand usage patterns, monitor performance, and debug issues across your applications.

​

A/B Testing for Prompts

Systematically compare different prompt versions to make data-driven decisions.

​

Additional Resources

For more in-depth information, check out our comprehensive documentation:

• Prompt Management Guide
• Evaluation Guide
• Agentic Workflows Guide
• Observability Guide