PromptLayer works seamlessly with many popular LLM frameworks and abstractions.

Don’t see the integration you are looking for? Email us! 👋

​

LangChain

Please read the LangChain documentation page.

​

LiteLLM

LiteLLM allows you to call any LLM API all using the OpenAI format. This is the easiest way to swap in and out new models and see which one works best for your prompts. Works with models such as Anthropic, HuggingFace, Cohere, PaLM, Replicate, Azure.

Please read the LiteLLM documentation page

​

LlamaIndex

LlamaIndex is a data framework for LLM-based applications. Read more about our integration on the LlamaIndex documentation page

​

Hugging Face

PromptLayer supports integration with Hugging Face, allowing you to use any model available on Hugging Face within the platform. To set up:

1. Go to Settings
2. Navigate to the Hugging Face section
3. Click “Create New”

Once configured, you can use Hugging Face models throughout the platform, including:

• Prompt Registry
• Evaluations
• All other platform features

​

Vertex AI

PromptLayer supports integration with Google Cloud Vertex AI, allowing you to use Gemini and Claude models through Google’s AI platform. To set up:

1. Go to Settings
2. Navigate to the Vertex AI section
3. Enter your Vertex AI Project ID
4. Enter your Vertex AI Location (e.g., us-central1)
5. Attach your Vertex AI Security Credentials JSON file
6. Click “Save Vertex AI Credentials”

Once configured, you can use Vertex AI models throughout the platform, including:

• Gemini models (gemini-pro, gemini-pro-vision, etc.)
• Claude models (claude-3-sonnet, claude-3-haiku, etc.)
• All platform features including Prompt Registry and Evaluations