PromptLayer works seamlessly with many popular LLM frameworks and abstractions.

Don’t see the integration you are looking for? Email us! 👋

LangChain

Please read the LangChain documentation page.

LiteLLM

LiteLLM allows you to call any LLM API all using the OpenAI format. This is the easiest way to swap in and out new models and see which one works best for your prompts. Works with models such as Anthropic, HuggingFace, Cohere, PaLM, Replicate, Azure.

Please read the LiteLLM documentation page

LlamaIndex

LlamaIndex is a data framework for LLM-based applications. Read more about our integration on the LlamaIndex documentation page

Hugging Face

PromptLayer supports integration with Hugging Face, allowing you to use any model available on Hugging Face within the platform. To set up:

  1. Go to Settings
  2. Navigate to the Hugging Face section
  3. Click “Create New”

Once configured, you can use Hugging Face models throughout the platform, including:

  • Prompt Registry
  • Evaluations
  • All other platform features