PromptLayer works seamlessly with many popular LLM frameworks and abstractions.

Donโ€™t see the integration you are looking for? Email us! ๐Ÿ‘‹

LangChain

Please read the LangChain documentation page.

LiteLLM

LiteLLM allows you to call any LLM API all using the OpenAI format. This is the easiest way to swap in and out new models and see which one works best for your prompts. Works with models such as Anthropic, HuggingFace, Cohere, PaLM, Replicate, Azure.

Please read the LiteLLM documentation page

LlamaIndex

LlamaIndex is a data framework for LLM-based applications. Read more about our integration on the LlamaIndex documentation page