15 projects
litellm
FeaturedPython SDK, Proxy Server (AI Gateway) to call 100+ LLM APIs in OpenAI (or native) format, with cost tracking, guardrails, loadbalancing and logging. [Bedrock, Azure, OpenAI, VertexAI, Cohere, Anthropic, Sagemaker, HuggingFace, VLLM, NVIDIA NIM]
dspy
FeaturedDSPy: The framework for programming—not prompting—language models
spaCy
Featured💫 Industrial-strength Natural Language Processing (NLP) in Python
openai-python
FeaturedThe official Python library for the OpenAI API
haystack
FeaturedOpen-source AI orchestration framework for building context-engineered, production-ready LLM applications. Design modular pipelines and agent workflows with explicit control over retrieval, routing, memory, and generation. Built for scalable agents, RAG, multimodal applications, semantic search, and conversational systems.
guidance
FeaturedA guidance language for controlling large language models.
outlines
FeaturedStructured Outputs
instructor
Featuredstructured outputs for llms
promptflow
FeaturedBuild high-quality LLM apps - from prototyping, testing to production deployment and monitoring.
openllmetry
Open-source observability for your GenAI or LLM application, based on OpenTelemetry
guardrails
Adding guardrails to large language models.
marvin
an ambient intelligence library
langchain-hub
Open-source skills project: langchain-hub
anthropic-sdk-python
Open-source skills project: anthropic-sdk-python
langchain
Elixir implementation of a LangChain style framework that lets Elixir projects integrate with and leverage LLMs.