llmops

MindsDB is a Server for Artificial Intelligence Logic. Enabling developers to ship to production AI powered projects (from the latest LLMs, vector operations, state of the art time-series forecasting to Machine Learning) in a fast and scalable way.

<⚡️> SuperAGI - A dev-first open source autonomous AI agent framework. Enabling developers to build, manage & run useful autonomous agents quickly and reliably.

Unified Model Serving Framework 🍱

An open platform for operating large language models (LLMs) in production. Fine-tune, serve, deploy, and monitor any LLMs with ease.

A high-throughput and memory-efficient inference and serving engine for LLMs

AGiXT is a dynamic AI Automation Platform that seamlessly orchestrates instruction management and complex task execution across diverse AI providers. Combining adaptive memory, smart features, and a versatile plugin system, AGiXT delivers efficient and comprehensive AI solutions.

🏕️ Reproducible development environment for AI/ML

ML Observability in a Notebook - Uncover Insights, Surface Problems, Monitor, and Fine Tune your Generative LLM, CV and Tabular Models

An awesome & curated list of best LLMOps tools for developers

The testing framework dedicated to ML models, from tabular to LLMs 🛡️🧑‍🔬

An open-source visual programming environment for battle-testing prompts to LLMs.

🧠 Motorhead is a memory and information retrieval server for LLMs.

FastAPI framework to build production-grade LLM applications

Rebuff.ai - Prompt Injection Detector

Test your prompts. Evaluate and compare LLM outputs, catch regressions, and improve prompt quality.

Evaluation and Tracking for LLM Experiments

🚀 Generate awesome README files from the terminal, powered by OpenAI's GPT language model APIs 💫

Resources for running, fine-tuning, and inferencing Dolly 2.0

Large Language Models (LLMs) tutorials & sample scripts, ft. langchain, openai, llamaindex, gpt, chromadb & pinecone

Infino - Fast and scalable service to store time series and logs - written in Rust