GenAI Ops Landscape

A curated list of GenAI Ops Projects.

GenAI Ops Tools

Content Safety API

by

Microsoft

Category
Content Filtering
What it does:
The Content Safety service provides you with AI algorithms for flagging objectionable content.
Open Source:
No
Read more →

DeepSeed-MII

by

Microsoft

Category
Model Inference Framework
What it does:
Increase inference speed
Open Source:
No
Read more →

Developer

by

Smol-AI

Category
Agent
What it does:
Human-centric & Coherent Whole Program Synthesis aka your own personal junior developer
Open Source:
Yes
Read more →

Dromedary

by

IBM

Category
Foundation Model
What it does:
Dromedary is an open-source self-aligned language model trained with minimal human supervision.
Open Source:
Yes
Read more →

Dust

by

Category
LLM Development Framework
What it does:
Design and Deploy Large Language Model Apps
Open Source:
Yes
Read more →

EditGPT

by

Category
Browser Extension
What it does:
A free browser extension that allows users to proofread, edit, and track changes to their content using OpenAI's ChatGPT.
Open Source:
No
Read more →

Filtir

by

Filtir

Category
Content Filtering
What it does:
Fact Checking API
Open Source:
No
Read more →

GraphSignal OpenAI

by

GraphSignal

Category
User-Model Supervision
What it does:
Monitor OpenAI API Latency, Tokens, Rate Limits, and More
Open Source:
No
Read more →

Guardrails AI

by

Guardrails AI

Category
Content Filtering
Prompt Engineering
What it does:
Standardize a protocol to extract information from LLM response. The protocol defines prompt, expected output, etc... If the output fails to conform the package can generate a new ask to the LLM to clarify.
Open Source:
Yes
Read more →