Open source stack for private AI
Curated projects we track for self-hosted inference, knowledge systems, agent learning, safety, and edge deployment. External links; verify licenses and fit for your environment.
Self-hosted & embedded AI
Run models on your hardware without cloud dependency.
-
Odysseus
Self-hosted AI stack for local inference and private assistant workflows.
OCR
Document and image text extraction for on-prem pipelines.
-
Unlimited OCR (Baidu)
Open OCR tooling for high-volume text recognition from images and scans.
Agent RL & live learning
Reinforcement and online learning bridges for LLM agents.
-
AReaL
RL bridge for LLM agents — connect training loops to real agent runtimes.
-
ODS (Osmantic)
Osmantic data system for agent-oriented storage and operational learning flows.
Security & LLM safety
Red teaming, guardrails, and structured policy via MCP.
-
DeepTeam (Confident AI)
LLM red-teaming framework for adversarial testing and vulnerability discovery.
-
Ontology MCP Server
MCP server exposing ontologies so agents can reason over typed domain concepts.
Healthcare AI
Open research and tooling from Google Health.
-
Google Health (open source)
Organization hub for health-related open-source models, datasets, and tools.
Meeting & local transcription
Privacy-first capture without sending audio to the cloud.
-
Meetily
Local meeting AI built in Rust with Ollama — transcription and summaries on-device.
Knowledge extraction
Structure text into graphs for downstream retrieval and reasoning.
-
Hyper-Extract
Hypergraph extraction from unstructured text for richer knowledge representation.
Local dev & infrastructure
Emulate cloud services on your laptop for private AI CI and testing.
-
floci
Lightweight local emulator alternative to AWS-style services for dev and integration tests.
Building on private hardware?
Map these tools to your edge or on-prem stack with our hardware configurator and Sovra tiers.