[02/B] Self-hosted
Self-hosted
The whole platform in one container on your hardware. No billing, no platform dependency — an annual license with a 14-day trial to start.
01
Single Service
Console UI and public API combined into one Express service. One container, one port, your infrastructure.
02
Linux + macOS
Conduit ships prebuilt Linux x64 and Apple Silicon macOS binaries, with npm and Docker images covering everything else.
03
Source Groups
Auto-grouped compute configs: pools of sources — including ephemeral ones — routed and scaled as a single unit.
04
Multi-Engine Support
Conduit drives vLLM, llama.cpp, MLX-LM, SGLang, TensorRT-LLM, ExLlamaV3 and custom OpenAI-compatible engine servers.
05
Model Fit Check
Conduit probes your GPUs, VRAM and RAM to show which models fit your machines, with AI-powered suggestions for your hardware.
06
Open Weight Model Catalog
A curated catalog of open weight models, sized against real hardware — from a 230M phone-class model to 284B flagships.
07
Endpoint Authentication
Per-endpoint API keys with scoped authentication: separate credentials for every consumer, revocable at any time.
08
Compatible APIs
OpenAI- and Anthropic-compatible REST surfaces. Existing agents, SDKs and CLIs work unchanged.
09
REST Management API
Scriptable CRUD over endpoints, sources, models and engines — manage the platform from scripts, pipelines or any HTTP client.
10
Decision Models
Serve decision models alongside LLMs: one state in, calibrated typed answers out — choices, scores and booleans in a single forward pass, zero generated tokens.
11
MCP Endpoints
Expose your own MCP tool services: agents connect once and call tools per request, metered individually.
12
MCP Proxying
Proxy third-party MCP servers through your account with authentication, quotas and per-call accounting.
13
Server-Side Tool Calling
The platform intercepts and executes tool calls server-side, so even basic clients get full agentic capabilities.
14
Document Ingestion
Parse PDF, DOCX, HTML, Markdown, CSV and JSON documents into RAG attachments — with OCR fallback and watched directories that ingest as files change.
15
Server-Side RAG
Retrieval-augmented generation over your own documents, executed inside the request path.
16
Hardware Telemetry
Live machine telemetry in the console: CPU, RAM, GPU model, VRAM usage, temperature and driver versions for every connected machine.
17
Open Telemetry
Open Telemetry metrics and traces for prompts, tokens and tool calls — feed them straight into your observability stack.
18
Auditing
Attach audits to inference endpoints and capture requests, tool calls, auth failures and source state. The cloud retains 90 days; self-hosted exports daily extracts to a volume you control.
19
Zero Billing
No credits, no Stripe, no metering. The entire billing surface is compiled out.
20
Own Your Data
Your own database with a curated, self-hosted migration set. Your data never leaves your network.
License the stack
Annual subscription, billed via Stripe. 14-day trial on every tier.
Standard
€349 /mo
- ENDPOINTS
- 2
- SOURCES
- 4
- TOOL SERVICES
- 3
- CONCURRENCY / EP
- 5
Pro
€699 /mo
- ENDPOINTS
- 8
- SOURCES
- 15
- TOOL SERVICES
- 10
- CONCURRENCY / EP
- 25
Max
€1499 /mo
- ENDPOINTS
- 25
- SOURCES
- 50
- TOOL SERVICES
- 50
- CONCURRENCY / EP
- 120
Billed annually — €4188 / €8388 / €17988 per year
One container to own it all
Start a 14-day trial, deploy the combined service and connect conduit to your engines.