[02/A] Cloud
Managed cloud
The managed platform. Your machines run the models; we run the routing, metering and control plane. Pay only for what flows through.
01
Bring-Your-Own Sources
Keep hardware wherever it lives; conduit connects outward, so no inbound firewall holes needed.
02
Linux + macOS
Conduit ships prebuilt Linux x64 and Apple Silicon macOS binaries, with npm and Docker images covering everything else.
03
Source Groups
Auto-grouped compute configs: pools of sources — including ephemeral ones — routed and scaled as a single unit.
04
Open Weight Model Catalog
A curated catalog of open weight models, sized against real hardware — from a 230M phone-class model to 284B flagships.
05
Auto-Scaling API
Public requests land on any instance; Redis pub/sub and streams carry them to the conduit holding your source connection.
06
Endpoint Authentication
Per-endpoint API keys with scoped authentication: separate credentials for every consumer, revocable at any time.
07
Compatible APIs
OpenAI- and Anthropic-compatible REST surfaces. Existing agents, SDKs and CLIs work unchanged.
08
MCP Endpoints
Expose your own MCP tool services: agents connect once and call tools per request, metered individually.
09
MCP Proxying
Proxy third-party MCP servers through your account with authentication, quotas and per-call accounting.
10
Server-Side Tool Calling
The platform intercepts and executes tool calls server-side, so even basic clients get full agentic capabilities.
11
Server-Side RAGSOON
Retrieval-augmented generation over your own documents, executed inside the request path.
12
Open Telemetry
Open Telemetry metrics and traces for prompts, tokens and tool calls — feed them straight into your observability stack.
13
Console
The full control panel: sources, models, endpoints, tool services and spend, from one place.
14
Credit Billing
Top up via Stripe, deduct in real time. No subscriptions, no minimums — metered infrastructure rates.
Pay for what flows
Credit-based and real time. Connected sources bill per hour; inference bills per token and per tool call.
Connect your first source
Install conduit on a machine with an engine server, register it in the console and point your stack at the API.