Enterprise AI Inference — Preview

Requests in.
Tokens out.

The apps your team loves and the inference backend your stack needs — at a tenth of the cost. Multiple models, one endpoint, zero retention of your data. Send a request. Get tokens back.

$ curl https://inference.basemnt.ai/v1/chat/completions \
  -H "Authorization: Bearer $API_KEY" \
  -d '{"model": "GLM-5.2", "messages": [{"role": "user", "content": "Hello"}]}'
> 200 OK · 47ms · tokens: 284
AMD INSTINCT MI350 Series NODE-00 // 8× MI355X TEMP 61°C PWR 11.2kW HBM3E 2.3TB
[ 01 ] — Live Telemetry

Target performance, measured like it's already live

Target Latency
<50ms
p50 at launch
Target Throughput
1M+ t/s
at full capacity
Target Uptime
99.99%
SLA commitment
Planned Regions
14
at general availability
Simulated Throughput — tok/s
[ 02 ] — System Topology

How requests move through the platform

Four layers between your HTTP call and a streamed token. Each one is boring, observable, and fast.

L4 Edge Router

Geo-DNS with latency-based routing. TLS terminated at the edge, rate limits applied before anything touches compute.

L3 Request Scheduler

Priority queues per model. Load balanced across healthy regions, KV-cache aware placement.

L2 Inference Engine

Continuous batching, token streaming with sub-50ms TTFB, automatic prompt deduplication.

L1 GPU Cluster

Dedicated Instinct MI355X nodes per workload. Region failure detected in <1s, traffic rerouted without dropping connections.

REQUEST IN TOKENS OUT
[ 03 ] — The Basement

Dedicated silicon. No abstraction leaks.

Workloads land on dedicated AMD Instinct MI355X accelerators, tuned and monitored end to end — never oversubscribed, never sharing a box with someone else's training run.

Accelerators Online
128 / 128
Cluster Temp
58.4 °C
Power Draw
61.2 kW
Utilization
87.3 %
[ 04 ] — Capabilities

What the platform does

Token Streaming

First token in under 50ms. Stream responses token-by-token with sub-second TTFB.

Elastic Scale

We handle the scaling. Traffic spikes are absorbed automatically. You never think about capacity.

Smart Routing

Geo-DNS with latency-based routing. Requests hit the nearest healthy region.

Observability

Token-level logging, request tracing, cost attribution. Export to any stack.

Intelligent Cache

KV-cache reuse across requests. Automatic prompt deduplication.

Automatic Failover

Region failure detected in <1s. Traffic rerouted without dropping connections.

[ 05 ] — Data Privacy

An inference company, not an AI lab.

We don't train models and we don't build products on your data. Prompts and completions are processed in memory and never written to disk — zero retention by architecture, not by policy.

0 bytes
Retained

Prompts, completions, and uploaded files live in volatile memory for the duration of the request. Then they're gone.

Never
Trained On Your Data

No fine-tuning, no evals, no "service improvement" pipelines. Your confidential data is never model input again.

Pure
Inference, No Lab

We have no models of our own and nothing to gain from your data. Our only product is fast, private inference.

[ 06 ] — Apps

Drop-in apps your team already knows.

Polished desktop and web assistants that feel instantly familiar — wired to your models, your SSO, your audit logs. Migrate seats in an afternoon, not a quarter.

app.basemnt.ai
Q3 vendor analysis
Legal review summary
Board deck draft
+ New chat
Retention 0 bytes
Summarize the liability clause in this contract.
Kimi-K2.7 · 38ms TTFT The liability cap is set at twelve months of fees, with carve-outs for data breaches and indemnification obligations…
Ask anything…
  • Instantly familiar. Drop-in replacements for the AI chat apps your team already uses every day.
  • SSO & SCIM provisioning. Seats follow your identity provider, not a spreadsheet.
  • Your models, your rules. Per-workspace model selection, admin controls, usage caps.
  • Audit everything. Full request logs and cost attribution per seat, per team.
  • Zero retention on every message. Privacy guarantees apply to apps and API alike.
[ 07 ] — API Reference

Multiple models. One endpoint.

POST /v1/chat/completions
// Multiple models. One endpoint.
{
  "model": "GLM-5.2",
  "messages": [{"role": "user", "content": "Hello"}],
  "stream": true,
  "temperature": 0.7
}
200 /v1/chat/completions
// Streaming response
{
  "id": "chatcmpl-...",
  "model": "Kimi-K2.7",
  "choices": [{
    "delta": {"content": "Hello"}
  }],
  "usage": {"prompt_tokens": 12, "completion_tokens": 284}
}
[ 08 ] — Pricing

A tenth of the cost. All of the capability.

One flat seat price for the apps, usage-based pricing for the API. Either way, expect roughly a 10x reduction against your current AI spend.

Solo
$30 / month
One operator, every app, every model.
  • All desktop & web apps included
  • API access with usage-based billing
  • Multiple models, one endpoint
  • Zero data retention, always
  • Personal use, no seat math
Join Waitlist
Team
$30 / seat / month
Every app, every model, one flat seat price.
  • All desktop & web apps included
  • API access with usage-based billing
  • Multiple models, one endpoint
  • Zero data retention, always
  • SSO & audit logs
Join Waitlist
// no per-message limits · no token counting for seats · cancel anytime
$ echo "coming soon"

Start building.

Early access for cost aware teams building with LLMs. No commitment required.

Join Waitlist →