InferenceDirect.com Docs Pricing Status Sign in

What happens to what you send us

Prompts and completions are not used to train any model, ours or a provider's. Beyond that, the honest answer depends on which product you're using — the direct API and the chat product handle content differently, so we describe both rather than paper over the difference.

The direct API

Nothing is written to permanent storage

Calls to api.inferencedirect.com are proxied straight through to the model provider and back. The prompt and completion text itself is never written to a database, cache, or log — the only record kept is call metadata (token counts, model, latency, cost), held for 7 days for billing and then purged.

An admin can turn on response caching

Tenants can opt into short-TTL, tenant-scoped caching for deterministic calls (temperature 0, non-streaming) to cut latency and cost on repeated requests. It's off by default. When it's on, a matching prompt/response pair is held for the configured TTL, scoped so no other tenant can ever read it.

chat.inferencedirect.com

Conversation history is stored, on purpose

Unlike the raw API, the chat product keeps a full, indefinite record of your conversations — that's what makes search, project history, and picking a thread back up tomorrow possible. If you need content gone rather than merely inaccessible, that's a support request today; self-serve export/delete tooling is on our roadmap, not yet shipped.

Access can be cut off immediately

Leaving or being removed from a team chat, or losing access to a project, revokes visibility into that conversation right away — both the app's authorization check and the underlying membership record enforce it, not just the UI.

Tenant isolation

Enforced at the database layer

Every tenant-scoped table is checked by a query-level guard, not just application logic above it — a second, independent layer that catches a cross-tenant query even if a handler above it has a bug.

Deleted means deleted

Closing an account starts a 90-day window (for audit trail and accidental-deletion recovery), after which every row tied to that tenant — conversations, messages, knowledge, everything — is permanently purged, not just hidden.

No shared caches across tenants

Where caching exists at all (see above), cache keys are derived per tenant and per billing node — there's no code path where one tenant's cached response can be served to another.

Encryption

In transit

Every response carries HSTS and standard hardening headers, and HTML responses are served with a per-response Content-Security-Policy nonce. All traffic is TLS.

At rest

Identity data, MFA secrets, Bring-Your-Own-Key provider credentials, and chat conversation content are individually encrypted (AES-256-GCM) before they're stored. Conversation content is additionally encrypted under a key derived per tenant (so one derived key compromise doesn't expose another tenant's data) and versioned, so the root key can be rotated without a hard cutover.

Two related options

Bring Your Own Key

Route calls through your own OpenAI, Anthropic, Azure, Google, OpenRouter, or AWS account instead of the platform's. Details →

Zero-retention model routing

A billing node can be restricted to only route to catalog models we've flagged as zero-retention with their provider. That's a curated attribute reflecting the provider's own stated policy, not something we independently audit — and it governs upstream routing, not chat's own conversation storage above.

Guardrails

Inline prompt-injection, jailbreak, and PII detection on both sides of a call, configurable per tenant. Details →

Automated decision-making

InferenceDirect itself doesn't make automated decisions about people — it's an inference conduit: it routes your prompt to a model and returns the response. If a decision that produces legal or similarly significant effects on someone gets made using that response (a loan approval, a hiring screen, an eligibility determination), that decision is made by whatever application you or your organization built on top of the API — which makes you the controller responsible for any automated-decision-making disclosure or human-review obligations that apply to it, not us. We don't profile individuals or make those decisions ourselves anywhere in this platform.

We don't hold a SOC 2, ISO 27001, or HIPAA certification today. Where a page elsewhere references HIPAA, it's describing an account-level attestation a tenant makes about their own use of a feature, not a platform certification — we'd rather say that plainly than let the distinction blur. See the Privacy Policy for the full legal terms; this page is the plain-language version.