Inference at the edge
Run 60+ open models on an OpenAI-compatible API — served from the US edge POP nearest your users. Single-digit-millisecond network overhead, data that never leaves the country.
DeepSeek-V3.1Two ways
to serve.
Start serverless and pay per token. Graduate to dedicated endpoints when you need reserved GPUs, fixed latency and a contractual SLA. Same API, same models, same edge fabric — flip a flag.
Serverless
Pay per tokenReal-time, pay-per-token inference. Point your SDK at one endpoint and ship — we handle scaling, routing and GPUs.
- OpenAI-compatible REST & gRPC
- Sub-second time-to-first-token
- Autoscales to demand, scales to zero
- 60+ open models, one base URL
- Per-token billing, no minimums
Dedicated endpoints
ReservedReserved GPUs with guaranteed isolation and predictable latency for mission-critical, high-volume workloads.
- Reserved H100 / MI300X capacity
- 99.99% uptime SLA
- Single-tenant isolation & fixed latency
- Custom autoscaling & regional pinning
- Bring fine-tuned checkpoints
The latest models,
the day they drop.
Weekly open-source refreshes and Day-0 access to select frontier releases. One base URL, one-line model switching — no migrations, no re-tooling. Need something we don't list? Request it from your dashboard.
One API for
every modality.
Text, images, video, speech and embeddings — served through the same endpoint, billed the same way, running on the same edge fleet. Hover a panel to expand it.
Text & reasoning
Chat, code, long-context reasoning and tool use through one OpenAI-compatible endpoint.
Image generation
FLUX and SDXL-class diffusion served on H100 for production-grade image pipelines.
Video generation
Wan-class text-to-video on reserved GPU clusters with frame-consistent output.
Speech
Real-time transcription and TTS with Whisper-class accuracy, streamed at the edge.
Compatible with
your SDK.
If you've called OpenAI, you've called WiLine. Keep your existing client — swap the base URL and key. REST, gRPC, streaming, function calling and structured outputs all work out of the box.
# pip install openai from openai import OpenAI client = OpenAI( base_url="https://inference.wiline.com/v1", api_key=os.environ["WEC_API_KEY"], ) resp = client.chat.completions.create( model="deepseek-v3.1", messages=[{"role": "user", "content": "Hello"}], ) print(resp.choices[0].message.content)
Everything chatbots
and agents need.
One inference fabric — from conversational AI and retrieval to autonomous agents, vision and transcription — with the embeddings, function calling, structured outputs and guardrails to assemble them already on the platform.
Conversational AI
Low-latency chatbots and copilots that respond from the POP nearest your users.
RAG pipelines
Embeddings, retrieval and generation in one governed plane — no data leaves the US.
Autonomous agents
Native function calling and structured JSON for reliable multi-step agent loops.
Vision & OCR
Document understanding, image classification and multimodal extraction at scale.
Transcription
Batch and streaming speech-to-text for media, support and compliance workloads.
Classification
High-throughput scoring, moderation and routing with sub-10ms network overhead.
Embedding models
State-of-the-art multilingual embeddings, served at high throughput for indexing and retrieval.
Function calling
Native tool-use schemas so agents can call your APIs with validated arguments.
Structured outputs
Constrain responses to JSON Schema for parser-free, production-safe pipelines.
Guardrails
Llama Guard and policy filters screen inputs and outputs before they reach users.
Built for inference,
not borrowed from it.
Hyperscalers retrofit inference onto centralized regions. WiLine starts at the edge: compute next to your users, weights that stay in-country, and an API that costs what it says it does.
Inference at the edge
Tokens stream from the POP nearest your users — single-digit-ms network overhead, nationwide.
US data sovereignty
Every request, log and weight stays inside US borders. Zero-retention mode by default.
OpenAI-compatible
Point your existing SDK at our base URL. No migration, no re-tooling, no lock-in.
Autoscaling throughput
Burst to hundreds of millions of tokens per minute with speculative decoding built in.
Transparent pricing
Per-token billing with clear, published rates. You pay only for the tokens you use.
Enterprise security
SOC 2 Type II, HIPAA and ISO 27001. SSO, RBAC and dedicated isolation on request.