| Deployment shape |
One server, many models and tasks, resident on demand |
One container per model, orchestrated by Kubernetes |
| Hardware |
CPU-first; CUDA, Vulkan, and Metal; vendor-agnostic down to a workstation |
NVIDIA GPUs only, with TensorRT-grade per-GPU performance |
| API surface |
OpenAI, Anthropic, Ollama, MCP, native REST |
OpenAI-compatible endpoints per microservice |
| Document intelligence |
Full pipelines on one server: OCR, Markdown, extraction with confidence, redaction, signatures, PDF/A |
Separate microservices per capability; you compose and operate the pipeline |
| Search and grounded answers |
Built-in service: ingestion, hybrid retrieval, reranking, answers citing document and page |
Retrieval components exist as separate containers; assembly is yours |
| Agents |
Server-side agents with skills, governed tools, memory, MCP |
Serves the models an agent stack calls; orchestration lives elsewhere |
| Governance and operations |
Admin console, identities, SSO, per-key grants, audit, capability policies |
Enterprise support and lifecycle through NVIDIA AI Enterprise; auth via your gateway |
| Platforms |
Windows, Linux, macOS; installers, desktop mode, Windows service |
Linux containers on Kubernetes or Docker |
| Licensing |
Free to build and evaluate; Professional for larger production use, not priced per GPU |
Free development tier; production through NVIDIA AI Enterprise, publicly listed at $4,500 per GPU per year |