| Primary job |
Application backend: documents, search, and agents as endpoints, plus model serving |
Model serving for agents: encode, score, extract, generate |
| API surface |
OpenAI, Anthropic, Ollama, MCP, native REST |
OpenAI-compatible endpoints |
| Document intelligence |
Full pipelines: OCR, Markdown, splitting, extraction with confidence, redaction, signatures, PDF/A |
Serves document-to-markdown models; the pipeline stays in your code |
| Search and grounded answers |
Built-in service: ingestion, hybrid retrieval, reranking, answers citing document and page |
Serves dense, sparse, and reranker models; the retrieval stack is yours to assemble |
| Agents |
Server-side agents with skills, governed tools, memory, MCP |
Serves the models an agent loop calls; the loop lives in your app |
| Governance and operations |
Admin console, identities, SSO, per-key grants, audit, capability policies |
Not documented; typically fronted by your own gateway |
| Platforms |
Windows, Linux, macOS; installers, desktop mode, Windows service |
Linux and macOS, via Docker, Kubernetes, or native Python |
| Hardware |
CPU-first; CUDA, Vulkan, and Metal acceleration |
CPU or NVIDIA CUDA; MLX on Apple Silicon |
| Scaling out |
Horizontal scaling, any node serves any request, KEDA-ready |
Kubernetes-native: Helm, KEDA scale-from-zero, Terraform modules |
| Licensing |
Free to build and evaluate; Professional for larger production use |
Apache 2.0 open source; managed cloud offered separately |