Seldon

Seldon is written for AI platform engineering groups rather than solo data scientists. The vendor names VP Engineering, Chief AI Officers and AI Platform Architects as the roles Seldon is purpose-built for, and lists Capital One, Covea, AstraZeneca, GSK, Aselsan, Noda and Cambridge University among the organizations using Seldon. Seldon also publishes 2M+ installs, 40+ storage backends, ten years of production usage and 25,000+ MLOps professionals as proof points on the same page.

The Seldon ecosystem is deliberately modular. Seldon Core 2 is the open-source deployment engine, MLServer is a lightweight multi-framework inference server speaking REST, gRPC and the Open Inference Protocol, and Alibi Detect and Alibi Explain supply outlier, adversarial and drift detection alongside local, global, black-box and white-box explanation methods. Layered on top, Seldon sells the LLM Module for generative workflows with prompt orchestration and configurable guardrails, the MPM Module for classification and regression quality metrics, and the Enterprise Platform for authentication, audit trails and team controls.

In daily practice, a team running Seldon commits manifests through Argo CD or Flux, routes traffic with Istio or Envoy, streams pipeline data over Kafka, and reads latency and drift from Prometheus and Grafana dashboards. Seldon supports A/B tests, canary deployments, shadow deployments and multi-armed bandits so a challenger model can be promoted without downtime. Seldon's multi-model serving with LRU memory swapping consolidates several models onto shared inference servers, which the vendor frames as a direct cut to GPU spend.

Pricing for Seldon is not published anywhere on the crawled site. Seldon exposes no pricing page, so only the open-source projects carry a knowable cost of zero, while the LLM Module, MPM Module and Enterprise Platform are quoted through a scheduled platform briefing. Seldon describes its modular architecture as a way to "budget accurately and only pay for what you need," yet no plan table backs that line, so procurement should expect a sales-led quote for anything beyond Core 2, MLServer and Alibi.

Two open questions deserve an early conversation with the Seldon team. The homepage leads with "Seldon is now TrueFoundry," describing a combined Kubernetes-first platform that extends into agentic AI, while the remainder of the same page continues to market Seldon modules, Seldon docs and a Seldon roadmap, leaving contracting entity, support ownership and long-term module naming unresolved. Seldon also states both "Top Open-Source AI Deployment Tool 2026" and "Ranked #4 best open-source AI deployment tool of 2026" on the same page, and those two vendor claims contradict each other.

Compared with category peers, Seldon sits far closer to KServe and Ray Serve than to a hosted model endpoint, because Seldon assumes a cluster the buyer already operates and trades managed convenience for portability across AWS EKS, Azure AKS, Google GKE, Alicloud, DigitalOcean and OpenShift. Teams that want a credit-card API and a token meter will find Seldon heavier than they need; teams that must keep inference inside their own VPC, log every prediction and explain every decision to a regulator will find that weight is the point.

The practical entry path into Seldon is the open-source route: install Seldon Core 2 on an existing cluster, serve a model through MLServer, add Alibi Detect for drift, and only then evaluate whether the LLM Module, MPM Module or Enterprise Platform justify a commercial conversation. Documentation for every Seldon component lives at docs.seldon.ai, spanning quickstart guides through advanced production patterns, and the legacy Seldon Core remains documented separately for teams still running the original engine.