Storage and query
The default for analytical reads at scale. Column codecs, materialised views and TTL tiering give us three separate levers on cost before anyone talks about bigger machines.
Still the right answer for transactional workloads and anything that needs real constraints. We keep it and stop asking it to do analytics.
Fine to arrive on, expensive to stay on when the workload is a small number of queries run very often. We migrate off it when the profile says so, not by default.
Streaming
Partitioning that survives a spike and consumer lag you can see before a customer does. Most of the pain we get called about is configuration, not the broker.
Worth it when the connector already exists and the transformation is simple. Not worth it when the pipeline logic belongs in code you can test.
Serving and orchestration
The scheduler is the point. We autoscale on request load rather than CPU, because CPU is a proxy that lies during a spike.
Provisions the node the pod actually needs instead of the node group somebody sized last year. The savings are real and they are also easy to lose to bad consolidation policy.
Throughput per GPU is where the inference bill is decided. Continuous batching moves that number more than a bigger instance does.
Predictable latency without garbage collection pause spikes, which is usually why the gateway rewrite happens in the first place.
Delivery and observability
Every environment reproducible, every change reviewable. The alternative is a console click nobody remembers making.
Versioned manifests that a new engineer can read on their first Monday. Boring on purpose.
Answers the question that matters after an incident: which model version served that request, and what trained it.
Three rules that decide what goes in.
Somebody here has broken it
We only put a tool in a client system if one of us has already hit its failure mode in production. Reading the documentation does not count.
Your team can operate it
If running it needs a specialist you do not employ, it is the wrong choice however good the benchmark looks.
The cost is legible
You should be able to answer what a single query costs. Tools that hide that make the bill impossible to defend later.