https://latini.dev/tags/ai-infrastructure/Recent content in Ai-Infrastructure on F. Latini - IT EngineerHugoenMon, 25 May 2026 08:00:00 +0000https://latini.dev/posts/your-llm-platform-is-repeating-your-ml-platforms-mistakes/Mon, 25 May 2026 08:00:00 +0000https://latini.dev/posts/your-llm-platform-is-repeating-your-ml-platforms-mistakes/<p>Every team I talk to is building an LLM platform right now. Some call it that. Some call it &ldquo;the AI gateway&rdquo;, &ldquo;the prompt service&rdquo;, &ldquo;the agent stack&rdquo;. The shape is the same: a layer between application teams and a handful of model providers, plus retrieval, plus evals, plus a slowly growing pile of glue.</p> <p>I have seen this movie. We made it five years ago and called it the ML platform. Most of the mistakes that made those platforms painful between 2018 and 2022 are quietly being reintroduced now, with bigger bills, more vendors, and less institutional memory.</p>