most Retrieval-Augmented Generation (RAG) systems in production today are fragile, expensive, and deceptively incomplete.

While a significant amount of security effort still centers on production defenses, the most effective attacks are increasingly targeting upstream, where artifacts are created and dependencies are resolved. And one of the most preventable (yet still common) entry points is also one of the earliest: secrets leaking into source control.

Modern infrastructure has evolved much faster than the way we operate it.

Today’s systems are distributed, constantly changing, and deeply interconnected. A single user request can move through many services, each producing logs, metrics, and traces. We now have more visibility than ever before.

It isn't. And the gap between those two things has eaten more than a few production environments.

Modernization used to mean something simpler: Move the workloads, update the tooling, declare the project done. In practice, that approach meant engineers manually migrating hundreds of DataStage jobs one at a time, a process that was slow, error-prone, and impossible to scale as platforms grew. The traditional model worked when volumes were low. It broke entirely when weekly release windows started carrying 500 jobs, and the only way through was brute-force manual effort.

What changed the equation was not just cloud infrastructure but also a fundamentally different operating model. When a CI/CD-based promotion mechanism replaced manual steps, reducing what once required hours of coordinated effort down to a single parameterized execution, hundreds of jobs could migrate consistently, with less human involvement and a verifiable audit trail. That shift exposed a harder truth: the technology was never the bottleneck. The operating model was.

Our team is responsible for the mobile backend infrastructure serving over 2 million registered users. The Docker Swarm cluster consists of 120 nodes: 5 manager nodes, 40 worker nodes, and the rest are infrastructure servers. The cluster runs about 50 services, totaling hundreds of replicas.

We inherited Swarm from the previous contractor. The client is not yet ready to migrate to Kubernetes, and Swarm is currently sufficient for the current scale. Services are distributed across nodes in groups and bound by labels: up to 4 worker nodes are allocated to heavier services, 2 to less loaded ones, and 1 to non-critical services. Nodes can host replicas of multiple services.

In reality, Kubernetes is a layered ecosystem where storage, compute, networking, security, and developer workflows interlock like gears in a precision machine. If one gear slips, everything grinds. If all align, you unlock a platform that scales, heals, and evolves with your applications.

That is where AgentOps comes in. 

In this article, we dive into the implementation details of the integration between the Bucket4j rate-limiting framework and Embedded Infinispan (not HotRod). This setup creates a data grid across different pods of a single application, allowing for seamless, distributed token management.

In my experience, these failures are rarely caused by tools. They come from how integration patterns are applied without considering real-world conditions like latency, retries, partial failures, and security boundaries.

Architecture Overview

The pipeline involves multiple components working together in sequence. Below is the event flow:

AI agents for DevOps can help here — but only when they sit on solid engineering foundations. They should compress the early correlation and triage phase, not take opaque, unsafe control of production.

Modern AI systems do not just consume data in batch. They retrieve, reason, act, monitor outcomes, and adapt in near real time. That shift is why agentic data pipelines are becoming a serious architectural pattern. Instead of moving data passively from source to sink, they actively decide what to retrieve, how to transform it, which tools to call, and when to trigger downstream actions. 

In this article, I will share how we adapted our Java backend for container orchestration. I will explain the specific lifecycle issues we encountered. I will detail the configuration changes that solved the dropout problem. This is not a guide on writing Dockerfiles. It is a record of the operational friction we faced when Java met Kubernetes. Building cloud-native Java apps requires more than just packaging a JAR. It requires understanding how the orchestration layer interacts with the JVM.

DevSecOps means security is part of software delivery from the beginning, where security is built into planning, coding, building, testing, releasing, and operations. As pipelines become faster and more automated, security checks should run inside the CI/CD pipeline and be enforceable across delivery.