Running AI MCP Tools on Kubernetes with kagent
Bret and Nirmal explore AI agents in Kubernetes with Eitan Yarmush, Senior Architect at Solo.io. Eitan explains how AI agents work through three simple components (system prompts, LLMs, and tools), and demonstrates the kagent project, which provides a Kubernetes-native way to deploy and manage AI workflows.
Also in this episode, we cover the Model Context Protocol (MCP), which standardizes how agents communicate with external tools, along with practical use cases like incident response, debugging workflows, and CI/CD integration. Eitan shows how to create an agent through a web interface.
We also address the challenges including security concerns (MCP lacks built-in security standards), cost considerations, and technical limitations like context window constraints.
Check out the video podcast version here: https://youtu.be/JTTqG5SOpWY
😇 My new GitHub Security workshop has launched! A free 2-hour workshop with hands-on labs to harden your repos and your workflows from common supply chain attacks. I'll cover how attackers are getting in, and then we'll lock down a sample repo so you know what needs to be done to protect your code. You'll leave with a deep understanding of risks and mitigations as well as a list of helpful tools to keep your repos safe, including my new "gasa" tool for scanning your repos and orgs.
Also in this episode, we cover the Model Context Protocol (MCP), which standardizes how agents communicate with external tools, along with practical use cases like incident response, debugging workflows, and CI/CD integration. Eitan shows how to create an agent through a web interface.
We also address the challenges including security concerns (MCP lacks built-in security standards), cost considerations, and technical limitations like context window constraints.
Check out the video podcast version here: https://youtu.be/JTTqG5SOpWY
- (00:00) - Intro
- (04:36) - Hype vs Reality
- (06:28) - Incident Response and Debugging
- (09:46) - Defining Agents and MCP
- (15:33) - Where Do You Run Agents?
- (18:37) - What Problem does kagent Solve?
- (29:05) - Authentication and Tool Limitations
You can also support this podcast by subscribing to my YouTube channel and my weekly newsletter at bret.news!
Grab the best coupons for my Docker and Kubernetes courses on Udemy.
Join my cloud native DevOps community on Discord.
Grab some merch at Bret's Loot Box
Homepage bretfisher.com
★ Support this podcast on Patreon ★
Grab the best coupons for my Docker and Kubernetes courses on Udemy.
Join my cloud native DevOps community on Discord.
Grab some merch at Bret's Loot Box
Homepage bretfisher.com
Creators and Guests
Host
Bret Fisher
Cloud native DevOps Dude. Course creator, YouTuber, Podcaster. Docker Captain and CNCF Ambassador. People person who spends too much time in front of a computer.
Producer
Beth Fisher
Producer of the DevOps and Docker Talk and Agentic DevOps podcasts. Assistant producer on Bret Fisher Live show on YouTube. Business and proposal writer by trade.
Editor
Cristi Cotovan
Video editor and educational content producer. Descript, Camtasia and Riverside coach.
