KubeCon + CloudNativeCon India 2024

Managing hybrid environments with public and private clouds poses significant challenges, especially with disparate interfaces and legacy applications. Our development and QE teams faced difficulties navigating multiple environments—testing private cloud code on private Docker clouds and public cloud code on public resources. Legacy apps, often running on bare metal or metal instances, added complexity. To tackle this, we used Kubernetes and CNCF projects like KubeVirt, CrossPlane, and Longhorn to build a unified hybrid hyper-converged cloud platform. This session will explore how we integrated these technologies to streamline operations. You'll learn about the initial challenges, how KubeVirt enabled virtualization, CrossPlane’s role in multi-cloud management, Longhorn’s storage solutions, and the unification of these components into a cohesive platform.

At Intuit, we have ~2000 production services that serve North-South and East-West Traffic using API Gateway and Service Mesh. These services span across ~350 k8s clusters and are managed by 10,000+ engineers. This talk walks you through multiple design iterations conducted by the Traffic team at Intuit in building the platforms that serve 1.5 Million+ TPS. Topics that are covered include lessons learnt while 1. Designing a cost effective, low latency, highly scalable, multi tenant API Gateway and Service Mesh platforms. 2.Using a non blocking model to externalise Authorization using an OPA based sidecar. 3.Distributing traffic configurations that are self serviced by 10,000+ engineers to the Traffic runtime platforms. 4. Designing Rate Limiting solutions with Low latency and low error

In Intuit, We have API Gateway and Service Mesh platforms that are responsible for handling ~30 billion requests every day and providing ingress to ~2000 services. With this talk, we’ll see - * How Admiral manages failover configurations by creating required custom resources like globalTrafficPolicy (GTP) across 300+ clusters and provides feedback on the activity. * Manage Observability for all failover activity and provide better insights to Developers. * How Intuit achieved simplified centralized failover UI experience leveraging Kubernetes and Istio features. * Operational challenges associated with managing the failover configurations. * High Availability and DR for services across 7000+ namespaces and enabling more than 900 teams to have seamless and unified experience to manage failover endpoints.

Applying modern deployment strategies, such as incremental releases, to complex ML architectures presents unique challenges, including managing resource constraints and ensuring cost efficiency. In the GPU environment, new replicas can take up to an hour to become operational due to extended image pull times. Despite these challenges, implementing advanced deployment strategies is crucial to minimise the impact of faulty versions, much like in traditional CPU workloads. In this session we will present on how to overcome these hurdles in GPU-based workloads. We will: - Start with traditional deployment approaches. - Progressively address advanced scenarios, such as implementing cost-efficient progressive delivery for high CPU-consuming workloads on GPU nodes and orchestrating sequential multi-resource deployments. - Reference our recent experience designing CI/CD for the GenAI applications. - Conclude by sharing cost comparison and best practices for GenAI model deployments.

How do we build a self-service platform that allows developers to interact with a legacy application through Kubernetes? In most other parts of the organisation, developers seek to operate on Kubernetes using the now-familiar concepts of GitOps and cloud-native ways for deploying their applications. When Kubernetes is a one-stop for deployment, the cognitive loads for platform and infrastructure can be minimized, and gives better focus to implementing business needs. In this talk, Bankdata.dk will share their experience building a Kubernetes API-driven self-service platform for operating three of their most critical legacy systems on Kubernetes, through ArgoCD and GitOps. The platform builds on the Java operator framework, and wraps operations on a portal server also running in Kubernetes. Bankdata.dk delivers all IT to 9 danish banks, including the 2nd and 3rd largest.

At PepsiCo, we are committed to enhancing efficiency and developer experience by continuously reviewing our processes and systems. As part of streamlining our deployment workflows, we transitioned to the GitOps methodology and adopted ArgoCD, a powerful GitOps tool with a feature-rich web UI that facilitates intuitive management of deployments, rollbacks, and application health. By leveraging ArgoCD's App of Apps pattern, we could define a bootstrapper Application, enabling the automation of application deployment. This approach allowed us to achieve self-service Continuous Delivery, empowering teams to independently manage their deployments while maintaining centralized control and visibility. Join us, as we share some of the challenges, including managing dependencies, configuring environments and ensuring consistency across deployments. Additionally, we will highlight the strategies and best practices, including the implementation of App of Apps pattern and the integration of Helm.

Traditionally, Network Management System (NMS) are very important and complex systems designed to help network operators from large service providers to small enterprises handling new service deployment, device lifecycle management, and fault management. However, their monolithic architecture combined all functions into one system, causing scalability issues and inefficiencies. The siloed design also impeded network management by isolating functions and restricting real-time monitoring. To address these constraints, we transitioned to a cloud-native architecture. We leveraged a comprehensive suite of open-source and CNCF technologies, including service mesh (Istio), container orchestration (Kubernetes), observability stack (Prometheus, Grafana, OpenSearch, Fluent Bit), and ingress gateway solutions (MetalLB, NGINX). This transformation resolved legacy issues while future-proofing our customers' networks, ensuring they stay agile, efficient, and prepared for future challenges.

With 178 projects, various SIGs & countless ways to contribute, it may be confusing to know where to start in the vast world of cloud-native tech. With my former intern Anushka's help, we'll break down barriers & share our personal journeys within the CNCF ecosystem. Whether you're considering GSoC, joining the shadow release program, fixing a typo in documentation, there's a place for you. We'll use hip hop elements—MCing, DJing, break dancing, art, & knowledge to illustrate how cloud-native is a union of diverse components. You'll get practical advice on taking that crucial first step, with concrete examples of how people from different backgrounds have done it—writing blogs, designing the Kubernetes Mandala, singing at Kuberoke, playing guitar at KubeJam or making their first pull request. By the end, you'll have actionable steps & the confidence to begin or deepen your cloud-native journey. Join us to celebrate the diversity of contributions & get inspired—plus, there'll be a rap!

Fidelity's journey to cloud started about a decade ago with Cloud Foundry. Open-Source adoption was our first step towards digital transformation and from there today we sit on a CNCF tools stack of Kubernetes, Backstage, Harbor, Elastic, Postgres, Argo, Kafka, Helm, Open Telemetry, Jenkins, TF, Cilium, AWS, Azure, et al. Neil Armstrong once said, "one small step for man, one giant leap for mankind" about his first step on moon; so was the case of Fidelity with CF adoption towards wider adoption. It was never an easy sail towards Open Source CNCF landscape adoption since Fidelity being a global financially regulated organization, has its own challenges for industry regulations and embedded culture. We have divided and conquered the goal taking on the challenges unified but in distributed work streams across the organization. In this talk we would like to share this journey, experience, and learnings with others to help their adoptions of cloud native tools at an enterprise scale.

Join me as I share my transformative journey from a regular user to a maintainer of Flux CD, a popular GitOps tool for Kubernetes. Open-source software thrives on the contributions of passionate individuals who go above and beyond to support and enhance the community. My journey with Flux CD began as a user, where I leveraged its powerful GitOps capabilities to streamline Kubernetes deployments. However, my desire to give back led me to become a maintainer. In this talk, I will recount my path, the challenges I faced, and the invaluable lessons I learned. Attendees will gain insights into the inner workings of open-source communities, the responsibilities of maintainers, and practical advice for those aspiring to contribute at a deeper level. This session is perfect for developers, DevOps engineers, and anyone interested in open-source contributions and Kubernetes.

Contributing to open-source projects like Istio can be a transformative experience, but how do you begin? In this session, Adil Mohamed M P, a computer engineering student from India and an LFX mentee, will share his personal journey on how the LFX Mentorship program has eased his cloud-native debut. He will share his contributor experience to one of the most popular CNCF projects, Istio, and how he was part of the latest Service mesh buzz word "Ambient Mesh". Adil will discuss how the LFX mentorship program has equipped him with the skills to excel in open-source development and collaboration. Whether you’re a beginner looking to contribute or an experienced developer seeking to give back, this session will offer valuable tips, and a roadmap for making meaningful contributions to cloud-native projects.

Explore AI innovation with the "Generative AI Demo using Open Data Hub," an open-source AI/ML platform tailored for Kubernetes. This demo features two Mistral-based LLMs, one utilizing Retrieval-Augmented Generation (RAG) with PostgreSQL vector extensions, and another without. Users interact through a Gradio chatbot, demonstrating how RAG improves accuracy. Two persona-based pipelines (Admin & Data Scientist) highlight Open Data Hub’s seamless integration with Tekton-powered OpenShift Pipelines, showcasing the Hybrid Cloud Strategy. Key components include the Kubernetes Platform, Node Feature Discovery, NVIDIA GPU Operators, Software Defined Storage, Tekton, Argo CD (for GitOps), Gitea Operator, Knative and Istio. Join us to see how GPU-accelerated AI and scalable, secure infrastructure power next-gen applications.