KubeCon + CloudNativeCon India 2024: Full Schedule

In-person
11-12 December
Learn More and Register to Attend

The Sched app allows you to build your schedule but is not a substitute for your event registration. You must be registered for KubeCon + CloudNativeCon India 2024 to participate in the sessions. If you have not registered but would like to join us, please go to the event registration page to purchase a registration.

Please note: This schedule is automatically displayed in India Standard Time (UTC+5:30). To see the schedule in your preferred timezone, please select from the drop-down menu to the right, above "Filter by Date." The schedule is subject to change and session seating is available on a first-come, first-served basis.

arrow_back View All Dates

9:30am IST

Keynotes to be Announced

Thursday December 12, 2024 9:30am - 11:00am IST

Room 1

Thursday December 12, 2024 9:30am - 11:00am IST
Room 1

Keynote Sessions

11:00am IST

Coffee Break ☕

Thursday December 12, 2024 11:00am - 11:30am IST

Room 1

Thursday December 12, 2024 11:00am - 11:30am IST
Room 1

Breaks

11:30am IST

⚡ Lightning Talk: Safer Cluster Upgrades with Mixed Version Proxy - Richa Banker, Google

Thursday December 12, 2024 11:30am - 11:35am IST

Room 1

Upgrading Kubernetes clusters often presents numerous challenges, including potential downtime, compatibility issues, and the complexity of managing multiple versions. The Mixed Version Proxy feature introduced in Kubernetes 1.28 aims to mitigate these challenges. This talk will delve into the technical intricacies of the Mixed Version Proxy, exploring its design and implementation. We will then highlight the substantial benefits it offers for cluster upgrades, such as minimizing downtime and enhancing overall reliability. Attendees will gain practical knowledge through (possibly a demonstration) on enabling and utilizing the Mixed Version Proxy. Finally, we will provide insights into the future roadmap for this feature, including upcoming beta releases and enhancements.

Speakers

Richa Banker

Software Engineer, Google

Currently a software engineer at Google. Exploring and contributing to OSS Kubernetes on the side.

Thursday December 12, 2024 11:30am - 11:35am IST
Room 1

⚡ Lightning Talks, Operations + Performance

Content Experience Level Intermediate

11:30am IST

Modernizing Network Automation: Embracing Cloud-Native Excellence for Scalable Automation Platforms - Diana Appanna & Srivatsa Srinivasa, Nokia

Thursday December 12, 2024 11:30am - 12:05pm IST

Room 2

Traditionally, Network Management System (NMS) are very important and complex systems designed to help network operators from large service providers to small enterprises handling new service deployment, device lifecycle management, and fault management. However, their monolithic architecture combined all functions into one system, causing scalability issues and inefficiencies. The siloed design also impeded network management by isolating functions and restricting real-time monitoring. To address these constraints, we transitioned to a cloud-native architecture. We leveraged a comprehensive suite of open-source and CNCF technologies, including service mesh (Istio), container orchestration (Kubernetes), observability stack (Prometheus, Grafana, OpenSearch, Fluent Bit), and ingress gateway solutions (MetalLB, NGINX). This transformation resolved legacy issues while future-proofing our customers' networks, ensuring they stay agile, efficient, and prepared for future challenges.

Speakers

Diana Appanna

Senior Technical Specialist, Nokia

Passionate Software Designer with over a decade of experience in developing and optimizing network management systems adept at implementing FCAPS (Fault, Configuration, Accounting, Performance, and Security) principles and cloud-native design

Srivatsa Srinivasa

Mr, Nokia

With over 15 years of experience in the networking industry, Srivatsa is a seasoned expert known for deep understanding of cloud native architecture and its transformative impact on modern technology landscapes. Throughout his career, Srivatsa has been at the forefront of pioneering... Read More →

Thursday December 12, 2024 11:30am - 12:05pm IST
Room 2

Cloud Native Experience

Content Experience Level Intermediate

11:30am IST

Scaling and Safeguarding the Heart of Kubernetes: Deep Dive Into etcd - Arka Saha, VMware by Broadcom

Thursday December 12, 2024 11:30am - 12:05pm IST

Room 6

SIG-etcd are hard at work on scaling & safeguarding etcd, but we need your help and feedback! This deep dive session will explore current & future etcd development efforts to share with both etcd & Kubernetes users & contributors. In particular we’ll focus on: Feature gates: - Reviewing recent KEPs for server & cluster level etcd feature gates. - How feature gates enable gradual rollouts, minimizing risk and breaking changes. etcd Operator Working Group: - Discuss progress and next steps for the official etcd Operator release. Tackling compaction correctness - A post-mortem of the recent etcd watch correctness issue & resolution. Github Actions migration: - Prowjob Adoption - Consistent e2e tests across minor versions Community Update: - Update on the growth of the etcd community and project news. Join our etcd maintainers and contributors to learn about these recent developments & future plans, including how you can contribute to them.

Speakers

Arka Saha

Software Engineer, VMware by Broadcom

Arka Saha, a Broadcom Software Engineer, primarily works on the release and maintenance of etcd and Kubernetes for VMware Cloud Foundation. He manages Broadcom's Prow infrastructure, ensuring long-term support for etcd, k8s, containers, Golang & related components. Previously he managed... Read More →

Thursday December 12, 2024 11:30am - 12:05pm IST
Room 6

Maintainer Track

11:30am IST

A Debugging Journey from Coredns to Coreutils - Akhil Mohan & Humble Devassy Chirammal, VMware by Broadcom

Thursday December 12, 2024 11:30am - 12:05pm IST

Room 4

It all started when CoreDNS pods entered a crash loop backoff state soon after the cluster was deployed. The only change was an unprivileged execution desired in the latest coreDNS image. The issue occurred only in worker nodes, not in control plane nodes, and refreshing the image by deleting and pulling it again resolved the issue. It happened in one OS distribution flavor but not in another. We investigated Docker build, setcap, and libc, and found that the required capability was missing in nodes during the issue. The stack was complex, involving FIPS/CGO, build system, runtime configuration, and binary packaging in OVA. Debugging included CoreDNS binary, containerd, runc, SELinux, AppArmor, Photon OS, and the kernel... lots of learning which could be useful for many developers/admins or cluster operators to debug unprivileged pod execution. Finally, we discovered something interesting in the bootstrapping scripts. Let's debug.

Speakers

Akhil Mohan

Software Engineer, VMware by Broadcom

Akhil works as a Software Engineer at VMware by Broadcom. An active contributor to projects in cloud native and container ecosystem. Akhil is a maintainer of containerd, and the kubernetes publishing-bot sub project. He works mostly on container runtimes and kubernetes sig-node a... Read More →

Humble Chirammal

R&D Engineer, VMware by Broadcom

Humble is part of VMware Tanzu Open Source Engineering. He is the tech lead for k8s and other core components to deliver successful LTS releases. He has more than 17 years of experience that includes extensive work in Openshift engineering & releases. He has led SDS based products... Read More →

Thursday December 12, 2024 11:30am - 12:05pm IST
Room 4

Operations + Performance

Content Experience Level Intermediate

11:30am IST

A Deep Dive Into the Current Runtime Security Landscape - Ankur Kothiwal, CERN

Thursday December 12, 2024 11:30am - 12:05pm IST

Room 3

The most widely used runtime enforcement techniques today are prone to attackers. Many of these techniques work on the principle of stopping or killing a process in response to an attack, which relies at the mercy of an exploit writer putting little to no effort into avoiding triggering these detection mechanisms. Our discussion will focus on various aspects of runtime security: how it is currently implemented, its shortcomings, and the performance implications associated with these approaches. We'll explore a various range of cloud-based runtime security implementations. We'll expose the attacker's perspective, demonstrating how they can bypass these common runtime security measures. This will equip you to anticipate and counter their tactics. Finally, we will cover recent popular attacks and how appropriate runtime security measures can prevent them in the future.

Speakers

Ankur Kothiwal

Computing Engineer, CERN

Ankur Kothiwal is a Computing Engineer at CERN. He is actively involved in open source, currently serving as a maintainer and a CNCF Ambassador. In the past, he participated in and mentored various open source outreach programs and has also been a committee member for KubeCon Paris... Read More →

Thursday December 12, 2024 11:30am - 12:05pm IST
Room 3

Security

Content Experience Level Any

11:30am IST

Tutorial: Flatcar Container Linux Deep Dive: Deploying, Managing, and Automating Workloads Securely - Sayan Chowdhury, Microsoft

Thursday December 12, 2024 11:30am - 12:55pm IST

Room 5

Flatcar is an operating system purpose-built for securely running container workloads. It ensures security by providing essential tools, reducing the OS size with minimal packages, and making the /usr directory immutable. This tutorial is designed for ops and DevOps professionals, offering step-by-step guidance on getting started with Flatcar. You’ll explore how to deploy it using Terraform, configure it with Ignition, and automate OS updates via Nebraska, enabling you to "set it and forget it.

Speakers

Sayan Chowdhury

Senior Software Engineer, Microsoft

Sayan is a Linux Software Engineer at Microsoft and a maintainer of Flatcar Container Linux. As a Release Manager, he works to maintain and build Flatcar. With a strong passion for open source, Sayan has been involved in other communities, namely Python, Fedora and Mozilla. Sayan... Read More →

Thursday December 12, 2024 11:30am - 12:55pm IST
Room 5

Tutorials, Cloud Native Novice

Content Experience Level Any

11:35am IST

⚡ Lightning Talk: Non-Intrusive Multi-Tenant Auth & Authz with Istio, OAuth2Proxy, and OPA - Adarsh Kumar Singh & Raghuram Sripada, Hitachi Vantara

Thursday December 12, 2024 11:35am - 11:40am IST

Room 1

Simplify authentication and authorization across applications, focusing solely on business logic while ensuring secure services. Our solution features a multitenant proxy to streamline authentication on the SAAS platform. Istio service mesh intercepts every request, with a multitenant-aware proxy (enhanced OAuth2Proxy and caching) connecting to a centralized Identity Provider (IDP) for authentication. Post-authentication, the proxy collaborates with an authorization agent like OPA, passing context for dynamic policy evaluation. Authentication and Authorization are decoupled from the code, allowing developers to use a centrally managed auth service. This shift lets development teams concentrate on business functions, leaving security rules to security analysts, saving time and resources. Externalized authorization management offers runtime controls, including policy management, enforcement, and decision modeling for fine-grained access to applications, services, transactions and data.

Speakers

Adarsh Kumar Singh

Software development engineer, Hitachi Vantara

With over 6 years in software engineering, I specialize in Authentication and authorization for diverse backend applications, utilizing multiple Identity Providers (IDP) through OpenID Connect (OIDC) and Federated Authentication. My expertise extends to building multiple node.js applications... Read More →

Raghuram Sripada

Sr. Director Engineering, Hitachi Vantara

I'm a passionate Engineering leader with over 25 years of experience building and managing enterprise-grade solutions. I currently lead a talented team at Hitachi, where we develop core platform components for Hybrid-Cloud Data Infrastructure and DataOps products.

Thursday December 12, 2024 11:35am - 11:40am IST
Room 1

⚡ Lightning Talks, Security

Content Experience Level Any

11:40am IST

⚡ Lightning Talk: Have No Fear When Boskos Is Here - Amulya Meka, IBM

Thursday December 12, 2024 11:40am - 11:45am IST

Room 1

Doesn't it get messy when resources are left behind after a test?How do we manage the life cycle of the infrastructure resources? Have you wondered if there's a way to handle it? You are at the right place then, welcome to the world of Boskos where resource management is easier than before. In this talk, we will explore some challenges faced in Continuous Integration(CI) with testing on various infrastructures. It will give an overview on how to use the resource manager service, Boskos to help you better manage your infrastructure and make sure that no stales are left unattended.

Speakers

Amulya Meka

Cloud Engineer, IBM India Private Limited

Amulya Meka is a Software Engineer at IBM. She works on open source projects in the SIG Cluster lifecycle community and has also worked in the container runtime ecosystem.

Thursday December 12, 2024 11:40am - 11:45am IST
Room 1

⚡ Lightning Talks, SDLC (Software Development Lifecycle)

Content Experience Level Any

11:45am IST

⚡ Lightning Talk: From Creation to Termination: Your Pod's Digital Footprint - Subalakshmi S, Google

Thursday December 12, 2024 11:45am - 11:50am IST

Room 1

Kubernetes relies on Kubelet and Containerd to manage the lifecycle of pods. These components provide a wealth of log data, but the sheer volume and complexity can be overwhelming, particularly for those new to the Kubernetes ecosystem. This talk aims to dissect a pod's journey from birth to termination, pinpointing key events like volume mounts, health checks, and the dreaded teardown. Listeners will learn to filter, search, and interpret logs like a pro, turning raw data into actionable insights. Whether you're troubleshooting a misbehaving pod or simply curious about its inner workings, this talk aims to equip the listeners with the skills to navigate the Kubernetes log labyrinth with confidence.

Speakers

Subalakshmi S

Ms, Google

Tech enthusiast, 5+ years in container orchestration (Docker, Kubernetes). Currently at Google, specializing in GKE & GDC for VMware/Bare metal on the Technical Solutions Engineering team.

Thursday December 12, 2024 11:45am - 11:50am IST
Room 1

⚡ Lightning Talks, Operations + Performance

Content Experience Level Intermediate

11:50am IST

⚡ Lightning Talk: Enhancing Hyperparameter Optimization with Advanced Parameter Distributions - Shashank Mittal, Kubeflow

Thursday December 12, 2024 11:50am - 11:55am IST

Room 1

In this session, Shashank Mittal, a Google Summer of Code (GSoC) 2024 contributor for Kubeflow, will discuss his work on enhancing the Katib component's Experiment APIs to support a wide range of parameter distributions for hyperparameter optimization. Katib is an integral part of the Kubeflow ecosystem that enables scalable and efficient hyperparameter tuning in machine learning workflows. The session will focus on the technical challenges and solutions involved in adding support for distributions such as uniform, log-uniform, normal, and lognormal, among others. Attendees will gain insights into the process of integrating these distributions into Katib's APIs and suggestion services like Optuna and Hyperopt. This talk is designed for developers and data scientists interested in MLOps and cloud-native machine learning infrastructure, highlighting the importance of advanced hyperparameter optimization techniques in improving model performance.

Speakers

Shashank Mittal

Shashank Mittal, Kubeflow

Shashank Mittal is a B.Tech student at IIT BHU and a 2024 Google Summer of Code contributor to Kubeflow. He specializes in MLOps and DevOps, focusing on enhancing hyperparameter optimization capabilities in cloud-native environments. His work in Kubeflow's Katib involves integrating... Read More →

Thursday December 12, 2024 11:50am - 11:55am IST
Room 1

⚡ Lightning Talks, AI + ML

Content Experience Level Intermediate

12:20pm IST

Rapper's Delight- A Hip Hop Journey Through Cloud Native - Bart Farrell, Learnk8s & Anushka Saxena, Independent

Thursday December 12, 2024 12:20pm - 12:55pm IST

Room 2

With 178 projects, various SIGs & countless ways to contribute, it may be confusing to know where to start in the vast world of cloud-native tech. With my former intern Anushka's help, we'll break down barriers & share our personal journeys within the CNCF ecosystem. Whether you're considering GSoC, joining the shadow release program, fixing a typo in documentation, there's a place for you. We'll use hip hop elements—MCing, DJing, break dancing, art, & knowledge to illustrate how cloud-native is a union of diverse components. You'll get practical advice on taking that crucial first step, with concrete examples of how people from different backgrounds have done it—writing blogs, designing the Kubernetes Mandala, singing at Kuberoke, playing guitar at KubeJam or making their first pull request. By the end, you'll have actionable steps & the confidence to begin or deepen your cloud-native journey. Join us to celebrate the diversity of contributions & get inspired—plus, there'll be a rap!

Speakers

Bart Farrell

Freelance Content Creator, Learnk8s

Bart Farrell is a CNCF Ambassador and Freelance Content Creator, event host, and community consultant. He brings creativity and passion to everything he does, whether it's rapping about Kubernetes or producing creative videos to bring technical concepts to life. Bart engages with... Read More →

Anushka Saxena

Cloud-Native Enthusiast, Job seeker

Learning and unlearning everyday to be a force for good.

Thursday December 12, 2024 12:20pm - 12:55pm IST
Room 2

Cloud Native Experience

Content Experience Level Any

12:20pm IST

Rook: Intro and Deep Dive with Ceph Storage - Subham Rai, Yati Padia & Parth Arora, IBM; Deepika Upadhyay, Clyso

Thursday December 12, 2024 12:20pm - 12:55pm IST

Room 6

The Rook project will be introduced to attendees of all levels and experience. Rook is an open-source cloud-native storage operator for Kubernetes, providing the platform, framework, and support for Ceph to natively integrate with Kubernetes. The panel will discuss various scenarios to show how Rook configures Ceph to provide a stable block, shared file system, and object storage for your production data. Rook was accepted as a graduated project by the Cloud Native Computing Foundation in October 2020.

Speakers

parth arora

IBM/Red Hat, Software Engineer, IBM

I am Parth Arora, a software developer specializing in distributed storage systems. As a developer, I have extensive experience working with Rook, a cloud-native storage orchestrator that enables storage systems like Ceph to be run as a service on Kubernetes. I have contributed to... Read More →

Subham Rai

Software Engineer, IBM

I'm Subham Rai from India. I have more than 3 years of experience in software or more specifically in the storage industry working mainly in rook-ceph. I hold a B.tech degree and I'm also RHCSA certified. I have spoken at FOSDEM 2022, Cephalocon 2023(Amsterdam). I'm in the top 4... Read More →

Deepika Upadhyay

Ceph Engineer, Clyso

I’m Deepika, a Ceph Engineer at Clyso working on the Rook project. With over 5 years in the Ceph community, I specialize in deploying large-scale Rook Ceph clusters for enterprises, particularly in containerized environments. My career started with Ceph Storage Engineering, focusing... Read More →

Yati Padia

Software Engineer IBM, IBM

Yati is a Software Engineer at IBM Storage. She contributes to CephCSI, CSI-Addons,Rook,Must-gather and ODF Disaster Recovery projects. She has actively contributed to features like Reclaim Space feature in CSI-Addons, Volume snapshots in Ceph-CSI,Volume Replication and DR soluti... Read More →

Thursday December 12, 2024 12:20pm - 12:55pm IST
Room 6

Maintainer Track

12:20pm IST

From Chaos to Control: Building Resilience with Effective Backup and Disaster Recovery in Kubernetes - Yash Pimple, Nirmata

Thursday December 12, 2024 12:20pm - 12:55pm IST

Room 4

As organizations scale, robust disaster recovery becomes critical. As clusters multiply and complexities grow, maintaining consistent RPO and RTO becomes challenging, requiring new techniques for efficient large-scale data backup and recovery. While GitOps excels at maintaining the desired state of infrastructure using Git as the single source of truth, it falls short for stateful workloads like databases and S3 buckets. Tools like Crossplane help deploy these resources in a GitOps model, but disaster recovery remains complex. You can't just spin up a new K8s cluster, point it to a Git repo, and expect a seamless recovery of critical stateful data Disaster recovery isn't 'one size fits all', each scenario requires a different approach depending on the scale of the disaster. In this talk, we’ll explore different strategies for handling different levels of disasters, from losing a single K8s cluster to facing a full region outage, helping folks to be better prepared for the unexpected.

Speakers

Yash Pimple

Open Source Contributor, Independent

Yash is a junior pursuing a Bachelor’s degree in India and is currently immersed in learning DevOps. He actively contributes to various open-source projects, generously sharing his knowledge to educate others based on his learning experiences.

Thursday December 12, 2024 12:20pm - 12:55pm IST
Room 4

Operations + Performance

Content Experience Level Beginner

12:20pm IST

Cell-Based Kubernetes - the Secret to Scalable, Repeatable and Resilient Cloud Architecture - Shweta Vohra, Booking.com

Thursday December 12, 2024 12:20pm - 12:55pm IST

Room 1

Cell-based architecture offers concentrated, self-contained functionalities but can be challenging to implement with Kubernetes clusters. However, integrating this architecture with Kubernetes brings significant benefits like enhanced scalability, resiliency, and resource management. This session will demystify the process, focusing on secure inter-cell communication, API gateway integration, and building resilience using Kubernetes-native features. I’ll demonstrate how to use Istio for secure inter-cell communication, ensuring efficient interaction between services while maintaining strict security. This includes configuring traffic management rules and leveraging Istio’s mutual TLS for secure communications with minimal complexity. We’ll also explore enforcing separation of concerns and governance for multi-tenancy and privacy. Attendees will gain actionable insights into leveraging cell-based architecture on Kubernetes, transforming complex setups into robust, scalable solutions.

Speakers

Shweta Vohra

Architect, Booking.com

Shweta is an Enterprise Architect and a Cloud Navigator! 🚀 As a seasoned Architect with a vast toolkit in Cloud, Platforms, Data, and ML technologies. She has spent over two decades crafting solutions across various domains and complexity levels. She is a frequent conference speaker... Read More →

Thursday December 12, 2024 12:20pm - 12:55pm IST
Room 1

SDLC (Software Development Lifecycle)

Content Experience Level Intermediate

12:20pm IST

Enhance Kubernetes Security with the Common Expression Language (CEL) - Hoon Jo, Megazone

Thursday December 12, 2024 12:20pm - 12:55pm IST

Room 3

Among the 4C (Cloud, Cluster, Container, Code) security in Kubernetes, there are various techniques to enhance the security of the cluster surface. In particular, Admission Control (webhook) is one of the most flexible and powerful methods. As this trend, there is movement to apply it to various forms of Kubernetes(e.g. GKE, Openshift and so on). In my opinion, one of the easiest and most efficient ways to apply it is to improve security through CEL (Common Expression Language). I believe that the Validating Admission Policy becoming `stable` in v1.30 is part of this proof. So I will show you the CEL DEMO provided by Google Cloud to get a quick and easy understanding of how to improve the security of GKE. Through this exercise, you will learn the basic structure of CEL and the freedom of scope that can be applied, and you will be able to apply it to any other platform with minimal effort.

Speakers

Hoon Jo

Cloud Solutions Architect | Cloud Native Engineer, Megazone

Hoon Jo is Cloud Solutions Architect as well as Cloud Native engineer at Megazone. He has many times of speaker experience for cloud native technologies. And spread out Cloud Native Ubiquitous in the world. He has written several books and latest books is 『CONTAINER INFRASTRUCTURE... Read More →

Thursday December 12, 2024 12:20pm - 12:55pm IST
Room 3

Security

Content Experience Level Beginner

12:55pm IST

Lunch 🍲

Thursday December 12, 2024 12:55pm - 2:55pm IST

TBA

Thursday December 12, 2024 12:55pm - 2:55pm IST
TBA

Breaks

2:55pm IST

AstraZeneca’s Cloud Native Machine Learning Platform - Nithin R, AstraZeneca

Thursday December 12, 2024 2:55pm - 3:30pm IST

Room 1

Showcasing AstraZeneca’s cutting-edge Enterprise Cloud Native Machine Learning Platform. It is built on Kubernetes and integrates a diverse array of cloud-native tools, enabling seamless development, deployment, and management of machine learning workflows. My presentation will delve into the architecture, key components, real-world applications, and the integration with Cloudability for cost management, highlighting its role in empowering data science teams and accelerating innovation within AstraZeneca. The tech stack involves Kubeflow, Weights & Biases, Ray, Volcano Scheduler, Grafana, Prometheus, ELK, Harbor, NetApp Ontap FSx, Kyverno, GitHub Actions, ArgoCD, Argo Rollouts, Milvus, etc

Speakers

Nithin R

Nithin, AstraZeneca

Building Enterprise AI Platform using Kubernetes, Kubeflow, Ray Cluster, Volcano Scheduler, Apache Spark, Deepspeed, Argo, Harbor, GitHub Actions, NVIDIA DGX A100, Milvus.

Thursday December 12, 2024 2:55pm - 3:30pm IST
Room 1

AI + ML

Content Experience Level Any

2:55pm IST

Bias-Busting AI with a Cloud Native Approach - Rajas Kakodkar, Broadcom

Thursday December 12, 2024 2:55pm - 3:30pm IST

Room 4

As Large Language Models gain prominence, the discussion around AI fairness and ethics has never been more pressing. Cloud Native is emerging as the standard infrastructure for training, deploying, and serving AI workloads, but its role doesn't stop there—it can also play a crucial part in minimizing bias in AI models. This session will delve into: - Mapping Cloud Native principles like attestation and supply chain fundamentals to AI workloads, enhancing explainability and providing actionable recourse. - Leveraging Kubernetes' reconciliation loop to offer feedback that corrects false positives in AI output. - Utilizing the distributed nature of cloud computing to decentralize AI power, promoting more responsible automation. This session is designed for AI practitioners seeking insights from the Cloud Native tech stack, infrastructure beginners looking to understand its extensibility, and experts and maintainers aiming to extend the boundaries of current Cloud Native infrastructure.

Speakers

Rajas Kakodkar

Staff Engineer at Broadcom | Tech Lead at CNCF TAG Runtime, Broadcom

Rajas is a staff engineer at Broadcom and a tech lead of the CNCF Technical Advisory Group, Runtime. He is actively involved in the AI working group in the CNCF. He is a Kubernetes contributor and has been a maintainer of the Kube Proxy Next Gen Project. He has also served as the... Read More →

Thursday December 12, 2024 2:55pm - 3:30pm IST
Room 4

AI_dev Sessions, Responsible AI: Ethics + Security + Governance in AI

Content Experience Level Any

2:55pm IST

How a Small Step Towards OSS Turned Out Into a Giant Leap to Cloud Native Adoption for an Enterprise - Ashwin Gupta & Shubham Bansal, Fidelity International

Thursday December 12, 2024 2:55pm - 3:30pm IST

Room 2

Fidelity's journey to cloud started about a decade ago with Cloud Foundry. Open-Source adoption was our first step towards digital transformation and from there today we sit on a CNCF tools stack of Kubernetes, Backstage, Harbor, Elastic, Postgres, Argo, Kafka, Helm, Open Telemetry, Jenkins, TF, Cilium, AWS, Azure, et al. Neil Armstrong once said, "one small step for man, one giant leap for mankind" about his first step on moon; so was the case of Fidelity with CF adoption towards wider adoption. It was never an easy sail towards Open Source CNCF landscape adoption since Fidelity being a global financially regulated organization, has its own challenges for industry regulations and embedded culture. We have divided and conquered the goal taking on the challenges unified but in distributed work streams across the organization. In this talk we would like to share this journey, experience, and learnings with others to help their adoptions of cloud native tools at an enterprise scale.

Speakers

Ashwin Gupta

Technical Associate Director - Cloud Engineering and Operations at Fidelity International Limited, Fidelity International Limited

Ashwin Gupta has a total IT industry experience of close to 2 decades. He works as a strategist and an engineer with capability to solve any problem through coding and automation while adhering to 12-factors principle and following extreme programming practices. His experiences spread... Read More →

Shubham Bansal

Distinguished Engineer - Fidelity International, Fidelity International

Shubham is a Software Engineer with 9 years of experience in Cloud, Platform Engineering and Developer Productivity. He is working as part of Global Engineering at Fidelity International where he works on incorporating and building new tech, platforms, and capabilities. Currently... Read More →

Thursday December 12, 2024 2:55pm - 3:30pm IST
Room 2

Cloud Native Experience

Content Experience Level Any

2:55pm IST

Safeguarding SLAs and Building Resilient Systems: A Sneak Peek to Chaos Engineering Probes - Saranya Jena, Vedant Shrotria & Amit Das, Harness; Siddharth Vijay, Baazi Games

Thursday December 12, 2024 2:55pm - 3:30pm IST

Room 6

In the dynamic landscape of cloud-native applications, resilience is essential to maintaining business continuity and user satisfaction. Resilience Probes play a crucial role in validating Service Level Agreements (SLAs) during Chaos Experiments. These versatile probes can perform checks across various layers of the stack, offering automated, and declarative validations. They can interact with APIs, K8s resources, and system commands, giving a thorough perspective on system health. Moreover, an effortless integration with observability platforms such as Prometheus, facilitates both standard and custom validation of system performance. In this talk, we will discuss how LitmusChaos-based Resilience Probes streamline SLA validation, and enable continuous monitoring. We'll explore real-world examples of probes uncovering hidden weaknesses and ensuring resilience against unpredictable failures. We also discuss a chaos engineering end-user use case shared by LitmusChaos user Baazi Games.

Speakers

Amit Kumar Das

Senior Software Engineer 2, Harness

Amit works at Harness as a Senior Software Engineer. He has been contributing to LitmusChaos, a CNCF incubating project from past 2 years and also maintaining it. He is passionate about system resiliency and is primarily working on creation of Chaos Workflows using Argo in Litmus... Read More →

Saranya Jena

Senior Software Engineer, Harness

Saranya is a Senior Software Developer at Harness and is a maintainer of LitmusChaos, a Chaos Orchestration framework designed for implementing chaos engineering in cloud-native environments. She likes contributing to the Open Source community, where her primary focus involves architecting... Read More →

Siddharth Vijay

AVP, Engineering, Baazi Games

Siddharth Vijay is an Expert Panel Speaker at various DevOps, Cloud & CyberSecurity conferences held in India & Abroad - details on Linkedin profile. Highly experienced and results-driven AVP Engineering with a proven track record of delivering innovative solutions and driving technology... Read More →

Vedant Shrotria

Senior Software Engineer, Harness

Vedant is a Senior Software Engineer at Harness, where they lead the release and QA efforts for the Chaos Engineering team. With 4 years of hands-on experience in Chaos Engineering, He is also a maintainer of the CNCF incubating project LitmusChaos, contributing to its release, testing... Read More →

Thursday December 12, 2024 2:55pm - 3:30pm IST
Room 6

Maintainer Track

2:55pm IST

Dynamic Management of X509 Certificates Using Kubernetes Certificate Operator - Abhidnya Joshi & Senthil Ponnuswamy, Dell Technologies

Thursday December 12, 2024 2:55pm - 3:30pm IST

Room 3

Security is non-negotiable area and Kubernetes based environments are no exception! Usage of x509 certificates is the key thing. Be it K8s deployments in private or public cloud, ensuring availability of "right" X509 certificate for a service is very important. If this service is getting connected from external (apps/clients which are outside of K8s cluster) clients, this is even more important! But what is really the "right" x509 certificate and how can we ensure that is always remains "right"? Can we make corrections dynamically? Can we also ensure easy propagation of certificates imported from outside the cluster? Propagation of Certificate revocation lists to ensure services can deny revoked certificates? This talk helps describe the strategy K8s based products can use to dynamically generate, make correction and propagation of X509 certificates within K8s cluster using K8s operator design pattern and makes use of well-known CNCF projects such as cert-manager and trust-manager.

Speakers

Abhidnya Joshi

Software Senior Principal Engineer, Dell Technologies

A technical leader in security and protocols area in Data Domain in Dell Technologies, has 18+ years of experience in the Software industry. Her domain expertise lies in popular file transfer protocols such as SMB, NFS and protocol Security and storage. She has worked with Samba community... Read More →

Senthil Ponnuswamy

Distinguished Engineer, DELL Technologies

Senthil Ponnuswamy is a security leader with 16+ years of experience in building security features for storage products. He is the Chief Security Architect for DELL Technologies Data Protection Engineering. Senthil has also 13 security-related patents granted by USPTO.

Thursday December 12, 2024 2:55pm - 3:30pm IST
Room 3

Security

Content Experience Level Intermediate

2:55pm IST

Tutorial: An Accelerated Introduction to AI Model Deployment with Cloud Native - Sreeram Venkitesh, BigBinary & Emily Chen, scikit-learn

Thursday December 12, 2024 2:55pm - 4:20pm IST

Room 5

The future of AI will be on cloud because of various reasons like scalability, computing power, features like Dynamic Resource Allocation and being able to run AI workloads across multiple clouds. However, the fields of cloud native and machine learning are still somewhat separated. We aim to bridge this gap with this tutorial. We plan on giving a brief introduction to machine learning with scikit-learn and cloud native with Kubernetes, then dive into a hands-on tutorial. We will show different ways to train and run ML models on and off the cloud (CPUs vs GPUs, public cloud vs on-prem, different flavors of Kubernetes) and evaluate performance in terms of training speed and cost. Additionally, training ML models is a complicated task and requires a lot of research. Optimizing your cloud setup on top of this makes it more difficult. There is no single solution, and we will explore a few of these options during this tutorial.

Speakers

Emily

Open Source Developer, scikit-learn

Emily is an engineering student at the University of Toronto with an emerging interest in Cloud Native. She is an active contributor to various CNCF projects, and an advocate for diversity and inclusion. She is involved with translation and localization of numerous documentations... Read More →

Sreeram Venkitesh

Software Engineer, BigBinary

Sreeram Venkitesh is a Software Engineer at BigBinary and is an active contributor to Kubernetes. He is part of the 1.29 release team.

Thursday December 12, 2024 2:55pm - 4:20pm IST
Room 5

Tutorials, Cloud Native Novice

Content Experience Level Beginner

3:45pm IST

Trust in Green: Towards a Cloud Native Approach for Building Sustainable and Reliable Enterprise AI - Vincent Caldeira, Red Hat

Thursday December 12, 2024 3:45pm - 4:20pm IST

Room 1

As organisations increasingly integrate AI solutions, the demand for environmentally sustainable practices within this space has never been more critical. This presentation delves into the collaborative effort between the Cloud Native Computing Foundation (CNCF) AI WG and the TAG Environmental Sustainability to define a repeatable design approach aimed at fostering sustainable AI in cloud-native environments. Our discussion will outline the crucial considerations in such approach, including efficient management of compute resources, storage optimisation, and advanced networking solutions. Attendees will gain insights into the lifecycle of AI/ML deployments, from inception through operation, emphasising resilience, scalability, and resource efficiency. By highlighting innovative "green" strategies, this session will provide actionable best practices and recommendations, alongside a forward-looking perspective on future trends and research directions in sustainable AI.

Speakers

Vincent Caldeira

CTO APAC, Red Hat

Vincent Caldeira, CTO of Red Hat in APAC, is responsible for strategic partnerships and technology strategy. Named a top CTO in APAC in 2023, he has 20+ years in IT, excelling in technology transformation in finance. An authority in open source, cloud computing, and digital transformation... Read More →

Thursday December 12, 2024 3:45pm - 4:20pm IST
Room 1

AI + ML

Content Experience Level Intermediate

3:45pm IST

From User to Maintainer: My Journey with Flux CD - Steve Wade, Independent

Thursday December 12, 2024 3:45pm - 4:20pm IST

Room 2

Join me as I share my transformative journey from a regular user to a maintainer of Flux CD, a popular GitOps tool for Kubernetes. Open-source software thrives on the contributions of passionate individuals who go above and beyond to support and enhance the community. My journey with Flux CD began as a user, where I leveraged its powerful GitOps capabilities to streamline Kubernetes deployments. However, my desire to give back led me to become a maintainer. In this talk, I will recount my path, the challenges I faced, and the invaluable lessons I learned. Attendees will gain insights into the inner workings of open-source communities, the responsibilities of maintainers, and practical advice for those aspiring to contribute at a deeper level. This session is perfect for developers, DevOps engineers, and anyone interested in open-source contributions and Kubernetes.

Speakers

Steven

From free-kicks to git commits, Independents

Steve Wade was a founding engineer at KSOC, a Kubernetes security startup. He held platform leadership roles at UnderWrite Me and Mettle, implementing GitOps for self-service platforms. As a Consultant at Apprenda, he provided Kubernetes consultancy and training worldwide. Steve has... Read More →

Thursday December 12, 2024 3:45pm - 4:20pm IST
Room 2

Cloud Native Experience

Content Experience Level Any

3:45pm IST

Cilium: Connecting, Observing, and Securing Kubernetes and Beyond with eBPF - Bill Mulligan, Isovalent at Cisco & Neeraj Bisht, Flipkart

Thursday December 12, 2024 3:45pm - 4:20pm IST

Room 6

Welcome to Cilium's maintainer track session where you'll get an update on how Cilium is expanding the frontiers of cloud native networking, observability, and security. Cilium is CNCF's most widely adopted CNI, being the default choice for all major cloud providers. This talk dives into the bytecode behind all of the buzz around the project. We'll start with a brief overview of each part of the project before diving into how Cilium is expanding beyond Kubernetes with load balancing and multi-cloud networking and into runtime enforcement with Tetragon. Hear from Cilium contributors and users Isovalent and Flipkart.

Speakers

Neeraj Bisht

Principal Architect at Flipkart, Flipkart

Neeraj Bisht is a Principal Architect at Flipkart with 15 years of industry experience. He works for the cloud platform team at Flipkart and comes with an extensive experience of solving complex problems at large scale.

Bill Mulligan

Community, Isovalent at Cisco

Bill Mulligan is a cloud native pollinator and community builder. He has given talks, written articles, and appeared on podcasts on a wide range of topics around cloud native. While at CNCF he restarted the Kubernetes Community Day program. He is currently at Isovalent growing the... Read More →

Thursday December 12, 2024 3:45pm - 4:20pm IST
Room 6

Maintainer Track

3:45pm IST

Keeping the Lights on: Zero Downtime Application Upgrades in Kubernetes - Shashank Pai & Sagar Jadhav, InfraCloud Technologies

Thursday December 12, 2024 3:45pm - 4:20pm IST

Room 4

Imagine adding all your favorite products to your shopping cart, only to have the page reload and—poof—everything’s gone. Frustrating, right?. For mission-critical apps, seamless upgrades in Kubernetes demand a solid grasp of how to tackle these challenges effectively. This session equips you with practical strategies for performing zero-downtime upgrades in Kubernetes. We will cover the role of readiness and liveness probes, explore rolling update strategies and Blue/Green deployments, and compare their benefits. We will also discuss handling SIGTERM signals, managing sidecar containers, and the importance of PodDisruptionBudgets and TopologySpreadConstraints. Finally, we will examine how Priority Classes and Pod Eviction impact stability during Kubernetes upgrades. By the end, you'll be equipped to confidently handle upgrades without downtime, ensuring your applications stay online and reliable, even during the most challenging updates.

Speakers

Sagar Jadhav

Senior Product Engineer, InfraCloud Technologies Pvt. Ltd.

Software Engineering has been Sagar Jadhav's field of expertise for more than a decade. Docker, Kubernetes, Terraform, Go, NodeJS, and other tools and programming languages are among the ones he has experience with.He is currently working in the space of infrastructure provisioning... Read More →

Shashank Pai

Senior SRE, Infracloud

Name: Shashank Pai Title: Senior SRE at InfraCloud Biography: Shashank is a Senior SRE at InfraCloud, bringing extensive experience in managing and scaling cloud-native applications. His expertise lies in Kubernetes, CI/CD automation, and infrastructure as code. He is passionate about... Read More →

Thursday December 12, 2024 3:45pm - 4:20pm IST
Room 4

Operations + Performance

Content Experience Level Intermediate

3:45pm IST

Fuzzing for Stability: Uncovering and Mitigating Helm's CVE - Jakub Ciolek, AlphaSense

Thursday December 12, 2024 3:45pm - 4:20pm IST

Room 3

Join this talk to uncover the story of a high severity CVE-2024-26147 [CVSS: 7.5] discovered in Helm and understand the role of fuzzing in maintaining the ecosystem’s integrity. Through this demonstration, you'll see firsthand the systematic approach used to identify the vulnerability that caused Helm to panic when faced with missing YAML metadata. The issue enabled crashing Helm SDK-based clients over the network and additionally, bricking local Helm client installations. We'll dive into the specific tools and techniques that were instrumental in detecting the issue, focusing on their applicability to your daily work. This session is designed not just to share a discovery but to foster a community-wide commitment to proactive security practices. Learn how these insights can be applied to strengthen the security and reliability of your Kubernetes deployments, ensuring a safer environment for all users of the ecosystem.

Speakers

Jakub Ciolek

Senior Tech Lead - Cloud Platform, AlphaSense

Jakub Ciolek is a seasoned Senior Tech Lead at AlphaSense, focused on Kubernetes and open-source innovation. He has made notable contributions to the Go compiler and identified key vulnerabilities in Helm and Argo CD. He is dedicated to driving forward secure, scalable solutions in... Read More →

Thursday December 12, 2024 3:45pm - 4:20pm IST
Room 3

Security

Content Experience Level Intermediate

4:20pm IST

Coffee Break ☕

Thursday December 12, 2024 4:20pm - 4:50pm IST

Room 1

Thursday December 12, 2024 4:20pm - 4:50pm IST
Room 1

Breaks

4:50pm IST

Guardians of the MLOps Galaxy: Simplifying Deployments with Buildpacks - Suman Chakraborty, Broadcom & Aditya Soni, Forrester Research

Thursday December 12, 2024 4:50pm - 5:25pm IST

Room 1

Machine learning platforms aim to streamline the workflow for ML practitioners, allowing them to focus on developing their models while the platform handles repetitive tasks like packaging code, dependencies and configurations. Traditional methods using Dockerfiles require ML engineers to navigate complex Linux processes and maintain multiple Dockerfiles for different projects, which can be time-consuming and prone to errors. Additionally, security mandates for regular patching and updates adding further to the complexity. Join this talk to explore how Cloud Native Buildpacks can simplify and secure MLOps deployments. By automating the packaging of ML projects, including custom libraries and hardware specifications, Buildpacks enhance flexibility, maintainability and security. This approach reduces the operational burden on both developers and security teams, ensuring a more efficient and scalable MLOps deployment process

Speakers

Aditya Soni

CNCF Ambassador, DevOps Engineer II, Forrester Research

Aditya Soni is a DevOps/SRE tech professional He worked with Product and Service based companies including Red Hat, Searce, and is currently positioned at Forrester Research as a DevOps Engineer II. He holds AWS, GCP, Azure, RedHat, and Kubernetes Certifications.He is a CNCF Ambassador... Read More →

Suman Chakraborty

Senior Solution Engineer @ VMware by Broadcom, Broadcom

Suman is a Senior Cloud Native Architect at VMware. He is a consultant and advisor for Tanzu platform and help the customers and users in their journey of app modernisation adoption and cultural shift with DevOps best practices. Suman is a distinguished speaker in many community Meetups... Read More →

Thursday December 12, 2024 4:50pm - 5:25pm IST
Room 1

AI + ML

Content Experience Level Beginner

4:50pm IST

Streamlining Machine Learning Operations with GitOps - Kunal Kushwaha, Civo

Thursday December 12, 2024 4:50pm - 5:25pm IST

Room 5

As AI becomes more popular, it's bringing some new headaches when it comes to managing models, from building them to getting them into production. The usual DevOps tools don't always cut it, especially when you need everything to be consistent and handle large datasets without a hitch. As ML projects grow, trying to manage everything manually just gets messy and prone to mistakes. In this talk, I'll break down how GitOps can make life easier by automating and simplifying ML operations. With Git as the go-to source for everything, GitOps keeps your ML models consistent and reproducible across different environments. I'll share some real-world examples, talk about the challenges, and give you practical tips on how to bring GitOps into your ML workflow. The goal is to help you deploy models faster and with fewer headaches.

Speakers

Kunal Kushwaha

DevRel manager, Civo

Kunal Kushwaha is a Developer Relations Manager at Civo, where he fosters a deep connection between developers and innovative cloud-native technologies. With a passion for empowering others, Kunal has taught thousands online and consulted numerous companies on their DevOps journey... Read More →

Thursday December 12, 2024 4:50pm - 5:25pm IST
Room 5

AI_dev Sessions, Foundations + Frameworks + Tools for Machine Learning

Content Experience Level Intermediate

4:50pm IST

Contributing to Istio : View from an LFX Mentee's Eyes - Adil Mohamed M P, Independent

Thursday December 12, 2024 4:50pm - 5:25pm IST

Room 2

Contributing to open-source projects like Istio can be a transformative experience, but how do you begin? In this session, Adil Mohamed M P, a computer engineering student from India and an LFX mentee, will share his personal journey on how the LFX Mentorship program has eased his cloud-native debut. He will share his contributor experience to one of the most popular CNCF projects, Istio, and how he was part of the latest Service mesh buzz word "Ambient Mesh". Adil will discuss how the LFX mentorship program has equipped him with the skills to excel in open-source development and collaboration. Whether you’re a beginner looking to contribute or an experienced developer seeking to give back, this session will offer valuable tips, and a roadmap for making meaningful contributions to cloud-native projects.

Speakers

Adil Mohamed M P

Graduated CNCF Mentee at Istio, not working

Adil, a computer engineering student from India, is an LFX Mentee who has significantly contributed to Istio Ambient Mesh. At his college, he is part of the tech team at the Innovation and Entrepreneurship Development Center (IEDC), working on new projects and startups. He is also... Read More →

Thursday December 12, 2024 4:50pm - 5:25pm IST
Room 2

Cloud Native Experience

Content Experience Level Any

4:50pm IST

Contributing to Kubernetes in Its Second Decade - How ContribEx Enhances the Journey! - Nabarun Pal, Independent & Sandeep Kanabar, Gen (formerly NortonLifeLock)

Thursday December 12, 2024 4:50pm - 5:25pm IST

Room 6

SIG Contributor Experience has been wildly successful in helping grow the contributor base of Kubernetes in the first ten years of the project via New Contributor Workshops. We stressed on the importance of growing existing contributors in our last maintainer track session. However, the other side of the sustainability coin is ensuring that contributors who get started with contributing to Kubernetes, actually stick around. A lot has changed in the last decade, and we also need to change how we teach folks to contribute and interact with the community. Join us as we give a comprehensive overview of the Kubernetes governance and community structure, where you can seek help and what some pitfalls are that you will unexpectedly but inadvertently face in your contributor journey. We will highlight areas that are suited for folks from all backgrounds: marketing, content creation, event planning, community elections, automation and so much more!

Speakers

Nabarun Pal

Kubernetes Maintainer, Independent

Nabarun is a Staff Software Engineer at VMware by Broadcom, a maintainer of the Kubernetes project, elected Kubernetes Steering Committee member and a chair of Kubernetes SIG Contributor Experience. He is a Release Manager for Kubernetes and has been the Kubernetes 1.21 Release Team... Read More →

Sandeep Kanabar

Lead Software Engineer, Gen (formerly NortonLifeLock)

Hailing from India, Sandeep is a passionate software engineer working at Gen (formerly NortonLifeLock). A frequent meetup speaker, Sandeep enjoys sharing his lessons learned from 15+ years in the tech space with the community. He's a staunch advocate for diversity and inclusion and... Read More →

Thursday December 12, 2024 4:50pm - 5:25pm IST
Room 6

Maintainer Track

4:50pm IST

Scaling Beyond Autoscaling: How We Grew Our Kubernetes Clusters - Bhavin Gandhi & Ruturaj Kadikar, InfraCloud Technologies

Thursday December 12, 2024 4:50pm - 5:25pm IST

Room 4

Picture this: Your startup just landed a big client, and as your business starts to grow, so does your Kubernetes cluster. The number of microservices and the traffic that they serve has started increasing. You configure auto-scaling of Nodes and Pods. Do you think that is enough, or do you need to look into other areas? What other components need scaling? What strategies should be devised? How do we verify whether there will not be any impact during scaling? In this session, we answer all these questions and come up with a blueprint for scaling a Kubernetes cluster from our experience with scaling our production cluster from merely 20-25 nodes to around 250 nodes with more than 5000 pods. We will touch base on the issues we faced and their resolution that will form a good prescription for those who want to scale their Kubernetes infrastructure.

Speakers

Bhavin Gandhi

Staff SRE, InfraCloud Technologies

Bhavin is working with InfraCloud Technologies. His main area of interest are Free/Libre and Open Source Software, DevSecOps, containers and Kubernetes. He has been part of cloud native transformation journeys for various companies. You can check what he is up to on his personal website... Read More →

Ruturaj Kadikar

Senior Engineer, Site Reliability, InfraCloud Technologies

I like to apply site reliability principles to facilitate business growth through the seamless and reliable performance of systems and infrastructure. I have built private clouds with OpenStack, built Kubernetes on premises & scaled Kubernetes on cloud for enterprises of various... Read More →

Thursday December 12, 2024 4:50pm - 5:25pm IST
Room 4

Operations + Performance

Content Experience Level Intermediate

4:50pm IST

SPIFFE as a Glue for Large Scale Telco Deployments: A Nephio Perspective - Rahul Jadhav, AccuKnox

Thursday December 12, 2024 4:50pm - 5:25pm IST

Room 3

Emerging Telco trends such as ORAN, advanced 5G core demands a disaggregated arch for scaling. Kubernetes based deployments are becoming a norm and much of the open CNCF/LF tooling are playing a major role. The aim of this submission is to talk about the challenges that Nephio(www.nephio.org) SIG-Security team faced about streamlining security operations across multi-cluster multi-region, multi-vendor based deployments. The aim is to talk about specific instances/use-cases where the Nephio management cluster needs to securely interact with regional/edge clusters for the control plane needs. Also why/how the Nephio security team envisaged SPIFFE as a foundational layer to bind multi region together. A particular problem statement in the context of ORAN deployments where SMO (Service Mgmt Orchestation) has to securely interact with IMS (Infra Mgmt Service) for secure creation of infrastructure and the role SPIFFE played in the context would be highlighted.

Speakers

Rahul Jadhav

Nephio SIG-Security chair, CNCF Ambassador, CTO AccuKnox, AccuKnox

An avid coder, a systems engineer working on solutions involving security and performance of cloud-native tech. Contributed towards several open sources including Linux Kernel and worked closely with IETF Standards (such as ROLL, 6lo, LWIG) and Linux Foundation. Taken several projects... Read More →

Thursday December 12, 2024 4:50pm - 5:25pm IST
Room 3

Security

Content Experience Level Intermediate

5:40pm IST

Scaling Private LLM Model Services with Kserve and Modelcar OCI: A Real-World Implementation - Mayuresh Krishna, initializ

Thursday December 12, 2024 5:40pm - 6:15pm IST

Room 1

Deploying large language models (LLMs) is inherently complex, challenging, and expensive. This case study demonstrates how Kubernetes, specifically Kserve with Modelcar OCI storage backend, simplifies the deployment and management of private LLM services. First, we explore how Kserve enables efficient and scalable model serving within a Kubernetes environment, allowing seamless integration and optimized GPU utilization. Second, we delve into how Modelcar OCI artifacts streamline artifact delivery beyond container images, reducing duplicate storage usage, increasing download speeds, and minimizing governance overhead. The session will cover implementation details, benefits, best practices, and lessons learned. Walk away learning how to leverage Kubernetes, Kserve, and OCI artifacts to enhance your MLOps journey, achieving significant efficiency gains and overcoming common challenges in deploying and scaling private LLM services.

Speakers

MK

CTO & Co-Founder, initializ

Mayuresh Krishna is the CTO and Co-Founder of initializ.ai, where he drives product engineering, building AI models and private AI services. He has previously worked at VMware Tanzu as a Solution Engineering Leader & Pivotal Software as a Senior Platform Architect.

Thursday December 12, 2024 5:40pm - 6:15pm IST
Room 1

AI + ML

Content Experience Level Intermediate

5:40pm IST

Unleashing Generative AI with Open Data Hub - Ritesh Shah & Prakhar Srivastava, Red Hat

Thursday December 12, 2024 5:40pm - 6:15pm IST

Room 2

Explore AI innovation with the "Generative AI Demo using Open Data Hub," an open-source AI/ML platform tailored for Kubernetes. This demo features two Mistral-based LLMs, one utilizing Retrieval-Augmented Generation (RAG) with PostgreSQL vector extensions, and another without. Users interact through a Gradio chatbot, demonstrating how RAG improves accuracy. Two persona-based pipelines (Admin & Data Scientist) highlight Open Data Hub’s seamless integration with Tekton-powered OpenShift Pipelines, showcasing the Hybrid Cloud Strategy. Key components include the Kubernetes Platform, Node Feature Discovery, NVIDIA GPU Operators, Software Defined Storage, Tekton, Argo CD (for GitOps), Gitea Operator, Knative and Istio. Join us to see how GPU-accelerated AI and scalable, secure infrastructure power next-gen applications.

Speakers

Ritesh Shah

Senior Principal Architect, AI Lead, Red Hat

Ritesh Shah is a Senior Principal Architect with Red Hat and focuses on creating and using next-generation platforms, including AI/ML workloads as well as application modernisation and deployment. Ritesh is an advocate for open source technologies and products, focusing on modern... Read More →

Prakhar Srivastava

Team Lead, Global Content Development Portfolio & Technology, Red Hat

As a seasoned technology professional and Team Lead for the Global Content Development team at Red Hat, my role is integral to driving the optimization of our sales and marketing strategies, ensuring that our products stand out in a highly competitive market. My primary focus is on... Read More →

Thursday December 12, 2024 5:40pm - 6:15pm IST
Room 2

AI_dev Sessions, Generative AI + Creative Computing

Content Experience Level Beginner

5:40pm IST

End to End LLMOps with Kubeflow - Johnu George & Gavrish Prabhu, Nutanix

Thursday December 12, 2024 5:40pm - 6:15pm IST

Room 6

In the newer world of generative AI models, enterprises bet on integrating large language models into their various business use cases. Due to the complex infrastructure requirements of large language models, building scalable optimized end-to-end GenAI pipelines connecting data and compute is not easy compared to traditional machine learning models. Cluster admins need better visibility into infrastructure to ensure the best utilization of cluster resources, including expensive accelerators. In contrast, data scientists need a clean Pythonic interface without exposure to any underlying stack details. In this talk, we will cover how the Kubeflow Platform helps in LLMOps journey from training an LLM on the custom dataset to fine-tuning the pipeline for the best results and, finally, deployment of the trained models at scale. We will discuss an optimized Kubernetes native ML reference stack for your LLM needs that provides maximum infra utilization.

Speakers

Johnu George

Technical Director, Nutanix, Nutanix

Johnu George is a Technical Director at Nutanix with a background in distributed systems and large-scale hybrid data pipelines. He is an active in open-source and has steered several industry collaborations on projects like Kubeflow, Apache Mnemonic and Knative. His research interests... Read More →

Gavrish Prabhu

Member of Technical Staff, Nutanix

Gavrish Prabhu is a Software Engineer on Nutanix's AI team. He works on the Nutanix AI Inference Platform, which created the GPT-in-a-box 2.0 Product that enables users to deploy their large language models (LLMs), ML Operations (MLOps), and generative AI (GenAI) apps anywhere... Read More →

Thursday December 12, 2024 5:40pm - 6:15pm IST
Room 6

Maintainer Track

5:40pm IST

Unleashing Observability: Enabling Distributed Tracing in gRPC with OpenTelemetry - Purnesh Dixit, Google

Thursday December 12, 2024 5:40pm - 6:15pm IST

Room 4

gRPC is often chosen for its high-performance communication, making it crucial to minimize latency. Distributed tracing helps identify and diagnose latency bottlenecks in gRPC calls, ensuring that the performance benefits of gRPC are fully realized. Setting up tracing from scratch for gRPC applications is complex and warrants significant maintenance overhead. Moreover, there is not much literature on how to do it properly, resulting in bespoke and suboptimal solutions. In this talk, Purnesh Dixit from the gRPC team will talk about the best practices for utilizing distributed tracing effectively in gRPC environments by configuring the new OpenTelemetry plug-in, created by the gRPC team in google.

Speakers

Purnesh Dixit

Purnesh Dixit (gRPC Team, Google), Google

Purnesh is a software engineer on the gRPC team at Google. He is a contributor to the OpenTelemetry support for distributed tracing in gRPC-go. He is also one of the maintainer of grpc-go open source library.

Thursday December 12, 2024 5:40pm - 6:15pm IST
Room 4

Observability

Content Experience Level Intermediate

5:40pm IST

Expedia Group's GitOps Revolution: Extensive Scalability Testing on ArgoCD for 30K+ Applications - Shivani Mehrotra, Expedia Group & Mohit Kumar, Coforge Limited

Thursday December 12, 2024 5:40pm - 6:15pm IST

Room 3

Expedia Group's journey to implement GitOps with ArgoCD is a story of innovation, scalability, and overcoming challenges. Our GitOps journey involved migrating from KubeFed to ArgoCD, focusing on extensive scalability testing across hundreds of virtual clusters, set up using open source tool, vcluster. We proactively identified potential challenges and prepared comprehensive test cases tailored to different application flavors. We created three types of applications for testing, with sizes varying between 15-30 resources, including CRDs and jobs, small applications containing 15 resources and large applications containing 30 resources. We experimented with multiple test scenarios, using permutation and combination of applications tested on 300 vclusters, scaling approximately 1,000 applications to 30,000+ across these clusters. We concluded this initiative with determining optimal settings for various tunable parameters in the ArgoCD controllers.

Speakers

Mohit Kumar

Coforge, Senior DevOps Engineer, Coforge Limited

Mohit, Senior DevOps Engineer at Coforge, specializes in GitOps and DevOps methodologies with a focus on Kubernetes orchestration and cloud infrastructure. His expertise ensures high availability and scalability across global platforms. Committed to the forefront of technology, Mohit... Read More →

Shivani Mehrotra

Shivani Mehrotra, Expedia Group, SDE-II, Expedia Group

Shivani, SDE-II at Expedia Group is a platform engineer, specializing in building robust systems. Passionate about innovation, Shivani thrives on challenges, delivering impactful results in her role. Outside of work, Shivani enjoys exploring new technologies and staying at the forefront... Read More →

Thursday December 12, 2024 5:40pm - 6:15pm IST
Room 3

Platform Engineering

Content Experience Level Intermediate

5:40pm IST

Ensuring Reliability of Production Ready Kubernetes Operators Using Envtest - Aniruddha Basak, Syself GmbH & Richard Case, Stealth Startup

Thursday December 12, 2024 5:40pm - 6:15pm IST

Room 5

We need to keep in mind many principles & techniques while writing a Kubernetes operator and especially so when used in production. Projects like kubebuilder go a long way to help in building operators. However, talks focus on how to write operators. But in this talk, you will learn how testing can help you create Kubernetes operators that are reliable and resilient to failure and give you the confidence to deploy them to production clusters. Often writing unit tests is not enough for an operator that manages infrastructure. Introducing e2e tests will help, but writing and running e2e tests are time-consuming. This session will share how a user can use envtest to simulate an environment very similar to a real environment and run the tests on behalf of that. In addition, you’ll learn what to keep in mind while writing the tests, such as it doesn’t support garbage collection, and a user must be very careful while creating objects and deleting them after a test suite is done.

Speakers

Richard Case

Principal Engineer and CAPI Maintainer, Stealth startup

Richard Case is a Principal Engineer. He’s currently one of the maintainers of a number of Cluster API providers and has been using and building solutions for Kubernetes since 2016.

Aniruddha Basak

Cloud Software Engineer, Syself GmbH

Aniruddha is a Software Engineer based in Germany persuing a master's in Computer Science at RPTU Kaiserslautern, working remotely with Syself GmbH. His passion is building Cloud-Native tools and vibrant inclusive communities around them. In his free time, he loves contributing to... Read More →

Thursday December 12, 2024 5:40pm - 6:15pm IST
Room 5

SDLC (Software Development Lifecycle)

Content Experience Level Intermediate