Senior Software Engineer - Event Capture & Processing (Kafka) India, USA Full Time Atlan is hiring an experienced Senior Software Engineer with expertise in Kafka consumption and Kafka cluster management. The ideal candidate will have a proven track record in ensuring the reliability, availability, and scalability of Kafka clusters, along with strong Kubernetes experience and exposure to CRD (Custom Resource Definition). Ensure Reliability, Availability & Scalability of Kafka Clusters Collaborate with the team to ensure Kafka clusters meet reliability, availability, and scalability requirements. Optimize Kafka configurations and settings to enhance performance and stability. Design and implement effective clustering, partitioning, and topical strategies for efficient Kafka message processing. Develop and implement monitoring and observability solutions to gain insights into Kafka cluster performance and consumer behaviour. Develop robust consumers over Atlan's event processing engine (Numaflow) to ensure fault tolerance and reliability. Demonstrated expertise in deploying and managing applications using Kubernetes. Experience working with Custom Resource Definitions (CRD) to define and manage custom resources. Proven track record of working with Kafka and utilizing its features to build efficient and scalable solutions. Familiarity with Atlan's event processing engine (Numaflow) is a significant advantage. Demonstrated experience in scaling Kafka clusters and consumers to handle increased load and demand. Bachelor's or Master's degree in Computer Science, Software Engineering, or a related field. Excellent problem-solving and analytical skills. Strong communication and collaboration abilities. Proven ability to work effectively in a team-oriented, collaborative environment. At Atlan, one of our core values is putting the problem first and solution second. That’s why our folks in the Business Team come to work every morning with the intent of helping as many people as they can. Even if this means telling them that we’re not the right fit for them. As part of our Business Team, you’ll be our eyes and ears on the ground—working to understand our users’ biggest challenges and wins—so we can integrate this information into our vision for our products. Every line of code we write and every pixel we create will be shaped by what you see and hear on a daily basis. Let’s lead from the front and show the world how it’s done. (Co-founders of Atlan) Get started on your application. Do your life's best work with Atlan Shape the future of our products As part of the Business Team, you play a pivotal role. You are the voice of our users and inform all the important decisions we make. You will work closely with our users and prospects to understand their pain points and feed this information into our product roadmap. I'm the eyes and ears for the product team and give them a clear picture of our users’ feedback, their daily workflows, critical decisions, motivations and more. This helps us build a product that truly solves the problems faced by every human of data that we work with! Aishwarya Bedekar Partnerships Manager I've been astounded thus far with my experience at Atlan. Everyone is an A+ player, works hard, and believes in the common mission. What I love most is the reflective culture we have. Everyone is self-aware and highlights challenges as opposed to hiding them. Over-communication is paramount, even more so in a remote culture, and I think we do a great job of it. Andrew Ermogenous Partnerships Manager My first week here had me hit the ground running with speaking to customers, onboarding them, and taking complete ownership of their experience. In my role, I get to collaborate with almost all functions in Atlan and this excellent support system enables me to drive a great customer experience. Being a primary interface between customers and the product team and playing a pivotal role in the growth of the product is both rewarding and fulfilling! Ashwin Murali Bangalore, India From day one, I have been under GREAT mentors who worked hard to upgrade my knowledge and skills. I came from a different work background and yet they were patient with me, while at the same time they recognized my achievements. The people here are so motivated and dedicated, it's contagious! I've never worked for a company that's more welcoming and nurturing as Atlan. Ma. Isabel Yonzon-Atienza Manila, Philippines Apply for Senior Software Engineer - Event Capture & Processing (Kafka) Fill the form below to kick-start your application. You will be redirected to our job site upon submitting your details.