Kafka Data Engineer

Introduction

A career in IBM Consulting is rooted in long-term relationships and close collaboration with clients across the globe.

You'll work with visionaries across multiple industries to improve the hybrid cloud and AI journey for the most innovative and valuable companies in the world. Your ability to accelerate impact and make meaningful change for your clients is enabled by our strategic partner ecosystem and our robust technology platforms across the IBM portfolio, including Software and Red Hat.

Curiosity and a constant quest for knowledge serve as the foundation to success in IBM Consulting. You will be encouraged to challenge the norm, investigate ideas outside of your role, and come up with creative solutions resulting in groundbreaking impact for a wide network of clients. Our culture of evolution and empathy centers on long-term career growth and development opportunities in an environment that embraces your unique skills and experience.

Your Role And Responsibilities

A Data Engineer specializing in Data Platforms is responsible for building applications using Big Data technologies, with a strong emphasis on API development. The role demands expertise in traditional application development, analytics libraries, open-source NLP tools, and statistical computing.

Key Responsibilities

• Lead and mentor development teams, ensuring quality and resolving technical challenges.
• Design and implement integration solutions using Confluent Kafka, SOAP, and REST APIs.
• Collaborate across teams for seamless platform integration.
• Develop and test components throughout the software lifecycle.
• Work with both on-premise and cloud environments (e.g., OpenShift).
• Optimize performance through logging and monitoring.
• Actively participate in Agile processes and continuous improvement efforts.
  
  

Required Technical And Professional Expertise

We are seeking a highly skilled Integration Developer with leadership experience to join our team in delivering enterprise-grade solutions. This role involves hands-on development, team guidance, and integration of complex systems using modern frameworks and technologies. If you have a strong background in API development, Kafka, and cloud/on-premise solutions—and experience in the energy & utility industry—this is a great opportunity to make a significant impact.

Required Professional and Technical Expertise

• 2–4 years of experience leading technical teams and reviewing work products.
• 2–5 years of hands-on development experience using Confluent Kafka.
• Strong experience with integration frameworks and API development (REST & SOAP).
• Proficiency in Python, OpenShift, and database technologies.
• Solid understanding of asynchronous messaging, logging, and middleware.
• Experience working in Agile/Scrum environments.
• Ability to support testing teams and troubleshoot integration issues.
  
  

Preferred Technical And Professional Experience

Preferred Professional and Technical Expertise

• Experience with CI/CD workflows, DevOps practices, and cloud-native development.
• Familiarity with performance tuning and scalable architecture design.
  
  

Nice-to-have

• 5+ years of experience in the energy & utility industry.