Kafka Systems Engineer

1 week ago


Pittsburgh, Pennsylvania, United States Tata Consultancy Services Full time
About the Role

We are seeking an experienced Kafka Systems Engineer to join our team at Tata Consultancy Services. This is a full-time remote position offering a competitive salary range of $100,000-$130,000 per year.

Job Description

The successful candidate will be responsible for designing, developing, and maintaining large-scale distributed systems using Apache Kafka. They will work closely with cross-functional teams to ensure seamless integration of Kafka with other technologies and platforms.

Required Skills and Qualifications
  1. Strong fundamentals in distributed systems design and operations, microservice architecture, integration patterns.
  2. Deep understanding of different messaging paradigms (pub/sub, queuing), as well as delivery models, quality-of-service, and fault-tolerance architectures.
  3. Established track record with Kafka technology, with hands-on production experience and a deep understanding of the Kafka architecture and internals of how it works, along with interplay of architectural components: brokers, Zookeeper, producers/consumers, Kafka Connect, Kafka Streams.
  4. Practical experience with how to scale Kafka, KStreams, and Connector infrastructures.
  5. Experience with Kafka Streams / KSQL architecture and associated clustering model.
  6. Hands-on experience as a developer who has used the Kafka API to build producer and consumer applications, along with expertise in implementing KStreams components.
  7. Have developed KStreams pipelines, as well as deployed KStreams clusters.
  8. Experience with developing KSQL queries and best practices of using KSQL vs KStreams.
  9. Strong knowledge of the Kafka Connect framework, with experience using several connector types: HTTP REST proxy, JMS, File, SFTP, JDBC.
  10. Experience using Source/sink connectors as RDBMS, NoSQL data stores.
  11. Hands-on experience in designing, writing, and operationalizing new Kafka Connectors using the framework.
  12. Strong familiarity of data formats such as XML, JSON, Avro, CSV, etc. along with serialization/deserialization options.
  13. Familiarity of the Schema Registry.
  14. Experience with monitoring Kafka infrastructure along with related components (Connectors, KStreams, and other producer/consumer apps).
  15. Familiarity with Confluent Control Center Firm understanding of SDLC (systems development lifecycle).
  16. Excellent written and verbal communication skills.
  17. Excellent analytical and troubleshooting abilities.
  18. Prior experience in banking/financial services industry and firm understanding of the banking data landscape.
What We Offer

We offer a dynamic and supportive work environment, opportunities for growth and professional development, and a competitive compensation package.



  • Pittsburgh, Pennsylvania, United States Syntricate Technologies Full time

    We are seeking an experienced Java Kafka Developer to join our team at Syntricate Technologies in Pittsburgh, PA. This is a contract position requiring 8-10 years of experience.About the RoleThis role involves developing and maintaining large-scale data processing systems using Java and Kafka Streaming API. The ideal candidate will have expertise in Oracle...


  • Pittsburgh, Pennsylvania, United States TeleTracking Technologies, Inc. Full time

    We are seeking a highly skilled Data Solutions Engineer to join our team at TeleTracking Technologies, Inc. As a key member of our data engineering team, you will be responsible for designing and implementing innovative data solutions that drive business growth and improvement.About the Role:This is a challenging and rewarding role that requires strong...


  • Pittsburgh, Pennsylvania, United States Synechron Full time

    About SynechronWe are a global consulting firm that combines creativity and innovative technology to deliver industry-leading digital solutions. Our progressive technologies and optimization strategies span end-to-end Artificial Intelligence, Consulting, Digital, Cloud & DevOps, Data, and Software Engineering, servicing an array of noteworthy financial...


  • Pittsburgh, Pennsylvania, United States Bruce & Merrilees Full time

    Discover a rewarding career as an Electrical Systems Engineer at Bruce & Merrilees, a family-owned business with 350+ team members and 200+ annual projects. Our company has a strong safety record, with 50+ Safe Work Awards, and we operate from six offices across the country.About the RoleWe are seeking an experienced Electrical Systems Engineer to join our...


  • Pittsburgh, Pennsylvania, United States Resource Informatics Group Inc Full time

    We are seeking a highly skilled Cloud Infrastructure Specialist to join our team at Resource Informatics Group Inc in Pittsburgh, PA. This is a full-time position with a duration of 06 months plus.**Job Summary:**The ideal candidate will have 6-8 years of experience in designing and implementing cloud infrastructure solutions using technologies such as...


  • Pittsburgh, Pennsylvania, United States BNY Full time

    Role OverviewAt BNY, we're seeking a skilled Software Engineer Lead to spearhead the development of our enterprise solutions. This is a hybrid role based in Pittsburgh, offering the perfect blend of innovation and work-life balance.About the JobThis is an exciting opportunity to leverage your technical expertise and leadership skills to drive project...


  • Pittsburgh, Pennsylvania, United States SMS group Inc Full time

    Electrical Systems Engineer OpportunityWe are seeking an experienced Electrical Systems Engineer to join our team at SMS group Inc. The successful candidate will be responsible for designing, specifying, and installing electrical control systems for process equipment associated with steel and aluminum production.About the Role:Perform electrical engineering...


  • Pittsburgh, Pennsylvania, United States Software Engineering Institute Full time

    At the Software Engineering Institute (SEI), we are pioneers in applied artificial intelligence and engineering excellence. Our mission is to advance the discipline of AI Engineering for Defense and National Security.We collaborate with government customers to integrate AI and machine learning into their operations, providing leap-ahead mission...


  • Pittsburgh, Pennsylvania, United States Titan Robotics, Inc. Full time

    Exciting Opportunity at Titan Robotics, Inc.We are seeking a skilled Mechanical Engineer to join our hardware group and contribute to the development and production of industrial automation systems.About the RoleDesign and develop mechanical systems and components for robotic applications.Collaborate with cross-functional teams to integrate mechanical...


  • Pittsburgh, Pennsylvania, United States SMS group Inc Full time

    Job OverviewSMS group Inc., the leading partner in the world of metals, is seeking a highly skilled Senior Electrical Systems Engineer to join their team.Salary: $120,000 - $180,000 per annum, depending on experience.Job DescriptionThe successful candidate will develop and implement automation solutions focused on drive and power technology for the metals...


  • Pittsburgh, Pennsylvania, United States Carnegie Robotics Full time

    Job OverviewCarnegie Robotics is a pioneering company in the field of robotics, partnering with industry leaders to provide customized robotic solutions. We're seeking an experienced Robotics Systems Engineer Leader to join our team.About the RoleThis leadership position involves overseeing a multi-disciplinary team to develop reliable robotic systems for...


  • Pittsburgh, Pennsylvania, United States SMS group Inc Full time

    Job DescriptionAt SMS group Inc., we are seeking a highly skilled Electrical Systems Design Engineer to join our team. In this role, you will be responsible for designing, specifying, installing, and troubleshooting electrical control systems for process equipment associated with steel and aluminum production.Key ResponsibilitiesPerform electrical...


  • Pittsburgh, Pennsylvania, United States Mine Vision Systems Full time

    Mine Vision Systems (MVS) is a cutting-edge technology company that provides innovative workflow-integrated perception and automation systems to improve speed, safety, and productivity in the mining industry.We are seeking a highly skilled Mechanical Engineer to join our team. As a key member of our engineering team, you will be responsible for designing and...


  • Pittsburgh, Pennsylvania, United States BNY Mellon Full time

    Mainframe Communication Engineer Job SummaryWe are seeking a skilled Mainframe Communication Engineer to join our Technology Services Group (TSG) - Mainframe Services team. This role will be responsible for supporting mainframe communications environment, VTAM, and TCP/IP, as well as working on the TCP/IP stack. The ideal candidate will have a strong...


  • Pittsburgh, Pennsylvania, United States The Maven Group, LLC Full time

    About the RoleWe are seeking an experienced Project Manager to lead a program and manage a team of engineers responsible for delivering advanced naval Guidance and Control systems for the US military. This is a world-class project that requires a strong background in Systems Engineering and a proven ability to manage complex technical projects.Key...


  • Pittsburgh, Pennsylvania, United States Acutronic USA Full time

    Job OverviewAcutronic USA Inc. is a leading developer of cutting-edge technologies in the aerospace, defense, and transportation industries.We are seeking an experienced Principal Mechanical Systems Engineer to join our team in Pittsburgh, PA.About the RoleThis key position will be responsible for designing complex electro-mechanical systems and components...


  • Pittsburgh, Pennsylvania, United States Aurora Innovation Full time

    About UsAurora Innovation is a leading technology company delivering the benefits of self-driving technology safely, quickly, and broadly. We're on a mission to make transportation safer, increasingly accessible, and more reliable and efficient than ever before.Job DescriptionWe are seeking a skilled Software Engineer to join our Vehicle Platforms team. As...


  • Pittsburgh, Pennsylvania, United States Howmet Aerospace Inc. Full time

    About the RoleHowmet Aerospace Inc. is seeking an experienced Windows Systems Engineer to join their Global Information Systems group in Pittsburgh, PA.


  • Pittsburgh, Pennsylvania, United States Wright Technical Services Full time

    Wright Technical Services: Leading the Electric Motor IndustryWe are seeking a seasoned Senior Electromechanical Engineer to spearhead design and optimization of projects related to our electromechanical systems.About the RoleThe ideal candidate will have a strong background in modeling and simulation, testing and validation best practices, and will be able...


  • Pittsburgh, Pennsylvania, United States Leidos Full time

    Job DescriptionA Distribution Engineer is needed for electric utility design engineering in the Pittsburgh, PA area.About the RoleThis role involves working directly with clients to ensure high-quality work and maintaining Leidos' reputation. As a valued team member, you can expect a fast-paced, diverse work environment and flexible work hours/work...