Kafka Confluent Lead

2 days ago


Chicago, Illinois, United States Northern Trust Full time
About Northern Trust

Northern Trust is a globally recognized, award-winning financial institution with a rich history dating back to 1889. As a Fortune 500 company, we provide innovative financial services and guidance to the world's most successful individuals, families, and institutions.

We pride ourselves on our enduring principles of service, expertise, and integrity, which have enabled us to build long-lasting relationships with our clients and partners.

Role

Lead, Infra Middleware - Kafka Confluent

Main Duties

Northern Trust Enterprise Middleware Service team is seeking an experienced and highly skilled Lead Confluent Kafka Administrator to join our team on a full-time basis.

The ideal candidate will lead the Kafka infrastructure, designing, implementing, and administering Kafka clusters to ensure performance, scalability, and security.

Responsibilities
  1. Design and deploy Kafka clusters to ensure scalability and high availability.
  2. Manage Kafka configurations and enforce best practices for optimal performance.
  3. Establish monitoring solutions to track Kafka cluster health and optimize resource usage.
  4. Implement and manage security measures, including authentication and authorization.
  5. Develop and maintain backup and recovery procedures for Kafka data.
  6. Perform capacity planning to anticipate and address future resource requirements.
  7. Lead the response to incidents, troubleshoot issues, and coordinate with relevant teams.
  8. Implement automation scripts for routine tasks to enhance operational efficiency.
  9. Maintain comprehensive documentation for Kafka configurations, procedures, and best practices.
  10. Collaborate with cross-functional teams, providing updates and aligning Kafka administration with organizational goals.
  11. Train and mentor team members on Kafka administration tasks.
  12. Plan and execute Kafka version upgrades and patch management with zero disruption.
  13. Automate platform to highest level as no-touch to servers.
  14. Implement end-to-end monitoring solutions for Kafka cluster using any vended or open-source components.
  15. Research and develop new features to the existing infrastructure as per industry standards.
Qualifications

The ideal candidate will have:

  • 3+ years of extensive experience as a Kafka Administrator, with a strong focus on Confluent Platform.
  • Proven experience as a Kafka Engineer with a focus on leading Kafka initiatives.
  • Deep understanding of Kafka ecosystem, Kafka architecture, configuration, and best practices.
  • Experience in designing and implementing Kafka clusters in both on-premise and Confluent Cloud.
  • Proven experience leading complex Kafka implementations, including capacity planning and management.
  • Strong knowledge of security protocols, access control, and data encryption within Kafka.
  • Proficiency in monitoring tools and performance tuning of Kafka clusters.
  • Scripting skills (e.g., Shell, Python) for automation of administrative tasks.
  • Automating the Kafka platform to allow application teams to leverage their artifacts using CI/CD or Self-service capabilities.
  • Excellent problem-solving and troubleshooting skills.
  • Excellent communication and collaboration skills, with the ability to lead technical discussions effectively.
  • Bachelor's degree in Computer Science or a related field.
Skills Sets

The following are required skills:

  • Extensive experience with Confluent Kafka admin and development.
  • Expert knowledge of scripting (Python, Java, etc.).
  • Knowledge/experience with GIT and CI/CD.
  • Familiarity with REST APIs.
  • Experience with Confluent Cloud a+.
  • Experience with other middleware or streaming platforms a +.
  • Experience with Docker, PCF, or other container platforms a +.
Working with Us

As a Northern Trust partner, you will be part of a flexible and collaborative work culture in an organization where financial strength and stability is an asset that emboldens us to explore new ideas.

Movement within the organization is encouraged, senior leaders are accessible, and you can take pride in working for a company committed to assisting the communities we serve.

We'd love to learn more about how your interests and experience could be a fit with one of the world's most admired and sustainable companies.

Build your career with us and apply today.



  • Chicago, Illinois, United States Northern Trust Full time

    About Northern TrustNorthern Trust is a globally recognized financial institution with a rich history dating back to 1889. As a Fortune 500 company, we pride ourselves on providing innovative financial services and guidance to the world's most successful individuals, families, and institutions.Role OverviewWe are seeking an experienced and highly skilled...


  • Chicago, Illinois, United States Northern Trust Full time

    About Northern TrustNorthern Trust is a globally recognized financial institution with a rich history dating back to 1889. As a Fortune 500 company, we provide innovative financial services and guidance to the world's most successful individuals, families, and institutions. Our commitment to service, expertise, and integrity has earned us a reputation as a...


  • Chicago, Illinois, United States CoolSnail Full time

    Job DescriptionJob Title: Confluent Kafka Solutions ArchitectLocation: RemoteDuration: 9+ MonthsAbout the Role:We are seeking a highly skilled Confluent Kafka Solutions Architect to join our team at CoolSnail. As a key member of our engineering team, you will be responsible for designing, implementing, and maintaining our Confluent Kafka messaging...

  • Kafka Architect

    2 weeks ago


    Chicago, Illinois, United States Diverse Lynx Full time

    Senior Confluent Kafka Developer/ArchitectAt Diverse Lynx LLC, we are seeking a highly experienced Senior Confluent Kafka Developer/Architect to join our team. As a key member of our engineering team, you will be responsible for designing, implementing, and operating a scalable and reliable streaming platform based on Confluent Kafka.Key...


  • Chicago, Illinois, United States United Software Group Inc Full time

    Position: Senior Kafka Platform EngineerLocation: RemoteEmployment Type: Full-TimeRole Overview:The Senior Kafka Platform Engineer will be responsible for the design, deployment, and management of Kafka clusters and Confluent Platform environments.Key Responsibilities:Architect and maintain Kafka producers and consumers to facilitate real-time data ingestion...


  • Chicago, Illinois, United States United Software Group Inc Full time

    Position: Senior Kafka Platform EngineerLocation: RemoteEmployment Type: Full-TimeRole Overview:The Senior Kafka Platform Engineer will be responsible for the architecture, deployment, and management of Kafka clusters and Confluent Platform environments.Key Responsibilities:Design and implement robust Kafka infrastructures to support real-time data...


  • Chicago, Illinois, United States Talent Groups Full time

    Role OverviewAs a Senior Kafka Platform Engineer, you will be instrumental in shaping the data streaming capabilities of our organization. Your expertise will guide the deployment and management of Kafka clusters, ensuring they operate at peak efficiency.Key ResponsibilitiesDesign and Management: Architect, deploy, and oversee Kafka clusters along with...


  • Chicago, Illinois, United States Confluent Full time

    Position at Confluent Inc Confluent is at the forefront of a revolutionary category of data infrastructure centered around data in motion. Have you ever enjoyed a new series on a streaming platform, picked up groceries with ease, or made a seamless payment? This illustrates the power of data in motion—providing organizations with immediate access to the...


  • Chicago, Illinois, United States Northern Trust Full time

    About Northern TrustNorthern Trust is a leading global financial institution with a rich history dating back to 1889. As a Fortune 500 company, we have established ourselves as a trusted provider of innovative financial services and guidance to the world's most successful individuals, families, and institutions.Role: Lead, Infra Middleware - Kafka...


  • Chicago, Illinois, United States Confluent, Inc Full time

    About the Role:We are seeking an experienced Enterprise Account Executive to join our Confluent Sales Team. As a key member of our team, you will be responsible for selling Confluent solutions to our National Accounts segment.Key Responsibilities:Drive revenue growth in our large, complex, and highly visible accountsProactively prospect, identify, qualify,...


  • Chicago, Illinois, United States Confluent, Inc Full time

    About the RoleWe are seeking a highly skilled Enterprise Account Executive to join our Confluent Sales Team. As a key member of our team, you will be responsible for selling Confluent solutions to our National Accounts segment.Key ResponsibilitiesDrive revenue growth in our large, complex, and highly visible accountsProactively prospect, identify, qualify,...


  • Chicago, Illinois, United States Confluent, Inc Full time

    About the Role:As a member of the Confluent Sales Team, the Enterprise Account Executive is responsible for driving revenue growth in our large, complex, and highly visible accounts. This involves proactively prospecting, identifying, qualifying, developing, and closing a sales pipeline while continuing to grow consumption in current customer accounts.Key...


  • Chicago, Illinois, United States Request Technology, LLC Full time

    Principal, Infrastructure (Network, Storage, Database) Architecture - Kafka PlatformThis role focuses on the redesign and development of Kafka platforms and Flink.The ideal candidate must possess strong expertise in Kafka and Flink, along with a solid understanding of Kubernetes, containerization, and DevOps practices.COMPENSATION: $200k - $215K with a 30%...


  • Chicago, Illinois, United States The Options Clearing Corporation Full time

    About The Options Clearing CorporationThe Options Clearing Corporation (OCC) stands as the premier clearing entity for equity derivatives globally. Established in 1973, OCC is committed to fostering market stability and integrity by providing comprehensive clearing and settlement services for options, futures, and securities lending transactions. As a...

  • Senior Java Developer

    2 weeks ago


    Chicago, Illinois, United States New York Technology Partners Full time

    About the RoleWe are seeking a highly skilled Senior Java Developer to join our team at New York Technology Partners. As a Principal Software Engineer, you will be responsible for designing and implementing a robust automation testing framework, hardening the framework, and building out web services and large data set processing.Key Responsibilities:Design...

  • Java FSD Lead

    1 day ago


    West Chicago, Illinois, United States Saransh Inc Full time

    Job Title: Java FSD LeadSaransh Inc is seeking a seasoned Java Lead with experience in Full Stack development, specializing in Java, Spring Boot, Microservices, and Event-driven architectures. The ideal candidate will have strong communication skills and experience in leading and coordinating with offshore teams.Key Responsibilities:Design, develop, test,...

  • Java FSD Lead

    4 days ago


    West Chicago, Illinois, United States Saransh Inc Full time

    Job Title: Java FSD LeadSaransh Inc is seeking a seasoned Java Lead with experience in Full Stack development, specializing in Java, Spring Boot, Microservices, and Event-driven architectures.Key Responsibilities:Design, develop, test, and deploy microservices-based applications using Java, Spring Boot, React JS, Kafka, and other relevant...


  • Chicago, Illinois, United States New Relic Full time

    About the RoleWe are seeking a highly skilled Cloud Platform Product Manager to join our team at New Relic. As a key member of our Cloud Platform PM team, you will play a crucial part in building an innovative cloud platform designed to scale from '0 to 100' within minutes.Key ResponsibilitiesDrive the vision and strategy for the Cloud Platform evolution,...


  • Chicago, Illinois, United States Nagarro Full time

    Job SummaryWe are seeking a Senior Cloud Architect to lead the design and development of large-scale, high-performance applications. The ideal candidate will have expertise in AWS and a strong understanding of customer requirements.Key ResponsibilitiesUnderstand customer requirements and create architectural models that operate at scale and high...

  • Lead Data Engineer

    7 days ago


    Chicago, Illinois, United States Motion Recruitment Full time

    Lead Data EngineerWe are seeking a highly skilled Lead Data Engineer to join our team at Motion Recruitment. As a key member of our data engineering team, you will be responsible for designing, developing, and maintaining large-scale data pipelines using AWS services.Key Responsibilities:Design and implement data pipelines using AWS services such as Lambda,...