Senior Backend Java Kafka Developer

2 weeks ago

Chicago, United States New York Technology Partners Full time

Overview:

A Senior Backend Java Kafka Developer is required to review and reverse engineer existing Java code, map data flows across multiple environments, and develop metadata and data lineage solutions. This role involves collaboration with technical teams to analyze applications, understand system design, and create data flow mappings across various data sources. The candidate will also work on metadata extraction automation and data lineage for both on-premises and cloud environments.


Key Responsibilities:


Code Review and Reverse Engineering:

Analyze and reverse engineer existing Java code to create source-to-target mapping for multiple data flows.

Map and document data flows from disparate data sources such as Kafka, Protocol Buffers, Redis, APIs, Flat Files, Databases, etc.

Ensure data flow and lineage documentation align with business requirements and data governance standards.


Metadata and Data Lineage Solutions:

Develop metadata solutions and data lineage documentation for on-premise and cloud systems.

Automate metadata extraction using custom connectors and programming tools to simplify lineage tracking across data sources.

Work with technical SMEs and developers to create detailed data flow diagrams and technical documentation for complex systems.


Custom Metadata Development:

Develop and implement programs that automate the extraction of metadata and creation of data lineage documents for various data platforms.

Use tools such as Python, PySpark, and Java to build solutions that automate and integrate metadata from different systems.


Data Quality & Governance:

Implement data quality solutions across data sources (Kafka, APIs, flat files, JSON, databases) to ensure adherence to governance standards.

Maintain data catalogs and data dictionaries and ensure compliance with data governance policies.


Documentation & Diagrams:

Create detailed technical documentation for Java-based applications that process data in real-time and batch.

Use tools like draw.io to create architecture and data flow diagrams for multiple systems.


Collaboration & Project Execution:

Collaborate with technical SMEs to understand applications and systems, enabling effective reverse engineering.

Support the administration and ingestion of metadata management assets through custom extensions and connectors.

Multitask across multiple projects, ensuring adherence to deadlines and providing updates to stakeholders.


Required Skills and Experience:

6+ years of data analysis experience focusing on metadata, data flows, and mappings.

Proficient in Java, especially Java 8 onwards, with hands-on experience in Spring, Spring Boot, microservices, and REST APIs.

Experience working with Kafka streams, protocol buffers, and APIs as data sources.

Strong SQL knowledge and proficiency in programming with Python or PySpark for data analysis.

Hands-on experience with a variety of databases (relational, NoSQL, object-based) and familiarity with Git for version control.

Proven experience with data lineage and metadata management across on-premise and cloud platforms.

Ability to understand Java codebases and reverse engineer data mappings and flows.

Experience working with draw.io or similar tools to create architecture or data flow diagrams.

Excellent skills in technical documentation, writing, and maintaining documentation for complex, real-time data systems.


Preferred Skills:

Experience working with Kafka and Protobuf as data sources.

Familiarity with data governance tools and solutions.

Knowledge of object-oriented design and software design patterns.

Ability to design and develop data quality solutions for multiple data environments.

  • Senior Backend Java Developer

    2 weeks ago

    Chicago, Illinois, United States New York Technology Partners Full time

    Job Title: Senior Backend Java Kafka DeveloperWe are seeking a highly skilled Senior Backend Java Kafka Developer to join our team at New York Technology Partners. As a key member of our team, you will be responsible for reviewing and reverse engineering existing Java code, mapping data flows across multiple environments, and developing metadata and data...

  • Senior Java Full Stack Developer

    3 weeks ago

    Chicago, United States Request Technology Full time

    NO SPONSORSHIPSenior Full Stack Java Developer from a regulated firmThey want stable fulltime candidates, no consultants.7-10 years experience SALARY: $140k - $150k plus 15% bonus LOCATION: CHICAGO, ILNo sponsorship hybrid 3 days in office and 2 days remote SELLING POINTS: 5 plus years strong backend java development, java 11 golang, kafka regulated...

  • Senior Java Full Stack Developer

    1 month ago

    Chicago, United States Request Technology, LLC Full time

    NO SPONSORSHIPSenior Full Stack Java Developer from a regulated firmThey want stable fulltime candidates, no consultants.7-10 years experience SALARY: $140k - $150k plus 15% bonus LOCATION: CHICAGO, ILNo sponsorship hybrid 3 days in office and 2 days remote SELLING POINTS: 5 plus years strong backend java development, java 11 golang, kafka regulated...

  • Senior Java Full Stack Developer

    3 weeks ago

    chicago, United States Request Technology Full time

    NO SPONSORSHIPSenior Full Stack Java Developer from a regulated firmThey want stable fulltime candidates, no consultants.7-10 years experience SALARY: $140k - $150k plus 15% bonus LOCATION: CHICAGO, ILNo sponsorship hybrid 3 days in office and 2 days remote SELLING POINTS: 5 plus years strong backend java development, java 11 golang, kafka regulated...

  • Senior Backend Java Developer

    4 weeks ago

    Chicago, Illinois, United States Request Technology, LLC Full time

    Job SummaryRequest Technology, LLC is seeking an experienced Senior Backend Java Developer to join our team. As a key member of our engineering team, you will be responsible for designing and developing high-performance, scalable, and secure software solutions using Java 11 and other relevant technologies.Key ResponsibilitiesDesign and Development:...

  • Senior Backend Java Developer

    4 weeks ago

    Chicago, Illinois, United States Request Technology, LLC Full time

    About the RoleWe are seeking a highly skilled Associate Principal, Backend Java Developer to join our team at Request Technology, LLC. As a key member of our engineering team, you will be responsible for designing and developing next-generation clearing applications using Java 11, Kafka, and Golang.Key ResponsibilitiesParticipate in the design of...

  • Java Developer/Kafka

    4 weeks ago

    Chicago, United States Motion Recruitment Full time

    Looking for a rewarding challenge? Join a global leader in risk mitigation solutions and contribute to building innovative, scalable software that secures online transactions worldwide. As a Senior Java Developer, you’ll collaborate with business stakeholders and development teams to create advanced security products using Java and Spring Boot. In this...

  • Associate Principal, Backend Java Developer

    1 month ago

    Chicago, United States Request Technology, LLC Full time

    ***Hybrid, 3 days onsite, 2 days remote******We are unable to sponsor as this is a permanent full-time role******NO CONTRACTORS OR CONSULTANTS***A prestigious company is looking for an Associate Principal, Backend Java Developer. This company needs someone with 7-10 years of experience focused on backend java development, Java 11, Kafka, Golang,...

  • Associate Principal, Backend Java Developer

    3 weeks ago

    chicago, United States Request Technology, LLC Full time

    ***Hybrid, 3 days onsite, 2 days remote******We are unable to sponsor as this is a permanent full-time role******NO CONTRACTORS OR CONSULTANTS***A prestigious company is looking for an Associate Principal, Backend Java Developer. This company needs someone with 7-10 years of experience focused on backend java development, Java 11, Kafka, Golang,...

  • Associate Principal, Backend Java Developer

    1 month ago

    Chicago, United States Request Technology, LLC Full time

    ***Hybrid, 3 days onsite, 2 days remote******We are unable to sponsor as this is a permanent full-time role******NO CONTRACTORS OR CONSULTANTS***A prestigious company is looking for an Associate Principal, Backend Java Developer. This company needs someone with 7-10 years of experience focused on backend java development, Java 11, Kafka, Golang,...

  • Java Kafka Developer

    2 weeks ago

    Chicago, United States New York Technology Partners Full time

    Role : Java Kafka Developer Duration : Fulltime Location : Chicago IL Hybrid Job Details:WORK TO BE PERFORMED: Develop Metadata and Data Lineage Solutions for multiple data sources across On Prem and Cloud environments including but not limited to Kafka, Protocol Buffers, REDIS, APIs, Databases, Flat Files, JSON, ETL/BI Tools and other Data Platform...

  • Java Kafka Developer

    2 weeks ago

    chicago, United States New York Technology Partners Full time

    Role : Java Kafka Developer Duration : Fulltime Location : Chicago IL Hybrid Job Details:WORK TO BE PERFORMED: Develop Metadata and Data Lineage Solutions for multiple data sources across On Prem and Cloud environments including but not limited to Kafka, Protocol Buffers, REDIS, APIs, Databases, Flat Files, JSON, ETL/BI Tools and other Data Platform...

  • Senior Java Developer

    4 weeks ago

    Chicago, Illinois, United States New York Technology Partners Full time

    About the RoleWe are seeking a highly skilled Senior Java Developer to join our team at New York Technology Partners. As a Principal Software Engineer, you will be responsible for designing and implementing a robust automation testing framework, hardening the framework, and building out web services and large data set processing.Key Responsibilities:Design...

  • Java Backend Developer

    2 weeks ago

    Chicago, Illinois, United States Spruce Infotech Full time

    Java Backend DeveloperWe are seeking a skilled Java Backend Developer to join our team at Spruce Infotech. The ideal candidate will have hands-on experience with Java, Spring Boot, and microservices architecture.Key Responsibilities:Design and develop scalable applications using Java and Spring BootWork with RESTful APIs, frontend technologies like...

  • Backend Java Developer

    3 weeks ago

    Chicago, Illinois, United States Saxon Global Full time

    Key ResponsibilitiesDevelop and execute JUnit or TestNG tests to ensure high-quality codeDesign and implement API testing strategies for Rest and Soap APIsUtilize Java, XML, JS, CSS, and HTML to build robust backend systemsCollaborate with the team to implement Jenkins and Azure infrastructureDrive the development of SR Level SDET skills and expertiseFocus...

  • Senior Java Microservices Developer

    4 months ago

    Chicago, United States NextRow Full time

    Job Description NextRow is looking to hire a contractor for 12+months project. POSITION RESPONSIBILITIES: The candidate will be part of a development team working with architects and domain experts to design and build Spring Boot microservices based on a common domain model that connects legacy data sources with Apache Kafka EXPERIENCE AND QUALIFICATIONS:...

  • Java Backend Developer

    3 weeks ago

    Chicago, Illinois, United States Mindlance Full time

    Job Title: Java Backend DeveloperLocation: Chicago, IL (Hybrid – 3 Days onsite)Duration: 3+ Months of ContractWe are seeking an experienced Java Backend Developer to join our team at Mindlance. The ideal candidate will have a strong background in Java, Python, and database (SQL) with experience in AWS.Key Responsibilities:Design, develop, and deploy...

  • Senior Java Developer

    1 month ago

    Chicago, Illinois, United States NextRow Full time

    Job OpportunityNextRow is seeking a skilled contractor for a long-term project.Position Responsibilities:The selected candidate will be part of a development team working closely with architects and domain experts to design and build Spring Boot microservices based on a common domain model that connects legacy data sources with Apache Kafka.The team will...

  • Senior Java Developer

    4 weeks ago

    Chicago, Illinois, United States NextRow Full time

    Job OpportunityNextRow is seeking a skilled contractor for a 12+ month project.Position Responsibilities:The candidate will be part of a development team working with architects and domain experts to design and build Spring Boot microservices based on a common domain model that connects legacy data sources with Apache Kafka.The team will collaborate to...

  • Sr. Java Kafka Developer

    2 weeks ago

    Chicago, United States New York Technology Partners Full time

    Job Title: Sr. Java Kafka Developer Location: Chicago, IL (Hybrid)Position Type: Fulltime / ContractJob Description:This role is part of the Renaissance project and the person engaged will architect, design and build streaming solution(s) as part of a Risk Based set of systems. We need a major contributor in the development of scalable resilient hybrid...