Data Migration Engineer

1 week ago

Dallas, United States Photon Full time

Role Overview:

We are seeking skilled engineers to lead the migration of IBM DataPower configurations and integrations (MQ connections and SOAP services) to a modern Spring Boot-based microservices architecture. The ideal candidate will have deep expertise in Spring Boot, the Spring ecosystem for microservices, cloud-native design principles, Kafka, and API development, ensuring seamless transitions and scalable, high-performance solutions.

Key Responsibilities:

  1. Migration Design and Planning
  2. Analyze existing IBM DataPower configurations, including XML firewall scripts, MQ configurations, and SOAP services.
  3. Design a migration strategy to transition DataPower-based solutions to Spring Boot microservices, ensuring feature parity and optimal performance.
  4. Collaborate with architects to design robust and scalable API and microservice solutions using the Spring framework.
  5. Microservice API Development
  6. Build RESTful APIs with Spring Boot to replace SOAP services, ensuring backward compatibility and efficiency.
  7. Leverage Spring WebFlux or Spring MVC for high-performance and scalable API design.
  8. Create secure APIs using Spring Security with OAuth2 and JWT for authentication and authorization.
  9. Cloud-Native Microservices Development
  10. Utilize Spring Cloud components (e.g., Eureka, Config Server, Circuit Breaker, and Gateway) to implement distributed system patterns for microservices.
  11. Develop fault-tolerant and resilient microservices with load balancing, service discovery, and centralized configuration.
  12. Design stateless microservices that integrate seamlessly with cloud platforms and support horizontal scalability.
  13. Kafka Integration and Event-Driven Architecture
  14. Implement event-driven microservices using Apache Kafka, ensuring reliable asynchronous communication and real-time data streaming.
  15. Develop and manage Kafka producers, consumers, and topics to enable seamless data flow between microservices.
  16. Optimize Kafka configurations for high throughput, low latency, and fault tolerance.
  17. Implementation and Development
  18. Rewrite DataPower scripts (XSLT, GatewayScript, and XML configurations) into equivalent Spring Boot microservices.
  19. Integrate microservices with MQ messaging systems for reliable data exchange and processing.
  20. Use the Spring ecosystem to manage messaging, API interactions, and distributed service orchestration.
  21. Testing and Validation
  22. Develop unit, integration, and performance tests for APIs and microservices using tools like JUnit, Mockito, and Postman.
  23. Validate API behavior and microservice performance against legacy DataPower implementations.
  24. Troubleshoot and resolve issues identified during testing and deployment.
  25. Collaboration and Documentation
  26. Collaborate with DevOps and operations teams to ensure seamless deployment of microservices into staging and production environments.
  27. Work closely with architects, business analysts, and QA teams to align deliverables with business objectives.
  28. Document technical designs, API specifications, Kafka integration guidelines, and migration processes.
  29. Optimization and Performance Tuning
  30. Optimize microservices and APIs for scalability, reliability, and cloud readiness.
  31. Apply caching, connection pooling, and performance tuning strategies using Spring Boot tools and techniques.
  32. Ensure security best practices are adhered to, including encrypting data in transit and at rest.
  33. Support and Troubleshooting
  34. Provide technical support for migrated services during and after the transition.
  35. Address and resolve issues related to API functionality, Kafka messaging, MQ integration, and service performance.

Key Qualifications:

  • Technical Expertise:
  • Hands-on experience with IBM DataPower, including XSLT, GatewayScript, and XML configurations.
  • Proficiency in Spring Boot and the broader Spring ecosystem, including Spring Cloud, Spring Security, and Spring Data.
  • Strong knowledge of RESTful API development and integration, including OpenAPI (Swagger) documentation.
  • Expertise in Kafka, including setting up producers, consumers, and real-time streaming in a distributed system.
  • Experience with MQ messaging systems (e.g., IBM MQ), including configuration and troubleshooting.
  • Additional Skills:
  • Proficiency in microservices design patterns such as service discovery, circuit breakers, and centralized logging.
  • Experience with CI/CD pipelines to support continuous integration and deployment of Spring-based applications.
  • Strong understanding of performance optimization and scaling for distributed systems.
  • Preferred Skills:
  • Knowledge of tools for monitoring and observability (e.g., Prometheus, Grafana, ELK stack).
  • Familiarity with database integration using Spring Data JPA, Hibernate, and RDBMS/NoSQL systems.
  • Experience in migrating legacy SOAP-based systems to RESTful, event-driven architectures.
  • Soft Skills:
  • Strong analytical and problem-solving skills.
  • Excellent communication and collaboration abilities.
  • Ability to work in cross-functional teams and adapt to changing priorities.

Education and Experience:

  • Bachelor's degree in Computer Science, Engineering, or a related field.

  • Data Migration Solutions Engineer

    7 days ago

    Dallas, Texas, United States Xlysi Full time

    Job OverviewXlysi is seeking a skilled Data Migration Solutions Engineer to join our team.About the RoleThe ideal candidate will have experience with data migration activities, including review of existing storage environments, remediation recommendations, and consideration of factors affecting data migration.ResponsibilitiesReview existing storage...

  • Photon | Data Migration Engineer | dallas, tx

    1 week ago

    dallas, United States Photon Full time

    Role Overview:We are seeking skilled engineers to lead the migration of IBM DataPower configurations and integrations (MQ connections and SOAP services) to a modern Spring Boot-based microservices architecture. The ideal candidate will have deep expertise in Spring Boot, the Spring ecosystem for microservices, cloud-native design principles, Kafka, and API...

  • SAP Data Migration Expert

    1 month ago

    Dallas, Texas, United States The Dignify Solutions LLC Full time

    SAP Data Migration ExpertWe are seeking a highly skilled SAP Data Migration Expert to join our team at The Dignify Solutions LLC. As a key member of our team, you will be responsible for leading the development and implementation of SAP data migration projects.Key Responsibilities:Develop and implement SAP data migration solutions using BODS and LTMCDesign...

  • SAP Data Migration Lead

    3 weeks ago

    Dallas, United States IBM Full time

    Introduction As a Package Consultant at IBM, get ready to tackle numerous mission-critical company directives. Our team takes on the challenge of designing, developing and re-engineering highly complex application components and integrating software packages using various tools. You will use a mix of consultative skills, business knowledge, and technical...

  • Meditech Systems Migration Specialist

    1 month ago

    Dallas, Texas, United States ClinDCast LLC Full time

    Job DescriptionRole: Meditech Data Migration SpecialistWork Mode: 100% RemoteDuration: 6+ MonthsWe are seeking a highly skilled Meditech Data Migration Specialist to join our team at ClinDCast LLC.Key ResponsibilitiesCollaborate with IT, data engineering, and clinical teams to gather requirements and ensure data accuracy and completeness during the migration...

  • Programmers & Data Migration Professionals

    6 months ago

    Dallas, United States MetaExperts™ Full time

    Please check your spam/junk email folder in the event any of our follow-on communication ends up there.MetaOps is seeking candidates in metro areas across the USA to be considered for roles with our growing nation-wide customer base that calls on us for interim and contract-to-hire resources having honed skills and deep experience in Programming, Data...

  • Data Engineer

    1 month ago

    Dallas, Texas, United States NTT DATA Full time

    Job SummaryNTT DATA Services is seeking a highly skilled Data Engineer to join our team in Dallas, Texas. As a Data Engineer, you will be responsible for designing, developing, and maintaining large-scale data systems to support our business operations.Key Responsibilities:Develop and maintain data pipelines to extract, transform, and load data from diverse...

  • Data Engineer

    5 months ago

    Dallas, United States NTT DATA Full time

    Job Description NTT DATA Services strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a Data Engineer (Onsite) to join our team in Dallas, Texas (US-TX), United States (US).Job Responsibilities...

  • Senior Data Systems Engineer

    1 month ago

    Dallas, Texas, United States Shtudy Full time

    Job Title: Senior Data Systems EngineerWe are seeking a highly skilled Senior Data Systems Engineer to join our dynamic team at Shtudy. This role requires a strong background in data engineering, cloud technologies, and quality assurance.Key Responsibilities:Automate ETL pipelines using Python to streamline data integration, transformation, and migration...

  • SAP Data Migration BODS Consultant- Dallas, TX

    6 months ago

    Dallas, United States The Dignify Solutions LLC Full time

    Minimum 10 years' experience with ECC and S4/HANA Data Migration technical development Expert SAP BODS development, administration skills Experience with IDOC & LSMW processing in SAP Experience with LTMC in S/4HANA Deploy SAP Rapid Data Migration Content on BODS Deploy BODS and implement security (Provide User Access etc.) BODS admin knowledge to...

  • Data Engineer

    2 weeks ago

    Dallas, United States Intracruit Solutions Full time

    Title: Cloud Data Engineer (AWS/Azure/GCP)Location: Dallas, TXDuration: 12 Months + Hybrid - 3 Days on Site Interview Mode: In-Person (No Exception)NOTE: W2 Candidates Preferred - C2C on case by case basis with (LinkedIn Refernce). Job Description: Extensive experience as Data Engineer with Python Language and Cloud Technologies (AWS preferably).Experience...

  • Data Engineer

    1 week ago

    dallas, United States Intracruit Solutions Full time

    Title: Cloud Data Engineer (AWS/Azure/GCP)Location: Dallas, TXDuration: 12 Months +Hybrid - 3 Days on SiteInterview Mode: In-Person (No Exception)NOTE: W2 Candidates Preferred - C2C on case by case basis with (LinkedIn Refernce).Job Description:Extensive experience as Data Engineer with Python Language and Cloud Technologies (AWS preferably).Experience in...

  • Data Engineer

    2 weeks ago

    dallas, United States Intracruit Solutions Full time

    Title: Cloud Data Engineer (AWS/Azure/GCP)Location: Dallas, TXDuration: 12 Months +Hybrid - 3 Days on SiteInterview Mode: In-Person (No Exception)NOTE: W2 Candidates Preferred - C2C on case by case basis with (LinkedIn Refernce).Job Description:Extensive experience as Data Engineer with Python Language and Cloud Technologies (AWS preferably).Experience in...

  • Lead Azure Data Engineer

    2 weeks ago

    dallas, United States InfoVision Inc. Full time

    Lead Azure Data Engineer (Hybrid - 3 days onsite in a week) Dallas, TexasLongterm Required SkillsSql: Synapse: ADF: EDW: Databricks: Python/Scala: Team handling: Large volumes of data :Migration projects from Legacy to Cloud :

  • Lead Azure Data Engineer

    2 weeks ago

    Dallas, United States InfoVision Inc. Full time

    Lead Azure Data Engineer (Hybrid - 3 days onsite in a week) Dallas, TexasLongterm Required SkillsSql: Synapse: ADF: EDW: Databricks: Python/Scala: Team handling: Large volumes of data :Migration projects from Legacy to Cloud :

  • Lead Azure Data Engineer

    2 weeks ago

    dallas, United States InfoVision Inc. Full time

    Lead Azure Data Engineer (Hybrid - 3 days onsite in a week) Dallas, TexasLongterm Required SkillsSql: Synapse: ADF: EDW: Databricks: Python/Scala: Team handling: Large volumes of data :Migration projects from Legacy to Cloud :

  • Data Engineer

    6 days ago

    Dallas, United States PDS Tech Commercial Full time

    Job DescriptionJob DescriptionJob Title: Data Engineer - Advanced Analytics Team (Wholesale Organization)PDS Tech Commercial, Inc. is seeking an experienced Data Engineer to join our Advanced Analytics team under the Wholesale organization. This role will focus on designing and building ETL pipelines to migrate data from SQL Server to Databricks, optimizing...

  • Lead Data Engineer

    1 month ago

    Dallas, United States Glocomms Full time

    **Lead Data Engineer**Location: Dallas, TX (On-Site)Base Comp: 140-165KRole cannot Provide SponsorshipAre you a passionate Lead Data Engineer seeking an exciting new challenge? We're looking for someone with strong coding abilities and substantial experience to join our dynamic team based in the heart of Dallas. This is not just another job; it's a chance to...

  • Lead Data Engineer

    1 month ago

    dallas, United States Glocomms Full time

    **Lead Data Engineer**Location: Dallas, TX (On-Site)Base Comp: 140-165KRole cannot Provide SponsorshipAre you a passionate Lead Data Engineer seeking an exciting new challenge? We're looking for someone with strong coding abilities and substantial experience to join our dynamic team based in the heart of Dallas. This is not just another job; it's a chance to...

  • Lead Data Engineer

    1 month ago

    dallas, United States Glocomms Full time

    **Lead Data Engineer**Location: Dallas, TX (On-Site)Base Comp: 140-165KRole cannot Provide SponsorshipAre you a passionate Lead Data Engineer seeking an exciting new challenge? We're looking for someone with strong coding abilities and substantial experience to join our dynamic team based in the heart of Dallas. This is not just another job; it's a chance to...