ETL SDET

1 day ago

Jersey City, NJ, United States Purple Drive Full time
Skills

SDET (MUST)

ETL (MUST)

Python

Pyspark

AWS S3

Strong SQL

We have an urgent ETL SDET requirement. Please share profiles with 10+ years of experience

Must-Have Skills:

  • ETL Testing, Python/PySpark - Coding Experience is Mandatory
  • AWS S3, Redshift
  • Complex SQL Quires - Wring Complex Query is Mandatory
Good to Have:
  • Kafka, Shell scripting, Healthcare domain
Note: Only ETL SDET profiles will be considered.

Position Summary:

The SDET (Software Development Engineer in Test) is responsible for ensuring the quality and reliability of ETL processes and data integration workflows.

This role involves designing and implementing automated tests to validate data transformation and migration,

as well as collaborating with data engineers and developers to identify and resolve data quality issues.

The ideal candidate will leverage their expertise in ETL testing and data validation to enhance the overall data pipeline performance and integrity.

Minimum Qualification:
  • At least 8 years of IT experience with minimum 5 years of experience in below skills:
  • Tech Skills
    • Proficiency in ETL Testing and developing automation framework & testcases in atleast one scripting language.
    • Strong SQL skills, with experience in handling big data using ETL tools (e.g., Informatica).
    • Testing experience in cloud environment (AWS s3)
    • Experience with Test Automation and DevOps practices in ETL and Cloud
    • Work experience in a Big Data ecosystem processing data in data Lakehouse.
    • Familiarity with DBT (Data Build Tool) or similar data transformation tools is a plus.
  • Experience providing testing oversight in Agile team.
  • Should have excellent business communication to interact with Business teams and cross-functional teams.
Responsibilities:
  • Review requirements, specifications, and technical design documents to understand and feedback.
  • Experience in developing and implementing test strategies for complex initiatives.
  • Estimate, prioritize, plan and coordinate testing activities.
  • Create automation test framework.
  • Design, develop and execute automation scripts.
  • Identify, record, document thoroughly and track bugs.
  • Strong problem-solving skills, troubleshooting, and root cause analysis skills.
  • Perform thorough regression testing when bugs are resolved.
  • Develop and apply testing processes for new and existing features to meet client needs.
  • Liaise with cross functional teams to identify system requirements.
  • Track quality assurance metrics, like defect densities and open defect counts.


Stay up to date with new testing tools

  • Senior Software Engineer in Test, Data

    5 days ago

    Kansas City, MO, United States DoiT International Full time

    Senior Software Engineer In Test, Data / Etl Our Senior Software Engineer In Test, Data / Etl will be an integral part of our Engineering team in EMEA. This full-time remote role is open to employees based in the UK, Ireland, Estonia, the Netherlands, Sweden, and Israel, and to contractors across other EMEA locations, including Eastern Europe and Portugal....

  • Lead Software Engineer in Test for Data and ETL

    5 days ago

    Kansas City, MO, United States DoiT International Full time

    Join our innovative Engineering team as a Lead Software Engineer in Test for Data and ETL. This remote position provides an exciting opportunity to contribute your expertise in validating and automating the quality of our data pipelines and ETL workflows. DoiT is a pioneering technology company dedicated to helping cloud-driven organizations harness the...

  • Lead Software Engineer in Test for Data and ETL

    1 week ago

    Kansas City, MO, United States DoiT International Full time

    Join our innovative Engineering team as a Lead Software Engineer in Test for Data and ETL. This remote position provides an exciting opportunity to contribute your expertise in validating and automating the quality of our data pipelines and ETL workflows. DoiT is a pioneering technology company dedicated to helping cloud-driven organizations harness the...

  • Lead Software Engineer in Test for Data and ETL

    5 days ago

    Kansas City, MO, United States DoiT International Full time

    Join our innovative Engineering team as a Lead Software Engineer in Test for Data and ETL. This remote position provides an exciting opportunity to contribute your expertise in validating and automating the quality of our data pipelines and ETL workflows. DoiT is a pioneering technology company dedicated to helping cloud-driven organizations harness the...