Data Quality Engineer

4 weeks ago


United, United States CyberTec Full time
Job Title:
Data Quality Engineer

Job Summary:
CyberTec is seeking an experienced Data Quality Engineer to join our Data and Analytics organization. As a key member of our team, you will play a crucial role in building and delivering best-in-class data and analytics solutions aimed at creating value and impact for the organization.

Responsibilities:
Architect, build, and maintain scalable and reliable data pipelines including robust data quality as part of data pipeline which can be consumed by analytics and BI layer.
Design, develop and implement low-latency, high-availability, and performant data applications and recommend & implement innovative engineering solutions.
Design, develop, test and debug code in Python, SQL, PySpark, bash scripting as per company standards.
Design and implement data quality framework and apply it to critical data pipelines to make the data layer robust and trustworthy for downstream consumers.
Design and develop orchestration layer for data pipelines which are written in SQL, Python and PySpark.
Apply and provide guidance on software engineering techniques like design patterns, code refactoring, framework design, code reusability, code versioning, performance optimization, and continuous build and Integration (CI/CD) to make the data analytics team robust and efficient.
Performing all job functions consistent with company policies and procedures, including those which govern handling PHI and PII.
Develop relationships with business team members by being proactive, displaying an increasing understanding of the business processes and by recommending innovative solutions.
Communicate project output in terms of customer value, business objectives, and product opportunity.

Requirements:
5+ years of experience with Bachelors / Master's degree in computer science, Engineering, Applied mathematics or related field.
Extensive hands-on development experience in Python, SQL and Bash, pytest.
Extensive Experience in performance optimization of data pipelines.
Extensive hands-on experience working with cloud data warehouse and data lake platforms like Databricks, Redshift or Snowflake.
Familiarity with building and deploying scalable data pipelines to develop and deploy Data Solutions using Python, SQL, PySpark.
Extensive experience in all stages of software development and expertise in applying software engineering best practices.
Experience in developing and implementing Data Quality framework either home grown or using any open-source frameworks like Great Expectations, Soda, Deequ.
Extensive experience in developing end-to-end orchestration layer for data pipelines using frameworks like Apache Airflow, Prefect, Databricks Workflow.
Familiar with RESTful Webservices (REST APIs) to be able to integrate with other services.
Familiarity with API Gateways like APIGEE to secure webservice endpoints.
Familiarity with concurrency and parallelism.
Familiarity with Data pipelines and Client development cycle.

  • Oakland, CA, United States Blue Shield of California Full time

    Your Role The Data Services Quality Engineering team is part of the BSC Data & Analytics Organization. We provide testing services for Data & Analytics projects. The data is sourced from various internal and external applications and loaded to the consumption layer. The Quality Engineer, Senior, will report to the IT Manager. In this role you will be working...


  • Oakland, CA, United States Blue Shield of California Full time

    Your Role The Data Services Quality Engineering team is part of the BSC Data & Analytics Organization. We provide testing services for Data & Analytics projects. The data is sourced from various internal and external applications and loaded to the consumption layer. The Quality Engineer, Senior, will report to the IT Manager. In this role you will be working...


  • Oakland, CA, United States Blue Shield of California Full time

    Your Role The Data Services Quality Engineering team is part of the BSC Data & Analytics Organization. We provide testing services for Data & Analytics projects. The data is sourced from various internal and external applications and loaded to the consumption layer. The Quality Engineer, Senior, will report to the IT Manager. In this role you will be working...


  • United, United States First Quality Full time

    Cloud Solution Architect - Data & Analytics First Quality was founded in 1989 and has grown to be a global privately held company with over 4,000 employees. Its corporate offices are located in Great Neck, New York, with manufacturing facilities and offices in Pennsylvania, South Carolina, Georgia, and Canada. First Quality is a diversified family of...


  • Boston, MA, United States NTT DATA, Inc. Full time

    Location - US/BostonJob Duties: Create and maintain optimal data pipeline architecture, Assemble large, complex data sets that meet functional / non-functional business requirements. Identify, design, and implement system internal process improvements: automating manual processes, optimizing data delivery, re-designing infrastructure for greater scalability,...


  • Boulder, CO, United States US Tech Solutions Full time

    Duration: 5 Months Contract Job Description: We are seeking a skilled Data Quality/Data Science Engineer to join our dynamic team. The ideal candidate will be responsible for ensuring the integrity, accuracy, and reliability of data used across various projects. This role combines data engineering, quality assurance, and data science principles to enhance...

  • Data Analyst

    3 weeks ago


    Herndon, VA, United States Numero Data Full time

    Required Skills:Ideal candidate should have a degree in a quantitative field (e.g., mathematics, computer science, physics, economics, engineering, statistics, operations research, quantitative social science, etc.).Basic Knowledge on software development principles and architecture.Good analytical and problem-solving abilities.Ability to break down and...

  • Data Scientist

    2 weeks ago


    Herndon, VA, United States Numero Data Full time

    Strictly on W2Required Skills:Ideal candidate should have a degree in a quantitative field (e.g., mathematics, computer science, physics, economics, engineering, statistics, operations research, quantitative social science, etc.).Basic Knowledge on software development principles and architecture.Good analytical and problem-solving abilities.Ability to break...


  • Warren, NJ, United States Saransh Inc Full time

    Role: Collibra Data Governance and Collibra Data Quality Principal EngineerLocation: Warren, NJ (Hybrid - 3 days a week onsite is must)Job Type: ContractJob Description:Configuring and managing Collibra Data Intelligence Platform and Collibra Data Quality platforms.Consultant must have technical expertise in metadata management, data lineage and data...


  • Charlotte, NC, United States Progilisys Solutions, A Talent Groups Company Full time

    Hybrid Remote (3 Days in Office in Charlotte, North Carolina)Contract to HireMust be eligible to work in the U.S. without sponsorship.Stack Ranked Experience (Must Have):ETL TestingAzure Data Analytics (Data Warehouse, Power BIAzure Data Factory, Databricks, PythonAgile MethodologyManagerial Experience of a Small QA TeamPosition Summary:The Data Quality...


  • Edison, NJ, United States BRUNS-PAK Data Center Solutions Full time

    Job Title: Senior Electrical or Mechanical Engineer (Contract) - Data Center FacilitiesJob Type: Contract. On-Site in Edison, NJ.Company Overview:BRUNS-PAK helps clients strategize, implement, and provision innovative, resilient solutions for mission-critical data center infrastructure. In an always-on world flooded by data and demanding information...

  • Data Engineer

    3 weeks ago


    Manchester, NH, United States Atmospheric G2 Full time

    Company Overview:For over twenty years, Atmospheric G2 has provided our customers market-leading weather intelligence software that enables them to confidently assess the impacts of weather on their markets. Our flagship product is up on monitors throughout the trading day across most trade floors in North America and Europe. AG2 forecasts have been proven,...

  • Data Engineer

    3 weeks ago


    Portland, OR, United States Aquent Full time

    As a Data Engineer, you will work closely with business and technical teams to adapt and transform business requirements into effective data management solutions. You will leverage cutting-edge technologies such as Databricks, AWS EMR, Spark, Snowflake, and DBSQL to design, optimize, and implement data models and solutions that drive business value. Key...


  • Wilmington, NC, United States Quality Chemical Laboratories Full time

    Quality Chemical Laboratories (QCL), a leading Pharmaceutical testing and manufacturing laboratory in Wilmington, is seeking a qualified candidate for the position of Manufacturing Quality Assurance Associate. This position, in the Manufacturing Quality Assurance department, requires a Bachelor s degree or higher in a scientific or engineering discipline...

  • Data Engineer

    3 weeks ago


    Washington, DC, United States Addison Group Full time

    We are focused on leveraging technology to drive data insights and innovation. We are seeking a skilled Data Engineer with experience in Google Cloud Platform (GCP), SQL, and ETL processes to join our growing data team. This role offers the opportunity to work on cutting-edge cloud-based solutions, build scalable data pipelines, and contribute to impactful...

  • Data Engineer

    3 weeks ago


    Salem, OR, United States Net2Source Inc. Full time

    Job Title: Data Engineer Location: Salem, ORDuration: 12 Months Job Description: Establishes database management systems, standards, guidelines and quality assurance for database deliverables, such as conceptual design, logical database, capacity planning, external data interface specification, data loading plan, data maintenance plan and security...

  • Data Engineer

    3 weeks ago


    Raleigh, NC, United States InterEx Group Full time

    Job SummaryWe are seeking a skilled and motivated Data Engineer to join a Specialty Insurance Firm. In this role, you will be responsible for building, maintaining, and optimizing the data infrastructure and pipelines to support advanced analytics, risk modeling, and data-driven decision-makingKey ResponsibilitiesData Pipeline Development: Design, build, and...

  • Data Engineer

    3 weeks ago


    Conshohocken, PA, United States Core BTS Full time

    Title: Data Engineer – (Subcontract at a Core BTS Client)Through Core BTS Resource Management Services (RMS), we offer custom talent solutions to help our clients meet their evolving technology and business needs. We help effectively match the right technology professional to their organization, recruiting for contract, contract-to-hire, and direct roles....


  • Plano, TX, United States NTT DATA Full time

    Req ID: 298697 NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a AI: Data Analytics Consulting, Director to join our team in Plano, Texas (US-TX), United States (US).As an Gen AI...


  • Chicago, IL, United States NTT DATA Full time

    Req ID: 298695 NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a AI: Data Analytics Consulting, Director to join our team in Plano, Texas (US-TX), United States (US).As an Gen AI...