Data engineer

6 months ago

Irving, United States CyberTec Full time

Client: Client, project implemented for Sonepar (Reminder- Do not post client info online)
Data Engineer
US Citizen ONLY
Rate options: $75/hr w2 + benefits + $7/hr referral fee to you OR $ 8 0/hr c2c AIC
Expected Start Date ASAP
End Date (if applicable): 12/31/24
Location: Irving, on-site 3x per week - locals to DFW only at this time.
Interview Process: 2 video interviews, 1 on-site

Data Engineer: Implementation Consultant
Summary
Client is currently onboarding North America based OPCO' s (Operating companies) to their new digital platform (Spark) which is built on Kubernetes running in AZURE, the customer and associate experience (CX/AX) on their new SPARK platform in EMEA. They are planning to migrate North American operating companies (OPCOs) to the platform, beginning in 2024.
With this integration work the engineer will be responsible for designing, configuring, and implementing data validation tools which will validate the data transferred between. You will ensure best practices are followed through the implementation lifecycle and help construct data sets for use by the team and other business stakeholders to power both reporting and validation.

Job responsibilities

  • Highly skilled and motivated Data Engineer
  • As a Data Engineer, you will be responsible for validating the data between two systems, ensuring accuracy and consistency.
  • Implement data quality checks and monitoring processes.
  • Design and Develop data entity validation scripts using python.
  • Validate and reconcile data between two systems, ensuring accuracy and consistency.
  • Collaborate with cross-functional teams to identify and resolve data discrepancies and issues.
  • Develop and implement data quality checks and monitoring processes to ensure data integrity.
  • Design and maintain data pipelines and ETL processes to extract, transform, and load data from various sources.
  • Optimize data storage and retrieval processes to improve performance and efficiency.
  • Perform data analysis and profiling to identify data quality issues and recommend solutions.
  • Develop and maintain documentation for data validation processes, data mappings, and data lineage.
  • Stay up to date with industry trends and best practices in data engineering and data validation.
  • Support migration of North American OPCOs, enabling data validation on the new platform.
  • Gather business requirements from key client stakeholders and translate these into technical tracking specifications based on standards and industry best practice.


Required Skills
  • Strong knowledge of IPAAS and data validation for migration of applications.
  • Demonstrable experience in delivering end to end data validation.
  • Confident understanding of web development and its languages and possess Python proficiency.
  • Proactive and highly organised with strong time management and planning skills. Able to change direction and work on multiple projects across a wide range of topics.
  • [Desired] Knowledge of Python/Google BigQuery architecture.


153193 Submission format - please complete in full:
First Middle Last Name
Bill rate:
OR Pay Rate:
Skill Highlights- please indicate the # of years on each of the following skills:
  • Data Engineer
  • IPaaS
  • Python
  • Spark
  • Google BigQuery
  • Azure
  • Kubernetes

Visa Status:
Location:
Availability to interview:
Availability to start:
LinkedIn Profile:
Phone Number:
Email Address:
Last 4 of SSN:
MM/DD of birth:

  • Senior Linux Engineer

    2 months ago

    Irving, United States NTT DATA Full time

    Req ID: 299982 NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a Senior Linux Engineer - Irving, Texas to join our team in Irving, Texas (US-TX), United States (US).NTT Data Americas is...

  • Data Engineer

    3 days ago

    Irving, United States Synechron Full time

    We areAt Synechron, we believe in the power of digital to transform businesses for the better. Our global consulting firm combines creativity and innovative technology to deliver industry-leading digital solutions. Synechron’s progressive technologies and optimization strategies span end-to-end Artificial Intelligence, Consulting, Digital, Cloud & DevOps,...

  • Data Engineer

    2 weeks ago

    Irving, United States Synechron Full time

    Our challengeWe are seeking a highly skilled Data Engineer to join our dynamic team having experience in Cloud technologies. (Snowflake, GCP, Cloudera etc.).The RoleResponsibilities:Dev Lead / Engineer for Data – Cloud technologies. (Snowflake, GCP, Cloudera etc)Able to Lead & solution AWS, Snowflake data engineering team & designs.Design, develop, and...

  • Data Engineer

    4 weeks ago

    Irving, United States Newt Global Full time

    Big Data EngineerIrving, TX - HybridW2 ContractDirect ClientQualifications:8+ years of experience in hadoop/big data technologies.3+ years of experience in spark.2+ years experience in Snowflake2+ year of experience working on Google or AWS cloud developing data solutions. Certifications preferred.Hands-on experience with Python/Pyspark/Scala and basic...

  • Big Data Engineer

    1 month ago

    Irving, Texas, United States Motion Recruitment Full time

    Job Title: Big Data EngineerAre you a skilled Big Data Engineer looking for a new challenge? We have an exciting opportunity for you to join our team at a leading global bank in Irving, TX.About the Role:We are seeking a highly motivated and experienced Big Data Engineer to join our team. As a Big Data Engineer, you will be responsible for the delivery of...

  • Data Engineer

    2 months ago

    Irving, United States Fusion Health Full time

    Job DescriptionJob DescriptionThe Data Engineer will work cross-functionally with application development, data science, and product management to support growth, strategy, and development of innovative solutions internally and for our external clients. This position will work with operational and business leaders to deliver business intelligence and...

  • Data Engineer

    4 months ago

    Irving, United States FusionHealth Full time

    Job Description Job Description The Data Engineer will work cross-functionally with application development, data science, and product management to support growth, strategy, and development of innovative solutions internally and for our external clients. This position will work with operational and business leaders to deliver business intelligence and...

  • Senior Linux Engineer

    2 months ago

    Irving, United States NTT DATA Full time

    Req ID: 299983NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a Senior Linux Engineer (Scripting / Spectrum Protect / Kubernetes) to join our team in Irving, Texas (US-TX), United...

  • data engineer

    4 months ago

    Irving, United States Resource Informatics Group Full time

    Role: Data Engineer Location: Hybrid onsite (Mclean, VA) Duration: 6-12 Months - (With possible extension) Must Haves Overall exp of 5 years SQL - 3 years Python (building data pipeline) - 3 years Spark - 3 years Big Data/Hadoop Unix/Shell Scripting Autosys

  • Kong API Gateway Engineer

    3 months ago

    Irving, United States NTT DATA Full time

    Req ID: 294790NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a Kong API Gateway Engineer to join our team in Irving, Texas (US-TX), United States (US).Job Duties and...

  • Senior Data Engineer

    1 month ago

    Irving, Texas, United States IVID TEK INC Full time

    Job Title: Lead Data EngineerAt IVID TEK INC, we are seeking a highly skilled and experienced Lead Data Engineer to join our team. As a key member of our data engineering team, you will be responsible for designing, developing, and deploying large-scale data processing systems and architectures.Key Responsibilities:Design and implement scalable data...

  • Senior Data Engineer

    1 week ago

    Irving, United States Newt Global Full time

    Greeting from Newt Global LLC!!!We are currently looking for Big Data Engineer to join our team for long term project with our Banking client. Interested with the below job description, please share your resume with expected rate/hr.Big Data EngineerIrving, TX (Hybrid – 2 Days a Week)Contract Type: W2Long TermExp: 6+ yrsBanking Exp RequiredBig Data...

  • Data Engineer

    2 weeks ago

    Irving, United States Vistra Corporate Services Company Full time

    If you have what it takes to become part of the Vistra family and would like to start a promising career with a global leader, take a look at the exciting employment opportunities that are currently available and apply online.Job SummaryAs an Associate Data Engineer, you will be responsible for supporting the management and maintenance of the...

  • Data Engineer

    6 months ago

    Irving, United States Photon Full time

    Job DescriptionData Engineer - Graph Database Specialist (Neo4j) Design, develop, and maintain graph databases using Neo4j. Collaborate with stakeholders to understand data requirements and translate them into database schemas. Strong understanding of graph database concepts, data modeling, and query optimization. Optimize database performance for efficient...

  • Senior Data Engineer

    6 months ago

    Irving, United States OTSI Full time

    Job Description Object Technology Solutions, Inc (OTSI) has an immediate opening for a Senior Data Engineer. Senior Data Engineer (Irving, Tx) JOB DESCRIPTION: • Analyze and understand data sources & APIs • Design and Develop methods to connect & collect data from different data sources • Design and Develop methods to filter/cleanse the data • Design...

  • Cyber Data Engineer

    1 week ago

    IRVING, United States Advanity Technologies Llc Full time

    Job Title: Cyber Data Engineer Location: Remote (Must be based in the U.S.) Duration: 3 months W2, all-inclusive Key Responsibilities: Design and implement secure data pipelines for efficient support of cybersecurity operations. Optimize data architectures that integrate various cybersecurity tools, platforms, and data sources to ensure robust data flows...

  • Senior Data Engineer

    4 weeks ago

    Irving, United States Addison Group Full time

    Our client is seeking a Sr. Data Engineer to join their growing team and be a part of an exciting phase of their journey to build out new systems. This person's primary objectives will be designing, building, and maintaining scalable data pipelines in Azure to ensure compliance with up-time, security, and privacy, as well as implementing API-based...

  • Senior Data Engineer

    2 weeks ago

    Irving, United States Synechron Full time

    Senior Lead Data EngineerLocation: Irving TX (hybrid/3 days a week from day one)Overview:We are seeking a highly skilled Data Engineer to join our dynamic team having experience in Cloud technologies. (Snowflake, GCP, Cloudera etc).The RoleResponsibilities:Dev Lead/Engg for Data – Cloud technologies. (Snowflake, GCP, Cloudera etc)Able to Lead & solution...

  • Senior Data Engineer

    4 months ago

    Irving, United States ShiftCode Analytics Full time

    Title: Senior Data Engineer Location: Irving, TX Hybrid: Onsite Tuesday, Wednesday, Thursday Project: Database that allows for internal self-service of BI. Eventually there will be some external access. This role will continue to work on the database to enhance and ensure all is correct. Responsibilities: Design, develop, enhance, code, test, deliver and...

  • Azure Cloud Data Engineer

    14 hours ago

    Irving, United States Motion Recruitment Full time

    We are looking for a Junior - Mid level Data Engineer with healthcare experience to join our team in Irving, Tx. This is a full-time hybrid position and will require 4 days a week in-office. Do you have a healthcare background in clinical data sets and a passion for enhancing patient and provider experience? In this role, you will be tasked with...