Lead Data Engineer

3 weeks ago


Yuma, United States Intone Networks Inc Full time
Job DescriptionJob DescriptionRole : Lead Data Engineer
Location : Scottsdale AZ (100% onsite)
Hire Type : FTE and CTH

Must have skill set:
Spark, S3, Glue, AWS Redshift , python and stream set exp

6-8 years of IT experience focusing on enterprise data architecture and management.
Experience in Conceptual/Logical/Physical Data Modelling & expertise in Relational and Dimensional Data Modelling
Experience with Databricks & on Prem , Structured Streaming, Delta Lake concepts, and Delta Live Tables required
Experience with Spark scala
Data Lake concepts such as time travel and schema evolution and optimization
Structured Streaming and Delta Live Tables with Databricks a bonus
Experience leading and architecting enterprise-wide initiatives specifically system integration, data migration, transformation, data warehouse build, data mart build, and data lakes implementation / support
Advanced level understanding of streaming data pipelines and how they differ from batch systems
Formalize concepts of how to handle late data, defining windows, and data freshness
Advanced understanding of ETL and ELT and ETL/ELT tools such as Data Migration Service etc
Understanding of concepts and implementation strategies for different incremental data loads such as tumbling window, sliding window, high watermark, etc.
Familiarity and/or expertise with Great Expectations or other data quality/data validation frameworks a bonus
Familiarity with concepts such as late data, defining windows, and how window definitions impact data freshness
Advanced level SQL experience (Joins, Aggregation, Windowing functions, Common Table Expressions, RDBMS schema design performance optimization)
Indexing and partitioning strategy experience
Debug, troubleshoot, design and implement solutions to complex technical issues
Experience with large-scale, high-performance enterprise big data application deployment and solution
Architecture experience in AWS environment a bonus
Familiarity working with Lambda specifically with how to push and pull data, how to use AWS tools to view data for processing massive data at scale a bonus
Experience with Gitlabs and CloudWatch and ability to write and maintain gitlabs for supporting CI/CD pipelines
Experience working with AWS Lambdas for configuration and optimization and experience with S3
Familiarity with Schema Registry, message formats such as Avro, ORC, etc.
Ability to thrive in a team-based environment
Experience briefing the benefits and constraints of technology solutions to technology partners, stakeholders, team members, and senior level of management
  • Lead Data Engineer

    1 week ago


    Yuma, United States Godspeed Workforce Full time

    Job DescriptionJob DescriptionJob Title: Lead Data EngineerLocation: Scottsdale, AZ (100% onsite)Hire Type: Contract/FTE/CTHVISA: No OPT, CPT, H1BMust-have skill set:Spark, S3, Glue, AWS Redshift, Python, and StreamSets experienceDescription:We are seeking a highly skilled Lead Data Engineer to join our team in Scottsdale, AZ. The ideal candidate will have...


  • Yuma, United States UrBench Full time

    Job Description Job Description Client-HCL America/Honeywell $70/hr USC/GC Role- System Engineer Lead Location-Phoenix, AZ (Onsite/Remote) Local Client-HCL America/Honeywell Job Description: Bachelor's degree in Computer Science/Software Engineering/Electrical Engineering with 10 to 15 years of proven experience , Master's degree is preferred. Comprehensive...

  • System Engineer Lead

    2 weeks ago


    Yuma, United States UrBench Full time

    Job DescriptionJob DescriptionClient-HCL America/Honeywell$70/hrUSC/GCRole- System Engineer Lead Location-Phoenix, AZ (Onsite/Remote) Local Client-HCL America/Honeywell Job Description: Bachelor's degree in Computer Science/Software Engineering/Electrical Engineering with 10 to 15 years of proven experience, Master's degree is preferred....


  • Yuma, United States Intone Networks Inc Full time

    Job DescriptionJob DescriptionRole : Automation QA Engineer / Big Data / ETL Tester Location : Scottsdale AZ (Day 1 Onsite) Hire type : C2C . FTE , CTHMust have : Automation , java , AWS , ETL , Scala , Spark Required: 6-8 years of IT experience focusing on Testing and Automation experience using Java and Groovy. Rest assured app concepts in automation. ...

  • Data Analyst

    7 days ago


    Yuma, United States Argyllinfotech Full time

    Job DescriptionJob DescriptionJob DescriptionThe Sr. Data Analyst will provide and support the implementation of business solutions by building relationships, identifying business needs, and carrying out processes and practices. The role is in client Home-Office and will report to the Senior Manager, Item Catalog. Data Source Identification Data Strategy...

  • GCP Data Engineer1

    4 days ago


    Yuma, United States Centraprise LLC Full time

    Job DescriptionJob DescriptionPlease share your interest and resume at rahul.j@centraprise.comPosition : GCP Data Engineer Location : Phoenix, AZ (Day 1 Onsite) Duration : Long Term Contract Job Description: Skills required: GCP - Data flow, Data proc, Apache Beam skills 6-9 Years of hands on Exp with GCP - Data flow, Data proc, Apache Beam skills Writing...


  • Yuma, United States Intone Networks Inc Full time

    Job DescriptionJob DescriptionPlease find the new open requirement for an AWS data architect.Role: Sr AWS Data Developer Client: CavaLocation: Phoenix, ArizonaDuration: 24 Months Experience: 12 YearsWork Authorisation: USC, Green Card, H1B (I94 travel approved)Open Requirements: 01Nature: Day one on-siteNote: The proposed candidate has to be on the...


  • Yuma, United States ORSA Technologies LLC Full time

    Job DescriptionJob DescriptionORSA Technologies is seeking experienced Operational Test Engineer (OTE)Responsibilities include:Plans and administers performance tests on aeronautical equipment, controls, systems, and other products and systems.Designs and directs engineering and technical personnel in testing and test-control apparatus and...


  • Yuma, United States ORSA Technologies LLC Full time

    Job DescriptionJob DescriptionORSA Technologies is seeking experienced Operational Test Engineer (OTE)Responsibilities include:Plans and administers performance tests on aeronautical equipment, controls, systems, and other products and systems.Designs and directs engineering and technical personnel in testing and test-control apparatus and...


  • Yuma, United States Pray & Company Full time

    Job Description Job Description Summary/Description: Lead and support theElectricalEngineering team for projects in the US MMM (Mining, Minerals, and Metals) business. Manage small to large projects, ensuring quality, cost, and schedule adherence. Responsible for theElectricalEngineering team's output, technical integrity, and compliance with safety...


  • Yuma, United States Pray & Company HR and Business Solutions, LLC Full time

    Job DescriptionJob DescriptionSummary/Description:Lead and support theElectricalEngineering team for projects in the US MMM (Mining, Minerals, and Metals) business. Manage small to large projects, ensuring quality, cost, and schedule adherence. Responsible for theElectricalEngineering team's output, technical integrity, and compliance with safety...


  • Yuma, United States ORSA Technologies LLC Full time

    JOB DESCRIPTION: Senior Flight Test EngineerOrsa Technologies is seeking qualified candidates to provide Senior Engineer Operational Flight Test and Evaluation to Marine Operational Test and Evaluation Squadron One. The Operational Test and Evaluation Engineer will conduct operational tests and evaluations to ensure the effectiveness and suitability of...


  • Yuma, United States ORSA Technologies LLC Full time

    Job DescriptionJob DescriptionJOB DESCRIPTION: Senior Flight Test EngineerOrsa Technologies is seeking qualified candidates to provide Senior Engineer Operational Flight Test and Evaluation to Marine Operational Test and Evaluation Squadron One. The Operational Test and Evaluation Engineer will conduct operational tests and evaluations to ensure the...


  • Yuma, United States ORSA Technologies LLC Full time

    JOB DESCRIPTION: Senior Flight Test Engineer Orsa Technologies is seeking qualified candidates to provide Senior Engineer Operational Flight Test and Evaluation to Marine Operational Test and Evaluation Squadron One. The Operational Test and Evaluation Engineer will conduct operational tests and evaluations to ensure the effectiveness and suitability of...


  • Yuma, United States ORSA Technologies LLC Full time

    Job DescriptionJob DescriptionJOB DESCRIPTION: Senior Flight Test EngineerOrsa Technologies is seeking qualified candidates to provide Senior Engineer Operational Flight Test and Evaluation to Marine Operational Test and Evaluation Squadron One. The Operational Test and Evaluation Engineer will conduct operational tests and evaluations to ensure the...

  • Mechanical Engineer

    2 weeks ago


    Yuma, United States Pray & Company HR and Business Solutions, LLC Full time

    Job DescriptionJob DescriptionResponsible for enhancing the performance and dependability of mechanical systems by working closely with team members and conducting analysis to identify solutions that optimize maintenance practices, reduce downtime, and improve the overall reliability of our equipment. The Mechanical Engineer is responsible for not only...


  • Yuma, United States SOS International LLC Full time

    SOS International LLC Child Wellbeing Lead Specialist Yuma , Arizona Apply Now SOSi is actively seeking a Child Well-Being Lead Specialist (Spanish Bilingual) to join us supporting our customer across several regional border Sectors including San Diego and El Centro, California; Yuma and Tucson, Arizona; and Big Bend, Laredo, El Paso, Del Rio, and Rio Grande...


  • Yuma, United States Saguaro Foundation Full time

    The Lead Assistant of Human Resources at Saguaro Foundation plays a critical role in supporting our mission by overseeing all aspects of human resource management. Reporting directly to the Chief Financial Officer, the Lead Human Resources Assistant will be responsible for developing and implementing HR strategies and initiatives that align with the...


  • Yuma, United States Saguaro Foundation Full time

    The Lead Assistant of Human Resources at Saguaro Foundation plays a critical role in supporting our mission by overseeing all aspects of human resource management. Reporting directly to the Chief Financial Officer, the Lead Human Resources Assistant will be responsible for developing and implementing HR strategies and initiatives that align with the...


  • Yuma, United States ORSA Technologies LLC Full time

    Job DescriptionJob DescriptionLABOR CATEGORY: Reliability, Maintainability, Logistic supportability, and Availability (RMLA) Analyst ORSA POSITION TITLE: RMLA AnalystLOCATION: MCAS Yuma, ArizonaJOB DESCRIPTION: ORSA Technologies is seeking qualified candidates to provide Reliability, Maintainability, Logistic supportability, and Availability Support to...