Gke data engineer

3 weeks ago

Scottsdale, United States Randstad Full time

job summary:
Our client is in need of a GKE Data Engineering Lead for a 2 year engagement to assist in solutioning the architecture as we Transform the rebate processing system from legacy platform. The potential candidate will be helping the engineers in rearchitecting, transforming, and designing data pipelines.

  • This resource will come in and help do a current state assesment, recommend the framework and lead team in builiding the solution for the migration

  • DataProc, Spark, AirFlow, Composer, etc...

  • 3 plus years of experience with Apache Airflow or Composer

  • 3 plus years of experience with Data Proc or Spark

  • 5 - 7 years of experience with CI/CD

  • Experience completing current state assesments for migration projects

  • Experience with producing architecture solutions with Composer and SparkNeeds to have a breadth of knowledge in the Data Space

  • Java Engineers and Architects will work with these Data Engineers to understand and help build out that environment

  • They will be part and parcel of the work they are doing, helping the rest of the team to build out the environment based on the recommendations they put forth in their assessments

  • Needs to be a leader, understands how to assess problems and navigate the team through any issues

  • Must understand Java - it is what the environment operates on.

  • Must be proactive as they need a leader to help direct the flow of the group's work.

  • Healthcare experience desired

  • Experience with producing architecture solutions with Composer and Spark

  • Experience in Large scale batch processing with cloud services.

  • Desired skills:

  • Apache Spark, Map Reduce, Spark Streaming, PySpark, Hive, HDFS, Kafka, Redis, Sqoop, Oozie, IBM Data sage, Springbatch
location: Scottsdale, Arizona
job type: Contract
salary: $70 - 75 per hour
work hours: 8am to 4pm
education: Bachelors

responsibilities:
Our client is in need of a GKE Data Engineering Lead for a 2 year engagement to assist in solutioning the architecture as we Transform the rebate processing system from legacy platform. The potential candidate will be helping the engineers in rearchitecting, transforming, and designing data pipelines.
  • This resource will come in and help do a current state assesment, recommend the framework and lead team in builiding the solution for the migration

  • DataProc, Spark, AirFlow, Composer, etc...

  • 3 plus years of experience with Apache Airflow or Composer

  • 3 plus years of experience with Data Proc or Spark

  • 5 - 7 years of experience with CI/CD

  • Experience completing current state assesments for migration projects

  • Experience with producing architecture solutions with Composer and SparkNeeds to have a breadth of knowledge in the Data Space

  • Java Engineers and Architects will work with these Data Engineers to understand and help build out that environment

  • They will be part and parcel of the work they are doing, helping the rest of the team to build out the environment based on the recommendations they put forth in their assessments

  • Needs to be a leader, understands how to assess problems and navigate the team through any issues

  • Must understand Java - it is what the environment operates on.

  • Must be proactive as they need a leader to help direct the flow of the group's work.

  • Healthcare experience desired

  • Experience with producing architecture solutions with Composer and Spark

  • Experience in Large scale batch processing with cloud services.

  • Desired skills:

  • Apache Spark, Map Reduce, Spark Streaming, PySpark, Hive, HDFS, Kafka, Redis, Sqoop, Oozie, IBM Data sage, Springbatch
qualifications:
  • Experience level: Experienced
  • Minimum 6 years of experience
  • Education: Bachelors

skills: GKE google kubernetes engine GCP cloud Java spark apache airflow composer Data Proc migration db2 legacy system PySpark CI/CD oozie API

Equal Opportunity Employer: Race, Color, Religion, Sex, Sexual Orientation, Gender Identity, National Origin, Age, Genetic Information, Disability, Protected Veteran Status, or any other legally protected group status.

At Randstad Digital, we welcome people of all abilities and want to ensure that our hiring and interview process meets the needs of all applicants. If you require a reasonable accommodation to make your application or interview experience a great one, please contact HRsupport@randstadusa.com.

Pay offered to a successful candidate will be based on several factors including the candidate's education, work experience, work location, specific job duties, certifications, etc. In addition, Randstad Digital offers a comprehensive benefits package, including health, an incentive and recognition program, and 401K contribution (all benefits are based on eligibility).

Applications accepted on ongoing basis until filled.

  • Google Cloud Engineer

    1 month ago

    Scottsdale, United States Recurring Decimal Full time

    Google Cloud Engineer Locations: Phoenix/Charlotte/Los Angeles (Hybrid) Minimum Required Experience: Bachelor’s degree or equivalent, Masters preferred in Computer Science. Cloud Infrastructure and security - 5 years. Ten years IT industry experience. 5-6 years terraform experience. Skills & Qualifications: Experience with GCP – CloudFunction, GKE,...

  • Google Cloud Engineer

    3 weeks ago

    Scottsdale, United States Recurring Decimal Full time

    Google Cloud Engineer Locations: Phoenix/Charlotte/Los Angeles (Hybrid) Minimum Required Experience: Bachelor’s degree or equivalent, Masters preferred in Computer Science. Cloud Infrastructure and security - 5 years. Ten years IT industry experience. 5-6 years terraform experience. Skills & Qualifications: Experience with GCP – CloudFunction, GKE,...

  • Data Engineer

    1 month ago

    Scottsdale, United States CBTS Full time

    CBTS is currently seeking a Data Engineer for a position located in Scottsdale, AZ. Responsibilities:Collaborate with fellow data engineering and cross-functional data teams to build and deliver custom enterprise data warehousing and database applications.Accurately estimate tasks, bugs, and spikes in your domain.Develop software that meets code quality...

  • Data Engineer

    3 weeks ago

    Scottsdale, United States CBTS Full time

    CBTS is currently seeking a Data Engineer for a position located in Scottsdale, AZ. Responsibilities:Collaborate with fellow data engineering and cross-functional data teams to build and deliver custom enterprise data warehousing and database applications.Accurately estimate tasks, bugs, and spikes in your domain.Develop software that meets code quality...

  • Data Engineer

    2 weeks ago

    Scottsdale, United States Stepstone Full time

    Company Description Appcast is the global leader in programmatic recruitment advertising technology and services. With advanced technology, unmatched market data and a team of the industry’s best recruitment marketers, Appcast’s technology and services manage job advertising annually for enterprise clients across industries. Headquartered in Lebanon,...

  • Data Engineer

    2 weeks ago

    Scottsdale, United States Collabera Full time

    Description Home Search Jobs Job Description Data Engineer Contract: Scottsdale, Arizona, US Salary: $50.00 Per Hour Job Code: 350344 End Date: 2024-07-05 Days Left: 23 days, 3 hours left Apply We are looking for Sr Data Engineer with one of our direct client. Location:-Scottsdale, AZ Duration:-10 monthsAbout the Role: We are looking for a Sr. Data...

  • Principle Data Engineer

    1 month ago

    Scottsdale, United States CBTS Full time

    Position Information:Seeking skilled Principal Data Engineers who thrive in a highly collaborative, agile team environment. Engineers design elegant technical solutions for complex product requirements, deliver high quality code as part of a fast-moving agile team, and own the stability and quality of their domain. We would love to hear from talented...

  • Principal Data Engineer

    3 weeks ago

    Scottsdale, United States CBTS Full time

    Position Information:Seeking skilled Principal Data Engineers who thrive in a highly collaborative, agile team environment. Engineers design elegant technical solutions for complex product requirements, deliver high quality code as part of a fast-moving agile team, and own the stability and quality of their domain. We would love to hear from talented...

  • Senior Data Engineer

    1 month ago

    Scottsdale, United States RiverPoint Full time

    Job DescriptionJob DescriptionInfomatics is hiring a Senior Data Engineer on a direct hire/FTE basis to lead design, development and implementation efforts on our client’s Enterprise Analytics platform which includes an MPP Enterprise Data Warehouse, cloud-based Data Lake and other Big Data technologies. Essential Duties and Responsibilities:Guides the...

  • Senior Data Engineer

    3 weeks ago

    Scottsdale, United States RiverPoint Full time

    Job DescriptionJob DescriptionInfomatics is hiring a Senior Data Engineer on a direct hire/FTE basis to lead design, development and implementation efforts on our client’s Enterprise Analytics platform which includes an MPP Enterprise Data Warehouse, cloud-based Data Lake and other Big Data technologies. Essential Duties and Responsibilities:Guides the...

  • Google Cloud Engineer

    1 month ago

    Scottsdale, AZ, United States Recurring Decimal Full time

    Google Cloud Engineer Locations: Phoenix/Charlotte/Los Angeles (Hybrid) Minimum Required Experience: Bachelor’s degree or equivalent, Masters preferred in Computer Science. Cloud Infrastructure and security - 5 years. Ten years IT industry experience. 5-6 years terraform experience. Skills & Qualifications: Experience with GCP - CloudFunction, GKE,...

  • Google Cloud Engineer

    1 month ago

    Scottsdale, AZ, United States Recurring Decimal Full time

    Google Cloud Engineer Locations: Phoenix/Charlotte/Los Angeles (Hybrid) Minimum Required Experience: Bachelor’s degree or equivalent, Masters preferred in Computer Science. Cloud Infrastructure and security - 5 years. Ten years IT industry experience. 5-6 years terraform experience. Skills & Qualifications: Experience with GCP – CloudFunction, GKE,...

  • Data Engineer

    6 days ago

    Scottsdale, United States Persistent Systems Full time

    About PersistentWe are a trusted Digital Engineering and Enterprise Modernization partner, combining deep technical expertise and industry experience to help our clients anticipate what’s next. Our offerings and proven solutions create a unique competitive advantage for our clients by giving them the power to see beyond and rise above. We work with many...

  • Data Engineer

    1 week ago

    Scottsdale, United States Persistent Systems Full time

    About PersistentWe are a trusted Digital Engineering and Enterprise Modernization partner, combining deep technical expertise and industry experience to help our clients anticipate what’s next. Our offerings and proven solutions create a unique competitive advantage for our clients by giving them the power to see beyond and rise above. We work with many...

  • Data Engineer III

    4 weeks ago

    Scottsdale, United States Troon Golf Full time

    Data Engineer is responsible for building a leading-edge Data & Analytics platform for enabling our new Troon Data Estate architecture & related analytics, business domain specific analytics & management (Finance, HR, Operations, & other), and general enterprise analytics needs. Designs, develops, maintains, and supports the cloud-based (Microsoft Azure) big...

  • Data Engineer III

    3 weeks ago

    Scottsdale, United States Troon Golf Full time

    Data Engineer is responsible for building a leading-edge Data & Analytics platform for enabling our new Troon Data Estate architecture & related analytics, business domain specific analytics & management (Finance, HR, Operations, & other), and general enterprise analytics needs. Designs, develops, maintains, and supports the cloud-based (Microsoft Azure) big...

  • Data Engineer III

    2 weeks ago

    Scottsdale, United States Troon Golf Full time

    Data Engineer is responsible for building a leading-edge Data & Analytics platform for enabling our new Troon Data Estate architecture & related analytics, business domain specific analytics & management (Finance, HR, Operations, & other), and general enterprise analytics needs. Designs, develops, maintains, and supports the cloud-based (Microsoft Azure) big...

  • Data Engineer III ICP

    7 days ago

    Scottsdale, Arizona, United States HonorHealth Full time

    OverviewLooking to be part of something more meaningful? At HonorHealth, you'll be part of a team, creating a multi-dimensional care experience for our patients. You'll have opportunities to make a difference. From our Ambassador Movement to our robust training and development programs, you can select where and how you want to make an impact. HonorHealth...

  • Sr Data and BI Engineer

    2 weeks ago

    Scottsdale, United States C Vs Pharmacy Full time

    As Sr Data and BI Engineer you will be responsible for Following?Design, build, and maintain the systems for storing and processing data. Combine unstructured data from multiple sources, evaluate it, and improve business operations. Maintain data qua Engineer, Business Operations, Data, Technology, Retail, Modeling

  • Sr Data and BI Engineer

    7 days ago

    Scottsdale, Arizona, United States C Vs Pharmacy Full time

    As Sr Data and BI Engineer you will be responsible for Following?Design, build, and maintain the systems for storing and processing data. Combine unstructured data from multiple sources, evaluate it, and improve business operations. Maintain data qua Engineer, Business Operations, Data, Technology, Retail, Modeling