GCP Data Engineer

2 weeks ago

Bentonville, United States Fractal Full time

Job Summary:

We are seeking a highly skilled and experienced GCP (Google Cloud Platform) Data Engineer with more than 6 years of expertise to join our dynamic team. The GCP Data Engineer will play a pivotal role in designing, implementing, and optimizing data solutions on Google Cloud Platform. The ideal candidate should have a deep understanding of GCP services, strong data engineering skills, and a proven track record of delivering robust and scalable data solutions.

Key Responsibilities:

  • Architecture Design: Design and implement scalable and efficient data architectures on Google Cloud Platform (GCP) to meet business requirements and performance goals.
  • Data Integration: Integrate data from various sources into GCP using services like Cloud Storage, Cloud Pub/Sub, Dataflow, and BigQuery.
  • Data Processing: Develop and implement data processing pipelines using Apache Beam, Apache Spark, or other suitable frameworks to transform and cleanse data for analysis.
  • Data Modeling: Design and implement data models for optimal performance and efficiency in BigQuery or other GCP data storage solutions.
  • Streaming Analytics: Implement real-time data processing and analytics solutions using GCP streaming services such as Cloud Dataflow and Cloud Pub/Sub.
  • Data Security and Governance: Ensure data security and compliance with regulatory requirements by implementing appropriate access controls, encryption mechanisms, and data governance policies.
  • Performance Optimization: Optimize data pipelines, queries, and data storage configurations to maximize performance and minimize costs.
  • Monitoring and Logging: Set up monitoring and logging solutions to track system performance, detect anomalies, and troubleshoot issues in GCP data environments.
  • Automation and DevOps: Implement automation scripts and workflows using tools like Terraform, Deployment Manager, or Google Cloud Deployment Manager to automate provisioning and management of GCP resources.
  • Collaboration: Collaborate with cross-functional teams including data scientists, analysts, and business stakeholders to understand data requirements and deliver data solutions that meet business needs.
  • Documentation and Knowledge Sharing: Create and maintain technical documentation, best practices, and guidelines for data engineering on GCP. Share knowledge and mentor junior team members.

Qualifications:

  • Bachelor's or Master's degree in Computer Science, Engineering, or a related field.
  • Minimum of 6 years of experience in data engineering, with at least 3 years of hands-on experience working with Google Cloud Platform.
  • Strong understanding of GCP services such as BigQuery, Cloud Storage, Dataflow, Pub/Sub, and Dataproc.
  • Proficiency in programming languages such as Python, Java, or Scala for data processing and scripting tasks.
  • Experience with data warehouse design, implementation, and optimization.
  • Knowledge of data streaming and real-time analytics technologies.
  • Familiarity with machine learning concepts and frameworks (e.g., TensorFlow, scikit-learn) is a plus.
  • Excellent problem-solving skills and the ability to troubleshoot complex data engineering issues.
  • Strong communication and collaboration skills, with the ability to work effectively in a team environment.

  • GCP Data Engineer

    7 days ago

    Bentonville, Arkansas, United States Cognizant Technology Solutions Full time

    GCP Data Engineer.Must have- GCP, Big Query, Cloud Composer, GCP File systems, GCP Hive.Qualification:• Post-grad in one of the following fields with strong academic credentials:• Computer Science/IT.• Operations Research/Applied Math.• Engineering.• Statistics.Responsibility:Business:'•Works with the business team to identify the right business...

  • GCP Data Architect

    7 days ago

    Bentonville, United States Fractal, Inc. Full time

    GCP Data Architect Bentonville, Arkansas Full time Permanent Description : Minimum of 6 years of experience in data engineering, with at least 3 years of hands-on experience working with Google Cloud Platform. Architecture Design: Design and implement scalable and efficient data architectures on Google Cloud Platform (GCP) to meet business requirements and...

  • Data Engineer

    17 hours ago

    Bentonville, United States The Dignify Solutions LLC Full time

    7 years exp Technical/Functional Skills - • Tech Skills - Scala, Spark, GCP, Dataproc, Hadoop, Airflow, SBT, Maven, Docker, Kubernetes, pyspark, Jenkins, Bigquery • Experience with workflow management tools such as Jenkins, Airflow • Experience running spark/hadoop workloads using Dataproc, Dataflow, Cloud composer, EMR, HD Insights or similar. •...

  • Data Engineer

    14 hours ago

    Bentonville, United States Redolent Full time

    One of our direct client is urgently looking for a Data Engineer TITLE: Data Engineer LOCATION: Bentonville AR or Remote Duration: 6 to 12+ Months Rate: DOE Required skills - Spark, Cassandra, GCP, Kafka ( experience with data pipelines ) Description: Designs, develops, and implements Hadoop eco-system based applications to support International Search...

  • Data Engineer

    2 weeks ago

    Bentonville, United States JobRialto Full time

    Location: Hoboken, NJ Sunnyvale, CA Herndon, VA Dallas, TX Bentonville, AR Job Description: Will be doing Data Engineering work for a One Data Lake Platform. The resource will be pulling data from structured data sources. Then ETL the data using Scala, no tooling used. Everything is done in a GCP environment they are off of Hadoop, so no Hadoop. We are open...

  • Data Engineer with ML, Data Scientist, Data Pipeline Experience.

    3 weeks ago

    Bentonville, United States Diligente Technologies Full time

    Core skills: Data engineering, Data analysis, Data science, Machine Learning, hypotheses & statistical data inference knowledge. Experience managing data pipelines, large scale of data,Expertise with: Kubernetes, Python, SQL, Pyspark, GCP, Azure, and Kubernetes. Being able to talk aboutML, Data scientist, etc. People with background in statistical skills,...

  • Data Engineer with ML, Data Scientist, Data Pipeline Experience.

    3 weeks ago

    Bentonville, United States Diligente Technologies Full time

    Core skills: Data engineering, Data analysis, Data science, Machine Learning, hypotheses & statistical data inference knowledge. Experience managing data pipelines, large scale of data,Expertise with: Kubernetes, Python, SQL, Pyspark, GCP, Azure, and Kubernetes. Being able to talk aboutML, Data scientist, etc. People with background in statistical skills,...

  • Data Engineer with ML, Data Scientist, Data Pipeline Experience.

    3 weeks ago

    Bentonville, United States Diligente Technologies Full time

    Core skills: Data engineering, Data analysis, Data science, Machine Learning, hypotheses & statistical data inference knowledge. Experience managing data pipelines, large scale of data,Expertise with: Kubernetes, Python, SQL, Pyspark, GCP, Azure, and Kubernetes. Being able to talk aboutML, Data scientist, etc. People with background in statistical skills,...

  • Data Engineer 3

    15 hours ago

    Bentonville, United States HonorVet Technologies Full time

    Job Description Position: Data Engineer Location: 100% Remote based in the U.S Top 3 skills: Python, Java, AWS Soft skill: working with the team- critical thinking, troubleshooting skills Years of Experience: 5-7 years with 4 years or more in data engineering Job Description: Python & AWS development to build, enhance and maintain monitoring...

  • VP of Engineering

    2 weeks ago

    Bentonville, United States Ox Full time

    Job DescriptionJob DescriptionJOB SUMMARY Our VP of Engineering will drive innovation while developing cutting-edge products and building a scalable and secure technical infrastructure. You will lead technical efforts to develop proprietary software optimizing frontline warehouse operators and streamlining supply chain processes. Responsibilities include...

  • VP of Engineering

    4 days ago

    Bentonville, United States Ox Full time

    Job DescriptionJob DescriptionJOB SUMMARY Our VP of Engineering will drive innovation while developing cutting-edge products and building a scalable and secure technical infrastructure. You will lead technical efforts to develop proprietary software optimizing frontline warehouse operators and streamlining supply chain processes. Responsibilities include...

  • VP of Engineering

    9 hours ago

    Bentonville, United States Ox Inc Full time

    JOB SUMMARY Our VP of Engineering will drive innovation while developing cutting-edge products and building a scalable and secure technical infrastructure. You will lead technical efforts to develop proprietary software optimizing frontline warehouse operators and streamlining supply chain processes. Responsibilities include guiding product development,...

  • Machine Learning Software Engineer

    1 day ago

    Bentonville, United States Flexton Full time

    Flexton Inc., Established in 2007, headquarter is in San Jose, CA with development centers in India at multiple locations. We are a leading professional services company offering a unique product mix that extends into Technology, Consulting, Digital and Operations. Flexton has been recognized multiple times by Inc 5000 as the Fastest Growing Company. Machin...

  • Senior Data Analyst

    2 weeks ago

    Bentonville, United States Wal-Mart Stores , Inc. Full time

    Location BENTONVILLE, AR Career Area Data Analytics and Business Intelligence Job Function Data Analytics Employment Type Regular/Permanent Position Type Salary Requisition WD1846145 What you'll do at What you'll do...Position: Senior Data AnalystJob Location: 702 SW 8th Street, Bentonville, AR 72712Duties: Analyze and interpret information for one or more...

  • Machine Learning Software Engineer

    1 week ago

    Bentonville, United States Flexton Full time

    Flexton Inc., Established in 2007, headquarter is in San Jose, CA with development centers in India at multiple locations. We are a leading professional services company offering a unique product mix that extends into Technology, Consulting, Digital and Operations. Flexton has been recognized multiple times by Inc 5000 as the Fastest Growing Company. Machin...

  • Machine Learning Software Engineer

    2 weeks ago

    Bentonville, United States Flexton Inc. Full time

    Flexton Inc., Established in 2007, headquarter is in San Jose, CA with development centers in India at multiple locations. We are a leading professional services company offering a unique product mix that extends into Technology, Consulting, Digital and Operations. Flexton has been recognized multiple times by Inc 5000 as the Fastest Growing Company. Machin...

  • Machine Learning Software Engineer

    2 weeks ago

    Bentonville, United States Flexton Inc. Full time

    Flexton Inc., Established in 2007, headquarter is in San Jose, CA with development centers in India at multiple locations. We are a leading professional services company offering a unique product mix that extends into Technology, Consulting, Digital and Operations. Flexton has been recognized multiple times by Inc 5000 as the Fastest Growing Company. Machin...

  • Machine Learning Software Engineer

    2 weeks ago

    Bentonville, United States Flexton Inc. Full time

    Flexton Inc., Established in 2007, headquarter is in San Jose, CA with development centers in India at multiple locations. We are a leading professional services company offering a unique product mix that extends into Technology, Consulting, Digital and Operations. Flexton has been recognized multiple times by Inc 5000 as the Fastest Growing Company. Machin...

  • Principal, Systems And Infrastructure Engineer, Information Security

    3 weeks ago

    Bentonville, Arkansas, United States Walmart Full time

    We combine a range of services and expertise to prevent fraud, detect threats, and manage digital risk and access.As an IoT/OT Principal Systems & Infrastructure Engineer, you will be for ensuring the security and compliance of IoT/OT systems and devices across the enterprise.Collaborate with vulnerability assessment and penetration testing teams to identify...

  • Software Engineer- Python with big data

    3 days ago

    Bentonville, United States Flexton Inc. Full time

    Flexton Inc., Established in 2007, headquarter is in San Jose, CA with development centers in India at multiple locations. We are a leading professional services company offering a unique product mix that extends into Technology, Consulting, Digital and Operations. Flexton has been recognized multiple times by Inc 5000 as the Fastest Growing Company.Software...