Droisys | GCP Data Engineer | sunnyvale, ca

5 days ago

sunnyvale, United States Droisys Full time

About Company,


Droisys is an innovation technology company focused on helping companies accelerate their digital initiatives from strategy and planning through execution. We leverage deep technical expertise, Agile methodologies, and data-driven intelligence to modernize systems of engagement and simplify human/tech interaction.


Amazing things happen when we work in environments where everyone feels a true sense of belonging and when candidates have the requisite skills and opportunities to succeed. At Droisys, we invest in our talent and support career growth, and we are always on the lookout for amazing talent who can contribute to our growth by delivering top results for our clients. Join us to challenge yourself and accomplish work that matters.


GCP Data Engineer

Sunnyvale, CA (Day 1 onsite/5 Days onsite)

Long term


Job Details:


Must have skills.

Overall Experience level:

3+ years of recent GCP experience

5+ years of hands-on experience Hadoop, Hive or Spark, Airflow or a workflow orchestration solution

4+ years of hands-on experience designing schema for data lakes or for RDBMS platforms

Experience with programming languages: Python, Java, Scala, etc.

Experience with scripting languages: Perl, Shell, etc.

As a Senior Data Engineer, you will

• Design and develop big data applications using the latest open source technologies.

• Desired working in offshore model and Managed outcome

• Develop logical and physical data models for big data platforms.

• Automate workflows using Apache Airflow.

• Create data pipelines using Apache Hive, Apache Spark, Apache Kafka.

• Provide ongoing maintenance and enhancements to existing systems and participate in rotational on-call support.

• Learn our business domain and technology infrastructure quickly and share your knowledge freely and actively with others in the team.

• Mentor junior engineers on the team

• Lead daily standups and design reviews

• Groom and prioritize backlog using JIRA

• Act as the point of contact for your assigned business domain

Requirements:

GCP Experience

• 3+ years of recent GCP experience

• Experience building data pipelines in GCP

• GCP Dataproc, GCS & BIGQuery experience

• 5+ years of hands-on experience with developing data warehouse solutions and data products.

• 5+ years of hands-on experience developing a distributed data processing platform with Hadoop, Hive or Spark, Airflow or a workflow orchestration solution are required

• 4+ years of hands-on experience in modeling and designing schema for data lakes or for RDBMS platforms.

• Experience with programming languages: Python, Java, Scala, etc.

• Experience with scripting languages: Perl, Shell, etc.

• Practice working with, processing, and managing large data sets (multi TB/PB scale).

• Exposure to test driven development and automated testing frameworks.

• Background in Scrum/Agile development methodologies.

• Capable of delivering on multiple competing priorities with little supervision.

• Excellent verbal and written communication skills.

• Bachelor's Degree in computer science or equivalent experience.

The most successful candidates will also have experience in the following:

• Gitflow

• Atlassian products – BitBucket, JIRA, Confluence etc.

• Continuous Integration tools such as Bamboo, Jenkins, or TFS


Droisys is an equal opportunity employer. We do not discriminate based on race, religion, color, national origin, gender, gender expression, sexual orientation, age, marital status, veteran status, disability status or any other characteristic protected by law. Droisys believes in diversity, inclusion, and belonging, and we are committed to fostering a diverse work environment.

  • GCP Data Engineer

    5 days ago

    Sunnyvale, United States Droisys Full time

    About Company,Droisys is an innovation technology company focused on helping companies accelerate their digital initiatives from strategy and planning through execution. We leverage deep technical expertise, Agile methodologies, and data-driven intelligence to modernize systems of engagement and simplify human/tech interaction.Amazing things happen when we...

  • Data Engineer

    2 weeks ago

    Sunnyvale, United States Insight Global Full time

    Contract/Contract-to-Hire Roles: Compensation:$60 to $ 75/hr on W2 Exact compensation may vary based on several factors, including skills, experience, and education. Benefit packages for this role will start on the 31st day of employment and include medical, dental, and vision insurance, as well as HSA, FSA, and DCFSA account options, and 401k retirement...

  • Data Engineer

    2 weeks ago

    Sunnyvale, United States DRISHTICON Inc Full time

    We have immediate requirement for a Sr Data Engineer with our direct clients in San Francisco Bay Area, CA. The position is a long term contract opportunity and Hybrid.Candidate is expected to work onsite 2-3 days in Sunnyvale CA.Looking for candidates who can work on W2.• What are the top 3 skills needed/required? -Object Oriented Programing-Big Data...

  • Data Engineer

    2 weeks ago

    sunnyvale, United States DRISHTICON Inc Full time

    We have immediate requirement for a Sr Data Engineer with our direct clients in San Francisco Bay Area, CA. The position is a long term contract opportunity and Hybrid.Candidate is expected to work onsite 2-3 days in Sunnyvale CA.Looking for candidates who can work on W2.• What are the top 3 skills needed/required? -Object Oriented Programing-Big Data...

  • Data Engineer

    2 weeks ago

    sunnyvale, United States DRISHTICON Inc Full time

    We have immediate requirement for a Sr Data Engineer with our direct clients in San Francisco Bay Area, CA. The position is a long term contract opportunity and Hybrid.Candidate is expected to work onsite 2-3 days in Sunnyvale CA.Looking for candidates who can work on W2.• What are the top 3 skills needed/required? -Object Oriented Programing-Big Data...

  • Facebook | Embedded Software Engineer | sunnyvale, ca

    6 days ago

    sunnyvale, United States Facebook Full time

    Meta Reality Labs - W2 ContractEmbedded Software Engineer - Sunnyvale, CA Job Description: Meta Reality Labs team is seeking Embedded Software Engineer to join their team in Sunnyvale CA! This person will be an integral member of the team, responsible for embedded software design and optimization with a concentration on Bluetooth connectivity and wireless SW...

  • Facebook | Embedded Software Engineer | sunnyvale, ca

    5 days ago

    sunnyvale, United States Facebook Full time

    Meta Reality Labs - W2 ContractEmbedded Software Engineer - Sunnyvale, CA Job Description: Meta Reality Labs team is seeking Embedded Software Engineer to join their team in Sunnyvale CA! This person will be an integral member of the team, responsible for embedded software design and optimization with a concentration on Bluetooth connectivity and wireless SW...

  • Sr Data Engineer

    3 weeks ago

    sunnyvale, United States DRISHTICON Inc Full time

    We have immediate requirements for Sr Data Engineer with our direct clients in San Francisco Bay Area, CA. The position is a long term contract opportunity and Hybrid.Candidate is expected to work onsite 2-3 days in Sunnyvale CA. • What are the top 3 skills needed/required? -Object Oriented Programing-Big Data Programing -Database Design• What skills...

  • Sr Data Engineer

    3 weeks ago

    Sunnyvale, United States DRISHTICON Inc Full time

    We have immediate requirements for Sr Data Engineer with our direct clients in San Francisco Bay Area, CA. The position is a long term contract opportunity and Hybrid.Candidate is expected to work onsite 2-3 days in Sunnyvale CA. • What are the top 3 skills needed/required? -Object Oriented Programing-Big Data Programing -Database Design• What skills...

  • Sr Data Engineer

    3 weeks ago

    sunnyvale, United States DRISHTICON Inc Full time

    We have immediate requirements for Sr Data Engineer with our direct clients in San Francisco Bay Area, CA. The position is a long term contract opportunity and Hybrid.Candidate is expected to work onsite 2-3 days in Sunnyvale CA. • What are the top 3 skills needed/required? -Object Oriented Programing-Big Data Programing -Database Design• What skills...

  • 3D Data Processing Operator for Consumer Electronics Company in Sunnyvale, CA

    2 weeks ago

    sunnyvale, United States OSI Engineering Full time

    Global Consumer Device Company seeking Data Processing Operator (2D/3D) in Sunnyvale, CA SummaryWork with different software tools to process visual 2D and 3D data from raw data to mission-critical datasets. Must have Skillsets2 years of experience using Windows PCs to create and modify documents (e.g. Word, Powerpoint, Excel) and using the Ability to move...

  • 3D Data Processing Operator for Consumer Electronics Company in Sunnyvale, CA

    3 weeks ago

    sunnyvale, United States OSI Engineering Full time

    Global Consumer Device Company seeking Data Processing Operator (2D/3D) in Sunnyvale, CA SummaryWork with different software tools to process visual 2D and 3D data from raw data to mission-critical datasets. Must have Skillsets2 years of experience using Windows PCs to create and modify documents (e.g. Word, Powerpoint, Excel) and using the Ability to move...

  • 3D Data Processing Operator for Consumer Electronics Company in Sunnyvale, CA

    3 weeks ago

    Sunnyvale, United States OSI Engineering Full time

    Global Consumer Device Company seeking Data Processing Operator (2D/3D) in Sunnyvale, CA SummaryWork with different software tools to process visual 2D and 3D data from raw data to mission-critical datasets. Must have Skillsets2 years of experience using Windows PCs to create and modify documents (e.g. Word, Powerpoint, Excel) and using the Ability to move...

  • GForce Life Sciences | Machine Learning Engineer | sunnyvale, ca

    6 days ago

    sunnyvale, United States GForce Life Sciences Full time

    Location: Hybrid (Sunnyvale)Duration: 12+ W2 Contract (C2C not available)Payrate: $55 - $62/hrJob Overview:The Machine Learning Engineer will design, develop, and deploy AI/ML applications at scale. The role involves creating robust systems, building data pipelines, and working with cross-functional teams to integrate AI solutions into products. You will be...

  • Senior Data Engineer

    3 weeks ago

    sunnyvale, United States Big Cloud Full time

    Would you like to shape a computer vision platform at an exciting start-up?Are you interested in a cross-functional team working across AI and 3D generative video?This start-up is revolutionizing video through AI-powered virtual environments. The team are architecting early-stage cutting-edge generative computer vision technology for iOS and web platforms...

  • Senior Data Engineer

    4 weeks ago

    sunnyvale, United States Big Cloud Full time

    Would you like to shape a computer vision platform at an exciting start-up?Are you interested in a cross-functional team working across AI and 3D generative video?This start-up is revolutionizing video through AI-powered virtual environments. The team are architecting early-stage cutting-edge generative computer vision technology for iOS and web platforms...

  • Facebook | Hardware Test Engineer | sunnyvale, ca

    6 days ago

    sunnyvale, United States Facebook Full time

    Meta Reality Labs - W2 Contract Hardware Test Engineer - Sunnyvale Job Description: Meta is seeking a Hardware Test Engineer to join their team in Sunnyvale, CA! In this position, you will be working with a collaborative team that is very supportive of one another. You will be be working in a Lab environment conducting lab tests, bench measurements, and...

  • Facebook | Hardware Test Engineer | sunnyvale, ca

    5 days ago

    sunnyvale, United States Facebook Full time

    Meta Reality Labs - W2 Contract Hardware Test Engineer - Sunnyvale Job Description: Meta is seeking a Hardware Test Engineer to join their team in Sunnyvale, CA! In this position, you will be working with a collaborative team that is very supportive of one another. You will be be working in a Lab environment conducting lab tests, bench measurements, and...

  • Senior Data Engineer

    1 month ago

    Sunnyvale, United States Big Cloud Full time

    Would you like to shape a computer vision platform at an exciting start-up?Are you interested in a cross-functional team working across AI and 3D generative video?This start-up is revolutionizing video through AI-powered virtual environments. The team are architecting early-stage cutting-edge generative computer vision technology for iOS and web platforms...

  • PeopleLogic | QE Automation | sunnyvale, ca

    5 days ago

    sunnyvale, United States PeopleLogic Full time

    Role: QE AutomationLocation: Sunnyvale, CADuration: Full-timeJob Description • 5+ years experience in Java in a service oriented architecture• 5+ years experience with Junit/TestNG, Jenkins, Gradle,SQL, JSON, XML• Experience in writing test automation frameworks for REST services• Experience in developing test strategies, test frameworks and tools•...