Data Engineer

5 days ago

Sunnyvale, California, United States VDart Inc Full time
Job Title: Data Engineer

VDart Inc is seeking a highly skilled Data Engineer to join our team.

Job Summary:

We are looking for a talented Data Engineer to design and develop big data applications using the latest open source technologies. The ideal candidate will have experience with GCP, Hadoop, Spark, and Scala, and will be able to automate workflows using Apache Airflow.

Key Responsibilities:

  • Design and develop big data applications using GCP, Hadoop, Spark, and Scala.
  • Develop logical and physical data models for big data platforms.
  • Automate workflows using Apache Airflow.
  • Create data pipelines using Apache Hive, Apache Spark, and Apache Kafka.
  • Provide ongoing maintenance and enhancements to existing systems and participate in rotational on-call support.
  • Learn our business domain and technology infrastructure quickly and share your knowledge freely and actively with others in the team.
  • Mentor junior engineers on the team.
  • Lead daily standups and design reviews.
  • Groom and prioritize backlog using JIRA.
  • Act as the point of contact for your assigned business domain.

Requirements:

We are looking for a candidate with:

  • 2+ years of recent GCP experience.
  • Experience building data pipelines in GCP.
  • GCP Dataproc, GCS & BIGQuery experience.
  • 5+ years of hands-on experience with developing data warehouse solutions and data products.
  • 5+ years of hands-on experience developing a distributed data processing platform with Hadoop, Hive or Spark, Airflow or a workflow orchestration solution.
  • 2+ years of hands-on experience in modeling and designing schema for data lakes or for RDBMS platforms.
  • Experience with programming languages: Python, Java, Scala, etc.
  • Experience with scripting languages: Perl, Shell, etc.
  • Practice working with, processing, and managing large data sets (multi TB/PB scale).
  • Exposure to test driven development and automated testing frameworks.
  • Background in Scrum/Agile development methodologies.
  • Capable of delivering on multiple competing priorities with little supervision.
  • Excellent verbal and written communication skills.
  • Bachelor's Degree in computer science or equivalent experience.

Preferred Skills:

The most successful candidates will also have experience in:

  • Gitflow.
  • Atlassian products BitBucket, JIRA, Confluence etc.
  • Continuous Integration tools such as Bamboo, Jenkins, or TFS.

What We Offer:

VDart Inc offers a competitive salary and benefits package, as well as opportunities for professional growth and development.

  • Data Engineer

    4 days ago

    Sunnyvale, California, United States Forhyre Full time

    Job Title: Data EngineerWe are seeking a highly skilled Data Engineer to join our team at Forhyre. As a Data Engineer, you will play a critical role in designing, developing, and maintaining our data infrastructure.Key Responsibilities:Design and develop ETL processes using Python and AzureDevelop and implement data models, including entity relationship...

  • Data Engineer

    2 days ago

    Sunnyvale, California, United States Forhyre Full time

    Job Title: Data EngineerWe are seeking a highly skilled Data Engineer to join our team at Forhyre. As a Data Engineer, you will play a critical role in designing, developing, and maintaining our data infrastructure.Key Responsibilities:Design and develop ETL processes using Python/Pyspark within Azure platformDevelop and implement data models, including...

  • Data Engineer

    3 days ago

    Sunnyvale, California, United States Forhyre Full time

    Job Title: Data EngineerWe are seeking a highly skilled Data Engineer to join our team at Forhyre. As a Data Engineer, you will play a critical role in designing, developing, and maintaining large-scale data systems that support our business operations.Key Responsibilities:Design and develop ETL processes using Python and Azure platformDevelop and implement...

  • Data Engineer

    3 days ago

    Sunnyvale, California, United States Forhyre Full time

    Job Title: Data EngineerWe are seeking a highly skilled Data Engineer to join our team at Forhyre. As a Data Engineer, you will play a critical role in designing, developing, and maintaining our data infrastructure.Key Responsibilities:Design and develop ETL processes using Python/Pyspark within Azure platformDevelop and implement data models, including...

  • Data Engineer

    3 days ago

    Sunnyvale, California, United States Forhyre Full time

    Job Title: Data EngineerWe are seeking a highly skilled Data Engineer to join our team at Forhyre. As a Data Engineer, you will play a critical role in designing, developing, and maintaining our data infrastructure.Key Responsibilities:Design and develop ETL processes using Python/Pyspark within Azure platformDevelop and implement data models, including...

  • Data Engineer

    24 hours ago

    Sunnyvale, California, United States Inabia Software & Consulting Inc. Full time

    Job Title: Data EngineerWe are seeking a highly skilled Data Engineer to join our team at Inabia Software & Consulting Inc. in Sunnyvale, CA.Job DescriptionThe ideal candidate will have 8+ years of experience in designing and developing big data applications using the latest open source technologies. They will be responsible for designing and developing big...

  • Senior Data Engineer

    3 weeks ago

    Sunnyvale, California, United States Wal-Mart Full time

    Job Summary:We are seeking a highly skilled Senior Data Engineer to join our team at Wal-Mart. As a Senior Data Engineer, you will be responsible for designing, developing, and maintaining large-scale data systems and architectures.Key Responsibilities:Design and implement data pipelines and architectures to support business intelligence and analytics...

  • Data Center Engineer

    3 weeks ago

    Sunnyvale, California, United States LinkedIn Full time

    About the RoleWe are seeking a highly skilled Data Center Engineer to join our team at LinkedIn. As a Data Center Engineer, you will play a critical role in designing, building, and maintaining our data centers, ensuring the stability, reliability, and security of our critical IT infrastructure.Key ResponsibilitiesReview and develop fit-out designs for new...

  • Data Engineer

    2 days ago

    Sunnyvale, California, United States LinkedIn Full time

    Job Title: Staff Data EngineerAt LinkedIn, we're committed to empowering our members to achieve their career goals. As a Staff Data Engineer, you'll play a critical role in helping us deliver data-driven insights and tools that drive member engagement, business growth, and monetization efforts.Responsibilities:Collaborate with cross-functional teams to...

  • Senior Data Engineer

    6 days ago

    Sunnyvale, California, United States Cloudious LLC Full time

    Job Title: Senior Data EngineerCloudious LLC is seeking a highly skilled Senior Data Engineer to join our team. As a Senior Data Engineer, you will be responsible for designing and developing big data applications using the latest open source technologies.Key Responsibilities:Design and develop big data applications using Hadoop, Spark, and other open source...

  • Data Engineer Position

    7 days ago

    Sunnyvale, California, United States IntelliPro Group Inc. Full time

    Job OpportunityWe are seeking a highly skilled Data Engineer to join our team at IntelliPro Group Inc.Job Summary:As a Data Engineer, you will be responsible for designing, developing, and maintaining large-scale data processing systems using Hadoop and related technologies. You will work closely with cross-functional teams to ensure data quality, integrity,...

  • Data Science Engineer

    2 weeks ago

    Sunnyvale, California, United States SRI Tech Full time

    Job DescriptionWe are seeking a highly skilled Data Science Engineer to join our team at SRI Tech Solutions.About the RoleAs a Data Science Engineer, you will be responsible for developing and implementing machine learning models using Python and R programming languages. You will work closely with our team to design and deploy scalable data pipelines, and...

  • Marketing Data Engineer

    3 weeks ago

    Sunnyvale, California, United States Fortinet Full time

    About the RoleFortinet is seeking a highly skilled Data Engineer to join our team of Marketing Analysts. The ideal candidate will be responsible for designing and implementing data pipeline architecture, automating and optimizing data flow and collection for cross-functional teams.Key ResponsibilitiesData Pipeline Architecture: Design and implement data...

  • Senior Data Center Engineer

    2 days ago

    Sunnyvale, California, United States LinkedIn Full time

    Job Title: Senior Data Center EngineerAt LinkedIn, we're committed to creating a world where everyone has the opportunity to achieve their career goals. As a Senior Data Center Engineer, you'll play a critical role in designing, building, and maintaining our data centers, ensuring the stability, reliability, and security of our critical IT infrastructure.Key...

  • Data Engineer

    2 weeks ago

    Sunnyvale, California, United States Fortinet Full time

    Job Title: Data EngineerWe are seeking a highly skilled Data Engineer to join our team at Fortinet. As a Data Engineer, you will be responsible for designing, building, and maintaining large-scale data pipelines and architectures to support our business needs.Key Responsibilities:Design and implement data pipelines to automate and optimize data flow and...

  • Data Science Engineer

    2 weeks ago

    Sunnyvale, California, United States SRI Tech Full time

    Job DescriptionWe are seeking a highly skilled Data Science Engineer to join our team at SRI Tech Solutions.About the RoleThis is a full-time position that requires a strong background in machine learning, data analysis, and software development. The ideal candidate will have experience in building and deploying machine learning models using Python and R...

  • Data Engineer

    4 days ago

    Sunnyvale, California, United States eTek IT Services, Inc. Full time

    Job DescriptionWe are seeking a highly skilled Data Engineer to join our team at eTek IT Services, Inc. The ideal candidate will have a strong background in computer programming, software development, and big data solutions.Key Responsibilities:Design, develop, and implement Hadoop ecosystem-based applications to support business requirements.Follow approved...

  • Staff Engineer

    3 weeks ago

    Sunnyvale, California, United States LinkedIn Full time

    About the RoleWe are seeking a highly skilled Data Center Engineer to join our team at LinkedIn. As a Data Center Engineer, you will play a critical role in designing, building, and maintaining our data centers, which are facilities used to house and manage critical IT infrastructure, applications, and data.Key ResponsibilitiesReview new sites, site...

  • Staff Software Engineer

    4 days ago

    Sunnyvale, California, United States LinkedIn Full time

    Job Title: Staff Software Engineer - Data ScienceAt LinkedIn, we're committed to empowering our members to achieve their career goals. As a Staff Software Engineer on our Data Science team, you'll play a critical role in building innovative data-driven solutions that drive business growth and member engagement.Responsibilities:Collaborate with...

  • Staff Software Engineer

    4 hours ago

    Sunnyvale, California, United States LinkedIn Full time

    About the RoleWe are seeking a talented Staff Software Engineer to join our Data Science team at LinkedIn. As a key member of our team, you will be responsible for designing, developing, and maintaining scalable data science applications that empower our data scientists to make data-driven decisions.ResponsibilitiesDesign and develop high-quality, scalable...