Sr. Data Engineer

2 days ago

Beaverton, OR, United States BizTek People Full time
Job Posting

The Data Engineer will collaborate with product owners, developers, database architects, data analysts, visual developers and data scientists on data initiatives and will ensure optimal data delivery and architecture is consistent throughout ongoing projects.

Must be self-directed and comfortable supporting the data needs of the product roadmap. The right candidate will be excited by the prospect of optimizing and building integrated and aggregated data objects to architect and support our next generation of products and data initiatives.

Create and maintain optimal data pipeline architecture, Assemble large, complex data sets that meet functional / non-functional business requirements. Identify, design, and implement internal process improvements: automating manual processes, optimizing data delivery, re-designing for greater scalability Comprehensive documentation and knowledge transfer to Production Support Work with Production Support to analyze and fix Production issues Participate in an Agile / Scrum methodology to deliver high-quality software releases every 2 weeks through Sprint Refine, plan stories, and deliver timely Analyze requirement documents and Source to target mapping

Must Have Skills

5+ years' experience in Big Data stack environments like AWS EMR, Clourdera, Hortonworks

3+ years of SPARK in batch mode

3+ years of experience in scripting using Python

3+ years of experience working on AWS Cloud environment

In-depth knowledge of Hive and S3

Strong understanding of Hadoop, MPP systems and data structures

Strong understanding of solution and technical design

Experience building cloud scalable high-performance data lake solutions

Experience with relational SQL & tools like Snowflake

Aware of Data warehouse concepts

Performance tuning with large datasets

Experience with source control tools such as GitHub and related dev processes

Experience with workflow scheduling tools like Airflow

Strong problem solving and analytical mindset

Able to influence and communicate effectively, both verbally and written, with team members and business stakeholders

  • Data Engineer

    5 days ago

    Beaverton, OR, United States Oregon Staffing Full time

    Data Engineer Build and deliver scalable data and analytics solutions focused on Consumer and Marketplace data products. Design, implement and integrate new technologies and evolve data and analytics products. Contribute to all aspects of data engineering from ingestion, transformation, and consumption in addition to designing and building test-driven...

  • Data Engineer

    4 days ago

    Beaverton, OR, United States Oregon Staffing Full time

    Data Engineer Build and deliver scalable data and analytics solutions focused on Consumer and Marketplace data products. Design, implement and integrate new technologies and evolve data and analytics products. Contribute to all aspects of data engineering from ingestion, transformation, and consumption in addition to designing and building test-driven...

  • Data Engineer

    4 days ago

    Beaverton, OR, United States Oregon Staffing Full time

    Data Engineer Build and deliver scalable data and analytics solutions focused on Consumer and Marketplace data products. Design, implement and integrate new technologies and evolve data and analytics products. Contribute to all aspects of data engineering from ingestion, transformation, and consumption in addition to designing and building test-driven...

  • Data Engineer

    4 days ago

    Beaverton, OR, United States Oregon Staffing Full time

    Data Engineer Build and deliver scalable data and analytics solutions focused on Consumer and Marketplace data products. Design, implement and integrate new technologies and evolve data and analytics products. Contribute to all aspects of data engineering from ingestion, transformation, and consumption in addition to designing and building test-driven...

  • Data Engineer

    4 days ago

    Beaverton, OR, United States Oregon Staffing Full time

    Data Engineer Build and deliver scalable data and analytics solutions focused on Consumer and Marketplace data products. Design, implement and integrate new technologies and evolve data and analytics products. Contribute to all aspects of data engineering from ingestion, transformation, and consumption in addition to designing and building test-driven...

  • Data Engineer

    4 days ago

    Beaverton, OR, United States Oregon Staffing Full time

    Data Engineer Build and deliver scalable data and analytics solutions focused on Consumer and Marketplace data products. Design, implement and integrate new technologies and evolve data and analytics products. Contribute to all aspects of data engineering from ingestion, transformation, and consumption in addition to designing and building test-driven...

  • Data Engineer

    3 days ago

    Beaverton, OR, United States Oregon Staffing Full time

    Data Engineer Build and deliver scalable data and analytics solutions focused on Consumer and Marketplace data products. Design, implement and integrate new technologies and evolve data and analytics products. Contribute to all aspects of data engineering from ingestion, transformation, and consumption in addition to designing and building test-driven...

  • Data Engineer

    3 days ago

    Beaverton, OR, United States Oregon Staffing Full time

    Data Engineer Build and deliver scalable data and analytics solutions focused on Consumer and Marketplace data products. Design, implement and integrate new technologies and evolve data and analytics products. Contribute to all aspects of data engineering from ingestion, transformation, and consumption in addition to designing and building test-driven...

  • Data Engineer

    3 days ago

    Beaverton, OR, United States Oregon Staffing Full time

    Data Engineer Build and deliver scalable data and analytics solutions focused on Consumer and Marketplace data products. Design, implement and integrate new technologies and evolve data and analytics products. Contribute to all aspects of data engineering from ingestion, transformation, and consumption in addition to designing and building test-driven...

  • Data Engineer

    3 days ago

    Beaverton, OR, United States Oregon Staffing Full time

    Data Engineer Build and deliver scalable data and analytics solutions focused on Consumer and Marketplace data products. Design, implement and integrate new technologies and evolve data and analytics products. Contribute to all aspects of data engineering from ingestion, transformation, and consumption in addition to designing and building test-driven...