Data Engineer 3

18 hours ago


Beaverton, United States Hire Talent Full time
Job Title: Data Engineer 3
Job Location: Beaverton OR (Remote)
Job Duration: 12 Months on W2


About Us:
We are the Consumer Data Engineering team (CoDE) at ***, seeking an experienced Senior Data Engineer to join our team. As a Senior Data Engineer, you will play a critical role in designing, building, and maintaining our big data infrastructure, ensuring the scalability, reliability, and performance of our data systems.

Job Summary:
We are looking for a highly skilled Senior Data Engineer with a strong background in big data engineering, cloud computing, and software development. The ideal candidate will have a proven track record of designing and implementing scalable data solutions using AWS, Spark, and Python. The candidate should have hands-on experience with Databricks, optimizing Spark applications, and building ETL pipelines. Experience with CI/CD, unit testing, and big data problem-solving is a plus.

Key Responsibilities:
• Design, build, and maintain large-scale data pipelines using AWS EMR, Spark, and Python
• Develop and optimize Spark applications and ETL pipelines for performance and scalability
• Collaborate with product managers and analysts to design and implement data models and data warehousing solutions
• Work with cross-functional teams to integrate data systems with other applications and services
• Ensure data quality, integrity, and security across all data systems
• Develop and maintain unit test cases for data pipelines and applications
• Implement CI/CD pipelines for automated testing and deployment
• Collaborate with the DevOps team to ensure seamless deployment of data applications
• Stay up to date with industry trends and emerging technologies in big data and cloud computing

Requirements:
• At least 5 years of experience in data engineering, big data, or a related field
• Proficiency in Spark, including Spark Core, Spark SQL, and Spark Streaming
• Experience with AWS EMR, including cluster management and job optimization
• Strong skills in Python, including data structures, algorithms, and software design patterns
• Hands-on experience with Databricks, including Databricks Lakehouse (advantageous)
• Experience with optimizing Spark applications and ETL pipelines for performance and scalability
• Good understanding of data modeling, data warehousing, and data governance
• Experience with CI/CD tools such as Jenkins, GitLab, or CircleCI (advantageous)
• Strong understanding of software development principles, including unit testing and test-driven development
• Ability to design and implement scalable data solutions that meet business requirements
• Strong problem-solving skills, with the ability to debug complex data issues
• Excellent communication and collaboration skills, with the ability to work with cross-functional teams

Nice to Have:
• Experience with Databricks Lakehouse
• Knowledge of data engineering best practices and design patterns
• Experience with agile development methodologies, such as Scrum or Kanban

REQUIRED:
5+ years in data engineering
Experience with AWS EMR, including cluster management and job optimization
Proficiency in Spark, including Spark Core, Spark SQL, and Spark Streaming

IDEAL CANDIDATE:
Hands on experience with Databricks and Lakehouse data
Migrating from AWS EMR to Databricks Lakehouse

Team:
Supporting the Commercial Analytics Engineering department
  • Data Engineer

    3 weeks ago


    beaverton, United States Mainz Brady Group Full time

    ONSITE IN BEAVERTON 3 DAYS A WEEKEstablishes database management systems, standards, guidelines, and quality assurance protocols for database deliverables, including conceptual design, logical databases, capacity planning, external data interface specifications, data loading plans, data maintenance strategies, and security policies. Documents and...

  • Data Engineer

    3 weeks ago


    Beaverton, United States Mainz Brady Group Full time

    ONSITE IN BEAVERTON 3 DAYS A WEEKEstablishes database management systems, standards, guidelines, and quality assurance protocols for database deliverables, including conceptual design, logical databases, capacity planning, external data interface specifications, data loading plans, data maintenance strategies, and security policies. Documents and...

  • Data Engineer

    3 weeks ago


    beaverton, United States Mainz Brady Group Full time

    ONSITE IN BEAVERTON 3 DAYS A WEEKEstablishes database management systems, standards, guidelines, and quality assurance protocols for database deliverables, including conceptual design, logical databases, capacity planning, external data interface specifications, data loading plans, data maintenance strategies, and security policies. Documents and...

  • Software Engineer

    2 weeks ago


    Beaverton, United States Hire Talent Full time

    Job Title: Software Engineer - Niche 3 Location: Beaverton, OR Duration: 12 MonthsWHO ARE WE LOOKING FOR We're looking for a seasoned engineer with the skills to automate repeatable processes, develop integrated solutions, and help deliver a seamless data and reporting platform. The candidate will have demonstrable experience coding and scripting using...

  • Data Engineer

    17 hours ago


    Beaverton, United States InterSources Full time

    Job Description: Job Title: Senior Data Engineer About Us: We are the Consumer Data Engineering team (CoDE) at ***, seeking an experienced Senior Data Engineer to join our team. As a Senior Data Engineer, you will play a critical role in designing, building, and maintaining our big data infrastructure, ensuring the scalability, reliability, and performance...

  • Data Scientist 3

    2 weeks ago


    Beaverton, United States Sunrise Systems, Inc. Full time

    Our client, a leading sporting goods & apparel manufacturing company, is looking for Data Scientist 3 in Beaverton, OR Job Title: Data Scientist 3 Reference ID:  24-05185 Location: Beaverton, OR Duration: 6 months Job Type: Contract (Candidates must be able to work on W2 without VISA sponsorship) This Assignment is OnSite at WHQ Top...

  • Data Engineer

    1 week ago


    Beaverton, United States Equiliem Full time

    Data Engineer - Lead Establishes database management systems, standards, guidelines and quality assurance for database deliverables, such as conceptual design, logical database, capacity planning, external data interface specification, data loading plan, data maintenance plan and security policy. Documents and communicates database design. Evaluates and...

  • Data Engineer

    4 weeks ago


    Beaverton, United States inSync Staffing Full time

    Data Engineer $72.00/hr Onsite: Beaverton, OR Will consider remote for exceptional candidates 8 month assignment Job Description: GT Title: Data Engineer - Lead New Title; Establishes database management systems, standards, guidelines and quality assurance for database deliverables, such as conceptual design, logical database,...

  • Data Engineer

    22 hours ago


    Beaverton, United States Hire Talent Full time

    Job Title: Data Engineer Job Location: Beaverton, OR Job Duration: 8 Months on W2 Job Description: Establishes database management systems, standards, guidelines and quality assurance for database deliverables, such as conceptual design, logical database, capacity planning, external data interface specification, data loading plan, data maintenance plan and...

  • Data Scientist 3

    22 hours ago


    Beaverton, United States Hire Talent Full time

    Job Title: Data and Analytics - Data Scientist/Architect Job Location: Beaverton, OR Job Duration: 06 Months on W2Job Description: Designs, develops and programs methods, processes, and systems to consolidate and analyze structured/unstructured, diverse "big data" sources to generate actionable insights and solutions for client services and product...

  • data engineer

    22 hours ago


    Beaverton, United States Randstad Full time

    data engineer. beaverton , oregon (remote) posted november 20, 2024 job details summary $55 - $60 per hour contract bachelor degree category computer and mathematical occupations reference1072791 job details job summary: WHO ARE WE LOOKING FOR We seek passionate analyst to join our team! As a Business Analyst, you will develop data...

  • Senior Data Engineer

    2 weeks ago


    Beaverton, United States Sunrise Systems, Inc. Full time

    Our client, a leading apparel and sporting goods manufacturing company, is looking for a Senior Data Engineer. This is for an initial duration of 12 months and is a REMOTE position . The candidates must be able to work in US Pacific hours.     Job Title: Senior Data Engineer Reference ID: 24-05247 Location: Beaverton, OR (REMOTE –...

  • Senior Data Engineer

    2 months ago


    Beaverton, United States RTA US Full time

    Job DescriptionJob DescriptionThe Information Technology team at Russell Tobin & Associates is supporting one of the top Sports Clients that has an opening for a Senior Data Engineer.Location: Beaverton, OR (Onsite)Pay Rate Range: $60 - $65/hour W2, based on experienceDuration: 7+ months contractResponsibilities:Establishes database management systems,...

  • Data Engineer 4

    1 month ago


    Beaverton, United States RTA US Full time

    Job DescriptionJob DescriptionThe Information Technology team at Russell Tobin & Associates is supporting one of the top Sporting Goods Manufacturing company and that has an opening for a Senior Data Engineer.Location: Beaverton, ORPay Rate Range: $50 - $62/hour W2, based on experienceDuration: 9+ months contractEstablishes database management systems,...


  • Beaverton, United States HireTalent Full time

    Job Title: Senior IAM EngineerLocation: Beaverton, ORDuration: 07 Months Job Description: If you're the one for this role, you'll be joining the Client Global Technology organization. Client Global Technology brings together technology and process expertise into one streamlined, consumer- and customer-oriented team. We deliver one-stop, integrated process...


  • Beaverton, United States Hire Talent Full time

    Job Title: Senior IAM Engineer Location: Beaverton, OR Duration: 07 Months Job Description: If you're the one for this role, you'll be joining the Client Global Technology organization. Client Global Technology brings together technology and process expertise into one streamlined, consumer- and customer-oriented team. We deliver one-stop, integrated process...

  • Software Engineer 3

    1 week ago


    Beaverton, United States Hire Talent Full time

    Job Title: Senior Software Engineer - GitHub Location: Beaverton, OR Duration: 12 Months W2.Job Description: ABOUT THE ROLE We are looking for a senior software engineer to join a platform team that administers a large, complex GitHub environment for client engineering teams. The engineer will help create automation for administration and governance....

  • Business Analyst 3

    24 hours ago


    Beaverton, United States Hire Talent Full time

    Job Title: Business Analyst Location: Remote Duration: 03 Months on W2 Job Description: WHO ARE WE LOOKING FOR We seek passionate analysts to join our team! As a Business Analyst, you will develop a data quality framework to surface data & pipeline health issues in real-time to upstream teams thus signalling the root cause of failure and reducing processing...

  • Data Analyst

    1 week ago


    Beaverton, United States 24 Seven Talent Full time

    $63.37/hr + benefits on W2Onsite in Beaverton, OR (WFH Fridays)3+ month contract with likely extension/conversionAs a Business Analyst, you will develop data quality framework to surface data & pipeline health issues in real time to upstream teams thus signaling on root cause of failure and reducing processing time to log in ticket and debug. This framework...

  • Data Analyst

    1 week ago


    Beaverton, United States 24 Seven Talent Full time

    $63.37/hr + benefits on W2Onsite in Beaverton, OR (WFH Fridays)3+ month contract with likely extension/conversionAs a Business Analyst, you will develop data quality framework to surface data & pipeline health issues in real time to upstream teams thus signaling on root cause of failure and reducing processing time to log in ticket and debug. This framework...