Data Engineer

18 hours ago

Beaverton, United States InterSources Full time

Job Description: Job Title: Senior Data Engineer

About Us:
We are the Consumer Data Engineering team (CoDE) at ***, seeking an experienced Senior Data Engineer to join our team. As a Senior Data Engineer, you will play a critical role in designing, building, and maintaining our big data infrastructure, ensuring the scalability, reliability, and performance of our data systems.

Job Summary:
We are looking for a highly skilled Senior Data Engineer with a strong background in big data engineering, cloud computing, and software development. The ideal candidate will have a proven track record of designing and implementing scalable data solutions using AWS, Spark, and Python. The candidate should have hands-on experience with Databricks, optimizing Spark applications, and building ETL pipelines. Experience with CI/CD, unit testing, and big data problem-solving is a plus.

Key Responsibilities:
• Design, build, and maintain large-scale data pipelines using AWS EMR, Spark, and Python
• Develop and optimize Spark applications and ETL pipelines for performance and scalability
• Collaborate with product managers and analysts to design and implement data models and data warehousing solutions
• Work with cross-functional teams to integrate data systems with other applications and services
• Ensure data quality, integrity, and security across all data systems
• Develop and maintain unit test cases for data pipelines and applications
• Implement CI/CD pipelines for automated testing and deployment
• Collaborate with the DevOps team to ensure seamless deployment of data applications
• Stay up to date with industry trends and emerging technologies in big data and cloud computing

Requirements:
• At least 5 years of experience in data engineering, big data, or a related field
• Proficiency in Spark, including Spark Core, Spark SQL, and Spark Streaming
• Experience with AWS EMR, including cluster management and job optimization
• Strong skills in Python, including data structures, algorithms, and software design patterns
• Hands-on experience with Databricks, including Databricks Lakehouse (advantageous)
• Experience with optimizing Spark applications and ETL pipelines for performance and scalability
• Good understanding of data modeling, data warehousing, and data governance
• Experience with CI/CD tools such as Jenkins, GitLab, or CircleCI (advantageous)
• Strong understanding of software development principles, including unit testing and test-driven development
• Ability to design and implement scalable data solutions that meet business requirements
• Strong problem-solving skills, with the ability to debug complex data issues
• Excellent communication and collaboration skills, with the ability to work with cross-functional teams

Nice to Have:
• Experience with Databricks Lakehouse
• Knowledge of data engineering best practices and design patterns
• Experience with agile development methodologies, such as Scrum or Kanban
Comments for Suppliers: Notes:
The team is looking for a Data Engineer with experience in big data infrastructure and system migration.

Please note this role will be affected by DTL.

Remote, PST hours

REQUIRED:
5+ years in data engineering
Experience with AWS EMR, including cluster management and job optimization
Proficiency in Spark, including Spark Core, Spark SQL, and Spark Streaming

IDEAL CANDIDATE:
Hands on experience with Databricks and Lakehouse data
Migrating from AWS EMR to Databricks Lakehouse

Team:
Supporting the Commercial Analytics Engineering department

  • Data Engineer

    1 week ago

    Beaverton, United States Equiliem Full time

    Data Engineer - Lead Establishes database management systems, standards, guidelines and quality assurance for database deliverables, such as conceptual design, logical database, capacity planning, external data interface specification, data loading plan, data maintenance plan and security policy. Documents and communicates database design. Evaluates and...

  • Data Engineer

    4 weeks ago

    Beaverton, United States inSync Staffing Full time

    Data Engineer $72.00/hr Onsite: Beaverton, OR Will consider remote for exceptional candidates 8 month assignment Job Description: GT Title: Data Engineer - Lead New Title; Establishes database management systems, standards, guidelines and quality assurance for database deliverables, such as conceptual design, logical database,...

  • Data Engineer

    23 hours ago

    Beaverton, United States Hire Talent Full time

    Job Title: Data Engineer Job Location: Beaverton, OR Job Duration: 8 Months on W2 Job Description: Establishes database management systems, standards, guidelines and quality assurance for database deliverables, such as conceptual design, logical database, capacity planning, external data interface specification, data loading plan, data maintenance plan and...

  • Data Engineer

    3 weeks ago

    beaverton, United States Mainz Brady Group Full time

    ONSITE IN BEAVERTON 3 DAYS A WEEKEstablishes database management systems, standards, guidelines, and quality assurance protocols for database deliverables, including conceptual design, logical databases, capacity planning, external data interface specifications, data loading plans, data maintenance strategies, and security policies. Documents and...

  • Data Engineer

    3 weeks ago

    Beaverton, United States Mainz Brady Group Full time

    ONSITE IN BEAVERTON 3 DAYS A WEEKEstablishes database management systems, standards, guidelines, and quality assurance protocols for database deliverables, including conceptual design, logical databases, capacity planning, external data interface specifications, data loading plans, data maintenance strategies, and security policies. Documents and...

  • Data Engineer

    3 weeks ago

    beaverton, United States Mainz Brady Group Full time

    ONSITE IN BEAVERTON 3 DAYS A WEEKEstablishes database management systems, standards, guidelines, and quality assurance protocols for database deliverables, including conceptual design, logical databases, capacity planning, external data interface specifications, data loading plans, data maintenance strategies, and security policies. Documents and...

  • Data Engineer 3

    19 hours ago

    Beaverton, United States Hire Talent Full time

    Job Title: Data Engineer 3 Job Location: Beaverton OR (Remote) Job Duration: 12 Months on W2About Us: We are the Consumer Data Engineering team (CoDE) at ***, seeking an experienced Senior Data Engineer to join our team. As a Senior Data Engineer, you will play a critical role in designing, building, and maintaining our big data infrastructure, ensuring the...

  • Senior Data Engineer

    2 weeks ago

    Beaverton, United States Sunrise Systems, Inc. Full time

    Our client, a leading apparel and sporting goods manufacturing company, is looking for a Senior Data Engineer. This is for an initial duration of 12 months and is a REMOTE position . The candidates must be able to work in US Pacific hours.     Job Title: Senior Data Engineer Reference ID: 24-05247 Location: Beaverton, OR (REMOTE –...

  • data engineer

    24 hours ago

    Beaverton, United States Randstad Full time

    data engineer. beaverton , oregon (remote) posted november 20, 2024 job details summary $55 - $60 per hour contract bachelor degree category computer and mathematical occupations reference1072791 job details job summary: WHO ARE WE LOOKING FOR We seek passionate analyst to join our team! As a Business Analyst, you will develop data...

  • Senior Data Engineer

    2 months ago

    Beaverton, United States RTA US Full time

    Job DescriptionJob DescriptionThe Information Technology team at Russell Tobin & Associates is supporting one of the top Sports Clients that has an opening for a Senior Data Engineer.Location: Beaverton, OR (Onsite)Pay Rate Range: $60 - $65/hour W2, based on experienceDuration: 7+ months contractResponsibilities:Establishes database management systems,...

  • Data Engineer 4

    1 month ago

    Beaverton, United States RTA US Full time

    Job DescriptionJob DescriptionThe Information Technology team at Russell Tobin & Associates is supporting one of the top Sporting Goods Manufacturing company and that has an opening for a Senior Data Engineer.Location: Beaverton, ORPay Rate Range: $50 - $62/hour W2, based on experienceDuration: 9+ months contractEstablishes database management systems,...

  • Data Architect

    1 month ago

    beaverton, United States Talent Groups Full time

    Data ArchitectLocation: Hybrid - Beaverton, ORTalent Groups is seeking a Data Platform Architect to lead the design and strategy of a scalable data environment. This role involves close collaboration with cross-functional teams to shape the future of data infrastructure.Key Responsibilities:Evaluate and improve the current data infrastructure for...

  • Data Architect

    2 months ago

    beaverton, United States Talent Groups Full time

    Data ArchitectLocation: Hybrid - Beaverton, ORTalent Groups is seeking a Data Platform Architect to lead the design and strategy of a scalable data environment. This role involves close collaboration with cross-functional teams to shape the future of data infrastructure.Key Responsibilities:Evaluate and improve the current data infrastructure for...

  • Data Architect

    2 months ago

    Beaverton, United States Talent Groups Full time

    Data ArchitectLocation: Hybrid - Beaverton, ORTalent Groups is seeking a Data Platform Architect to lead the design and strategy of a scalable data environment. This role involves close collaboration with cross-functional teams to shape the future of data infrastructure.Key Responsibilities:Evaluate and improve the current data infrastructure for...

  • Data Analyst 4

    2 weeks ago

    Beaverton, United States Mainz Brady Group Full time

    Data Analyst (Mid-Level) Our Fortune 100 client is looking for a Data Analyst This is a contract role: Skill set Experience in Agile/Scrum (Incl. SAFe) and waterfall methodology with cross-functional team expanding against multiple time zones. Deep understanding of data warehousing, development/support Data profiling that involves analyzing and...

  • Distinguished Engineer

    4 weeks ago

    Beaverton, United States NIKE Full time

    Become a Part of the NIKE, Inc. Team NIKE, Inc. does more than outfit the world's best athletes. It is a place to explore potential, obliterate boundaries and push out the edges of what can be. The company looks for people who can grow, think, dream and create. Its culture thrives by embracing diversity and rewarding imagination. The brand seeks achievers,...

  • Distinguished Engineer

    4 weeks ago

    Beaverton, United States NIKE Full time

    Become a Part of the NIKE, Inc. Team NIKE, Inc. does more than outfit the world's best athletes. It is a place to explore potential, obliterate boundaries and push out the edges of what can be. The company looks for people who can grow, think, dream and create. Its culture thrives by embracing diversity and rewarding imagination. The brand seeks achievers,...

  • Data Analyst

    1 week ago

    Beaverton, United States 24 Seven Talent Full time

    $63.37/hr + benefits on W2Onsite in Beaverton, OR (WFH Fridays)3+ month contract with likely extension/conversionAs a Business Analyst, you will develop data quality framework to surface data & pipeline health issues in real time to upstream teams thus signaling on root cause of failure and reducing processing time to log in ticket and debug. This framework...

  • Data Analyst

    1 week ago

    Beaverton, United States 24 Seven Talent Full time

    $63.37/hr + benefits on W2Onsite in Beaverton, OR (WFH Fridays)3+ month contract with likely extension/conversionAs a Business Analyst, you will develop data quality framework to surface data & pipeline health issues in real time to upstream teams thus signaling on root cause of failure and reducing processing time to log in ticket and debug. This framework...

  • Data Scientist

    1 month ago

    Beaverton, Oregon, United States Nike Full time

    **Unlock the Power of AI at Nike**At Nike, we're on a mission to inspire and innovate for all athletes. We're looking for a highly skilled Data Scientist to join our AI team, where you'll have the opportunity to work on cutting-edge projects that drive business outcomes and create a competitive edge in the market.The ideal candidate will have a strong...