Big Data Engineer

3 weeks ago

Seattle, Washington, United States Amazon Full time


AWS Sales, Marketing, and Global Services (SMGS) is responsible for driving revenue, adoption, and growth from the largest and fastest growing small- and mid-market accounts to enterprise-level customers including public sector.

The AWS Global Support team interacts with leading companies and believes that world-class support is critical to customer success.

AWS Support also partners with a global list of customers that are building mission-critical applications on top of AWS services.


The AWS Sales, Marketing, and Global Services Operations (SMGS Ops) Revenue technology team is responsible for publishing Daily Estimated Revenue (DER) and monthly Amortized Sales Revenue (ASR).

DER and ASR are used by downstream customers in AWS Finance, Accounting, Sales Operations, Segmentation & Planning (S&P), Data & Analytics and Compensation to set quotas, manage sales goals, forecast, and derive business insights.

We collect and process billions of usage and billing transactions every single day and relate it to the largest data feed supported by We transform this raw data into actionable information in the Data Lake and make it available to our internal service owners to analyze their business and service our external customers.

We are truly leading the way to disrupt the big data industry.

We are accomplishing this vision by bringing to bear Big Data technologies like Elastic Map Reduce (EMR) in addition to data warehouse technologies like Spectrum to build a data platform capable of scaling with the ever-increasing volume of data produced by AWS services.


You should have expertise in the design, creation, management, and business use of large datasets, across a variety of data platforms.

You should have excellent business and interpersonal skills to be able to work with business owners to understand data requirements, and to build ETL to ingest the data into the data lake.

You should be an authority at crafting, implementing, and operating stable, scalable, low cost solutions to flow data from production systems into the data lake.

Above all you should be passionate about working with huge data sets and someone who loves to bring datasets together to answer business questions and drive growth.

Key job responsibilities

  • Expertise in the design, creation, management, and business use of large datasets, across a variety of data platforms.
  • Excellent business and interpersonal skills to be able to work with business owners to understand data requirements, and to build ETL to ingest the data into the data lake.
  • Be an authority at crafting, implementing, and operating stable, scalable, low cost solutions to flow data from production systems into the data lake.

  • Above all you should be passionate about working with huge data sets and someone who loves to bring datasets together to answer business questions and drive growth.

About the team

ABOUT AWS:
Diverse Experiences
Amazon values diverse experiences.

Even if you do not meet all of the preferred qualifications and skills listed in the job description, we encourage candidates to apply.

If your career is just starting, hasn't followed a traditional path, or includes alternative experiences, don't let it stop you from applying.

Why AWS
Amazon Web Services (AWS) is the world's most comprehensive and broadly adopted cloud platform.

We pioneered cloud computing and never stopped innovating - that's why customers from the most successful startups to Global 500 companies trust our robust suite of products and services to power their businesses.

Work/Life Balance
We value work-life harmony.

Achieving success at work should never come at the expense of sacrifices at home, which is why flexible work hours and arrangements are part of our culture.

When we feel supported in the workplace and at home, there's nothing we can't achieve in the cloud.

Inclusive Team Culture
Here at AWS, it's in our nature to learn and be curious. Our employee-led affinity groups foster a culture of inclusion that empower us to be proud of our differences.

Ongoing events and learning experiences, including our Conversations on Race and Ethnicity (CORE) and AmazeCon (gender diversity) conferences, inspire us to never stop embracing our uniqueness.

Mentorship and Career Growth
We're continuously raising our performance bar as we strive to become Earth's Best Employer.

That's why you'll find endless knowledge-sharing, mentorship and other career-advancing resources here to help you develop into a better-rounded professional.

BASIC QUALIFICATIONS

  • This position requires a Bachelor's Degree in Computer Science or a related technical field, and 3+ years of related employment experience.
  • 3+ years of work experience with ETL, Data Modeling, and Data Architecture.
  • Expertlevel skills in writing and optimizing SQL.
  • Experience with Big Data technologies such as Hadoop, Hive, Spark.
  • Proficiency in one of the scripting languages python, ruby, linux or similar.
PREFERRED QUALIFICATIONS

  • Experience working in very large data warehouses or data lakes.
  • Sound knowledge and handson experience in ETL optimization, designing, coding, and tuning big data processes using Apache Spark or similar technologies.
  • Experience with building data pipelines and applications to stream and process datasets at low latencies.
  • Demonstrate efficiency in handling data tracking, lineage, ensuring data quality, and improving discoverability of data.
  • Sound knowledge of distributed systems and data architecture (lambda) design and implement batch and stream data processing pipelines, knows how to optimize the distribution, partitioning in MPP architecture.
  • Knowledge of Engineering and Operational Excellence using standard methodologies.
Amazon is committed to a diverse and inclusive workplace.

Amazon is an equal opportunity employer and does not discriminate on the basis of race, national origin, gender, gender identity, sexual orientation, protected veteran status, disability, age, or other legally protected status.

For individuals with disabilities who would like to request an accommodation, please visit

Our compensation reflects the cost of labor across several US geographic markets.

The base pay for this position ranges from $91,200/year in our lowest geographic market up to $185,000/year in our highest geographic market.

Pay is based on a number of factors including market location and may vary depending on job-related knowledge, skills, and experience.

Amazon is a total compensation company.

Dependent on the position offered, equity, sign-on payments, and other forms of compensation may be provided as part of a total compensation package, in addition to a full range of medical, financial, and/or other benefits.

For more information, please visit This position will remain posted until filled. Applicants should apply via our internal or external career site.

  • Big Data Architect

    5 days ago

    Seattle, Washington, United States TikTok Full time

    About the RoleWe are seeking a highly skilled and motivated individual to join our TikTok Data Ecosystem Team as a Software Development Engineer Graduate. As a key member of our team, you will play a vital role in crafting and implementing a storage solution for offline data in our recommendation system, which caters to over a billion users.Key...

  • Big Data

    3 months ago

    Seattle, Washington, United States Elajika Inc Full time

    Job Title Technology Lead | Big Data Data Processing | SparkWork Location & Address SeattleWA Seventh Avenue Seattle Washington Zip 98101Contract duration 12Does this position require Visa independent candidates only? NoClient specific background requirements NoAssignment reporting detailsJob DetailsMust-Have SkillsJava Kafka SparkNice to have skillsScala...

  • Data Engineer, Analytics Engineering Specialist

    2 days ago

    Seattle, Washington, United States PitchBook Data Full time

    About the RoleWe are seeking a highly skilled Data Engineer to join our Enterprise Data Platform team at PitchBook Data. As a Data Engineer, you will be responsible for designing, developing, and maintaining large-scale data pipelines to support business analytics and decision-making.Key ResponsibilitiesDesign and implement data pipelines to ingest and...

  • Software Engineer

    4 days ago

    Seattle, Washington, United States Amazon Development Center U.S., Inc. Full time

    About the RoleWe are seeking a highly skilled Software Engineer to join our team at Amazon Development Center U.S., Inc. as a Software Engineer - Big Data and Distributed Systems. As a member of our team, you will have the opportunity to work on cutting-edge AWS technologies such as Kinesis, EMR, DynamoDB, Redshift, Aurora, and many more.Key...

  • Senior Data Engineer

    5 days ago

    Seattle, Washington, United States Hireio, Inc. Full time

    Job OverviewHireio, Inc. is seeking a highly skilled Senior/Staff Data Engineer to join our team. As a key member of our data engineering team, you will be responsible for designing, building, and maintaining scalable data solutions that empower our business with data-driven insights.Key ResponsibilitiesDesign and implement big data processing and...

  • Senior Data Engineer

    12 hours ago

    Seattle, Washington, United States Hireio, Inc. Full time

    Job OverviewHireio, Inc. is seeking a highly skilled Senior/Staff Data Engineer to join our team. As a key member of our data engineering team, you will be responsible for designing, building, and maintaining scalable data solutions that empower our business with data-driven insights.Key ResponsibilitiesDesign and implement large-scale data processing...

  • Data Center Civil Engineer, AWS Data Center Design Engineering

    1 week ago

    Seattle, Washington, United States Amazon Data Services, Inc. Full time

    About the RoleAmazon Data Services, Inc. is seeking a highly skilled Data Center Civil Engineer to join its design team in a dynamic and innovative environment. As a Data Center Civil Engineer, you will play a critical role in the design and construction of Amazon's global infrastructure.Key ResponsibilitiesManage external civil design consultants through...

  • Staff Software Development Engineer

    3 days ago

    Seattle, Washington, United States PitchBook Data Full time

    About the RoleWe are seeking a highly skilled and experienced Staff Software Development Engineer to join our Product and Engineering team at PitchBook Data. As a key member of our team, you will be responsible for architecting and delivering the next suite of services that power our platform.Key ResponsibilitiesArchitect, design, develop, and maintain...

  • Staff Software Development Engineer

    15 hours ago

    Seattle, Washington, United States PitchBook Data Full time

    About the RoleWe are seeking a highly skilled and experienced Staff Software Development Engineer to join our Product and Engineering team at PitchBook Data. As a key member of our team, you will be responsible for architecting and delivering the next suite of services that power our platform.Key ResponsibilitiesArchitect, design, develop, and maintain...

  • Senior Data Engineer

    5 days ago

    Seattle, Washington, United States GEICO Full time

    Job SummaryGEICO is seeking an experienced Senior Data Engineer to join our team as a Staff Engineer - Data Lakehouse Platform. As a key member of our engineering staff, you will play a critical role in driving our insurance business transformation by designing and building high-performance, low-maintenance, zero-downtime platforms and core data...

  • Data Engineer, People Analytics

    1 month ago

    Seattle, Washington, United States SoFi Full time

    Employee Applicant Privacy Notice Who we are:Shape a brighter financial future with us.Together with our members, we're changing the way people think about and interact with personal finance.We're a next-generation financial services company and national bank using innovative, mobile-first technology to help our millions of members reach their goals. The...

  • Data Engineer

    3 days ago

    Seattle, Washington, United States Amazon Services LLC Full time

    About the RoleWe are seeking a highly skilled Data Engineer to join our innovative team at Amazon Services LLC. As a Data Engineer, you will play a critical role in designing, implementing, and supporting our data lake infrastructure using AWS big data stack, Python, Redshift, Quicksight, Glue/lake formation, EMR/Spark/Scala, Athena, and other...

  • Data Engineer II

    3 weeks ago

    Seattle, Washington, United States Expedia Group Full time

    If you need assistance during the recruiting process due to a disability, please reach out to our Recruiting Accommodations Team through the Accommodation Request form. This form is used only by individuals with disabilities who require assistance or adjustments in applying and interviewing for a job. This form is not for inquiring about a position or the...

  • Senior Data Engineer

    3 weeks ago

    Seattle, Washington, United States Swiftly Full time

    Swiftly is a leading provider of technology and solutions for retailers worldwide. Our best-in-class platform delivers innovative, turn-key solutions that empower retailers to grow sales and build loyalty, while enabling brands to reach more shoppers through retail media networks. Swiftly is the first vendor in the industry to connect the digital and...

  • Senior Software Engineer

    12 hours ago

    Seattle, Washington, United States Databricks Full time

    About the RoleWe are seeking a highly skilled Senior Software Engineer to join our Runtime team at Databricks. As a key member of our team, you will be responsible for building the next generation of distributed data storage and processing systems that can outperform specialized SQL query engines in relational query performance.Key ResponsibilitiesDesign and...

  • Principal Data Solutions Engineer

    2 months ago

    Seattle, Washington, United States Liberty Mutual Insurance Full time

    Pay PhilosophyThe typical starting salary range for this role is determined by a number of factors including skills, experience, education, certifications and location. The full salary range for this role reflects the competitive labor market value for all employees in these positions across the national market and provides an opportunity to progress as...

  • Senior Software Engineer

    1 day ago

    Seattle, Washington, United States Databricks Full time

    About the RoleWe are seeking a highly skilled Senior Software Engineer to join our Runtime team at Databricks. As a key member of our team, you will be responsible for building the next generation of distributed data storage and processing systems that can outperform specialized SQL query engines in relational query performance.Key ResponsibilitiesDesign and...

  • Senior Data Engineer

    3 weeks ago

    Seattle, Washington, United States Pacific Northwest National Laboratory Full time

    Senior Data Engineer - SeattlePacific Northwest National Laboratory - Seattle, WAOverview:Protecting U.S. residents and visitors is among our nation's highest priorities. As adversaries gain access to sophisticated technologies and materials, the threats grow more dynamic and complex—from cyber and nuclear to chemical and biological weapons of mass effect...

  • Data Science Engineer

    1 week ago

    Seattle, Washington, United States AI Technologies LLC. Full time

    Job OverviewJob ID: J38181Specialized Area: Data ScienceJob Title: Data Science EngineerLocation: RemoteDuration: 12 MonthsEmployment Type: W-2Job SummaryWe are seeking a highly skilled Data Science Engineer to join our team at AI Technologies LLC. as a Business Intelligence Specialist. In this role, you will be responsible for driving business growth by...

  • Machine Learning Engineer II

    1 week ago

    Seattle, Washington, United States Expedia Group Full time

    About the RoleWe are seeking a highly skilled Machine Learning Engineer II to join our team at Expedia Group. As a key member of our Machine Learning Engineering group, you will be responsible for designing, coding, and deploying large-scale batch and real-time ML solutions.Key ResponsibilitiesCollaborate with Cross-Functional Teams: Work with Machine...