Senior Data Engineer, GFP Analytics

Found in: Talent US C2 - 2 weeks ago

Austin, United States Amazon.com Services LLC Full time
The GFP Analytics Data & Infrastructure team consists of experienced engineers and manages a suite of core data services that ingests and processes all data related to Amazon’s rapidly growing delivery fleet of vans, trucks, electric vehicles, and more. The tech stack designed, built, and operated by the team uses an event-driven architectural paradigm enabled through creative use of AWS- and Amazon-internal data services.

As a senior data engineer on this team, you will have the exciting opportunity to work on one of the largest vehicle based data sets in the world. You will work closely with program managers, engineers, analysts and business teams to design solutions for their respective needs, which will require creativity and strong problem solving skills. You will also help in developing data engineering roadmaps that help build platforms to solve complex problems in efficient and scalable ways. This role will work backwards from customer problems to design solutions to meet the goals.

Additionally, you will be responsible for designing, developing, and operating a data service platform using Python, Airflow, and SQL to build the various ETL, analytics, and data quality components. You’ll automate deployments using AWS CodeDeploy, AWS CodePipeline, AWS Cloud Development Kit (CDK), and AWS Cloud Formation. You will design and implement complex data models and build the end-to-end infrastructure for reports and dashboards to be created by our customers. You will work with AWS services like Redshift, Glue, S3, IAM, CloudWatch, and more.

This role may be located out of Austin (preferably), Nashville, Seattle, or Arlington.

Responsibilities include:
- Work with external data partners to establish SFTP connections to ingest various datasets
- Interface with other technology teams to extract, transform, and load data from a wide variety of data sources using different AWS products such as Lambda, Glue, EMR, Kinesis Firehose
- Maintain and enhance existing data pipelines
- Create extensible designs and easy to maintain solutions with the long term vision in mind
- Interface with cross functional teams, gathering requirements and delivering data solutions
- Improve tools, processes, scale existing solutions, create new solutions as required based on team and stakeholder needs

About the team
Here at Global Fleet and Products (GFP), we are building the safest, most efficient, and most sustainable fleet in the world. GFP Analytics is a growing and dynamic team dedicated to the curation, governance, and analytics/reporting of data about our worldwide fleet of delivery vehicles, especially data related to managing the supply chain and ongoing operation of the fleet. We have two sub-teams, Data/Infra and BI/Analytics, comprised of a diverse set of product/program managers, data engineers, business analysts, and business intelligence engineers. We love data and helping our customers drive the GFP mission

We are open to hiring candidates to work out of one of the following locations:

Austin, TX, USA | Bellevue, WA, USA | Nashville, TN, USA

BASIC QUALIFICATIONS

- 5+ years of data engineering experience
- Experience with data modeling, warehousing and building ETL pipelines
- Experience with SQL
- Experience in at least one modern scripting or programming language, such as Python, Java, Scala, or NodeJS
- Experience mentoring team members on best practices
- Bachelor's degree in computer science, engineering, analytics, mathematics, statistics, IT or equivalent
- Experience building data products incrementally and integrating and managing data sets from multiple sources
- Experience building/operating highly available, distributed systems of data extraction, ingestion, and processing of large data sets
- Experience providing technical leadership on high-impact cross-fucntional technical project
- Experience with MPP databases such as Amazon Redshift

PREFERRED QUALIFICATIONS

- Experience with big data technologies such as: Hadoop, Hive, Spark, EMR
- Experience operating large data warehouses
- Proficiency in the DevOps style of software deployment (infrastructure-as-code)
- Proficiency with AWS database/ETL tools including Lambda, Glue, Redshift, DynamoDB
- Proficiency with AWS technologies including SNS, SQS, SES, Route 53, Cloudwatch, VPC
- Background in Big Data, non-relational databases, Machine Learning and Data Mining is a plus

  • Verification Engineer

    7 days ago

    Austin, United States Cosmik Systems LLC Full time

    Verify complex design blocks using equally complex SV/UVM verification environments Develop and execute pre-silicon verification test plans Develop directed and random verification tests to validate block and IP functionality Develop verification components and tools Develop verification functional coverage using industry standard coverage analysis...

  • Senior Data Engineer

    7 days ago

    Austin, United States Tecovas Full time

    Tecovas is the first direct-to-consumer western brand, founded with the simple goal of making the world's best western boots, apparel and leather goods - and selling them at a fair price. We are a brand revolutionizing a category and welcoming first-time boot buyers and western enthusiasts alike.Tecovas is looking for a Senior Data Engineer to join our...

  • Senior Data Engineer

    6 days ago

    Austin, United States M.V.P. Group Inc Full time

    About MVP: Headquartered in the heart of Austin, Texas, MVP is the best-in-class SaaS measurement platform that provides omnichannel media and sponsorship valuation. We offer a built-to-scale software for our clients - Fortune 1,000 brands, professional sports, global agencies and media, to accurately quantify the value of their partnerships, sponsorships,...

  • Senior Data Engineer

    1 week ago

    Austin, United States Linux Foundation Full time

    Job DescriptionJob DescriptionCompany DescriptionThe Linux Foundation is the organization of choice for the world’s top developers and companies to build ecosystems that accelerate open technology development and commercial adoption. Together with the worldwide open source community, it is solving the hardest technology problems by creating the largest...

  • Senior Data engineer

    2 days ago

    Austin, United States Diverse Lynx Full time

    Responsibilities : We are looking for a Senior Data Engineer to join our team and help us build and maintain our data infrastructure and pipelines. As a Senior Data Engineer, you will be responsible for designing, developing, and implementing scalable and reliable data solutions to support our business needs. You will also work closely with other engineers...

  • Associate Director, Data

    7 days ago

    Austin, United States THIRD EAR Full time

    **About Us** THIRD EAR is an identities-led agency for today's America. Our purpose is to unleash a deep understanding of diverse identities to craft meaningful connections between consumers and brands. With a fully integrated agency offering, services include strategic planning, creative development, branding + design, content development, media strategy +...

  • Senior Data Engineer

    1 week ago

    Austin, United States MVP Group Inc Full time

    Job DescriptionJob DescriptionAbout MVP:Headquartered in the heart of Austin, Texas, MVP is the best-in-class SaaS measurement platform that provides omnichannel media and sponsorship valuation. We offer a built-to-scale software for our clients - Fortune 1,000 brands, professional sports, global agencies and media, to accurately quantify the value of their...

  • Associate Director, Data

    3 days ago

    Austin, United States THIRD EAR Full time

    Hybrid position About Us THIRD EAR is an identities-led agency for today's America. Our purpose is to unleash a deep understanding of diverse identities to craft meaningful connections between consumers and brands. With a fully integrated agency offering, services include strategic planning, creative development, branding + design, content development, media...

  • Associate Director, Data

    2 days ago

    Austin, United States THIRD EAR Full time

    Hybrid positionAbout UsTHIRD EAR is an identities-led agency for today's America. Our purpose is to unleash a deep understanding of diverse identities to craft meaningful connections between consumers and brands. With a fully integrated agency offering, services include strategic planning, creative development, branding + design, content development, media...

  • Associate Director, Data

    7 days ago

    Austin, United States THIRD EAR Full time

    Job DescriptionJob DescriptionAbout UsTHIRD EAR is an identities-led agency for today's America. Our purpose is to unleash a deep understanding of diverse identities to craft meaningful connections between consumers and brands. With a fully integrated agency offering, services include strategic planning, creative development, branding + design, content...

  • Associate Director, Data

    7 days ago

    Austin, United States THIRD EAR Full time

    Job DescriptionJob DescriptionHybrid positionAbout UsTHIRD EAR is an identities-led agency for today's America. Our purpose is to unleash a deep understanding of diverse identities to craft meaningful connections between consumers and brands. With a fully integrated agency offering, services include strategic planning, creative development, branding +...

  • Senior Engineer, Data Infrastructure

    Found in: Resume Library US A2 - 5 days ago

    Austin, Texas, United States Procore Technologies Full time

    Job Description What if you could use your technology skills to develop a product that impacts the way communities’ hospitals, homes, sports stadiums, and schools across the world are built? Construction impacts the lives of nearly everyone in the world, and yet it’s also one of the world’s least digitized industries. That’s why we’re looking for...

  • Senior Engineer, Data Infrastructure

    Found in: Resume Library US A2 - 1 week ago

    Austin, Texas, United States Procore Technologies Full time

    Job Description What if you could use your technology skills to develop a product that impacts the way communities’ hospitals, homes, sports stadiums, and schools across the world are built? Construction impacts the lives of nearly everyone in the world, and yet it’s also one of the world’s least digitized industries, not to mention one of the most...

  • Data Engineer

    1 week ago

    Austin, United States The HT Group Full time

    MUST BE IN AUSTIN, TX NO SPONSORSHIP AVAILABLE AT THIS TIME The HT Group is hiring an experienced Power BI developer with DAX expertise and advanced SQL skills fora full time, direct hire opportunity in central Austin, TX. This Data Engineer will work within the Information Systems Department, on the Data Team, translating raw data into actionable and...

  • Data Engineer

    Found in: beBee jobs US - 2 weeks ago

    Austin, Texas, United States TekStream Solutions Full time

    TekStream has an immediate opening for a Data Engineer with a strong background in Python and API integration for a remote long term contract. Applicants able to work on W2 basis preferred.What we're looking for...Strong proficiency in Python for data manipulation and analysisMust be highly experienced in API integration developmentExperience with Databricks...

  • Lead Data Engineer

    Found in: Talent US 2 C2 - 1 week ago

    Austin, United States Texas Department of Aging & Disability Services Full time

    Job Description: The Fraud Analytics unit within the Data Reviews Division of the Office of Inspector General (OIG) is responsible for performing innovative and advanced data analytics to detect fraud, waste and abuse in state health and human services programs such as Medicaid, the Childrens Health Insurance Program (CHIP), Supplemental Nutrition...

  • Data Analytics Manager

    Found in: Talent US 2 C2 - 1 week ago

    Austin, United States Texas Department of Aging & Disability Services Full time

    Job Description: The Data Analyst V (Data Analyst Manager) reports to the Director of Operations with the Managed Care Utilization Review (MCUR) department. The Data Analyst Manager will be responsible for overseeing the day-to-day operations of the data analysts’ team, ensuring the accuracy, integrity, and efficiency of data-related processes. Performs...

  • Engineering Manager, Data

    Found in: beBee S US - 2 weeks ago

    Austin, United States Atlassian Full time

    JOB DUTIES: LEAD EFFORTS IN DEMOCRATIZING DATA AND BUILDING AN EXCEPTIONAL ANALYTICS PLATFORM FOR THE COMPANY. OVERSEE THE USE OF DATA AND DEVELOPMENT OF BACKEND SYSTEMS AND DATA MODELS TO ENABLE A WORLD-CLASS DATA ENGINEERING PRACTICE. PROVIDE DEEP TECHNICAL GUIDANCE IN A NUMBER OF ASPECTS OF DATA ENGINEERING IN A SCALABLE ECOSYSTEM. MANAGE A TEAM OF DATA...

  • Engineering Manager, Data

    Found in: beBee jobs US - 1 week ago

    Austin, Texas, United States Atlassian Full time

    JOB DUTIES:LEAD EFFORTS IN DEMOCRATIZING DATA AND BUILDING AN EXCEPTIONAL ANALYTICS PLATFORM FOR THE COMPANY. OVERSEE THE USE OF DATA AND DEVELOPMENT OF BACKEND SYSTEMS AND DATA MODELS TO ENABLE A WORLD-CLASS DATA ENGINEERING PRACTICE. PROVIDE DEEP TECHNICAL GUIDANCE IN A NUMBER OF ASPECTS OF DATA ENGINEERING IN A SCALABLE ECOSYSTEM. MANAGE A TEAM OF DATA...

  • Senior Data Engineer

    Found in: Talent US C2 - 7 days ago

    Austin, United States 2K Full time

    Who We Are 2K is headquartered in Novato, California and is a wholly owned label of Take-Two Interactive Software, Inc. (NASDAQ: TTWO). Founded in 2005, 2K Games is a global video game company, publishing titles developed by some of the most influential game development studios in the world. Our studios responsible for developing 2K’s portfolio of...