Data Ingestion Platform Engineer

3 weeks ago


Seattle, Washington, United States Redfin Full time
Job Description

In this hybrid role, you will be responsible for building and maintaining Redfin's data ingestion platform. This includes creating new data pipelines and tooling to keep our inventory updated faster and higher quality than our competitors. You will also work with spatial and shape data, integrating lat/long data within these shape files. Additionally, you will develop large-scale applications backed by relational and non-relational databases such as Postgres and SQL. You will also build tooling to monitor, maintain, and update essential data. As a senior developer, you will lead the development team and ensure that all projects are completed on time and within budget.

Required Skills and Qualifications

To be successful in this role, you should have 5+ years of experience developing full-stack data ingestion platforms. You should also have experience working with Kafka, Java, Python, Postgres, SQL, K8s, Jenkins, and Airflow in AWS. Furthermore, you should be able to build tooling to help monitor, maintain, and update essential data. Your ability to take risks, champion new ideas, and exercise thought leadership in designing, architecting, and implementing solutions for difficult challenges faced by partner teams is crucial. You should also be able to communicate effectively with stakeholders and lead the development team to ensure project success.

Benefits

Redfin offers a generous benefits package, including flexible vacation time, paid holidays, paid parental leave, and sick leave; medical, dental, and vision insurance benefits; flexible spending account, health savings account, life and disability insurance; fertility benefits, commuter benefits, Employee Assistance Programs; and 401(k) employer match.

Location

This position is a hybrid role requiring employees to work from our headquarters location in Seattle, WA every Tuesday and Wednesday, and remote all other days. Depending on your preference, you can work from either our Seattle, WA or Atlanta, GA headquarters locations.

  • Seattle, Washington, United States VDart Full time

    Job OverviewAs a key member of the VDart team, we are seeking an experienced Data Ingestion Specialist to join our team in Seattle WA. This is an onsite contract opportunity with a duration of 6+ months.The estimated salary for this role is $120,000 - $180,000 per year, depending on experience.Responsibilities:Design, build and maintain data ingestion and...


  • Seattle, Washington, United States HireIO Inc Full time

    HireIO Inc. is seeking a highly skilled Senior Software Engineer to join our Data Management Suite team. This is an exciting opportunity to build, optimize, and grow one of the largest data platforms in the world.The ideal candidate will have experience with data integration, data ingestion, and large-scale systems design. A bachelor's degree in Computer...


  • Seattle, Washington, United States Hireio, Inc. Full time

    Job SummaryWe are seeking a highly skilled Data Engineer to join our Global E-Commerce team. This role offers the opportunity to design and build data transformations efficiently and reliably, as well as develop scalable big data systems that support core products and business.About the RoleThis is a unique chance to gain hands-on experience on all kinds of...


  • Seattle, Washington, United States Snowflake Computing Full time

    About Snowflake ComputingWe are seeking a highly skilled Principal Sales Specialist to drive sales execution for our Data Engineering workload in the Enterprise segment.Job DescriptionThis is a strategic role that works closely with the broader field organization to ensure successful customer adoption of Snowflake's Data Engineering and Data Lake...


  • Seattle, Washington, United States Apple Full time

    Job Summary">We are seeking a highly skilled Big Data Engineer to join our team in Seattle, Washington. As a key member of our data engineering team, you will be responsible for designing and implementing features that rely on processing and serving very large datasets.About the Role">This is a unique opportunity to work with large-scale data systems and...


  • Seattle, Washington, United States Hireio, Inc. Full time

    Job DescriptionAt Hireio, Inc., we are seeking a highly skilled Senior Software Engineer for Data Development Platform to join our Data Management Suite team.We are building products that cover the whole lifecycle of data pipeline, including data ingestion and Integration, data development, data catalog, data security and data governance. These Products...


  • Seattle, Washington, United States Amazon Full time

    **About Amazon Worldwide Advertising**We are one of Amazon's fastest growing and most profitable businesses. Our Partner Experience and Growth (PEG) organization leverages advanced analytics and experimentation to unlock value for our advertising partners and mutual customers.As a Data Engineer, you will provide technical leadership, lead data engineering...

  • Data Engineering Lead

    3 weeks ago


    Seattle, Washington, United States Capgemini Full time

    Job DescriptionWe are seeking an experienced Data Engineering Lead to join our team at Capgemini. As a key member of our data architecture practice, you will be responsible for designing and implementing scalable data ingestion frameworks, transforming various datasets, and serving as a subject matter expert in cloud platforms.Your primary focus will be on...


  • Seattle, Washington, United States Amazon Full time

    About the RoleAs a Senior Data Engineer within our Corp FP&A team, you will be responsible for designing and developing scalable big data pipelines to ingest, transform, and publish large volumes of financial data. This opportunity is ideal for an experienced data engineer who enjoys working on large-scale computing and transforming complex data sets...


  • Seattle, Washington, United States Amazon Full time

    Senior Data ArchitectThe ideal candidate for this Senior Data Architect position at Amazon is a seasoned expert in designing and implementing large-scale data architectures. You will work closely with cross-functional teams to develop data platforms that support self-service analytics and drive business growth.Key responsibilities include:Designing and...


  • Seattle, Washington, United States Xaira Therapeutics Full time

    Data Platform Engineering LeadXaira Therapeutics is looking for a seasoned data platform engineering lead to join our team. As a senior software engineer with cloud engineering experience, you will be responsible for building our internal platform to support engineers, AI scientists, and our cutting-edge AI-powered biotechnology company. This is an exciting...


  • Seattle, Washington, United States Amazon Full time

    About this Exciting OpportunityWe are seeking a highly skilled Data Engineer to join our team at Amazon Worldwide Advertising. This is an excellent chance to work with a talented team and contribute to the success of our company. You will design, implement, and operate large-scale, high-volume, high-performance data structures for analytics and data...

  • Big Data Engineer

    3 weeks ago


    Seattle, Washington, United States Amazon Full time

    The Amazon Publisher Monetization team is shaping the future of advertising for Amazon's publishers. Our mission is to build earth's most customer-centric advertising services.Job Description:We are seeking an exceptional Data Engineer to join our team. If you have a passion for Big data technologies, building scalable real-time analytical solutions, and...


  • Seattle, Washington, United States HireIO Inc Full time

    HireIO Inc. is a leading company in the e-commerce industry, and we're looking for a skilled Sr. Data Engineer to join our team!We're a dynamic team of professionals who work together to build and maintain one of the largest data platforms in the world. As a Sr. Data Engineer, you'll have the opportunity to design, build, and optimize complex data systems...


  • Seattle, Washington, United States Amazon Full time

    About the PositionWe are seeking a highly skilled Senior Big Data Engineer to join our team. As a key member of our data engineering team, you will be responsible for designing and developing scalable big data pipelines to ingest, transform, and publish large volumes of data efficiently. You will work closely with finance and business stakeholders to...

  • Data Engineer Lead

    3 weeks ago


    Seattle, Washington, United States Insight Global Full time

    At Insight Global, we're looking for a talented Data Engineer Lead to join our team. As a key member of our Store and Supply Chain Team, you'll be responsible for designing, developing, testing, and supporting data pipelines to enable continuous data processing for data exploration, data preparation, and real-time business analytics.The ideal candidate will...


  • Seattle, Washington, United States Reddit Full time

    Job OverviewWe are seeking a skilled Data Engineer to join our Data Infrastructure team and contribute to the design, implementation, and maintenance of our next-generation data warehouse platform.


  • Seattle, Washington, United States Amazon Full time

    Job Description:Amazon is seeking an experienced Cloud Data Solutions Architect to join our Global Finance Technology team. As a key member of this team, you will be responsible for designing and developing scalable big data pipelines to ingest, transform, and publish large volumes of financial data efficiently.The ideal candidate will have 3+ years of...


  • Seattle, Washington, United States Unify Consulting Full time

    Job Details">">Capacity planning, configuring, deploying, and maintaining Databricks clusters, workspaces, and Snowflake infrastructure on Azure cloud platforms.">Automating provisioning and deployment using Terraform to ensure consistency and repeatability by treating infrastructure as code.">Monitoring and optimizing Databricks cluster performance and...


  • Seattle, Washington, United States Databricks Full time

    Transforming Data ArchitectureWe're on a mission to revolutionize the data lifecycle, from ingestion to analytics. Our vision is a unified platform that simplifies data warehousing and advanced analytics. We believe in a Lakehouse architecture that replaces traditional data warehouses, addressing challenges like data staleness, reliability, and total cost of...