Staff Data Engineer

4 weeks ago

Los Angeles, United States Metropolis Full time
Job DescriptionJob Description

Location: Santa Monica, CA, Seattle, WA, Chicago, IL, Nashville, TN or New York City, NY (Hybrid)

The Company

Metropolis develops advanced computer vision and machine learning technology that makes mobile commerce remarkable. Our platform is already deployed in hundreds of mobility facilities and industries with billions in opportunity. We're building the digital pipes through which the future of mobile commerce will move.

Position Overview and Responsibilities

At Metropolis, we are building the next-gen end-to-end data ecosystem including Data Ingestion, Data Warehousing, Data Integration, Analytic Data Products and Machine Learning capabilities. We are looking for a hands-on thought leader to drive the technical vision, design and development of the data systems. If you are excited about working with Data APIs, Data Vault and Dimensional data modeling, Serverless Cloud platforms, Data Pipeline, Data Lake, ML Ops, etc. you might be interested in this opportunity.

In this role, you will help define and build the data tech stack including Snowflake, AWS Redshift, Databricks, Python, Scala, SQL, SparkSQL, Talend, Airflow, AWS Glue, Tableau, AWS Sagemaker. You will play a key and significant role in enabling the Metropolis business teams to leverage data to meet business goals.

Key Responsibilities

  • Collaborate with Application and Engineering teams to build a strong understanding of the source data systems
  • Leverage your understanding of the source data systems to design and build conceptual, logical and physical data models for the Data Warehouse, Data Marts and MDM repositories.
  • Collaborate with the analytics and business teams to architect and implement performant data solutions for Analytics and Machine Learning business use cases.
  • Design and lead the implementation of frameworks and best practices for data ingestion, data integration and ETL processes.
  • Design and lead the implementation of data quality framework including data quality metrics and continuous data quality monitoring, assessment and resolution.
  • Create business data catalog and/or data dictionaries to document data lineages, data definitions and metadata for data domains.
  • Assist with establishing best practices and standards for data privacy and data security.
  • Work closely with data engineering, analytics, business and offshore/onshore consulting teams to ensure alignment on architecture and design.
  • Provide technical oversight and mentor development teams
  • Hands-on development to support DW and ETL initiatives.

Requirements and Qualifications

  • Bachelor's degree in a STEM discipline or related field
  • 10+ years of relevant hands-on experience in data and analytics domain / teams.
  • Expert level proficiency in SQL
  • 5+ years of demonstrated experience in building relational and dimensional data warehouse data models. Experience with Data Vault methodology would be a plus.
  • 5+ years experience in data ingestion (batch, streaming, API, etc.) and data integration (ETL) development using Informatica, Talend, AWS Glue or similar.
  • 3+ years experience working with cloud data warehouses such as Snowflake, AWS Redshift, Azure, BigQuery or similar. Proficiency in Snowflake is strongly preferred.
  • 2+ programming experience developing data solutions in Python, Java, Scala or similar
  • 2+ years Agile / Scrum experience including participating in daily sprints, backlog grooming and program increments
  • Demonstrated ability to adapt to new data technologies and learn quickly
  • Ability to communicate across all levels of the organization and work with diverse project teams.
  • Preferred local to Santa Monica, CA, Seattle, WA, or New York City, NY. Hybrid working environment (3 days in office per week). Other locations considered on a case-by-case basis.

When you join Metropolis, you'll join a team of world-class product leaders and engineers, building an ecosystem of technologies at the intersection of parking, mobility, and real estate. Our goal is to build an inclusive culture where everyone has a voice and the best idea wins. You will play a key role in building and maintaining this culture as our organization grows. The anticipated base salary for this position is $140,000.00 to 225,000.00 annually. The actual base pay offered is determined by a number of variables, including, as appropriate, the applicant's qualifications for the position, years of relevant experience, distinctive skills, level of education attained, certifications or other professional licenses held, and the location of residence and/or place of employment. Base pay is one component of Metropolis's total compensation package, which may also include access to or eligibility for healthcare benefits, a 401(k) plan, short-term and long-term disability coverage, basic life insurance, a lucrative stock option plan, bonus plans and more.

#LI-DL1 #LI-H

  • Staff Data Engineer

    14 hours ago

    Los Angeles, United States Motion Recruitment Full time

    A cutting-edge AI Series C well-funded startup that is in a rapidly growing phase, looking to IPO is hiring a Principal/Staff level Data Engineer to join their team. This person will be a leader in their space having experience working with very large amounts of streaming data. Working on a brand new R&D project, they are looking for someone with innovative...

  • Staff Data Engineer

    1 month ago

    Los Angeles, United States Motion Recruitment Full time

    A pioneering AI company based in Los Angeles is seeking a Staff Data Engineer. This role, reporting directly to the Chief Technology Officer (CTO), will be pivotal in shaping the organization's data infrastructure and team. The product you will be working on will be used by millions of people and will help make things more seamless in this specific space....

  • Data Engineer

    1 month ago

    Los Angeles, United States Proliance Consulting Full time

    Data EngineerLength: until 10/31/24 (strong possibility of extension or conversion)Associate Vendors: We are accepting applications from candidates who are currently authorized to work in the US for any employer without sponsorship.Role & Responsibilities• Build complex data engineering pipelines using Python and Airflow to hydrate datamarts in Snowflake...

  • Data Engineer

    5 days ago

    Los Angeles, United States Proliance Consulting Full time

    Data EngineerLength: until 10/31/24 (strong possibility of extension or conversion)Associate Vendors: We are accepting applications from candidates who are currently authorized to work in the US for any employer without sponsorship.Role & Responsibilities• Build complex data engineering pipelines using Python and Airflow to hydrate datamarts in Snowflake...

  • Data Engineer

    4 weeks ago

    Los Angeles, United States Proliance Consulting Full time

    Data EngineerLength: until 10/31/24 (strong possibility of extension or conversion)Associate Vendors: We are accepting applications from candidates who are currently authorized to work in the US for any employer without sponsorship.Role & Responsibilities• Build complex data engineering pipelines using Python and Airflow to hydrate datamarts in Snowflake...

  • Data Engineer

    2 hours ago

    Los Angeles, United States TekWissen LLC Full time

    Job DescriptionJob DescriptionOverview: TekWissen Group is a workforce management provider throughout the USA and many other countries in the world. Our client is a media and entertainment company that develops, produces, and markets entertainment, news, and information. It owns and operates a portfolio of news and entertainment television networks, a motion...

  • Data Engineer

    4 weeks ago

    Los Angeles, United States VISART Full time

    Responsibilities Implement data ingestion routines both real time and batch using best practices in data modeling. Develop ETL/ELT processes leveraging AWS technologies and Big data tools. Gather business and functional requirements and translate these requirements into robust scalable operable solutions that work well within the overall data...

  • Data Engineer

    1 month ago

    Los Angeles, California, United States VISART Full time

    Responsibilities Implement data ingestion routines both real time and batch using best practices in data modeling. Develop ETL/ELT processes leveraging AWS technologies and Big data tools. Gather business and functional requirements and translate these requirements into robust scalable operable solutions that work well within the overall data architecture....

  • Data Engineer II

    1 week ago

    Los Angeles, California, United States Riot Games Full time

    Data Engineers at Riot bring deep knowledge of specific technical areas and also value the opportunity to work in many broader domains. Our engineers are player-focused and aim to find solutions that make players excited to experience our games. Senior Engineers, at Riot, are often called on to help with the hardest problems on a project by using their...

  • Staff Security Engineer

    4 weeks ago

    Los Angeles, United States Incode Technologies Full time

    The Opportunity We seek a trustworthy and proactive Staff Security Engineer as the technical thought leader and driver of holistic security operations across Incode. As an early security hire at Incode, you will work across the security operations lifecycle for detection engineering and incident response, influence the security operations program...

  • Lead Data Engineer

    13 hours ago

    Los Angeles, United States SoLo Funds Full time

    SoLo Funds is on a mission to help the millions of Americans that live paycheck to paycheck and can’t survive a money crunch. Launched in 2018 as a unique and proprietary lending marketplace, today SoLo is the leading alternative financial solution providing the fastest loans available for borrowers and the opportunity for lenders to earn significant...

  • Principal Data Engineer

    4 weeks ago

    Los Angeles, California, United States Riot Games Full time

    Data Engineers at Riot bring deep knowledge of data management so we can synthesize data within and across data domains. Our engineers are player and Rioter focused and aim to find solutions that make players excited to experience our games, and Rioters excited to deliver on our mission. Principal Engineers, at Riot, are often called on to help with the...

  • Enterprise Account Executive

    1 day ago

    Los Angeles, United States Redpanda Data Full time

    We are a team of doers, seasoned engineers, hackers and builders, working on the future of streaming data. Funded by premier investors including GV and Lightspeed, Redpanda is building the streaming data platform for developers. We’re evolving streaming beyond the Apache Kafka protocol into a unified “engine of record” that delivers a categorical...

  • Data Engineer, Analytics

    13 hours ago

    Los Angeles, United States Meta Full time

    Meta Platforms, Inc. (Meta), formerly known as Facebook Inc., builds technologies that help people connect, find communities, and grow businesses. When Facebook launched in 2004, it changed the way people connect. Apps and services like Messenger, Instagram, and WhatsApp further empowered billions around the world. Now, Meta is moving beyond 2D screens...

  • Data Engineer, Analytics

    14 minutes ago

    Los Angeles, California, United States Meta Full time

    Meta Platforms, Inc. (Meta), formerly known as Facebook Inc., builds technologies that help people connect, find communities, and grow businesses. When Facebook launched in 2004, it changed the way people connect. Apps and services like Messenger, Instagram, and WhatsApp further empowered billions around the world. Now, Meta is moving beyond 2D screens...

  • Sr. Data Engineer

    14 hours ago

    Los Angeles, United States Motion Recruitment Full time

    We are a quantitatively driven, independent Investment Advisory that helps clients who are frustrated with Wall Street’s high expenses, excessive risks, and conflicts of interest. By bringing aboard top talent in computer science and finance, and investing heavily in technology infrastructure, we have created an innovative platform to provide...

  • Sr Data Engineer

    4 weeks ago

    Los Angeles, United States wipros Full time

    Responsibilities Building data architectures and data pipelines to collectively bring together data. Designing solutions using Microsoft Azure services and other tools. Assuring that data is cleansed mapped transformed and optimized for storage and use according to business and technical requirements Automating tasks and deploying production standard...

  • Sr Data Engineer

    4 weeks ago

    Los Angeles, California, United States wipros Full time

    Responsibilities Building data architectures and data pipelines to collectively bring together data. Designing solutions using Microsoft Azure services and other tools. Assuring that data is cleansed mapped transformed and optimized for storage and use according to business and technical requirements Automating tasks and deploying production standard code....

  • Data Engineer II

    1 week ago

    Los Angeles, United States Riot Games Full time

    Data Engineers at Riot bring deep knowledge of specific technical areas and also value the opportunity to work in many broader domains. Our engineers are player-focused and aim to find solutions that make players excited to experience our games. Senior Engineers, at Riot, are often called on to help with the hardest problems on a project by using their...

  • Senior Data Engineer

    2 days ago

    Los Angeles, United States Keeling Labs Full time

    Job DescriptionJob DescriptionOur MissionFounded in 2022, Keeling Labs was started as a place to develop and apply machine learning to solve the world's biggest problem—climate change. Our current priority is getting the grid to run on 100% clean energy, which is currently limited by battery storage (specifically, the algorithms that control...