Data Engineering Lead

1 week ago

San Francisco, California, United States KingCom Full time
About KingCom

We are the gateway for brands to the #1 cross-platform gaming company in the western world, with hundreds of millions of players across over 190 countries.

Our Mission

Our mission is simple: great game experiences offer great marketing experiences.

Job Description

As a Senior Staff Data Engineer, you will be responsible for designing and building data pipelines to collect, transform, store, analyze, explore, and visualize. You will work with the product team to understand data sources, use cases, and data models, and choose the right technology stack to align with those use cases with scalability.

Responsibilities
  • Design and build data pipelines to collect, transform, store, analyze, explore, and visualize.
  • Craft and build cloud-based data lakes and data warehouses.
  • Work with the product team to understand data sources, use cases, and data models.
  • Choose the right technology stack to align with those use cases with scalability.
  • Collaborate with other team members across different teams.
  • Develop alert and monitoring systems and procedures for faster disaster recovery.
  • Build and contribute to data products with a focus on data quality and data governance.
Qualifications
  • Bachelor's degree in Computer Science or similar technical field of study or equivalent practical experience.
  • Strong experience in software development in Java or Python.
  • Working experience in building data warehouses and data lakes.
  • 8+ years of demonstrated ability working with relational databases such as MySQL, Postgres, etc.
  • 4+ years of experience in NoSQL databases like Bigtable, Cassandra, HBase, etc.
  • Expert-level SQL skills and database performance concepts.
  • Extensive experience in relational and dimensional data modeling.
  • Experience with developing extract-transform-load (ETL).
  • Understanding of distributed computing frameworks like Apache Spark and Flink.
Preferred Qualifications
  • Experience building data warehouse, data lake, and data pipeline using Google Cloud Platform (GCP).
  • Experience with large-scale distributed systems with large datasets.
  • Experience in distributed computing framework - Hadoop, Spark, Flink, or Storm.
  • Experience with messaging systems like Kafka and RabbitMQ.
  • Knowledge of advertising platforms.
Why Work with Us?
  • We offer a comprehensive benefits package including medical, dental, vision, health savings account or health reimbursement account, healthcare spending accounts, dependent care spending accounts, life and AD&D insurance, disability insurance.
  • We have a competitive annual salary of $192,688, paid bi-weekly.
  • We offer 401(k) with Company match, tuition reimbursement, charitable donation matching.
  • We provide paid holidays and vacation, paid sick time, floating holidays, compassion and bereavement leaves, parental leave.
  • We have mental health & wellbeing programs, fitness programs, free and discounted games.

  • Software Engineering Lead

    3 weeks ago

    San Francisco, California, United States People Data Labs Full time

    Role OverviewWe are seeking an exceptional Software Engineering Lead to join our team at People Data Labs. This role is a fantastic opportunity to drive our self-serve product offerings, grow new revenue, and develop innovative data products.

  • Data Engineering Lead

    2 weeks ago

    San Francisco, California, United States WEX Full time

    About the RoleWe are seeking a highly skilled Senior Data Engineer to join our dynamic team at WEX. The ideal candidate will have extensive experience in designing and implementing cloud-based data solutions, with a strong focus on scalability, performance, and data governance.The Data Engineering Lead will be responsible for leading the design and...

  • Data Engineering Lead

    2 weeks ago

    San Francisco, California, United States Federal Reserve Bank Full time

    Job OverviewThe Federal Reserve Bank of San Francisco seeks a highly skilled Data Engineering Lead to join our team. As a key member of our data engineering group, you will be responsible for designing and implementing cloud-based data and AI solutions that meet the needs of our business stakeholders. This is an excellent opportunity to work with...

  • Data Analytics Engineer

    4 weeks ago

    San Francisco, California, United States Advanced Engineering Group LLC Full time

    Company Overview: Advanced Engineering Group LLC is a leading technology firm that seeks highly motivated and enthusiastic engineers to join our product development team. Our technology stack primarily includes Java/Javascript, and while experience with these languages is beneficial, it's not essential.Job Description: We're looking for an exceptional Data...

  • Lead Data Science Architect

    4 weeks ago

    San Francisco, California, United States Windfall Data, Inc. Full time

    Windfall Data, Inc. is seeking a seasoned data professional to play a pivotal role in developing and scaling our foundational predictive models.This is a highly impactful position where you will influence the core of our data product offerings and collaborate with cross-functional teams to maintain the highest standards of model performance.We're on a...

  • Data Engineer Lead

    2 weeks ago

    San Francisco, California, United States Tekfortune Inc Full time

    Job Summary: Tekfortune Inc is a fast-growing consulting firm specialized in permanent, contract & project-based staffing services for world's leading organizations. We are looking for an experienced GCP Data Engineer to fill this 12+ month contract position. The successful candidate will provide technical leadership and contribute to the definition,...

  • Data Engineering Lead

    1 week ago

    San Francisco, California, United States eTeam Inc. Full time

    eTeam Inc. is seeking a talented Data Engineering Lead to join our team. As a key member of our data engineering team, you will be responsible for designing, developing, and managing large-scale data pipelines and workflows using Trino SQL/Spark SQL warehoused in HDFS datasets.We offer a competitive salary of $120,000 - $150,000 per year, depending on...

  • Technical Lead

    1 week ago

    San Francisco, California, United States Discord Full time

    Job DescriptionWe are seeking a highly skilled Technical Lead - Data Engineering to join our team and help us build and maintain the data infrastructure that powers our platform. As a Technical Lead, you will be responsible for overseeing the development and implementation of data solutions that meet the needs of our business.You will work closely with our...

  • Enterprise Data Engineering Lead

    1 week ago

    San Francisco, California, United States Tekfortune Inc Full time

    **Job Title:** Enterprise Data Engineering Lead**Job Summary:**Tekfortune Inc is seeking an experienced enterprise data engineering lead to join our team. As a key contributor, you will design and implement PI systems, components, and interfaces, and lead our data engineering efforts to drive business growth.We offer a competitive salary package starting at...

  • Data Engineering Lead

    7 days ago

    San Francisco, California, United States Eppo, Inc Full time

    About Eppo, Inc.We are a pioneering company in the experimentation space, empowering businesses to make data-driven decisions. Our cutting-edge platform combines the modern data stack with high-velocity experimentation, enabling customers to unlock new insights and drive growth.Job OverviewThis role is perfect for a seasoned software engineer who is...

  • Data Engineering Team Lead

    2 days ago

    San Francisco, California, United States DoorDash USA Full time

    About the CompanyDoorDash is a leading food delivery and logistics company that relies heavily on data to drive its success. The company's Data Engineering team plays a critical role in building scalable and reliable database solutions to support various use cases.About the RoleWe are seeking an experienced Staff Software Engineer, Data to lead our data...

  • Data Engineer Architect Lead

    4 weeks ago

    San Francisco, California, United States DoorDash USA Full time

    **About DoorDash USA**We are a technology company at heart, using data to fuel our mission of connecting people with the food they love. Our Data Engineering team plays a critical role in this mission, building scalable database solutions for various use cases.About the Role:We are seeking a highly experienced Staff Software Engineer, Data to join our Data...

  • Data Engineering Lead

    1 week ago

    San Francisco, California, United States WEX Full time

    About the Role">We are seeking a highly skilled Senior Data Engineer to join our dynamic team at WEX. As a key member of our organization, you will play a critical role in designing and implementing industry-leading data solutions that meet the needs of our business. The ideal candidate will have extensive experience working with AWS services, Snowflake, and...

  • Data Engineering Lead

    1 week ago

    San Francisco, California, United States OpenAI Full time

    About the CompanyAt OpenAI, we're dedicated to ensuring that general-purpose artificial intelligence benefits all of humanity. We push the boundaries of the capabilities of AI systems and seek to safely deploy them to the world through our products.The roleWe're looking for a seasoned Data Engineer to help drive our product analytics and growth. The ideal...

  • Machine Learning Data Engineering Lead

    2 days ago

    San Francisco, California, United States Unity Technologies Full time

    We are seeking an experienced Machine Learning Data Engineering Lead to drive our data strategy and develop optimized data pipelines for machine learning models.Job OverviewUnity Technologies is the world's leading platform of tools for creators to build and grow real-time games, apps, and experiences across multiple platforms. As a Machine Learning Data...

  • Data Engineering Team Lead

    6 days ago

    San Francisco, California, United States Perplexity AI Full time

    Perplexity AI is seeking a seasoned technical director to oversee the growth and scalability of our data engineering team. The ideal candidate will lead the design, creation, and deployment of systems that power product experiences across a growing tech stack.The exponential increase in data at Perplexity AI necessitates the investment in a robust data...

  • Data Engineer Lead

    1 week ago

    San Francisco, California, United States Unity Technologies Full time

    Job DescriptionThis is an exciting opportunity to work with our global and cross-functional teams to create meaningful data products and drive technical solutions. As a Senior Data Engineer, you will be responsible for designing and developing data pipelines and services to enable data-driven insights and power BI, ML, experimentation, and user-facing...

  • Data Engineering Team Lead

    3 weeks ago

    San Francisco, California, United States Perplexity AI Full time

    Perplexity AI OverviewAt Perplexity AI, we are revolutionizing the way people search and interact with the internet. Our conversational answer engine has amassed 10 million monthly active users as of early 2024, with our mobile apps installed over 1 million times across iOS and Android devices.We have raised significant funding from some of the most...

  • Data Engineering Team Lead

    4 weeks ago

    San Francisco, California, United States Peregrine Technologies Full time

    About Peregrine TechnologiesPeregrine Technologies is a leading provider of innovative software solutions for public safety agencies across the United States. With a strong foundation in technology and a passion for making a difference, we empower our customers to improve operations and make better decisions in the moments that matter.We are a team of public...

  • Data Engineering Lead

    4 days ago

    San Francisco, California, United States YO HR CONSULTANCY Full time

    We are seeking a highly skilled Sr Data Engineer to join our team in Glendale, CA. The ideal candidate will have 7+ years of experience in data engineering and proficiency in at least one major programming language (e.g. Python, Java, Scala).The successful candidate will work with technologies such as Airflow, Spark, Databricks, and Snowflake, and contribute...