Data Platform Engineer

4 weeks ago


San Francisco, United States Motion Recruitment Full time

Ourlarge cryptocompany is looking for a contractData Platform Engineer.This is aremote contract position.

Contract Duration: 12-Months

Required Skills & Experience

4+ years of relevant work experience. Fluent SQL skills for ETL/ELT, data quality, and reporting. Strong Python or Spark backend development skills. General experience working with Snowflake, Databricks or Trino. Experience with core AWS services and concepts (S3, IAM, ASG, RDS). Leverage your Python, Airflow, and Looker/Superset expertise to scale our data pipelines and models.

Desired Skills & Experience

Computer Science/Engineering degree is preferred. Snowflake/Databricks/Hadoop training certificate is a plus. [Optional] Experience with Kafka or Pub/Sub for streaming ecosystem.

What You Will Be Doing

Daily Responsibilities

Data Platform team builds and operates systems to centralize all of the client's data, making it easy for teams across the company to access, transform, and consume/serve that data for analytics, ML, and powering end-user experiences. As an engineer on the team you will manage scalable data storage and pipelines, optimize data model, system efficiency and developer experience. For example, you will onboard new datasets from MongoDB/RDS/Kafka to Snowflake and Databricks, conduct impact analysis based on data lineage, and refactor data model for quality, reusability, performance and cost efficiency.

#J-18808-Ljbffr



  • San Francisco, California, United States Woven Full time

    About WovenConsumer Travel is Ripe for DisruptionToday's travelers are seeking personalized, immersive, and authentic experiences that reflect their unique tastes and interests. They want to be inspired, to feel the thrill of discovery, and to seamlessly benefit from technology throughout their journeys. Yet, the current travel landscape is a maze of...


  • San Francisco, California, United States Everyday Agents Full time

    About WovenConsumer Travel is Ripe for DisruptionToday's travelers are seeking personalized, immersive, and authentic experiences that reflect their unique tastes and interests. They want to be inspired, to feel the thrill of discovery, and to seamlessly benefit from technology throughout their journeys. Yet, the current travel landscape is a maze of...


  • San Francisco, California, United States Everyday Agents Full time

    About WovenConsumer Travel is Ripe for DisruptionToday's travelers are seeking personalized, immersive, and authentic experiences that reflect their unique tastes and interests. They want to be inspired, to feel the thrill of discovery, and to seamlessly benefit from technology throughout their journeys. Yet, the current travel landscape is a maze of...


  • San Francisco, United States Woven Full time

    About Woven Consumer Travel is Ripe for DisruptionToday's travelers are seeking personalized, immersive, and authentic experiences that reflect their unique tastes and interests. They want to be inspired, to feel the thrill of discovery, and to seamlessly benefit from technology throughout their journeys. Yet, the current travel landscape is a maze of...


  • San Francisco, CA, United States Nextdoor Full time

    #TeamNextdoorNextdoor is where you connect to the neighborhoods that matter to you so you can belong. Our purpose is to cultivate a kinder world where everyone has a neighborhood they can rely on.Neighbors around the world turn to Nextdoor daily to receive trusted information, give and get help, get things done, and build real-world connections with those...


  • San Francisco, United States Snorkel AI, Inc. Full time

    We are looking for a Director of Engineering to lead our AI Platform team. Our AI Platform team builds innovative software systems to power the Snorkel Flow platform. This includes services to train and serve generative AI and machine learning models using novel data-centric techniques, libraries to support AI workflows for a variety of data modalities and...

  • Platform Engineer

    1 month ago


    San Francisco, California, United States Watchtower AI Full time

    "As an early Platform Engineer at Watchtower, you'll enable us to deliver our platform reliably, securely, and at massive scale. You'll help architect low latency, real-time microservices that process & detect sensitive data at scale.Responsibilities:Building highly-available and secure authentication and API servicesMaintaining and evolving mission-critical...


  • San Francisco, CA, United States Discord Full time

    Discord is about giving people the power to create space to find belonging in their lives. We want to make it easier for you to talk regularly with the people you care about. We want you to build genuine relationships with your friends and communities close to home or around the world. Original, reliable, playful, and relatable. These are the values that...


  • San Francisco, United States Nightfall AI Full time

    Nightfall makes safeguarding sensitive data for every application simple and seamless. Organizations, from startups to global brands, trust Nightfall's software platform and APIs to discover, classify, and protect sensitive data. We are looking for an exceptional engineering technical leader to join our growing team at Nightfall. As a senior, hands-on,...


  • San Francisco, United States Juniper Square Full time

    About Juniper Square Our mission is to unlock the full potential of private markets. Privately owned assets like commercial real estate, private equity, and venture capital make up half of our financial ecosystem yet remain inaccessible to most people. We are digitizing these markets, and as a result, bringing efficiency, transparency, and access to one of...


  • San Francisco, United States VAST Data Full time

    VAST Data is looking for a Senior Systems Engineer to join our growing team! This is a great opportunity to be part of the fastest-growing infrastructure company in history. In just a few short years, we’ve shaken up the industry by challenging traditional architecture models and introduced a revolutionary set of storage possibilities through our...

  • Cloud Data Engineer

    2 days ago


    San Francisco, United States Unreal Gigs Full time

    Job DescriptionJob DescriptionCompany Overview: Welcome to the forefront of cloud data engineering! At our company, we're dedicated to leveraging the power of cloud technology to drive data-driven innovation. Our mission is to develop scalable and robust cloud data solutions that enable organizations to harness the full potential of their data. Join us...


  • San Francisco, United States OpenAI Full time

    About the Team The Research Platform Analytics team designs, builds, and operates the critical foundational data and analytics infrastructure that enables research at OpenAI. Our goal is one, and one only: accelerate the progress of research towards AGI. We do this by owning critical components of the research training stack, starting from key data...


  • San Mateo, United States Zoox Full time

    Zoox is on a mission to make personal transportation safer, cleaner, and more enjoyable for everyone. We are transforming mobility-as-a-service by developing a fully autonomous, purpose-built robotaxi designed for AI to drive and humans to enjoy. We are still in the early stages of deploying our robotaxis on public roads, and it is a great time to join Zoox...


  • San Jose, United States HireIO Inc Full time

    Team Introduction: Our mission in experimentation and evaluation team is to build the next-gen A/B testing platform, that empowers the company to make data-driven decision for the products. The supported scenarios include recommendation, push, ads, search, mobile app, UI interaction and service upgrades etc. Our platform's capabilities cover the entire...


  • San Francisco, California, United States platform Full time

    is a groundbreaking hosting and development tool for web applications. We run dozens of cloud regions all over the world with a mix of clients, from individual developers running small development clusters to the biggest companies on earth, running some of their critical apps on us.For its groundbreaking PaaS solution, is looking for a Cloud Software...


  • San Jose, United States Hireio, Inc. Full time

    Job DescriptionJob DescriptionTeam Introduction:Our mission in experimentation and evaluation team is to build the next-gen A/B testing platform, that empowers the company to make data-driven decision for the products. The supported scenarios include recommendation, push, ads, search, mobile app, UI interaction and service upgrades etc. Our platform's...

  • Software Engineer

    4 weeks ago


    San Francisco, California, United States Platform Venture Studio Full time

    PlatformOS is our proprietary software platform for running Platform Venture Studio. Think of it as "Github for building startups". It captures all of our best practice, allows us to build in the open, and engages the collective intelligence of our network.PlatformOS comprises various responsive web applications, a browser extension, API integrations, and...

  • Platform Engineer

    4 weeks ago


    San Francisco, United States Watchtower AI Full time

    "As an early Platform Engineer at Watchtower, you’ll enable us to deliver our platform reliably, securely, and at massive scale. You’ll help architect low latency, real-time microservices that process & detect sensitive data at scale.Responsibilities:Building highly-available and secure authentication and API servicesMaintaining and evolving...

  • Software Engineer

    4 weeks ago


    San Francisco, United States Platform Venture Studio Full time

    PlatformOS is our proprietary software platform for running Platform Venture Studio. Think of it as "Github for building startups". It captures all of our best practice, allows us to build in the open, and engages the collective intelligence of our network. PlatformOS comprises various responsive web applications, a browser extension, API integrations, and...