Data Engineer

2 days ago


San Francisco CA United States Outdefine Full time

As a skilled professional seeking career growth, you deserve access to the best job opportunities available. Join Outdefine's Trusted community today and apply to premier job openings with leading enterprises globally. Set your own rate, keep all your pay, and enjoy the benefits of a fee-free experience.

Data Engineer Outdefine Partner Web3 10-50 San Francisco, CA, USA Apply Now

About the job Overview:

Job Overview
Location: Hybrid, Guadalajara - MX
Long term Contract: All MX benefits
Mandatory: 5+ years
Experience with: Azure, Spark/Databricks, Snowflake, ETLs
Hiring Process: 3 rounds

Roles and Responsibilities:
  1. Designs, develops, optimizes, and maintains data architecture and pipelines that adhere to ELT principles and business goals.
  2. Solves complex data problems to deliver insights that helps business achieve its goals.
  3. Creates data products for engineers, analysts, and data scientist team members to accelerate their productivity.
  4. Engineer effective features for modelling in close collaboration with data scientists and businesses.
  5. Leads the evaluation, implementation and deployment of emerging tools and processes for analytics data engineering to improve productivity and quality.
  6. Partners with machine learning engineers, BI, and solutions architects to develop technical architectures for strategic enterprise projects and initiatives.
  7. Fosters a culture of sharing, re-use, design for scale stability, and operational efficiency of data and analytical solutions.
  8. Advises, consults, mentors, and coaches other data and analytic professionals on data standards and practices.
  9. Develops and delivers communication and education plans on analytic data engineering capabilities, standards, and processes.
  10. Learns about machine learning, data science, computer vision, artificial intelligence, statistics, and/or applied mathematics as necessary to carry out role effectively.
Required Skills:
  1. 5-10 years of experience required.
  2. Experience with designing and maintaining data warehouses and/or data lakes with big data technologies such as Spark/Databricks, or distributed databases, like Redshift and Snowflake.
  3. Experience in building data pipelines and deploying/maintaining them following modern DE best practices (e.g., DBT, Airflow, Spark, Python OSS Data Ecosystem).
  4. Knowledge of Software Engineering fundamentals and software development tooling (e.g., Git, CI/CD, JIRA) and familiarity with the Linux operating system and the Bash/Z shell.
  5. Experience with cloud database technologies (e.g., Azure) and developing solutions on cloud computing services and infrastructure in the data and analytics space.
  6. Basic familiarity with BI tools (e.g., Alteryx, Tableau, Power BI, Looker).
  7. Expertise in ELT and data analysis, SQL primarily.
  8. Conceptual knowledge of data and analytics, such as dimensional modelling, reporting tools, data governance, and structured and unstructured data.

Employee location: San Francisco, CA, USA
Experience level: Not specified
Workplace type: Hybrid
Job type: Full time contract
Compensation: $25 - 35 /hr
Currency: USD

#J-18808-Ljbffr

  • Atlanta, GA, United States Data Engineer Jobs Full time

    *Please note: This role is not eligible for 100% remote work. Employees must live within a commutable distance of the Atlanta Area and must be willing to be onsite at the client and/or Slalom Atlanta office up to 5 days a week.* Who You'll Work With As a modern technology company, our Slalom Technologists are disrupting the market and bringing to life the...


  • San Francisco, California, United States Braintrust Data Full time

    About Braintrust DataWe are a cutting-edge developer platform for building world-class AI products. Our innovative approach combines code and datasets, incrementally refining both using frequent evaluations. We provide a rich set of tools to visualize changes and interrogate failures, empowering developers to integrate our platform into their continuous...

  • Data Engineer

    2 days ago


    San Francisco, CA, United States Woven Full time

    FORE is unlocking dormant operational data with advanced AI to diagnose operational challenges and support better performance. With close advisory from leading academic experts in Information and Operational Theory, we enable leaders across Healthcare, Private Equity, and Enterprise to understand the drivers of inefficiencies and how they can improve. At...

  • Lead Data Engineer

    2 days ago


    San Francisco, CA, United States Unreal Gigs Full time

    Company Overview: Welcome to the forefront of data-driven innovation! Our company is dedicated to harnessing the power of data to drive transformative change and solve complex problems across industries. We're committed to building scalable and reliable data infrastructure that enables advanced analytics, machine learning, and business intelligence. Join us...

  • Data Engineer

    2 days ago


    San Francisco, CA, United States Stepping Up Solutions Full time

    RadiumOne is the 6th largest web property in the U.S. according to comScore We build intelligent software that automates media buying, making big data actionable for marketers and connects them to their next customer. Based in San Francisco, we are seeking a talented Software Engineering Manager. RadiumOne generates first-party data about actual customers...


  • San Francisco, CA, United States Braintrust Data Full time

    About the company Braintrust is the end-to-end developer platform for building world-class AI products. AI development is a relatively new paradigm combining code and datasets, incrementally refining both using frequent evaluations. Our product lets you evaluate LLM applications and iteratively improve them, with a rich set of tools to visualize changes and...


  • San Francisco, CA, United States Stars Group Full time

    Responsibilities: Leadership & Strategy: Lead and mentor a team of data engineers, driving best practices in data engineering and ensuring alignment with the overall data strategy. Architecture & Development: Architect and develop highly scalable data pipelines and infrastructure using Apache Kafka, Apache Spark or Databricks, Python, Scala, and other...


  • San Francisco, CA, United States Tampa Gardens Senior Living Full time

    About Us Move money. Make money. Finix processes billions of dollars every year for leading SaaS, marketplace, and e-commerce platforms. With one developer-friendly API, Finix helps companies accept payments, manage payouts, and onboard merchants—everything you need to enable payment processing, and grow revenue. Finix has raised over $100M from...

  • Azure Data Engineer

    2 days ago


    San Francisco, CA, United States Outdefine Full time

    As a skilled professional seeking career growth, you deserve access to the best job opportunities available. Join Outdefine's Trusted community today and apply to premier job openings with leading enterprises globally. Set your own rate, keep all your pay, and enjoy the benefits of a fee-free experience. Azure Data Engineer Outdefine Partner Web3 ...


  • San Francisco, CA, United States DoorDash USA Full time

    About the Team Data is at the foundation of DoorDash's success. The Data Engineering team builds database solutions for various use cases including reporting, product analytics, marketing optimization, and financial reporting. The team serves as the foundation for decision-making at DoorDash. About the Role DoorDash is looking for a Staff Software Engineer,...

  • Big Data Engineer

    2 days ago


    San Francisco, CA, United States Unreal Gigs Full time

    Are you passionate about handling massive datasets and building the infrastructure that enables complex data analysis and machine learning at scale? Do you excel in creating robust, scalable data pipelines that fuel data-driven decision-making? If you’re ready to tackle the challenges of big data, our client has the perfect role for you. We’re seeking a...

  • Big Data Engineer

    1 day ago


    San Francisco, CA, United States ZipRecruiter Full time

    Job Description Are you passionate about handling massive datasets and building the infrastructure that enables complex data analysis and machine learning at scale? Do you excel in creating robust, scalable data pipelines that fuel data-driven decision-making? If you’re ready to tackle the challenges of big data, our client has the perfect role for you....

  • Cloud Data Engineer

    2 days ago


    San Francisco, CA, United States Unreal Gigs Full time

    Are you passionate about building and optimizing data pipelines that drive data-driven decision-making in cloud environments? Do you have the technical expertise to design robust data architectures that manage large-scale data processing and ensure seamless data flow? If you’re ready to harness the power of cloud technology to create scalable data...


  • San Francisco, CA, United States Trunk.io Full time

    At Trunk, we're on a mission to empower growing software organizations to deliver high-quality software quickly. We understand the challenges of merge conflicts, poor code quality or consistency, flaky tests, and other distractions that can drain productivity and morale. Our unique approach enables engineering teams to stay focused on designing,...

  • Lead Data Engineer

    2 days ago


    San Francisco, CA, United States Windfall Full time

    Windfall is seeking a Lead Data Engineer to join our core data team. As a Lead Data Engineer on our core data team, you will be building out the core data asset that everything else at Windfall is built on top of. Communication and collaboration are at the heart of Windfall, and you will work closely with our product, data science, and other engineering...


  • San Francisco, United States Amazon Data Services, Inc. Full time

    This unique vantage point allows the Design Managers to maintain a close connection with project details and drive project outcomes.You will have an impact on the design direction and ability to improve design delivery for an entire region, while establishing design procedures and protocols for the development of future systems.Responsibilities...


  • San Francisco, CA, United States apply.workable.com - ATS Full time

    Gridware exists to enhance and protect the mother of all networks: the electrical grid. The grid touches everything, and when it grinds to a halt, the consequences can be dire: wildfires burn, land is destroyed, property is damaged, progress stops, and lives are lost. Our team engineers an advanced sensing system to continuously analyze both the electrical...


  • San Diego, CA, United States Open Data Science Full time

    FuturHealth operates in the healthy food and medicine market, addressing health concerns as well as excess weight through telemedicine, customized nutrition plans, medications, healthy meals delivery, and insurance among Americans. Operating in one of the largest markets in the USA, FuturHealth addresses the pressing health concern of excess weight among...


  • San Francisco, CA, United States OpenAI Full time

    About the Team You’ll join the team that’s behind OpenAI’s data infrastructure that powers critical engineering and product teams core to the work we do at OpenAI. The systems we support include our data warehouse, batch compute infrastructure, streaming infrastructure, data orchestration system, data lake, vector databases, critical integrations, and...


  • San Francisco, CA, United States Stars Group Full time

    We are looking for a highly skilled Manager of Data Engineering to join our young and highly motivated team. In this role, you will be responsible for leading a highly qualified team and solving complex problems. You will partner with multiple stakeholders across the organization to efficiently deliver data infrastructure, data modeling, and also play the...