Data Engineer

2 weeks ago


San Francisco, United States Unreal Gigs Full time
Job DescriptionJob Description

Company Overview: Welcome to the forefront of data-driven innovation At our company, we're revolutionizing how businesses leverage data to drive insights and make informed decisions. Our mission is to develop scalable and robust data infrastructure that empowers organizations to unlock the full potential of their data. Join us and be part of a dynamic team committed to shaping the future of data engineering.

Position Overview: As a Data Engineer, you'll play a crucial role in designing, building, and maintaining the data infrastructure that powers our analytics and machine learning initiatives. Working closely with cross-functional teams of data scientists, analysts, and software engineers, you'll ensure the reliability, scalability, and efficiency of our data pipelines and systems. If you're passionate about data engineering and eager to drive innovation through scalable data solutions, we want you on our team.

Requirements

Key Responsibilities:

  1. Data Pipeline Development: Design, build, and maintain scalable and reliable data pipelines for ingesting, processing, and transforming large volumes of data from diverse sources.
  2. Data Modeling: Design and implement data models and schemas to support analytics, reporting, and machine learning applications, ensuring data quality, consistency, and performance.
  3. Data Integration: Integrate data from internal and external sources, including databases, APIs, and streaming platforms, ensuring data consistency and integrity across systems.
  4. Data Transformation: Implement data transformation and cleansing processes to standardize and enrich data for analysis and modeling, using tools and frameworks such as Apache Spark or Apache Beam.
  5. Data Storage and Management: Manage data storage solutions, including data lakes, data warehouses, and NoSQL databases, optimizing for performance, cost, and scalability.
  6. Data Governance and Security: Implement data governance policies and security controls to ensure compliance with regulatory requirements and protect sensitive data.
  7. Monitoring and Optimization: Monitor data pipelines and systems for performance, reliability, and efficiency, proactively identifying and addressing issues to minimize downtime and optimize resource utilization.
  8. Documentation and Collaboration: Document data infrastructure and processes, including data dictionaries, data lineage, and workflow diagrams, and collaborate with cross-functional teams to ensure alignment and transparency.

Qualifications:

  • Bachelor's degree or higher in Computer Science, Engineering, or related field.
  • Strong background in data engineering, with hands-on experience in designing, building, and maintaining data pipelines and systems.
  • Proficiency in programming languages such as Python, Java, or Scala, and experience with data processing frameworks such as Apache Spark or Apache Beam.
  • Experience with data modeling and database design, including relational databases (e.g., PostgreSQL, MySQL) and NoSQL databases (e.g., MongoDB, Cassandra).
  • Familiarity with data integration tools and technologies, such as Apache Kafka, AWS Glue, or Google Dataflow.
  • Strong problem-solving abilities and analytical thinking, with a keen attention to detail and a passion for tackling complex technical challenges.
  • Excellent communication and collaboration skills, with the ability to work effectively in cross-functional teams and communicate technical concepts to non-technical stakeholders.

Benefits

  • Competitive salary: The industry standard salary for Data Engineers typically ranges from $140,000 to $210,000 per year, depending on experience and qualifications. Exceptional candidates may be eligible for higher compensation packages.
  • Comprehensive health, dental, and vision insurance plans.
  • Flexible work hours and remote work options.
  • Generous vacation and paid time off.
  • Professional development opportunities, including access to training programs, conferences, and workshops.
  • State-of-the-art technology environment with access to cutting-edge tools and resources.
  • Vibrant and inclusive company culture with team-building activities and social events.
  • Opportunities for career growth and advancement within the company.
  • Exciting projects with real-world impact across diverse industries.
  • Chance to work alongside top talent and industry experts in the field of data engineering.

Join Us: Ready to shape the future of data engineering? Apply now to join our team and be part of an exciting journey of innovation and discovery



  • San Francisco, United States People Data Labs Full time

    Job DescriptionJob DescriptionAbout UsAt People Data Labs, we're committed to democratizing access to high-quality B2B data and leading the emerging DaaS economy. We empower developers, engineers, and data scientists to create innovative, compliant data products at scale with our clean, easy-to-use datasets of resume, company, location, and education...

  • Data Analyst

    5 days ago


    San Francisco, United States People Data Labs Full time

    Job DescriptionJob DescriptionAbout UsAt People Data Labs, we're committed to democratizing access to high-quality B2B data and leading the emerging DaaS economy. We empower developers, engineers, and data scientists to create innovative, compliant data products at scale with our clean, easy-to-use datasets of resume, company, location, and education...


  • San Francisco, CA, United States Data Masked Full time

    Neighbors around the world turn to Nextdoor daily to receive trusted information, give and get help, get things done, and build real-world connections with those nearby — neighbors, businesses, and public services. At Nextdoor, our Growth Marketing team is charged with driving member growth and revenues from businesses advertising on the platform. This...

  • Data Engineer

    5 days ago


    San Francisco, United States Plaid Full time

    We believe that the way people interact with their finances will drastically improve in the next few years. We’re dedicated to empowering this transformation by building the tools and experiences that thousands of developers use to create their own products. Plaid powers the tools millions of people rely on to live a healthier financial life. We work with...


  • San Francisco, United States StreetLight Data Full time

    StreetLight pioneered the use of Big Data analytics to shed light on how people, goods, and services move, empowering smarter, data-driven transportation decisions. The company applies proprietary machine-learning algorithms and data processing resources to measure travel patterns of vehicles, bicycles and pedestrians that enable complex transportation...


  • San Francisco, United States VAST Data Full time

    VAST Data is looking for a Senior Systems Engineer to join our growing team! This is a great opportunity to be part of the fastest-growing infrastructure company in history. In just a few short years, we’ve shaken up the industry by challenging traditional architecture models and introduced a revolutionary set of storage possibilities through our...

  • Data Engineer

    6 days ago


    San Francisco, California, United States teamworkonline Full time

    Company OverviewSwish Analytics is a sports analytics, betting and fantasy startup building the next generation of predictive sports analytics data products. We believe that oddsmaking is a challenge rooted in engineering, mathematics, and sports betting expertise; not intuition. We're looking for team-oriented individuals with an authentic passion for...

  • Data Engineer

    1 month ago


    San Francisco, United States Legalist Full time

    Job DescriptionJob DescriptionIntro description:Legalist is an institutional alternative asset management firm. Founded in 2016 and incubated at Y Combinator, the firm uses data-driven technology to invest in credit assets at scale. We are always looking for talented people to join our team.As a highly collaborative organization, our data engineers work...

  • Data Engineer

    1 day ago


    San Francisco, United States Sia Partners Full time

    Job DescriptionSia Partners is looking for a talented Data Engineer to support our activities within the Data Science Business Unit. You will be working alongside with our Data Science consultants and our clients on Data Engineering topics, including creating relevant data models, developing powerful data pipelines, exposing them through various mechanisms...


  • San Francisco, CA, United States Data Masked Full time

    When Square started, it was difficult and expensive (or just plain impossible) for some businesses to take credit cards. Square made credit card payments possible for all by turning a mobile phone into a credit card reader. Since then Square has been building an entire business toolkit of both hardware and software products including Banking, Commerce, Staff...

  • Lead Data Engineer

    2 weeks ago


    San Francisco, United States Unreal Gigs Full time

    Job DescriptionJob DescriptionCompany Overview: Welcome to the forefront of data-driven innovation! Our company is dedicated to harnessing the power of data to drive transformative change and solve complex problems across industries. We're committed to building scalable and reliable data infrastructure that enables advanced analytics, machine learning,...

  • Data Engineer

    6 days ago


    San Francisco, United States Speak Full time

    Job DescriptionJob DescriptionAbout usOur mission is to become the de facto way people learn foreign languages. We begin by teaching the next billion people English and Spanish.English is the global language of business, culture, and communication, and over 1.5 billion people around the world are actively trying to learn right now. Others dream of...

  • Data Engineer

    2 months ago


    San Francisco, California, United States iTvorks Inc Full time

    Required Skills Data engineer main skills Good knowledge of Data warehousing with expertise in data modeling and ETL. Advanced skills in SQL and HQL Should be good at these core tech AWS/EMR/Spark Hadoop Hive Vertica Qlikview Tableau Should have exp in CI/CD

  • Data Engineer

    6 days ago


    San Francisco, United States Rigil Corporation Full time

    Job DescriptionJob DescriptionRole: Data EngineerAbout Rigil:Rigil is an award-winning, woman-owned, small business that specializes in technology consulting, strategy consulting and product development. We value teamwork and strive to build strong leaders.Location: San Francisco, CAJob Type: Full TimeData Engineer is integral to evolving Vision and its...

  • Data Engineer

    7 days ago


    San Francisco, United States Rigil Corporation Full time

    Role: Data Engineer About Rigil: Rigil is an award-winning, woman-owned, small business that specializes in technology consulting, strategy consulting and product development. We value teamwork and strive to build strong leaders.Location: San Francisco, CAJob Type: Full TimeData Engineer is integral to evolving Vision and its underlying data and AI...

  • Senior Data Engineer

    2 weeks ago


    San Francisco, United States Unreal Gigs Full time

    Job DescriptionJob DescriptionCompany Overview: Welcome to the forefront of data-driven innovation! Our company is dedicated to harnessing the power of data to drive transformative change and solve complex problems across industries. We're committed to building scalable and reliable data infrastructure that enables advanced analytics, machine learning,...

  • Senior Data Engineer

    4 weeks ago


    San Francisco, United States UpRecruit Full time

    Job DescriptionJob DescriptionJob Details: Title: Sr. Data EngineerSalary: $180-$230K Requirements: 8+ years of software dev exp (Large Data Sets or Big Data)Location: 100% onsite (San Francisco Bay Area) Our client, a gaming startup, is seeking a Sr. Data Engineer to join their passionate team. The ideal candidate is an experienced engineer who will play a...


  • San Francisco, United States Premise Data Corporation Full time

    We all know every decision should be driven by data. But what about the data you don’t know? For years, the status quo in data aggregation has lacked visibility, moved slowly, and cost too much…leaving organizations to make critical decisions, day after day, without the whole picture. Premise changes that. Across 138 countries and counting, our...

  • Software Engineer

    6 days ago


    San Francisco, United States Equilibrium Energy Full time

    About Our Company Equilibrium Energy is a well-funded, Series B clean energy startup backed by some of the most prominent institutional investors in climate. We are building a digital native power company operating at the intersection of grid variability, market volatility, economic optimization, commercial structuring, and risk management, across the...

  • Data Engineer

    2 weeks ago


    San Francisco, United States Sia Partners Full time

    Job DescriptionJob DescriptionCompany DescriptionSia Partners is a next-generation management consulting firm. We offer a unique blend of AI and design capabilities, augmenting traditional consulting to deliver superior value to our clients. Counting 3,000 consultants in 19 countries, we expect to achieve USD 420 million in turnover for the current fiscal...