Senior Data Engineer

4 weeks ago

San Francisco, United States Nightfall AI Full time

Nightfall makes safeguarding sensitive data for every application simple and seamless. Organizations, from startups to global brands, trust Nightfall’s software platform and APIs to discover, classify, and protect sensitive data.

We’re looking for a Senior Data Engineer to enhance Nightfall’s core data models and infrastructure supporting our real-time and data annotation pipelines, analytics warehouse, MLOps, real-time monitoring, and business intelligence reporting. 

 

At Nightfall, we use ML/NLP to detect and protect sensitive personal, health, financial, and credential information in real time. You will contribute directly to the core product. Working with Engineers, Data Scientists, and Data Analysts, you will ensure high technical standards for data management and drive Nightfall’s short and long-term data strategies.

This is a hybrid role based out of our San Francisco office.

Responsibilities

  • Design, build, and own the core data models and infrastructure to manage data across Nightfall’s analytics stack - AWS, Kafka, Glue, S3, Snowflake, Cassandra, Cockroach DB, Tableau, and Datadog.
  • Collaborate closely with Data Analysts to unlock the data needed to power dashboards, ad-hoc analyses, monitoring, and high-quality decision-making across the company.
  • Collaborate closely with ML Engineering and Data Science to scale our data pipelines for machine learning, analytics, and data annotation.
  • Design and implement a data quality monitoring system with source-to-target data validations and anomaly detection.
  • Collaborate with Security and Engineering to meet data governance requirements.

Qualifications

  • SQL Expert. Solid experience in Python or similar. 
  • Experience (3+ years) with analytical data warehouses/lakes. AWS/Snowflake preferred.
  • Experience (3+ years) developing data pipelines supporting ML/NLP projects. Experience with popular MLOps and data annotation platforms is a plus.
  • Experience (3+ years) analyzing complex datasets using SQL, optimizing queries, working with Data Analysts to automate dashboards (Tableau preferred), and performing ad-hoc analyses that lead to actionable business insights.
  • Bachelor's degree in Computer Science or related field. MS/PhD a plus.
  • Experience with source code repositories and cloud monitoring tools (Datadog preferred).
  • Possess excellent communication skills, strong analytical skills, and the ability to work independently and as part of a team.
  • The ability to thrive in a dynamic environment, being flexible and willing to jump in and do whatever it takes to be successful.
About Nightfall:

Nightfall is a cybersecurity startup dedicated to helping organizations secure and manage their sensitive data. As a leading enterprise technology company, our product affects the personal data that people entrust businesses to store & process with care every day. Critical data in modern organizations is often sprayed across a broad set of cloud data silos, and it’s a herculean task for security & compliance teams to monitor, manage, and protect this highly sensitive data. Via machine learning, our product makes it easy for organizations to discover, classify, and protect this sensitive data across their cloud footprint - such as their corporate SaaS, data infrastructure, and even their own apps. In doing so, we prevent data leakage, provide unprecedented data visibility & protection across the cloud, and enable compliance. We’re a technology startup founded in San Francisco, well-funded by leading institutional investors like Bain and Venrock, and a cadre of security & IT leaders from Okta, Salesforce, Atlassian, Splunk, FireEye, and more. Learn more on our website www.nightfall.ai or by reaching out via email at careers@nightfall.ai.

  • Senior Systems Engineer

    2 weeks ago

    San Francisco, United States VAST Data Full time

    VAST Data is looking for a Senior Systems Engineer to join our growing team! This is a great opportunity to be part of the fastest-growing infrastructure company in history. In just a few short years, we’ve shaken up the industry by challenging traditional architecture models and introduced a revolutionary set of storage possibilities through our...

  • Senior Data Engineer

    2 days ago

    San Francisco, United States Unreal Gigs Full time

    Job DescriptionJob DescriptionCompany Overview: Welcome to the forefront of data-driven innovation! Our company is dedicated to harnessing the power of data to drive transformative change and solve complex problems across industries. We're committed to building scalable and reliable data infrastructure that enables advanced analytics, machine learning,...

  • Senior Data Engineer

    3 weeks ago

    San Francisco, United States UpRecruit Full time

    Job DescriptionJob DescriptionJob Details: Title: Sr. Data EngineerSalary: $180-$230K Requirements: 8+ years of software dev exp (Large Data Sets or Big Data)Location: 100% onsite (San Francisco Bay Area) Our client, a gaming startup, is seeking a Sr. Data Engineer to join their passionate team. The ideal candidate is an experienced engineer who will play a...

  • Senior Data Engineer

    1 month ago

    San Francisco, United States Sephora Full time

    At Sephora we inspire our customers, empower our teams, and help them become the best versions of themselves.  We create an environment where people are valued, and differences are celebrated. Every day, our teams across the world bring to life our purpose: to expand the way the world sees beauty by empowering the ExtraOrdinary in each of us. We are...

  • Senior Data Engineer

    2 weeks ago

    San Francisco, United States SmithRx Full time

    Job DescriptionJob DescriptionWho We Are:SmithRx is a rapidly growing, venture-backed Health-Tech company. Our mission is to disrupt the expensive and inefficient Pharmacy Benefit Management (PBM) sector by building a next-generation drug acquisition platform driven by cutting edge technology, innovative cost saving tools, and best-in-class customer service....

  • Senior Data Integration Engineer

    4 weeks ago

    San Francisco, California, United States Trace3, Inc Full time

    Our major field office locations include Denver, Indianapolis, Grand Rapids, Lexington, Los Angeles, Louisville, Texas, San Francisco.Juice - The "Stuff" it takes to be a Needle MoverWe look forward to the goal, mentallymapping outevery checkpoint on the pathway to success, and visualizing what the final destination looks and feels like.We're looking to add...

  • Senior Data Warehouse Engineer

    2 days ago

    San Francisco, United States Unreal Gigs Full time

    Job DescriptionJob DescriptionCompany Overview: Welcome to the forefront of data-driven innovation! Our company is dedicated to leveraging the power of data to drive transformative change and solve complex problems across industries. We're committed to building scalable and efficient data warehousing solutions that enable advanced analytics, reporting,...

  • Senior Data Engineer

    3 weeks ago

    San Francisco, California, United States UpRecruit Full time

    Job Details:  Title: Sr. Data Engineer Salary: $180-$230K  Requirements: 8+ years of software dev exp (Large Data Sets or Big Data) Location: 100% onsite (San Francisco Bay Area)  Our client, a gaming startup, is seeking a Sr. Data Engineer to join their passionate team. The ideal candidate is an experienced engineer who will play a vital role...

  • Senior Data Engineer

    1 month ago

    San Francisco, California, United States Nightfall AI Full time

    Nightfall makes safeguarding sensitive data for every application simple and seamless. Organizations, from startups to global brands, trust Nightfall's software platform and APIs to discover, classify, and protect sensitive data.We're looking for a Senior Data Engineer to enhance Nightfall's core data models and infrastructure supporting our real-time and...

  • Senior Data Systems Engineer

    2 days ago

    San Francisco, United States Unreal Gigs Full time

    Company Overview: Welcome to the forefront of data-driven innovation! Our company is dedicated to harnessing the power of data to drive transformative change and solve complex problems across industries. We're committed to building cutting-edge data systems that enable efficient data management, processing, and analysis. Join us and be part of a dynamic team...

  • Senior Data Systems Engineer

    2 days ago

    San Francisco, United States Unreal Gigs Full time

    Company Overview: Welcome to the forefront of data-driven innovation! Our company is dedicated to harnessing the power of data to drive transformative change and solve complex problems across industries. We're committed to building cutting-edge data systems that enable efficient data management, processing, and analysis. Join us and be part of a dynamic team...

  • Senior Data Systems Engineer

    2 days ago

    San Francisco, United States Unreal Gigs Full time

    Job DescriptionJob DescriptionCompany Overview: Welcome to the forefront of data-driven innovation! Our company is dedicated to harnessing the power of data to drive transformative change and solve complex problems across industries. We're committed to building cutting-edge data systems that enable efficient data management, processing, and analysis....

  • Senior Cloud Data Engineer

    5 hours ago

    San Francisco, United States Unreal Gigs Full time

    Company Overview: Welcome to the forefront of data-driven innovation! Our company is dedicated to harnessing the power of data to drive transformative change and solve complex problems across industries. We're committed to building cutting-edge cloud data solutions that leverage the scalability, flexibility, and power of cloud platforms. Join us and be part...

  • Senior Cloud Data Engineer

    2 days ago

    San Francisco, United States Unreal Gigs Full time

    Job DescriptionJob DescriptionCompany Overview: Welcome to the forefront of data-driven innovation! Our company is dedicated to harnessing the power of data to drive transformative change and solve complex problems across industries. We're committed to building cutting-edge cloud data solutions that leverage the scalability, flexibility, and power of...

  • Senior Big Data Engineer

    2 days ago

    San Francisco, United States Unreal Gigs Full time

    Job DescriptionJob DescriptionCompany Overview: Welcome to the forefront of data-driven innovation! Our company is committed to harnessing the power of big data to drive transformative change and solve complex problems across industries. We're dedicated to building scalable and efficient big data solutions that enable advanced analytics, machine...

  • Senior Real-Time Data Engineer

    2 days ago

    San Francisco, United States Unreal Gigs Full time

    Job DescriptionJob DescriptionCompany Overview: Welcome to the forefront of data-driven innovation! Our company is dedicated to harnessing the power of real-time data to drive transformative change and solve complex problems across industries. We're committed to building cutting-edge real-time data solutions that enable timely insights and actions. Join...

  • Senior Data Warehouse Engineer

    1 day ago

    San Francisco, United States TuneIn Full time

    **Senior Data Warehouse Engineer** San Francisco / Engineering Platform / Full-time Regular **Location: San Francisco, Los Angeles, New York, or Remote** At TuneIn, we are reinventing radio for a connected world, with live sports, up-to-the-minute news, curated music, millions of podcasts, and over 120,000 streaming radio stationsstreamed to tens of...

  • Remote Data Engineer

    2 days ago

    San Francisco, California, United States Archipelo Full time

    CompanyArchipelo is building a code security platform that gives organizations the ability to verify the authenticity and provenance of code within their software development lifecycle. They are solving a painful problem that affects every software developer on the planet: ensuring software security, authenticity, integrity, and compliance - by providing the...

  • Senior Data Scientist

    1 day ago

    San Francisco, United States Xero Full time

    About the Team  The Data team is responsible for driving the adoption of data driven decision making across Xero - for both our internal users and our global audience of small business owners, bookkeepers and accountants. We create, manage and deliver a wide range of data services and products including core reporting, key data dimensions, extensible and...

  • Senior Data Scientist

    2 days ago

    San Francisco, California, United States Xero Full time

    About the Team The Data team is responsible for driving the adoption of data driven decision making across Xero - for both our internal users and our global audience of small business owners, bookkeepers and accountants. We create, manage and deliver a wide range of data services and products including core reporting, key data dimensions, extensible and...