Data Infrastructure Security Engineer

1 month ago


San Francisco, California, United States Databricks Full time

While candidates in the listed locations are encouraged for this role, we are open to remote candidates in other locations.

As a Data Infrastructure Engineer on the security data infrastructure team you will help build Lakehouse for Security organization. You will build reliable, large-scale, multi-geo data pipelines to support detecting threats(internal and external threats) in Databricks systems, incident response forensics analysis and periodic compliance audits. You will build and deploy data pipelines in multi cloud(AWS, Azure and GCP) environments to process data and logs from external SaaS systems. You will report to the manager of Security Engineering as part of the CSO's organization.

The impact you will have:

Build data pipelines to collect telemetry and logs from millions of virtual machines running in the cloud(AWS, Azure and GCP).
Partner with security engineers, detection engineers and incident response engineers to build bronze, silver, gold quality data sets to meet detection, forensics and compliance needs.
Build tools to detect, improve data quality and monitor data pipeline performance.
Perform on-call rotation to support any production issues or troubleshooting production jobs.

What we look for:

3+ years of experience in software or data engineering.
2+ years of experience in programming with python, Scala or SQL. (preference for python)
1+ years of experience in building data pipelines using Spark or dataframes.
1+ years of experience in AWS, Azure or GCP.
Bachelor's Degree in CIS/MIS, engineering or equivalent and relevant experience.

Benefits

Comprehensive health coverage including medical, dental, and vision
401(k) Plan
Equity awards
Flexible time off
Paid parental leave
Family Planning
Gym reimbursement
Annual personal development fund
Work headphones reimbursement
Employee Assistance Program (EAP)
Business travel accident insurance
Mental wellness resources

About Databricks

Databricks is the data and AI company. More than 7,000 organizations worldwide — including Comcast, Condé Nast, H&M, and over 40% of the Fortune 500 — rely on the Databricks Lakehouse Platform to unify their data, analytics and AI. Databricks is headquartered in San Francisco, with offices around the globe. Founded by the original creators of Apache SparkTM, Delta Lake and MLflow, Databricks is on a mission to help data teams solve the world's toughest problems. To learn more, follow Databricks on Twitter, LinkedIn and Facebook.

Our Commitment to Diversity and Inclusion

At Databricks, we are committed to fostering a diverse and inclusive culture where everyone can excel. We take great care to ensure that our hiring practices are inclusive and meet equal employment opportunity standards. Individuals looking for employment at Databricks are considered without regard to age, color, disability, ethnicity, family or marital status, gender identity or expression, language, national origin, physical and mental ability, political affiliation, race, religion, sexual orientation, socio-economic status, veteran status, and other protected characteristics.

Databricks focuses on Enterprise Software, Information Technology, Analytics, Open Source, and Software. Their company has offices in San Francisco, New York, and London. They have a very large team that's between employees. To date, Databricks has raised $990M of funding; their latest round was closed on October 2019.

You can view their website at or find them on Twitter, Facebook, and LinkedIn.



  • San Francisco, California, United States Fathom Full time

    Fathom is on a mission to use AI to understand and structure the world's medical data, starting by making sense of the terabytes of clinician notes contained within the electronic health records of the world's largest health systems. Our deep learning engine automates the translation of patient records into the billing codes used for healthcare provider...


  • San Francisco, California, United States Fathom Full time

    Fathom is on a mission to use AI to understand and structure the world's medical data, starting by making sense of the terabytes of clinician notes contained within the electronic health records of the world's largest health systems. Our deep learning engine automates the translation of patient records into the billing codes used for healthcare provider...


  • San Mateo, California, United States Observe Full time

    The Infrastructure team at Observe is responsible for developing, scaling, and maintaining development and production infrastructure. We're a small team with a wide domain, and we value collaboration, willingness to learn, and the ability to solve immedate problems quickly while building towards a long-term vision. If you think this sounds interesting, you...

  • Senior Data Engineer

    1 month ago


    San Francisco, California, United States Nightfall AI Full time

    Nightfall makes safeguarding sensitive data for every application simple and seamless. Organizations, from startups to global brands, trust Nightfall's software platform and APIs to discover, classify, and protect sensitive data.We're looking for a Senior Data Engineer to enhance Nightfall's core data models and infrastructure supporting our real-time and...


  • San Francisco, California, United States Observable Full time

    Observable is seeking a full-time infrastructure and site reliability engineer to help improve, administrate, and grow Observable systems as we scale to meet our customer's needs.What you will doPerform site reliability and ops work for Observable production and staging environments. (Manage servers Tweak WAF rules Optimize SQL queries And more)Design and...


  • San Francisco, California, United States Databricks Full time

    While candidates in the listed locations are encouraged for this role, we are open to remote candidates in other locations.At Databricks Information Technology, we are a product led organization transforming the way we work from how easy it is to use our IT services to the applications we develop that help us scale seamlessly in face of incredible growth.The...


  • San Francisco, California, United States Imbue Full time

    Summary: Imbue leverages large amounts of compute to make its small research team more effective. This role is about enabling and supporting those large-scale compute efforts and all of the other software infrastructure that goes into making research a pleasant, seamless experience for the rest of the team, especially as they scale to increasingly...


  • San Francisco, California, United States Roadio (Formerly Streetlogic) Full time

    Streetlogic is a team of cyclists on a mission to make biking safer. Our product gives more people the confidence to bike - leading to more livable cities and a cleaner environment.We're building a light-weight, Advanced Driver Assistance System (ADAS) for ebikes, using a vision-first approach to detect incoming collisions and give riders early warning and...

  • Software Engineer

    1 month ago


    San Francisco, California, United States Abnormal Security Full time

    About Abnormal Abnormal Security is defining the next generation of email security defense. Our platform uses machine learning and artificial intelligence to baseline communication content, user identity, and behavioral signals in real-time and at scale in order to detect the abnormalities of email attacks.Customers love us because we consistently detect and...


  • San Francisco, California, United States Stripe Full time

    Who we areAbout StripeStripe is a financial infrastructure platform for businesses. Millions of companies—from the world's largest enterprises to the most ambitious startups—use Stripe to accept payments, grow their revenue, and accelerate new business opportunities. Our mission is to increase the GDP of the internet, and we have a staggering amount of...


  • San Francisco, California, United States Discord Full time

    Discord is about giving people the power to create space to find belonging in their lives. Trusted by millions of people to keep their communications secure, private, and out of the hands of evildoers, security and privacy are necessary to Discord's success.We are looking for a Senior Security Engineer, Platform Security reporting to the Platform Security...


  • San Francisco, California, United States Archipelo Full time

    CompanyArchipelo is building a code security platform that gives organizations the ability to verify the authenticity and provenance of code within their software development lifecycle. They are solving a painful problem that affects every software developer on the planet: ensuring software security, authenticity, integrity, and compliance - by providing the...


  • San Francisco, California, United States Stripe Full time

    About StripeStripe is a financial infrastructure platform for businesses. Millions of companies—from the world's largest enterprises to the most ambitious startups—use Stripe to accept payments, grow their revenue, and accelerate new business opportunities. Our mission is to increase the GDP of the internet, and we have a staggering amount of work ahead....


  • San Francisco, California, United States Woven Full time

    About WovenConsumer Travel is Ripe for DisruptionToday's travelers are seeking personalized, immersive, and authentic experiences that reflect their unique tastes and interests. They want to be inspired, to feel the thrill of discovery, and to seamlessly benefit from technology throughout their journeys. Yet, the current travel landscape is a maze of...


  • San Francisco, California, United States Everyday Agents Full time

    About WovenConsumer Travel is Ripe for DisruptionToday's travelers are seeking personalized, immersive, and authentic experiences that reflect their unique tastes and interests. They want to be inspired, to feel the thrill of discovery, and to seamlessly benefit from technology throughout their journeys. Yet, the current travel landscape is a maze of...


  • San Francisco, California, United States Everyday Agents Full time

    About WovenConsumer Travel is Ripe for DisruptionToday's travelers are seeking personalized, immersive, and authentic experiences that reflect their unique tastes and interests. They want to be inspired, to feel the thrill of discovery, and to seamlessly benefit from technology throughout their journeys. Yet, the current travel landscape is a maze of...

  • Principal Engineer

    4 days ago


    San Francisco, California, United States Domino Data Lab Full time

    Who we areDomino Data Lab is a game-changer, providing a leading Enterprise AI platform trusted by more than 20% of the Fortune 100 companies. With Domino, businesses speed up data science work, foster collaboration, and uphold governance. Enterprises globally benefit from Domino's solutions, improving areas such as healthcare, agriculture, automotive...


  • San Francisco, California, United States Department Of Homeland Security Full time

    Summary Securing Travel, Protecting People - At the Transportation Security Administration, you will serve in a high-stakes environment to safeguard the American way of life. In cities across the country, you would secure airports, seaports, railroads, highways, and/or public transit systems, thus protecting America's transportation infrastructure and...


  • San Francisco, California, United States MVUP Full time

    This is the first opportunity to join a core team that's excited about software security and reimagining the tools required for building groundbreaking applications. We believe that Ethereum will continue to be the leading platform for smart contract development but it's far from its potential. We are bringing to Ethereum the benefits of security-first...


  • San Francisco, California, United States TeraWatt Infrastructure Full time

    About Terawatt InfrastructureTerawatt Infrastructure is the leader in financing, developing, and operating electric vehicle charging solutions. Our mission is to power electrified fleets with the most reliable network of charging centers. With increasing demand for electric vehicles, we are facing a once-in-a-century technology transition. The market for EV...