Principal Infrastructure Engineer

1 month ago

San Francisco CA, United States Nextdata Technologies Inc Full time

The company

Decentralized data is the future. Data mesh is the right idea. We’re here to make it a reality. Nextdata OS is a data-mesh-native platform built to meet the challenge of decentralizing data at scale. We are inventing a new way for developers to work with data and share it responsibly via data product containers.

Our vision is to build a world where AI/ML and analytics are powered by decentralized, responsible, and equitable data ownership, across boundaries of organizations, technology, and most importantly boundaries of trust.

Our purpose is to change the experience of creating, sharing, discovering, and using data forever, to be connected, fast, and fair based on data mesh principles.

Our technology is designed to empower data developers, users and owners with a delightful experience where data products are a first-class primitive, with trust built-in.

We are here to accept the reality that the world of data is complex and messy; data models are out-of-date the moment they are created; data is owned across trust boundaries; data is stored on different platforms; data is used in many different modes and most importantly data can't protect itself. We are here to recognize that past approaches to tackle these complexities with centralized data collection, modeling and governance are ineffective at best and pathologically unfair at worst. We are here to reimagine, withyou

The Role

As a Principal Infrastructure Engineer , you will help build out the automation for provisioning and managing the Nextdata OS in multiple clouds. Given that we are in the early, your work will shape the future of how data mesh will get adopted by the industry.

You will apply your knowledge of having deployed large scale distributed systems and data and ML/analytics infrastructure to join the founding engineering team to deliver a self-service and secure OS platform for the data product developers of the future.

You will contribute to the overall Nextdata OS design and own the design and implementation of the deployment of the OS in PaaS, SaaS and customer cloud environments. You will write scalable and modular infrastructure-as-code and review others’ code to ensure the overall code quality. You will own the quality of the code you have written, even (especially) when it is running in production.

You will work with customers to understand their requirements, collaborate with the product team, and co-create the Nextdata OS with the rest of the engineering team.

You Are The Right Fit If You Have

-Bachelor's Degree in Computer Science, IT, Engineering, or related field.

-10+ years of experience as an Infrastructure Engineer.

-Experience working for a start-up.

-Experience with designing, developing, and maintaining robust CI/CD automation for Kubernetes native applications in multiple clouds and on customer cloud environments.

-Successfully dealt with the complexities of PaaS and SaaS deployment models for a large number of customers.

-Experience with provisioning and managing data and ML/analytics ecosystem on multiple clouds, such as Snowflake, -Databricks, AWS/Azure/GCP data warehouses and ML platforms.

-Successfully worked on minimizing infrastructure costs for deployments.

-Led or contributed significantly to infrastructure security audits.

-Experience troubleshooting system issues, providing timely resolution to minimize downtime.

-Solid understanding of containerization technologies, specifically Docker.

-Expert knowledge of Kubernetes, with experience in managing and operating Kubernetes clusters across multiple environments.

-Proficiency in working with AWS EKS, Google GKE, Azure AKS

-Strong experience in network architecture, particularly in cloud environments (AWS VPC, Azure VNet, GCP VPC).

-Proven experience with Infrastructure as Code (IaC) tools such as Terraform or CloudFormation.

-Familiarity with monitoring and logging tools such as Prometheus and ELK stack.

-Excellent problem-solving skills, attention to detail, and the ability to work in a fast-paced, dynamic, team-oriented environment.

-Experience with service meshes like Istio or Linkerd.

-Familiarity with cloud security practices and tools.

Our Benefits

We are an early stage company, but we don't subsist on ramen We are an experienced team with families. We provide $2000 for your home workspace setup, premium health, vision, dental insurance coverage for you and your family. And of course, early stage equity and market rate salary.

#J-18808-Ljbffr

  • Principal Site Reliability Engineer

    1 day ago

    San Francisco, United States Apollo Solutions Full time

    Principal Site Reliability Engineer Apollo Solutions have partnered with a groundbreaking Fintech start-up backed by top tier venture capital. They are looking to significantly disrupt how we view, store and invest our personal finance and have already made significant waves in the industry. The Principal Site Reliability Engineer will be working closely...

  • Principal Machine Learning Engineer, Infrastructure

    2 weeks ago

    San Francisco, CA, United States Genentech Full time

    The PositionThe PositionAt Genentech Computational Sciences (gCS) Prescient Design, we are at the forefront of employing machine learning to revolutionize drug discovery, adopting novel methods, techniques, and infrastructure to transform the field. Our Engineering team is seeking engineers with strong skills and hands-on experience in designing,...

  • Principal Software Engineer, APIs and Infrastructure

    2 weeks ago

    San Diego, CA, United States Shield AI Full time

    San Diego Metro AreaHivemind – Design /Full Time Employee /On-siteHivemind Design (HMD) is an innovative simulation, data science, and infrastructure team at Shield AI. We own the tools for designing, developing, testing, deploying and evaluating instances of the Hivemind AI pilot and commander. Our software products enable companies to construct and...

  • Principal Engineer

    2 weeks ago

    San Leandro, United States Wells Fargo Bank N.A Full time

    PRINCIPAL ENGINEER, Wells Fargo Bank, , San Leandro, California: Work closely with application teams, infrastructure and middleware teams to maintain applications that are secure and highly scalable/ available. Must have a Bachelor's degree in Computer Science, Computer Engineering or related t...

  • Principal Machine Learning Infrastructure Engineer

    2 weeks ago

    San Francisco, United States Acceler8 Talent Full time

    Introduction:Join a pioneering team at the forefront of AI and ML technology, where human-computer collaboration is not just a concept but a reality. Our team is dedicated to revolutionizing user experiences by innovating at every level, from user interfaces down to the most efficient models. This is more than a job; it's a journey into the future of...

  • Principal Machine Learning Infrastructure Engineer

    2 weeks ago

    San Francisco, United States Acceler8 Talent Full time

    Introduction:Join a pioneering team at the forefront of AI and ML technology, where human-computer collaboration is not just a concept but a reality. Our team is dedicated to revolutionizing user experiences by innovating at every level, from user interfaces down to the most efficient models. This is more than a job; it's a journey into the future of...

  • Principal Machine Learning Infrastructure Engineer

    2 weeks ago

    San Francisco, United States Acceler8 Talent Full time

    Introduction:Join a pioneering team at the forefront of AI and ML technology, where human-computer collaboration is not just a concept but a reality. Our team is dedicated to revolutionizing user experiences by innovating at every level, from user interfaces down to the most efficient models. This is more than a job; it's a journey into the future of...

  • Stream Infrastructure Engineer

    1 week ago

    San Francisco, CA, United States OpenAI Full time

    About the TeamYou’ll join the team that’s behind OpenAI’s data infrastructure that powers critical engineering, product, alignment teams that are core to the work we do at OpenAI. The Streaming Infrastructure team within Data Platform is responsible for building and maintaining our streaming platform. This platform plays a crucial role in facilitating...

  • Principal Software Engineer

    1 week ago

    San Francisco, CA, United States Nextdoor Full time

    #TeamNextdoorNextdoor is where you connect to the neighborhoods that matter to you so you can belong. Our purpose is to cultivate a kinder world where everyone has a neighborhood they can rely on.Neighbors around the world turn to Nextdoor daily to receive trusted information, give and get help, get things done, and build real-world connections with those...

  • Principal Validation Engineer

    2 weeks ago

    San Jose, CA, United States CyberCoders Full time

    San Jose, CA Full-time $160,000.00 - $240,000.00Posted 12/07/2023Job Title: Principal Validation Engineer - SerDesJob Location: San Jose, CACompensation: $160K - $240K base Depending on experience plus significant equity!Requirements: Validation, SerDes, High-Speed Interconnects, PCIe, CXL, Ethernet, Testing We were founded in 2020 by a team of veterans in...

  • Principal engineer

    2 weeks ago

    San Francisco, United States Bayone Full time

    The position is for Principal engineer Level reporting into me. I am looking for a hands on engineer who has deep understanding of building E2E Cloud Platform. The candidate should be an expert in Cloud Foundations ( IAM, Networking) Runtime Platforms ( Kubernetes, Serverless) Programming (Golang/Pyton/ Rust)

  • Principal Software Engineer

    2 weeks ago

    San Francisco, CA, United States Nextdoor Full time

    #TeamNextdoorNextdoor is where you connect to the neighborhoods that matter to you so you can belong. Our purpose is to cultivate a kinder world where everyone has a neighborhood they can rely on.Neighbors around the world turn to Nextdoor daily to receive trusted information, give and get help, get things done, and build real-world connections with those...

  • Software Engineer, Infrastructure

    1 week ago

    San Francisco, CA, United States OpenAI Full time

    About the TeamThe Applied Engineering team works across research, engineering, product, and design to bring OpenAI’s technology to consumers and businesses.We seek to learn from deployment and distribute the benefits of AI, while ensuring that this powerful tool is used responsibly and safely. Safety is more important to us than unfettered growth.About the...

  • Principal SVE Expert | Environmental Engineer

    1 day ago

    San Francisco, United States LVI Associates Full time

    My client is a full service environmental consulting firm looking for a Principal level SVE Expert to add to their Northern California team! Responsibilities: Overseeing, directing, and guiding multi-disciplinary project teams. Supervising and executing preliminary investigations and drafting contract documents. Reviewing and preparing technical reports and...

  • Online Storage Infrastructure Engineer, Applied Engineering

    1 week ago

    San Francisco, CA, United States OpenAI Full time

    About the TeamThe Applied Engineering team works across research, engineering, product, and design to bring OpenAI’s technology to consumers and businesses.We seek to learn from deployment and distribute the benefits of AI, while ensuring that this powerful tool is used responsibly and safely. Safety is more important to us than unfettered growth.You’ll...

  • Cloud Infrastructure Engineer

    6 days ago

    San Francisco, United States forhyre.com Full time

    Job Description Job Description Do you enjoy solving technical issues, empathize with customer user experiences and want to keep up with the latest tech? We are looking for a Cloud Infrastructure Engineer that will work with talented software engineering and support teams to deploy, maintain and ensure reliability of our applications in a fast paced...

  • Data Infrastructure Engineer

    3 weeks ago

    San Francisco, United States Acceler8 Talent Full time

    Data Infrastructure EngineerAre you an experienced Data Infrastructure Engineer ready to tackle challenges in AI and data processing at an unprecedented scale? Our organization is looking for a skilled professional to join our dynamic team. Here, technology and innovation intersect to create smarter solutions that redefine human-computer interactions.About...

  • Data Infrastructure Engineer

    3 weeks ago

    San Francisco, United States Acceler8 Talent Full time

    Data Infrastructure EngineerAre you an experienced Data Infrastructure Engineer ready to tackle challenges in AI and data processing at an unprecedented scale? Our organization is looking for a skilled professional to join our dynamic team. Here, technology and innovation intersect to create smarter solutions that redefine human-computer interactions.About...

  • IT Infrastructure Design

    1 week ago

    San Francisco, CA, United States RICEFW Technologies Full time

    Please Note: As of July 22, 2021, our team will require that all candidate submissions include a LinkedIn profile. Please do not submit any candidates that do not have a LinkedIn.A cloud engineer is an IT professional responsible for any technological duties associated with cloud computing, including design, planning, management, maintenance and support. Job...

  • Remote Infrastructure Engineer

    4 weeks ago

    San Francisco, California, United States Imbue Full time

    Summary: Imbue leverages large amounts of compute to make its small research team more effective. This role is about enabling and supporting those large-scale compute efforts and all of the other software infrastructure that goes into making research a pleasant, seamless experience for the rest of the team, especially as they scale to increasingly...