Stream Infrastructure Engineer

4 weeks ago

San Francisco CA, United States OpenAI Full time

About the TeamYou’ll join the team that’s behind OpenAI’s data infrastructure that powers critical engineering, product, alignment teams that are core to the work we do at OpenAI. The Streaming Infrastructure team within Data Platform is responsible for building and maintaining our streaming platform. This platform plays a crucial role in facilitating the seamless exchange of data across various systems within OpenAI and serves as a foundational component of our infrastructure.Our team is focused on supporting distributed event buses to support the growing scalability and reliability needs of OpenAI's products and services. We enable other teams within OpenAI by offering intuitive abstractions and self-service tools to empower users in managing their services efficiently. Our commitment to operational excellence is reflected in our ongoing efforts to automate maintenance operations and reduce operational overhead.We are looking for engineers who are excited about event-driven streaming architecture and tackling complex challenges related to distributed systems. In addition to technical expertise, we value the ability to build collaborative relationships with other teams at OpenAI, understanding their unique use-cases, and working together to unlock new capabilities.About the RoleThe Applied Data Platform team designs, builds, and operates the foundational data infrastructure that enables products and teams at OpenAI.You should be experienced working with streaming platforms such as Azure EventHub, Apache Kafka, Apache Flink or Amazon Kinesis. You’re comfortable with infrastructure tooling such as Terraform, worked with Kubernetes, and have the skillsets of a SRE. This role is based in San Francisco, CA. We use a hybrid work model of 3 days in the office per week and offer relocation assistance to new employees.In this role, you will:Maintain the health and operability of critical data infrastructure systems such as Kafka, Azure EventHub while ensuring scalability, reliability, and security Ensure our data platform can scale reliably to the next several orders of magnitudeAccelerate company productivity by empowering your fellow engineers & teammates with excellent data tooling and systems, providing a best in case experienceBring new features and capabilities to the world by partnering with product engineers, trust & safety and other teams to build the technical foundationsLike all other teams, we are responsible for the reliability of the systems we build. This includes an on-call rotation to respond to critical incidents as needed You might thrive in this role if you: Have 4+ years in stream infrastructure engineering maintaining Kafka, Azure EventHub, AWS Kinesis, etc.Have 4+ years in infrastructure engineering with a strong interest in streaming systemsTake pride in building and operating scalable, reliable, secure systemsAre comfortable with ambiguity and rapid changeHave a voracious and intrinsic desire to learn and fill in missing skills—and an equally strong talent for sharing learnings clearly and concisely with othersThis role is exclusively based in our San Francisco HQ. We offer relocation assistance to new employees.About OpenAIOpenAI is an AI research and deployment company dedicated to ensuring that general-purpose artificial intelligence benefits all of humanity. We push the boundaries of the capabilities of AI systems and seek to safely deploy them to the world through our products. AI is an extremely powerful tool that must be created with safety and human needs at its core, and to achieve our mission, we must encompass and value the many different perspectives, voices, and experiences that form the full spectrum of humanity. We are an equal opportunity employer and do not discriminate on the basis of race, religion, national origin, gender, sexual orientation, age, veteran status, disability or any other legally protected status. For US Based Candidates: Pursuant to the San Francisco Fair Chance Ordinance, we will consider qualified applicants with arrest and conviction records.We are committed to providing reasonable accommodations to applicants with disabilities, and requests can be made via this link.OpenAI Global Applicant Privacy PolicyAt OpenAI, we believe artificial intelligence has the potential to help people solve immense global challenges, and we want the upside of AI to be widely shared. Join us in shaping the future of technology.Compensation Range: $200K - $385KLocationSan Francisco, CATypeFull timeDepartmentApplied AICompensation$200K – $385KIn addition to the salary range listed above, total compensation also includes generous equity and benefits.Medical, dental, and vision insurance for you and your familyMental health and wellness support401(k) plan with 50% matchingUnlimited time off and 13 company holidays per yearPaid parental leave (20 weeks) and family-planning supportAnnual learning & development stipend ($1,500 per year)

  • Stream Infrastructure Engineer

    6 days ago

    San Francisco, CA, United States OpenAI Full time

    About the Team You'll join the team that's behind OpenAI's data infrastructure that powers critical engineering, product, alignment teams that are core to the work we do at OpenAI. The Streaming Infrastructure team within Data Platform is responsible for building and maintaining our streaming platform. This platform plays a crucial role in...

  • Role: Streaming/Batch Infrastructure Engineer

    6 days ago

    San Francisco, CA, United States Qualitative Financials Full time

    Role: Streaming/Batch Infrastructure Engineer Locations: Remote (San Francisco, CA) Once in a quarter they need to Visit San Francisco, CA Duration: Contract/Fulltime Job Description: 4+ years of professional experience in Stream/Batch Processing systems at scale. Strong Programming skills in Java, Python. Experience in Public Cloud is a must....

  • Tech Lead(Multimedia)

    6 days ago

    San Jose, CA, United States Tik Tok Full time

    TikTok is the leading destination for short-form mobile video. TikTok has global offices including Los Angeles, New York, London, Paris, Berlin, Dubai, Singapore, Jakarta, Seoul and Tokyo. Creation is the core of TikTok's purpose. Our platform is built to help imaginations thrive. This is doubly true of the teams that make TikTok possible. At TikTok,...

  • Tech Lead(Multimedia)

    6 days ago

    San Jose, CA, United States Tik Tok Full time

    Responsibilities TikTok is the leading destination for short-form mobile video. Our mission is to inspire creativity and bring joy. TikTok has global offices including Los Angeles, New York, London, Paris, Berlin, Dubai, Singapore, Jakarta, Seoul and Tokyo. Why Join Us Creation is the core of TikTok's purpose. Our platform is built to help...

  • Stream Software Engineer

    6 days ago

    San Francisco, CA, United States OnHires Full time

    Our client is a liquidity and technology provider of solutions for the crypto and foreign exchange (FX) industry. The company specializes in the sphere of B2B services and products, catering to a wide range of clients including large licensed brokers, crypto exchanges, crypto brokers, forex brokers, hedge and crypto funds, and professional managers. The...

  • Tech Lead(Multimedia)

    3 weeks ago

    San Jose, United States Tik Tok Full time

    Responsibilities TikTok is the leading destination for short-form mobile video. Our mission is to inspire creativity and bring joy. TikTok has global offices including Los Angeles, New York, London, Paris, Berlin, Dubai, Singapore, Jakarta, Seoul and Tokyo. Why Join Us Creation is the core of TikTok's purpose. Our platform is built to help imaginations...

  • Sr. Product Manager, Streaming

    1 month ago

    San Francisco, CA, United States DataBricks Full time

    RDQ225R415At Databricks, we are passionate about enabling data teams to solve the world's toughest problems — from making the next mode of transportation a reality to accelerating the development of medical breakthroughs. We do this by building and running the world's best data and AI infrastructure platform so our customers can use deep data insights to...

  • Staff Software Engineer, Revenue Infrastructure

    6 days ago

    San Francisco, CA, United States Discord Full time

    Staff Software Engineer, Revenue Infrastructure Founded in 2015, Discord is a voice, video and text app that helps friends and communities come together to hang out and explore their interests - from artists and activists, to study groups, sneakerheads, plant parents, and more. With 150 million monthly users across 19 million active communities, called...

  • Infrastructure Engineering

    6 days ago

    San Francisco, CA, United States X Corp. Full time

    Are you prepared to join the X team and help build the ultimate real-time information-sharing app, revolutionizing how people connect? At X, we're on a mission to become a trusted global digital public square, committed to minimal censorship within legal boundaries. Our goal is to empower every user to freely create and share ideas, fostering open public...

  • Software Engineer, Infrastructure

    1 week ago

    San Francisco, United States Orb Full time

    Mission Orb is on an ambitious mission to provide every business with the infrastructure to unlock their revenue. Best-in class businesses find ways to effectively align their monetization to product usage-whether that's through seats, consumption, feature limits, or usage-based tiers. Orb brings that opportunity to every software company. We are reimagining...

  • Software Engineer, Infrastructure

    2 days ago

    San Francisco, United States Orb Full time

    Mission Orb is on an ambitious mission to provide every business with the infrastructure to unlock their revenue. Best-in class businesses find ways to effectively align their monetization to product usage-whether that's through seats, consumption, feature limits, or usage-based tiers. Orb brings that opportunity to every software company. We are reimagining...

  • Software Engineer, Infrastructure

    16 hours ago

    San Francisco, United States Orb Full time

    Mission Orb is on an ambitious mission to provide every business with the infrastructure to unlock their revenue. Best-in class businesses find ways to effectively align their monetization to product usage-whether that's through seats, consumption, feature limits, or usage-based tiers. Orb brings that opportunity to every software company. We are reimagining...

  • Infrastructure engineer

    6 days ago

    San Francisco, CA, United States Watershed Full time

    The infrastructure team at Watershed owns foundational capabilities that our product is built upon. We support an application with a quickly growing codebase and build systems that are used by every single engineer at the company. It’s an exciting time for Infrastructure at Watershed! We are growing our team specifically to design and build out the next...

  • Infrastructure Engineer

    6 days ago

    San Francisco, CA, United States Theorem LP Full time

    [Full Time] Infrastructure Engineer at Theorem LP (United States) | BEAMSTART Jobs Infrastructure Engineer Theorem LP United States Date Posted 31 Oct, 2022 Work Location San Francisco, United States Salary Offered Not Specified Job Type Full Time Experience Required 6+ years Remote Work Yes Stock Options No Vacancies 1...

  • Civil Engineer

    6 days ago

    San Francisco, CA, United States snipebridge Full time

    Job Description Job Description COMPANY Highly Awarded dynamic and innovative engineering firm that specializes in sustainable infrastructure and delivering cutting-edge solutions. With a strong commitment to excellence, sustainability, and community, they have established themselves as a trusted partner in the industry. POSITION SUMMARY Seeking a Civil...

  • ML Inference Infrastructure Lead, Video Streaming

    6 days ago

    San Francisco, CA, United States Twelve Labs Full time

    Who we are We're a fast-moving, diverse team pushing the frontiers of artificial intelligence. At Twelve Labs, our mission is to help developers build programs that can see, listen, and understand the world as we do by bringing the world's most powerful video understanding infrastructure to market. As a part of achieving this mission, we are...

  • Cloud Infrastructure Engineer

    6 days ago

    San Francisco, CA, United States Chalk Full time

    About the role We are hiring Infrastructure Engineers to join our team. This is an opportunity to join us in-person as an early employee and make a large impact at a high growth start-up. You will tackle challenging engineering problems with a high degree of autonomy and ownership. We are looking for a software engineer with a strong background in...

  • Experienced Infrastructure Engineer

    6 days ago

    San Francisco, CA, United States Stytch Full time

    Stytch is the platform for user authentication. We build infrastructure that sits in the critical path of our customer's applications. As an Experienced Software Engineer, you'll work on designing and building back end systems and infrastructure to be secure and highly reliable for our customers globally. Solving problems with pragmatic solutions — you...

  • Senior/Staff Backend Engineer, Data Warehouse Infrastructure

    6 days ago

    San Francisco, CA, United States Airbnb Full time

    As a senior technical individual contributor, you will bring a unique skill set and experience to our organization, and work to solve some of the broader technical challenges . Our engineering organization is one where we value everyones input and ideas. Although you will be at the senior level or higher, all individual contributors at Airbnb are Software...

  • Data Infrastructure Engineer

    6 days ago

    San Francisco, CA, United States Acceler8 Talent Full time

    Data Infrastructure Engineer Are you an experienced Data Infrastructure Engineer ready to tackle challenges in AI and data processing at an unprecedented scale? Our organization is looking for a skilled professional to join our dynamic team. Here, technology and innovation intersect to create smarter solutions that redefine human-computer interactions. ...