Founding Lead Infrastructure Engineer
2 weeks ago
Founding Lead Infrastructure Engineer
We're searching for a Founding Lead Infrastructure Engineer to join an ambitious, early-stage team driving LLM infrastructure forward. This role is based in New York and reports directly to the CTO. As Founding Lead Infrastructure Engineer, you’ll take ownership of core backend and infrastructure decisions that will set the technical and cultural foundation of this new company. For those seeking substantial impact and influence over a company’s direction, this role as a Founding Lead Infrastructure Engineer will be rewarding and challenging.
The company is on a mission to advance large-scale machine learning solutions with real-world applications. They’re focused on deploying high-performance, reliable systems tailored to LLM inference at scale. Operating in a fast-paced, high-quality environment, this team has a commitment to tackling complex technical challenges. They work directly with customers, building for performance, scalability, and robustness, aiming to become the go-to API for LLM-based solutions.
As a Founding Lead Infrastructure Engineer, you’ll architect, build, and deploy backend systems designed for scalable LLM inference. You’ll handle everything from designing efficient GPU clusters to managing complex workload orchestration and failure scenarios. This role involves extensive hands-on work and will place you at the heart of strategy and development discussions. By engaging directly with clients, you’ll gain insight into user needs, creating solutions that drive success. As the team grows, you’ll serve as the experienced backbone others turn to for guidance.
What We Can Offer You:
- Competitive salary with substantial equity stake
- Direct influence on technical and cultural direction
- Opportunities to build and lead a high-performing engineering team
- Collaboration with founding team on strategy and growth
- A culture that values ownership, innovation, and direct client engagement
Key Responsibilities:
- Architect and maintain backend systems for LLM inference
- Design and manage infrastructure for high-efficiency GPU usage
- Engage with clients to understand needs, ensuring solutions are effective
- Implement cutting-edge frameworks to optimize infrastructure
- Provide technical leadership and mentorship as the team expands
- Contribute to strategic discussions and go-to-market efforts
Relevant Experience Keywords: LLM inference, backend systems, Kubernetes, Pulumi, Terraform, GPU clusters, deep learning frameworks, cloud infrastructure, Python, high-performance systems, customer-focused engineering
-
Founding Lead Infrastructure Engineer
2 weeks ago
new york city, United States Acceler8 Talent Full timeFounding Lead Infrastructure EngineerWe're searching for a Founding Lead Infrastructure Engineer to join an ambitious, early-stage team driving LLM infrastructure forward. This role is based in New York and reports directly to the CTO. As Founding Lead Infrastructure Engineer, you’ll take ownership of core backend and infrastructure decisions that will set...
-
Founding Lead Infrastructure Engineer
2 weeks ago
New York, United States Acceler8 Talent Full timeFounding Lead Infrastructure EngineerWe're searching for a Founding Lead Infrastructure Engineer to join an ambitious, early-stage team driving LLM infrastructure forward. This role is based in New York and reports directly to the CTO. As Founding Lead Infrastructure Engineer, you’ll take ownership of core backend and infrastructure decisions that will set...
-
Data Infrastructure Engineer
1 week ago
new york city, United States Garden Full timeAbout the RoleAs a Founding Infrastructure Engineer, you will build and maintain the scalable and secure infrastructure that powers our AI-driven applications. You'll work with terabytes of data processed through our Rust-based ETL pipelines and ensure that our systems are robust and efficient. This role is critical for supporting our rapid growth and...
-
Data Infrastructure Engineer
2 weeks ago
new york city, United States Garden Full timeAbout the RoleAs a Founding Infrastructure Engineer, you will build and maintain the scalable and secure infrastructure that powers our AI-driven applications. You'll work with terabytes of data processed through our Rust-based ETL pipelines and ensure that our systems are robust and efficient. This role is critical for supporting our rapid growth and...
-
Data Infrastructure Engineer
2 weeks ago
New York, United States Garden Full timeAbout the RoleAs a Founding Infrastructure Engineer, you will build and maintain the scalable and secure infrastructure that powers our AI-driven applications. You'll work with terabytes of data processed through our Rust-based ETL pipelines and ensure that our systems are robust and efficient. This role is critical for supporting our rapid growth and...
-
Founding Engineer
2 weeks ago
new york city, United States Skale Full timeSkale are partnered with a software infrastructure startup for LLM's. They're building open source infrastructure to make companies LLM's perform better.They've just raised a seed round from Tier 1 investors and are building their team, hiring a Founding ML Engineer. Please note, this role is onsite in New York.Tech stack: Python, Node, React, Typescript,...
-
Founding Engineer
2 weeks ago
new york city, United States Skale Full timeSkale are partnered with a software infrastructure startup for LLM's. They're building open source infrastructure to make companies LLM's perform better.They've just raised a seed round from Tier 1 investors and are building their team, hiring a Founding ML Engineer. Please note, this role is onsite in New York.Tech stack: Python, Node, React, Typescript,...
-
Founding Engineer
2 weeks ago
New York, United States Skale Full timeSkale are partnered with a software infrastructure startup for LLM's. They're building open source infrastructure to make companies LLM's perform better.They've just raised a seed round from Tier 1 investors and are building their team, hiring a Founding ML Engineer. Please note, this role is onsite in New York.Tech stack: Python, Node, React, Typescript,...
-
Founding Engineer
4 weeks ago
new york city, United States Stealth Full timeAbout UsPrescribers face many administrative roadblocks when prescribing expensive medications for their patients. Squad Health helps patients and providers access specialty medications by automating prior authorizations and navigating other barriers to treatment access. We are building an AI-powered tool to revolutionize how providers handle prior...
-
Founding Engineer
1 month ago
new york city, United States Stealth Full timeAbout UsPrescribers face many administrative roadblocks when prescribing expensive medications for their patients. Squad Health helps patients and providers access specialty medications by automating prior authorizations and navigating other barriers to treatment access. We are building an AI-powered tool to revolutionize how providers handle prior...
-
Founding Engineer – Onsite NY
2 months ago
new york city, United States Alldus Full timeFounding Engineer – Onsite NYWe are currently recruiting for a Founding Engineer to join a rapidly growing startup based in New York City. If you are keen to join a small startup and help them on a rapid growth journey this could be an ideal role for you.Our client is a small team of Ex Bigtech engineers building a GenAI product to revolutionize and...
-
Founding Engineer – Onsite NY
1 month ago
new york city, United States Alldus Full timeFounding Engineer – Onsite NYWe are currently recruiting for a Founding Engineer to join a rapidly growing startup based in New York City. If you are keen to join a small startup and help them on a rapid growth journey this could be an ideal role for you.Our client is a small team of Ex Bigtech engineers building a GenAI product to revolutionize and...
-
Lead Infrastructure Engineer Linux HFT
1 week ago
new york city, United States Client Server Full timeLead Infrastructure Engineer (Linux HFT) New York onsite to $300,000Do you have expertise with Linux combined with High Frequency Trading systems experience?You could be progressing your career at a global systematic trading firm, in senior, hands-on Lead Infrastructure Engineer role.As the Lead Infrastructure Engineer you'll be an instrumental part of a...
-
Founding Engineer
1 month ago
New York, United States Stealth Full timeAbout UsPrescribers face many administrative roadblocks when prescribing expensive medications for their patients. Squad Health helps patients and providers access specialty medications by automating prior authorizations and navigating other barriers to treatment access. We are building an AI-powered tool to revolutionize how providers handle prior...
-
Founding Engineer – Onsite NY
4 months ago
New York, United States Alldus Full timeFounding Engineer – Onsite NYWe are currently recruiting for a Founding Engineer to join a rapidly growing startup based in New York City. If you are keen to join a small startup and help them on a rapid growth journey this could be an ideal role for you.Our client is a small team of Ex Bigtech engineers building a GenAI product to revolutionize and...
-
Founding Software Engineer
2 weeks ago
New York, United States Syrup Full timeJob DescriptionJob DescriptionAbout SyrupWe are an early stage startup building the only product-led email platform for SaaS. Leveraging AI and product usage data, Syrup communicates with users individually, increasing customer retention, loyalty and revenue growth. We are a team of eight backed by High Alpha, a leading venture firm led by former ExactTarget...
-
Security Engineer
1 week ago
new york city, United States Garden Full timeAbout the RoleAs a Founding Security Engineer, you will be responsible for safeguarding our applications, infrastructure, and data. You'll implement security protocols and practices to protect sensitive patent information and ensure compliance with industry standards. Your role is pivotal in establishing a security-first culture as we...
-
Security Engineer
2 weeks ago
new york city, United States Garden Full timeAbout the RoleAs a Founding Security Engineer, you will be responsible for safeguarding our applications, infrastructure, and data. You'll implement security protocols and practices to protect sensitive patent information and ensure compliance with industry standards. Your role is pivotal in establishing a security-first culture as we...
-
Founding Software Architect
4 weeks ago
New York, New York, United States Opkit Full timeAbout Us & VisionOpkit is an automated health insurance verification startup. Our software helps healthcare providers efficiently collect, verify and track their patients' insurance.We're solving a major pain point in the healthcare industry: confusion about insurance coverage and costs.Our vision is to become the default processor for all payments involving...
-
Founding Software Architect
4 weeks ago
New York, New York, United States Harnham Full timeFounding EngineerWe are working with an exciting fintech startup that is revolutionizing financial management in the film industry. Their platform provides fintech solutions to streamline expenses during film productions, allowing companies to easily manage finances for everything from equipment rentals to catering. This growing startup is looking for a...
