Founding Lead Infrastructure Engineer

1 week ago

New York, United States Acceler8 Talent Full time

Founding Lead Infrastructure Engineer


We're searching for a Founding Lead Infrastructure Engineer to join an ambitious, early-stage team driving LLM infrastructure forward. This role is based in New York and reports directly to the CTO. As Founding Lead Infrastructure Engineer, you’ll take ownership of core backend and infrastructure decisions that will set the technical and cultural foundation of this new company. For those seeking substantial impact and influence over a company’s direction, this role as a Founding Lead Infrastructure Engineer will be rewarding and challenging.


The company is on a mission to advance large-scale machine learning solutions with real-world applications. They’re focused on deploying high-performance, reliable systems tailored to LLM inference at scale. Operating in a fast-paced, high-quality environment, this team has a commitment to tackling complex technical challenges. They work directly with customers, building for performance, scalability, and robustness, aiming to become the go-to API for LLM-based solutions.


As a Founding Lead Infrastructure Engineer, you’ll architect, build, and deploy backend systems designed for scalable LLM inference. You’ll handle everything from designing efficient GPU clusters to managing complex workload orchestration and failure scenarios. This role involves extensive hands-on work and will place you at the heart of strategy and development discussions. By engaging directly with clients, you’ll gain insight into user needs, creating solutions that drive success. As the team grows, you’ll serve as the experienced backbone others turn to for guidance.


What We Can Offer You:


  • Competitive salary with substantial equity stake
  • Direct influence on technical and cultural direction
  • Opportunities to build and lead a high-performing engineering team
  • Collaboration with founding team on strategy and growth
  • A culture that values ownership, innovation, and direct client engagement


Key Responsibilities:


  • Architect and maintain backend systems for LLM inference
  • Design and manage infrastructure for high-efficiency GPU usage
  • Engage with clients to understand needs, ensuring solutions are effective
  • Implement cutting-edge frameworks to optimize infrastructure
  • Provide technical leadership and mentorship as the team expands
  • Contribute to strategic discussions and go-to-market efforts


Relevant Experience Keywords: LLM inference, backend systems, Kubernetes, Pulumi, Terraform, GPU clusters, deep learning frameworks, cloud infrastructure, Python, high-performance systems, customer-focused engineering

  • Founding Lead Infrastructure Engineer

    1 week ago

    new york city, United States Acceler8 Talent Full time

    Founding Lead Infrastructure EngineerWe're searching for a Founding Lead Infrastructure Engineer to join an ambitious, early-stage team driving LLM infrastructure forward. This role is based in New York and reports directly to the CTO. As Founding Lead Infrastructure Engineer, you’ll take ownership of core backend and infrastructure decisions that will set...

  • Founding Lead Infrastructure Engineer

    1 week ago

    new york city, United States Acceler8 Talent Full time

    Founding Lead Infrastructure EngineerWe're searching for a Founding Lead Infrastructure Engineer to join an ambitious, early-stage team driving LLM infrastructure forward. This role is based in New York and reports directly to the CTO. As Founding Lead Infrastructure Engineer, you’ll take ownership of core backend and infrastructure decisions that will set...

  • Data Infrastructure Engineer

    1 week ago

    New York, United States Garden Full time

    About the RoleAs a Founding Infrastructure Engineer, you will build and maintain the scalable and secure infrastructure that powers our AI-driven applications. You'll work with terabytes of data processed through our Rust-based ETL pipelines and ensure that our systems are robust and efficient. This role is critical for supporting our rapid growth and...

  • Data Infrastructure Engineer

    6 days ago

    new york city, United States Garden Full time

    About the RoleAs a Founding Infrastructure Engineer, you will build and maintain the scalable and secure infrastructure that powers our AI-driven applications. You'll work with terabytes of data processed through our Rust-based ETL pipelines and ensure that our systems are robust and efficient. This role is critical for supporting our rapid growth and...

  • Data Infrastructure Engineer

    1 week ago

    new york city, United States Garden Full time

    About the RoleAs a Founding Infrastructure Engineer, you will build and maintain the scalable and secure infrastructure that powers our AI-driven applications. You'll work with terabytes of data processed through our Rust-based ETL pipelines and ensure that our systems are robust and efficient. This role is critical for supporting our rapid growth and...

  • Founding Engineer

    1 week ago

    New York, United States Skale Full time

    Skale are partnered with a software infrastructure startup for LLM's. They're building open source infrastructure to make companies LLM's perform better.They've just raised a seed round from Tier 1 investors and are building their team, hiring a Founding ML Engineer. Please note, this role is onsite in New York.Tech stack: Python, Node, React, Typescript,...

  • Founding Engineer

    1 week ago

    new york city, United States Skale Full time

    Skale are partnered with a software infrastructure startup for LLM's. They're building open source infrastructure to make companies LLM's perform better.They've just raised a seed round from Tier 1 investors and are building their team, hiring a Founding ML Engineer. Please note, this role is onsite in New York.Tech stack: Python, Node, React, Typescript,...

  • Founding Engineer

    1 week ago

    new york city, United States Skale Full time

    Skale are partnered with a software infrastructure startup for LLM's. They're building open source infrastructure to make companies LLM's perform better.They've just raised a seed round from Tier 1 investors and are building their team, hiring a Founding ML Engineer. Please note, this role is onsite in New York.Tech stack: Python, Node, React, Typescript,...

  • Founding Engineer

    1 month ago

    New York, United States Stealth Full time

    About UsPrescribers face many administrative roadblocks when prescribing expensive medications for their patients. Squad Health helps patients and providers access specialty medications by automating prior authorizations and navigating other barriers to treatment access. We are building an AI-powered tool to revolutionize how providers handle prior...

  • Founding Engineer – Onsite NY

    4 months ago

    New York, United States Alldus Full time

    Founding Engineer – Onsite NYWe are currently recruiting for a Founding Engineer to join a rapidly growing startup based in New York City. If you are keen to join a small startup and help them on a rapid growth journey this could be an ideal role for you.Our client is a small team of Ex Bigtech engineers building a GenAI product to revolutionize and...

  • Founding Engineer

    4 weeks ago

    new york city, United States Stealth Full time

    About UsPrescribers face many administrative roadblocks when prescribing expensive medications for their patients. Squad Health helps patients and providers access specialty medications by automating prior authorizations and navigating other barriers to treatment access. We are building an AI-powered tool to revolutionize how providers handle prior...

  • Founding Engineer

    1 month ago

    new york city, United States Stealth Full time

    About UsPrescribers face many administrative roadblocks when prescribing expensive medications for their patients. Squad Health helps patients and providers access specialty medications by automating prior authorizations and navigating other barriers to treatment access. We are building an AI-powered tool to revolutionize how providers handle prior...

  • Founding Software Engineer

    2 weeks ago

    New York, United States Syrup Full time

    Job DescriptionJob DescriptionAbout SyrupWe are an early stage startup building the only product-led email platform for SaaS. Leveraging AI and product usage data, Syrup communicates with users individually, increasing customer retention, loyalty and revenue growth. We are a team of eight backed by High Alpha, a leading venture firm led by former ExactTarget...

  • Founding Engineer – Onsite NY

    1 month ago

    new york city, United States Alldus Full time

    Founding Engineer – Onsite NYWe are currently recruiting for a Founding Engineer to join a rapidly growing startup based in New York City. If you are keen to join a small startup and help them on a rapid growth journey this could be an ideal role for you.Our client is a small team of Ex Bigtech engineers building a GenAI product to revolutionize and...

  • Founding Engineer – Onsite NY

    2 months ago

    new york city, United States Alldus Full time

    Founding Engineer – Onsite NYWe are currently recruiting for a Founding Engineer to join a rapidly growing startup based in New York City. If you are keen to join a small startup and help them on a rapid growth journey this could be an ideal role for you.Our client is a small team of Ex Bigtech engineers building a GenAI product to revolutionize and...

  • Lead Infrastructure Engineer Linux HFT

    5 days ago

    new york city, United States Client Server Full time

    Lead Infrastructure Engineer (Linux HFT) New York onsite to $300,000Do you have expertise with Linux combined with High Frequency Trading systems experience?You could be progressing your career at a global systematic trading firm, in senior, hands-on Lead Infrastructure Engineer role.As the Lead Infrastructure Engineer you'll be an instrumental part of a...

  • Founding Software Architect

    4 weeks ago

    New York, New York, United States Opkit Full time

    About Us & VisionOpkit is an automated health insurance verification startup. Our software helps healthcare providers efficiently collect, verify and track their patients' insurance.We're solving a major pain point in the healthcare industry: confusion about insurance coverage and costs.Our vision is to become the default processor for all payments involving...

  • Founding Software Architect

    4 weeks ago

    New York, New York, United States Harnham Full time

    Founding EngineerWe are working with an exciting fintech startup that is revolutionizing financial management in the film industry. Their platform provides fintech solutions to streamline expenses during film productions, allowing companies to easily manage finances for everything from equipment rentals to catering. This growing startup is looking for a...

  • Founding Full Stack Engineer

    4 weeks ago

    New York, United States Wild.Codes Full time

    Title: Founding Full Stack EngineerTime: FullTime (Work timezone EST; 8 hours/day)The CompanyOur client builds and provides accounting products for toptier startups and companies. They already have over 200 top startups across fintech AI and healthcare and are only getting started. They are well funded and nbsp;profitable growing rapidly and rolling out...

  • Founding Full Stack Engineer

    1 month ago

    New York, United States Wild.Codes Full time

    Title: Founding Full Stack EngineerTime: FullTime (Work timezone EST; 8 hours/day)The CompanyOur client builds and provides accounting products for toptier startups and companies. They already have over 200 top startups across fintech AI and healthcare and are only getting started. They are well funded and nbsp;profitable growing rapidly and rolling out...