Network Architect

Join to apply for the Network Architect role at Together AI 5 days ago Be among the first 25 applicants About The Role: Together AI is building the next-generation AI compute platform, and networking is at the center of that mission. As a Network Architect, you will define and evolve the global network architecture that powers our AI training, inference, and research platforms. This is a deeply technical and strategic role: you will own the endtoend routing, topology, traffic engineering, and controlplane strategy for a global network spanning self-built data centers, partner colo, cloud environments, and highcapacity backbone fabrics. You will collaborate closely with infrastructure engineering, compute systems, hardware, and operations teams to design architectures that deliver massive eastwest bandwidth, low latency, high resiliency, and predictable performance at multiterabit scale. Your work directly influences how we build, scale, and operate the physical and logical networks that underpin cuttingedge AI workloads. This is a role for architects who are handson enough to validate designs in production, experienced enough to reason about systems at huge scale, and creative enough to develop architectures that dont exist yet. Responsibilities Define and evolve Together AIs global routing and backbone architecture, spanning self-built data centers, partner colocation sites, PoPs, cloud regions, and interconnect fabrics. Establish the end-to-end topology strategy for high-bandwidth AI workloads: eastwest fabrics, spine/superspine/core, DCI, and cross-region interconnect. Design traffic engineering, load balancing, and capacity planning models to ensure low latency, deterministic performance, and fault tolerance at scale. Develop the multicloud interconnect and peering strategy, including BGP policy frameworks, route leak mitigation, and security posture across heterogeneous networks. Architect the control-plane stack for programmability, stability, and automationincluding routing design, provisioning, configuration management, and state consistency. Establish foundational observability primitives for a global backbone (telemetry, flow sampling, path validation, synthetic testing, health models). Work closely with compute, storage, hardware, and data platform teams to ensure network design meets the performance demands of distributed AI training workloads. Collaborate with operations and NOC teams to ensure designs are supportable, debuggable, and resilient under real-world failure conditions. Provide architectural direction and mentorship to engineers across the org, influencing longterm strategy for both physical and virtual network domains. Model evolving topologies for nextgeneration workloads (multiTbps eastwest, high fanin/fanout distributed systems, GPU cluster fabrics). Evaluate and guide the adoption of emerging technologies: advanced optical transport, RoCEv2, high-speed Ethernet fabrics, Infiniband overlays, EVPN/VXLAN, SRMPLS/SRv6, programmable data planes, and hardware offload. Requirements Have deep experience designing and operating large-scale GPU clusters or HPCstyle compute fabrics, and understand the unique demands these workloads place on network design (eastwest dominance, congestion behavior, fanin/fanout patterns, loss sensitivity). Are fluent in building highthroughput data center fabrics (leafspine/superspine/core) that support tens of thousands of GPUs, multiterabit eastwest traffic, and strict performance SLAs. Have architected or operated RoCEv2 or lossless Ethernet environments at scaleincluding PFC/ECN tuning, congestion control, and endtoend stability considerations. Are experienced designing backbone and DCI architectures that support GPU training clusters across multiple regions, interconnect exotic fabrics, and handle highvolume synchronization traffic. Have led architecture for networks spanning multiple clouds, private backbones, and diverse PoPs, and understand how AI workloads behave across these domains. Design with operational realities in mind: observability, capacity modeling, automation, telemetry, and failuremode analysis for GPUheavy environments. Are comfortable setting architectural direction in fastmoving environments where compute, storage, and network evolution are tightly coupled. About Together AI Together AI is a researchdriven artificial intelligence company. We believe open and transparent AI systems will drive innovation and create the best outcomes for society, and together we are on a mission to significantly lower the cost of modern AI systems by codesigning software, hardware, algorithms, and models. We have contributed to leading opensource research, models, and datasets to advance the frontier of AI, and our team has been behind technological advancement such as FlashAttention, Hyena, FlexGen, and RedPajama. We invite you to join a passionate group of researchers and engineers in our journey in building the next generation AI infrastructure. Compensation We offer competitive compensation, startup equity, health insurance and other competitive benefits. The US base salary range for this fulltime position is: $250,000 - $280,000 + equity + benefits. Our salary ranges are determined by location, level and role. Individual compensation will be determined by experience, skills, and jobrelated knowledge. Equal Opportunity Together AI is an equal opportunity employer and is proud to offer equal employment opportunity to everyone regardless of race, color, ancestry, religion, sex, national origin, sexual orientation, age, citizenship, marital status, disability, gender identity, veteran status, and more. Please see our privacy policy at #J-18808-Ljbffr