Data Engineering Lead

18 hours ago


New York, New York, United States Arbiter AI Full time $180,000 - $240,000

Arbiter is reimagining how healthcare works - not by adding more point solutions, but by building the infrastructure that runs the system. We're designing the intelligent operating spine that unifies data, automates workflows, and aligns incentives across providers, payers, and patients. Our platform embeds AI into real-world care and revenue cycle operations, transforming administrative chaos into orchestrated execution.

We've just closed one of the largest early-stage raises in healthtech history - backed by some of the most influential players in the industry who collectively manage millions of lives and billions in spend. Paired with a powerhouse board and executive team, we have the capital, context, and relationships to move quicker than anyone - tackling the problems we know intimately and scaling what works. Our MVP is already live with hundreds of providers managing hundreds of thousands of lives, and improving daily based on real-world feedback.

At Arbiter, engineers don't just ship features - they shape the foundation of an industry in flux. You'll work alongside a small, elite team of product leaders and technologists from FAANG and top startup and healthcare orgs to architect systems that handle millions of patient records, build AI agents that execute critical healthcare workflows, and design platforms that major health entities depend on daily. Every line of code you write shapes how a $4T industry operates.

This role can be remote or onsite, based in our New York City or Boca Raton offices, in a fast-paced, collaborative environment where great ideas move quickly from whiteboard to production.

Our Engineering Culture & Values

We are a high-performing group of engineers dedicated to delivering innovative, high-quality solutions to our clients and business partners. We believe in:

  • Engineering Excellence: Taking immense pride in our technical craft and the products we build, treating both with utmost respect and care.

  • Impact-Driven Development: Firmly committed to engineering high-quality, fault-tolerant, and highly scalable systems that evolve seamlessly with business needs, minimizing disruption.

  • Collaboration Over Ego: Valuing exceptional work and groundbreaking ideas above all else. We seek talented individuals who are accustomed to working in a fast-paced environment and are driven to ship often to achieve significant impact.

  • Continuous Growth: Fostering an environment of continuous learning, mentorship, and professional development, where you can deepen your expertise and grow your career.

Responsibilities

As a Data Engineering Lead, you will provide technical and team leadership while playing a pivotal role in building our data ecosystem:

  • Lead Architect & Hands-On Developer: Lead the design and build key components of our robust, scalable, and high-performance data processing systems (batch and real-time streaming) that power critical business functions, AI agents, and advanced analytics.

  • Team Leadership & Oversight: Oversee the planning, execution, and delivery of the data engineering roadmap. Guide and unblock team members, manage project timelines, and ensure the team's output meets high standards for reliability, efficiency, and maintainability.

  • Mentorship & Technical Standards: Actively mentor and develop data engineers on your team, fostering their professional growth through technical guidance, constructive code reviews, and knowledge sharing. Set and enforce best practices for coding, testing, and system design.

  • Data Modeling & Governance: Drive the design of our data models for optimal storage, retrieval, and analytical performance, ensuring alignment with product, business, and regulatory requirements.

  • Platform & Tooling: Champion and contribute to the development of core data platform tooling, frameworks, and standards that enhance developer productivity and data quality across the organization, supporting our AI agents and auditable systems.

  • Cross-Functional Collaboration: Partner closely with product managers, software engineers, and other non-technical stakeholders to understand data needs, deliver impactful solutions, and provide expert data insights that drive the intelligent operating system.

  • Team Building: Partner with engineering leadership to hire, interview, and onboard new team members, helping to build a world-class data engineering organization.

Minimum Qualifications

  • 8+ years of deep, hands-on experience in Data Engineering, Data Infrastructure, or building Data Engineering Tools and Frameworks.

  • Proven experience in a technical leadership or lead engineer role, with demonstrated ability to mentor other engineers, lead code reviews, and guide team projects.

  • Exceptional expertise in data structures, algorithms, and distributed systems.

  • Mastery in Python for large-scale data processing; experience with other languages like Java or Scala is a plus.

  • Extensive experience designing, building, and optimizing complex, fault-tolerant data pipelines (both batch and real-time streaming).

  • Profound understanding and hands-on experience with cloud-native data platforms, especially Google Cloud Platform (GCP) services like BigQuery, Dataflow, Composer, Dataproc.

  • Demonstrated experience with modern data orchestration (e.g., Airflow), data transformation (dbt), and data warehousing concepts.

  • Experience with project management and breaking down large, ambiguous problems into clear, executable work for a team.

  • Intimate knowledge of and ability to implement unit, integration, and functional testing strategies.

  • Friendly communication skills and ability to work well in a diverse, cross-functional setting.

  • Demonstrated experience leading a software product or component vision and delivery plan.

Preferred Qualifications

  • Demonstrated experience developing and deploying machine learning algorithms in a production environment, particularly within the healthcare or life sciences domain, with a focus on AI agent development.

  • Experience with advanced data extraction and correlation techniques, especially from unstructured medical data sources (e.g., PDF charts, clinical notes) for automated insights.

  • Proficiency with data analysis and visualization tools such as Looker, Tableau, or similar BI platforms, for creating comprehensive command centers.

  • Familiarity with data governance, data security, and compliance frameworks (e.g., HIPAA, GDPR) in a highly regulated industry.

Job Benefits

We offer a comprehensive and competitive benefits package designed to support your well-being and professional growth:

  • Highly Competitive Salary & Equity Package: Designed to rival top FAANG compensation, including meaningful equity.

  • Generous Paid Time Off (PTO): To ensure a healthy work-life balance.

  • Comprehensive Health, Vision, and Dental Insurance: Robust coverage for you and your family.

  • Life and Disability Insurance: Providing financial security.

  • Simple IRA Matching: To support your long-term financial goals.

  • Professional Development Budget: Support for conferences, courses, and certifications to fuel your continuous learning.

  • Wellness Programs: Initiatives to support your physical and mental health.

Pay Transparency

The annual base salary range for this position is $180,000-$240,000. Actual compensation offered to the successful candidate may vary from the posted hiring range based on work experience, skill level, and other factors.


  • Lead Data Engineer

    3 days ago


    New York, New York, United States TEK NINJAS Full time $120,000 - $180,000 per year

    Job Title: Lead Data Engineer (Asset management/Alternatives Investments)Location: New York City, NY; (Onsite – 5 days/week)Duration: 6-12+ MonthsTech skill sets: Data Architecture, Data Modelling, Expert level SQL, Python, AWS Technologies (Glue), Snowflake and data engineering design patternsDomain:Asset management, Alternatives Investments, Financial...


  • New York, New York, United States InfraTech Solutions Full time $120,000 - $180,000 per year

    Lead Data Quality and Validation EngineerOverviewOur client, a highly successful and established organization, is seeking an experiencedLead Data Quality and Validation Engineerto spearhead critical enterprise data quality initiatives. This role focuses on owning and optimizing the quality assurance lifecycle across complex, large-scale data platforms,...


  • New York, New York, United States NTT DATA North America Full time $80,928 - $168,000 per year

    Req ID:339010NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a Lead Quality Engineer to join our team in Parsipany, New Jersey (US-NJ), United States (US).Quality Engineer LeadWho we...

  • Lead Data Engineer

    5 days ago


    New York, New York, United States Sogeti Full time $125,000 - $175,000 per year

    Location: New York (Hybrid - 2 days a week in officerequired)About the job:We're seeking a Lead Data Engineer to drive innovation and excellence across our Marketing Technology data ecosystem. You thrive in dynamic, fast-paced environments and are comfortable navigating both legacy systems and modern data architectures. You balance long-term strategic...


  • New York, New York, United States Capgemini Engineering Full time $115,000 - $140,000 per year

    Choosing Capgemini means choosing a company where you will be empowered to shape your career in the way you'd like, where you'll be supported and inspired by a collaborative community of colleagues around the world, and where you'll be able to reimagine what's possible. Join us and help the world's leading organizations unlock the value of technology and...


  • New York, New York, United States Daydream Full time $180,000 - $300,000 per year

    About DaydreamDaydream is the first chat-based shopping agent built exclusively for fashion. Designed to redefine how people search and discover fashion, Daydream offers a personalized, conversational experience powered by advanced AI and natural language understanding.Backed by top-tier investors including Forerunner Ventures, Index Ventures, Google...


  • New York, New York, United States Publicis Groupe Full time $110,000 - $173,995 per year

    *Company Description*Publicis Groupe is a global leader in communication and is positioned at every step of the value chain, from consulting to execution, combining marketing transformation and digital business transformation. Through a unified and fluid organization, Publicis Groupe partners with its clients across communication, media, data and technology...


  • New York, New York, United States Lead Bank Full time $190,000 - $210,000 per year

    Lead is a fintech building banking infrastructure for embedded financial products and services. We operate an FDIC-insured bank headquartered in Kansas City, Missouri. Additionally, we have offices in San Francisco, Sunnyvale, and New York City, where our technical, product, design, and legal teams operate.We are built for a constantly evolving financial...

  • Data Engineer

    3 days ago


    New York, New York, United States SoHo Dragon Full time $120,000 - $200,000 per year

    Position: Data EngineerLocation:New York City(Hybrid 3x in office)Employment Type:ContractContract Duration: 1-2 yearsThe data engineer is responsible for designing, building, and maintaining the systems and infrastructure needed for data storage, processing, and analysis. The data engineer will work with a multidisciplinary Agile team to build high-quality...

  • Data Team Lead

    3 days ago


    New York, New York, United States Trinity Technology Solutions LLC Full time $120,000 - $180,000 per year

    Job Title: Data LeadLocation: New York, NYDuration : ContractJob SummaryThe Technical Data Lead will design, oversee, and ensure the execution of all technical aspects of data migration, including data analysis, cleansing, and conversion between systems.Key ResponsibilitiesLead all technical components of the data migration process.Develop data migration...