Principal Engineer for Large-Scale Data Systems

3 days ago


New York, New York, United States StartUs GmbH Full time

Company Overview

We are a leading technology company dedicated to revolutionizing the way people experience music. Our Engineering org is at the forefront of this innovation, and we're looking for a talented Principal Engineer to join our team.

About the Role

The estimated salary for this position is $140,000 - $180,000 per year, depending on location and experience.

We're seeking an experienced Software Engineer with a strong background in data systems and distributed architecture. As a Principal Engineer, you will design, develop, and deploy large-scale data pipelines using Scalding, Scio, Storm, Spark, and the Google Cloud Platform. You will also work on architecting and operating services that support millions of users.

Key Responsibilities

  • Design and implement complex data pipelines with high-volume heterogeneous data, leveraging distributed systems such as Hadoop, BigTable, and Cassandra.
  • Develop distributed, high-volume services in Java or Scala, ensuring scalability, reliability, and performance.
  • Collaborate with cross-functional teams to drive optimization, testing, and tooling to improve data and system quality.
  • Leverage best practices in continuous integration and delivery, ensuring seamless deployment and operation of services.

Requirements

  • At least 5 years of professional experience working in a product-driven environment, preferably with large-scale data systems and distributed architecture.
  • Deep understanding of system design, data structures, and algorithms, with expertise in data modeling, data access, and data storage techniques.
  • Familiarity with agile software processes, data-driven development, reliability, and responsible experimentation.
  • Excellent collaboration skills, with experience working in cross-functional teams to achieve common goals.

What We Offer

We are proud to foster a workplace free from discrimination and promote diversity of experience, perspectives, and background. This is something we value deeply and encourage everyone to come be a part of changing the way the world listens to music.


  • Senior Data Engineer

    24 hours ago


    New York, New York, United States Amazon Full time

    About the OpportunityWe are seeking a highly skilled Senior Data Engineer to join our ADSP Product Analytics team. As a key member of this team, you will be responsible for building and maintaining large-scale data processing systems that integrate across multiple sources.


  • New York, New York, United States ASCENDING Full time

    Job DescriptionData Engineer for Large-Scale Data PipelinesWe're seeking a skilled data engineer with 3-7 years of experience to join our team at ASCENDING. This role centers on ensuring the robustness and reliability of large-scale data pipelines, from inception through deployment.Key Responsibilities:Conduct thorough testing of SQL-centric applications to...

  • Data Architect

    22 hours ago


    New York, New York, United States Harnham Full time

    Job Summary:We are seeking a highly experienced Data Architect to join our team in a large scale solutions environment. The successful candidate will design and develop Azure data warehouses and data pipelines for ML model execution.Design and develop Azure data warehouses and data pipelines for ML model executionCollaborate in a cross-functioning team and...


  • New York, New York, United States Scale AI Full time

    About ScaleAt Scale AI, our mission is to accelerate the development of AI applications. We are the leading AI data foundry, helping fuel the most exciting advancements in AI, including generative AI, defense applications, and autonomous vehicles. With our recent Series F round, we're accelerating the abundance of frontier data to pave the road to Artificial...


  • New York, New York, United States Scale AI Full time

    About ScaleAt Scale AI, our mission is to accelerate the development of AI applications. We are a leading AI data foundry, helping fuel the most exciting advancements in AI, including generative AI, defense applications, and autonomous vehicles. With our recent funding, we're accelerating the abundance of frontier data to pave the road to Artificial General...


  • New York, New York, United States Scale AI Full time

    About Scale AIAt Scale, our mission is to accelerate the development of AI applications that transform industries and improve lives. Our data foundry powers some of the world's most advanced LLMs and generative models through innovative approaches like Reinforcement Learning with Human Feedback (RLHF) and human data generation.About Our Horizontal Task...


  • New York, New York, United States Jobot Full time

    As a Senior Data Engineer at Jobot, you will be part of a fast-growing SaaS company that offers stability and excellent leadership.This role is ideal for an experienced engineer who can build out data pipelines and storage procedures for large amounts of data.We are looking for someone with experience working with Large Language Models (LLMs) such as OpenAi,...

  • AI Systems Engineer

    6 hours ago


    New York, New York, United States Scale AI Full time

    Job Title: AI Systems EngineerAt Scale AI, we're pushing the boundaries of artificial intelligence to transform industries and improve lives. As an AI Systems Engineer, you'll be instrumental in designing and developing cutting-edge AI systems that power the world's most advanced LLMs and generative models.Your Role:* Design and develop foundational...


  • New York, New York, United States Jobot Full time

    Company Overview:We are an innovative analytics company that has recently been acquired by a leading industry giant. This acquisition has brought us the financial stability of a publicly traded company while still allowing us to operate independently.We work in the public space and have developed/are developing cutting-edge apps that redefine how public...


  • New York, New York, United States Datadog Full time

    Job SummaryDatadog is seeking a skilled Cybersecurity Engineer to join our team in protecting our large-scale system infrastructure. As a key member of our Vulnerability Governance program, you will play a critical role in identifying and remediating vulnerabilities across our multi-provider ecosystem.About the RoleIn this position, you will be responsible...


  • New York, New York, United States Shaped Full time

    Shaped is a pioneering company at the forefront of artificial intelligence discovery. We are seeking an exceptional Senior Data Engineer to spearhead the design, development, and optimization of our real-time and batch streaming infrastructure.We're building a state-of-the-art AI discovery engine that relies on the reliable ingestion of customer data through...


  • New York, New York, United States Lilt Full time

    About LiltLilt is a cutting-edge machine learning company that specializes in large-scale language translation systems. Our team invests heavily in workflow and backend AI systems, prioritizing usability and interface design to provide seamless experiences for our users.Salary and BenefitsWe offer a competitive salary, with a range of $150,000 - $200,000 per...


  • New York, New York, United States Scale AI Full time

    **About Us**Solidify the future of artificial intelligence by joining Scale AI's Operator Group team.We're accelerating the development of AI applications, leveraging our expertise to power the world's most advanced LLMs and generative models. Our mission is to make this transition happen faster across every industry.As a Senior Software Engineer and Data...


  • New York, New York, United States City of New York Full time

    About the RoleWe are seeking a highly skilled Reliability Engineer to join our team in the City of New York. This is an exciting opportunity to work on large-scale infrastructure maintenance projects and contribute to the development and implementation of reliability-centered maintenance programs.


  • New York, New York, United States Scale AI Full time

    About ScaleAt Scale, our mission is to accelerate the development of AI applications. With 8 years of experience as a leading AI data foundry, we've helped drive advancements in AI, including generative AI, defense applications, and autonomous vehicles.We're accelerating the abundance of frontier data to pave the road to Artificial General Intelligence (AGI)...


  • New York, New York, United States Constellation Energy Full time

    Job Title: Senior Project Manager - Large Scale ProjectsConstellation Energy is seeking a Senior Project Manager to lead large-scale projects in the energy sector. About the RolePlan, direct, and coordinate project activities to ensure timely completion within budget and to contractual requirements.Manage all parties involved and ensure professional project...


  • New York, New York, United States Capital One Full time

    Transforming Banking through Cutting-Edge TechnologyWe are seeking a highly skilled Lead Software Engineer - Java to lead the charge in transforming our banking systems. With your expertise in Java and passion for innovation, you will drive the development of large-scale projects that meet regulatory needs and deliver robust cloud-based solutions.The ideal...


  • New York, New York, United States Scale AI Full time

    About ScaleAccelerate AI application development with our 8-year AI data foundry. Our Generative AI, defense applications, autonomous vehicles, and frontier data for Artificial General Intelligence (AGI) enable enterprise customers and governments to deepen their capabilities and offerings.About Data EngineWe develop the world's most advanced LLMs and...


  • New York, New York, United States Dstillery Full time

    About DstilleryDstillery is a leading custom audience solutions company that empowers brands and their agencies to maximize the value of customer data and transform the way they connect with their audiences.We're a group of relentlessly curious data scientists, engineers, and marketing and advertising professionals solving companies' toughest problems in the...


  • New York, New York, United States Scale AI Full time

    About ScaleAt Scale, we believe that the transition from traditional software to artificial intelligence is one of the most significant shifts of our time. Our mission is to accelerate this process across every industry, and our team is transforming how organizations build and deploy AI. SolutionsOur products power the world's most advanced large language...