Principal Engineer for Large-Scale Data Systems

2 days ago


New York, New York, United States StartUs GmbH Full time

Company Overview

We are a leading technology company dedicated to revolutionizing the way people experience music. Our Engineering org is at the forefront of this innovation, and we're looking for a talented Principal Engineer to join our team.

About the Role

The estimated salary for this position is $140,000 - $180,000 per year, depending on location and experience.

We're seeking an experienced Software Engineer with a strong background in data systems and distributed architecture. As a Principal Engineer, you will design, develop, and deploy large-scale data pipelines using Scalding, Scio, Storm, Spark, and the Google Cloud Platform. You will also work on architecting and operating services that support millions of users.

Key Responsibilities

  • Design and implement complex data pipelines with high-volume heterogeneous data, leveraging distributed systems such as Hadoop, BigTable, and Cassandra.
  • Develop distributed, high-volume services in Java or Scala, ensuring scalability, reliability, and performance.
  • Collaborate with cross-functional teams to drive optimization, testing, and tooling to improve data and system quality.
  • Leverage best practices in continuous integration and delivery, ensuring seamless deployment and operation of services.

Requirements

  • At least 5 years of professional experience working in a product-driven environment, preferably with large-scale data systems and distributed architecture.
  • Deep understanding of system design, data structures, and algorithms, with expertise in data modeling, data access, and data storage techniques.
  • Familiarity with agile software processes, data-driven development, reliability, and responsible experimentation.
  • Excellent collaboration skills, with experience working in cross-functional teams to achieve common goals.

What We Offer

We are proud to foster a workplace free from discrimination and promote diversity of experience, perspectives, and background. This is something we value deeply and encourage everyone to come be a part of changing the way the world listens to music.


  • Senior Data Engineer

    7 hours ago


    New York, New York, United States Amazon Full time

    About the OpportunityWe are seeking a highly skilled Senior Data Engineer to join our ADSP Product Analytics team. As a key member of this team, you will be responsible for building and maintaining large-scale data processing systems that integrate across multiple sources.

  • Data Architect

    4 hours ago


    New York, New York, United States Harnham Full time

    Job Summary:We are seeking a highly experienced Data Architect to join our team in a large scale solutions environment. The successful candidate will design and develop Azure data warehouses and data pipelines for ML model execution.Design and develop Azure data warehouses and data pipelines for ML model executionCollaborate in a cross-functioning team and...


  • New York, New York, United States Scale AI Full time

    About Scale AIAt Scale, our mission is to accelerate the development of AI applications that transform industries and improve lives. Our data foundry powers some of the world's most advanced LLMs and generative models through innovative approaches like Reinforcement Learning with Human Feedback (RLHF) and human data generation.About Our Horizontal Task...


  • New York, New York, United States Datadog Full time

    Job SummaryDatadog is seeking a skilled Cybersecurity Engineer to join our team in protecting our large-scale system infrastructure. As a key member of our Vulnerability Governance program, you will play a critical role in identifying and remediating vulnerabilities across our multi-provider ecosystem.About the RoleIn this position, you will be responsible...


  • New York, New York, United States Scale AI Full time

    **About Us**Solidify the future of artificial intelligence by joining Scale AI's Operator Group team.We're accelerating the development of AI applications, leveraging our expertise to power the world's most advanced LLMs and generative models. Our mission is to make this transition happen faster across every industry.As a Senior Software Engineer and Data...


  • New York, New York, United States Lilt Full time

    About LiltLilt is a cutting-edge machine learning company that specializes in large-scale language translation systems. Our team invests heavily in workflow and backend AI systems, prioritizing usability and interface design to provide seamless experiences for our users.Salary and BenefitsWe offer a competitive salary, with a range of $150,000 - $200,000 per...


  • New York, New York, United States Constellation Energy Full time

    Job Title: Senior Project Manager - Large Scale ProjectsConstellation Energy is seeking a Senior Project Manager to lead large-scale projects in the energy sector. About the RolePlan, direct, and coordinate project activities to ensure timely completion within budget and to contractual requirements.Manage all parties involved and ensure professional project...


  • New York, New York, United States Scale AI Full time

    About ScaleAccelerate AI application development with our 8-year AI data foundry. Our Generative AI, defense applications, autonomous vehicles, and frontier data for Artificial General Intelligence (AGI) enable enterprise customers and governments to deepen their capabilities and offerings.About Data EngineWe develop the world's most advanced LLMs and...


  • New York, New York, United States Dstillery Full time

    About DstilleryDstillery is a leading custom audience solutions company that empowers brands and their agencies to maximize the value of customer data and transform the way they connect with their audiences.We're a group of relentlessly curious data scientists, engineers, and marketing and advertising professionals solving companies' toughest problems in the...


  • New York, New York, United States Output Biosciences Full time

    Job SummaryOutput Biosciences is seeking a talented Biological Systems Engineer to join our team. As a key member of our team, you will be responsible for designing and implementing advanced machine learning algorithms to enhance model performance and biological understanding.Develop and fine-tune generative models for biological applications, exploring...


  • New York, New York, United States Capital One Full time

    Transforming Banking through Artificial Intelligence">At Capital One, we are committed to revolutionizing the banking industry by leveraging the power of artificial intelligence. Our team of experts is dedicated to designing, developing, and deploying cutting-edge AI solutions that enhance customer experiences and drive business growth.">We are seeking a...


  • New York, New York, United States Spotify Full time

    Job Title: Senior Machine Learning EngineerAbout the Role:Spotify is seeking a highly skilled Senior Machine Learning Engineer to join our team.Key Responsibilities:Collaborate with a cross-functional agile team to build new product features.Prototype new algorithms, evaluate with small-scale experiments, and implement solutions at scale.Build feature...


  • New York, New York, United States Capital One Full time

    Job SummaryWe are seeking an experienced Senior Manager, Technical Program Management to lead our technical program management team in developing large-scale products and platforms. As a key member of our organization, you will be responsible for overseeing the development of these products and ensuring they meet the required standards.About the RoleThis...

  • AI Engineer Team Lead

    9 hours ago


    New York, New York, United States Capital One Full time

    At Capital One, we are dedicated to creating innovative and responsible AI systems that transform the banking experience. As a Senior Manager, AI Engineer on our Intelligent Foundations and Experiences (IFX) team, you will play a crucial role in advancing the state of the art in science and AI engineering.About the RoleWe are seeking an experienced AI...

  • Data Engineering Lead

    6 hours ago


    New York, New York, United States Rhode Island Blood Center Full time

    Lead Data EngineerAt Rhode Island Blood Center, we are seeking a highly skilled Lead Data Engineer to join our team. As a key member of our data engineering team, you will be responsible for designing, implementing, and leading initiatives for optimizing databases and data pipelines.Key Responsibilities:Lead the architectural design and optimization of...


  • New York, New York, United States Match Group Full time

    Overview">We are looking for a skilled Data Engineer to join our Product Platform team at Match Group. As a Senior Data Engineer, you will play a key role in designing, building, and optimizing data pipelines and products that support foundational product services.">Salary">The estimated annual salary for this position is around $170,000 - $200,000,...


  • New York, New York, United States InterEx Group Full time

    Job Overview:InterEx Group is searching for a highly skilled AWS Data Engineer to support the build-out of a brand new data platform on AWS Data Lake. This is an exciting opportunity for a talented individual to join our team and work extensively with AWS.Key Responsibilities:Design and implement data pipelines using AWS servicesDevelop and maintain...

  • Data Systems Director

    3 weeks ago


    New York, New York, United States Index Exchange Full time

    About the Role:As a key member of our Technology Operations organization, we are seeking a skilled and visionary Director of Data Systems to lead our dynamic team in managing on-premise and hybrid data environments with low-latency requirements.Our company is dedicated to pushing the boundaries of technology and data-driven solutions, and we need a leader...


  • New York, New York, United States Capital One Services, LLC Full time

    About Capital One Services, LLCCapital One is a leader in data-driven decision-making. We use advanced technologies to unlock opportunities for our customers. As a Principal Data Scientist on the AI Training Team, you'll work with cutting-edge tools and methods to deliver AI-powered products.Job DescriptionWe're looking for an experienced data scientist to...

  • Data Engineer

    5 hours ago


    New York, New York, United States American Express Full time

    About This RoleWe are seeking a highly skilled Data Engineer to join our team at American Express. As a Data Engineer, you will be responsible for designing, building, and maintaining large-scale data systems that support our business operations.Your primary focus will be on developing and maintaining a dynamic technology infrastructure cost allocation...