Principal Engineer for Large-Scale Data Systems

2 days ago


New York, New York, United States StartUs GmbH Full time

Company Overview

We are a leading technology company dedicated to revolutionizing the way people experience music. Our Engineering org is at the forefront of this innovation, and we're looking for a talented Principal Engineer to join our team.

About the Role

The estimated salary for this position is $140,000 - $180,000 per year, depending on location and experience.

We're seeking an experienced Software Engineer with a strong background in data systems and distributed architecture. As a Principal Engineer, you will design, develop, and deploy large-scale data pipelines using Scalding, Scio, Storm, Spark, and the Google Cloud Platform. You will also work on architecting and operating services that support millions of users.

Key Responsibilities

  • Design and implement complex data pipelines with high-volume heterogeneous data, leveraging distributed systems such as Hadoop, BigTable, and Cassandra.
  • Develop distributed, high-volume services in Java or Scala, ensuring scalability, reliability, and performance.
  • Collaborate with cross-functional teams to drive optimization, testing, and tooling to improve data and system quality.
  • Leverage best practices in continuous integration and delivery, ensuring seamless deployment and operation of services.

Requirements

  • At least 5 years of professional experience working in a product-driven environment, preferably with large-scale data systems and distributed architecture.
  • Deep understanding of system design, data structures, and algorithms, with expertise in data modeling, data access, and data storage techniques.
  • Familiarity with agile software processes, data-driven development, reliability, and responsible experimentation.
  • Excellent collaboration skills, with experience working in cross-functional teams to achieve common goals.

What We Offer

We are proud to foster a workplace free from discrimination and promote diversity of experience, perspectives, and background. This is something we value deeply and encourage everyone to come be a part of changing the way the world listens to music.



  • New York, New York, United States Lilt Full time

    About LiltLilt is a cutting-edge machine learning company that specializes in large-scale language translation systems. Our team invests heavily in workflow and backend AI systems, prioritizing usability and interface design to provide seamless experiences for our users.Salary and BenefitsWe offer a competitive salary, with a range of $150,000 - $200,000 per...


  • New York, New York, United States Scale AI Full time

    **About Us**Solidify the future of artificial intelligence by joining Scale AI's Operator Group team.We're accelerating the development of AI applications, leveraging our expertise to power the world's most advanced LLMs and generative models. Our mission is to make this transition happen faster across every industry.As a Senior Software Engineer and Data...


  • New York, New York, United States Scale AI Full time

    About ScaleAccelerate AI application development with our 8-year AI data foundry. Our Generative AI, defense applications, autonomous vehicles, and frontier data for Artificial General Intelligence (AGI) enable enterprise customers and governments to deepen their capabilities and offerings.About Data EngineWe develop the world's most advanced LLMs and...


  • New York, New York, United States Dstillery Full time

    About DstilleryDstillery is a leading custom audience solutions company that empowers brands and their agencies to maximize the value of customer data and transform the way they connect with their audiences.We're a group of relentlessly curious data scientists, engineers, and marketing and advertising professionals solving companies' toughest problems in the...


  • New York, New York, United States Capital One Full time

    Transforming Banking through Artificial Intelligence">At Capital One, we are committed to revolutionizing the banking industry by leveraging the power of artificial intelligence. Our team of experts is dedicated to designing, developing, and deploying cutting-edge AI solutions that enhance customer experiences and drive business growth.">We are seeking a...


  • New York, New York, United States Capital One Full time

    Job SummaryWe are seeking an experienced Senior Manager, Technical Program Management to lead our technical program management team in developing large-scale products and platforms. As a key member of our organization, you will be responsible for overseeing the development of these products and ensuring they meet the required standards.About the RoleThis...


  • New York, New York, United States Spotify Full time

    Job Title: Senior Machine Learning EngineerAbout the Role:Spotify is seeking a highly skilled Senior Machine Learning Engineer to join our team.Key Responsibilities:Collaborate with a cross-functional agile team to build new product features.Prototype new algorithms, evaluate with small-scale experiments, and implement solutions at scale.Build feature...


  • New York, New York, United States Capital One Full time

    At Capital One, we are dedicated to creating innovative and responsible AI systems that transform the banking experience. As a Senior Manager, AI Engineer on our Intelligent Foundations and Experiences (IFX) team, you will play a crucial role in advancing the state of the art in science and AI engineering.About the RoleWe are seeking an experienced AI...


  • New York, New York, United States InterEx Group Full time

    Job Overview:InterEx Group is searching for a highly skilled AWS Data Engineer to support the build-out of a brand new data platform on AWS Data Lake. This is an exciting opportunity for a talented individual to join our team and work extensively with AWS.Key Responsibilities:Design and implement data pipelines using AWS servicesDevelop and maintain...

  • Data Systems Director

    3 weeks ago


    New York, New York, United States Index Exchange Full time

    About the Role:As a key member of our Technology Operations organization, we are seeking a skilled and visionary Director of Data Systems to lead our dynamic team in managing on-premise and hybrid data environments with low-latency requirements.Our company is dedicated to pushing the boundaries of technology and data-driven solutions, and we need a leader...


  • New York, New York, United States Scale AI Full time

    About ScaleAt Scale AI, our mission is to accelerate the development of AI applications. For years, we've been the leading AI data foundry, helping fuel the most exciting advancements in AI, including generative AI, defense applications, and autonomous vehicles. With our recent Series F round, we're accelerating the abundance of frontier data to pave the...


  • New York, New York, United States New York Life Full time

    Job Summary:We are seeking a highly skilled Principal Data Architect to lead the design and execution of our company's modern data product strategy.As a key member of the Enterprise Data team, you will collaborate with Data Product Owners, Architects, Data Scientists, Data Engineers, and end-users to reimagine, design, and build the next generation of...

  • Senior Data Architect

    4 weeks ago


    New York, New York, United States Match Group Full time

    Main Responsibilities:Design, build, and optimize data pipelines and products that support foundational product services.Collaborate closely with product and engineering teams to create innovative solutions for handling large-scale data challenges.Ensure data consistency, low latency, and fault tolerance in data pipelines.About the Role:As a Senior Data...


  • New York, New York, United States Launch Potato Full time

    About the RoleLaunch Potato is a digital media company that connects advertisers to customers at various stages of the consumer journey. We are seeking a Senior Data Scientist and Machine Learning Engineer to join our team and contribute to the development of deep personalization models and complex optimization algorithms.Key ResponsibilitiesDesign and...

  • Data Science Expert

    2 days ago


    New York, New York, United States Capital One Full time

    Job DescriptionThis is a unique opportunity for an individual contributor to work at all phases of the data science lifecycle, including building machine learning models and partnering with engineering teams to operationalize them in scalable production systems.The ideal candidate will be curious and creative, thriving on bringing definition to big problems....


  • New York, New York, United States Evolutionary Scale Full time

    Unlocking the Future of Biotech with AIAt EvolutionaryScale, we're revolutionizing the field of biotechnology by harnessing the power of artificial intelligence. Our mission is to develop cutting-edge AI solutions that unlock new possibilities for human health and society.About the RoleWe're seeking an exceptional Senior Biotech AI Engineer to join our team....


  • New York, New York, United States Capital One Full time

    Capital One OverviewCapital One is a leading financial institution that empowers millions of Americans to achieve financial freedom. We are committed to innovation, diversity, and inclusion in the workplace.Job DescriptionWe are seeking a highly skilled Senior Data Engineer to join our team in Chicago, Illinois. As a key member of our data engineering team,...


  • New York, New York, United States Capital One Full time

    Are you a talented data science professional looking to take your career to the next level?About the Role:As a Senior Machine Learning Engineer at Capital One, you'll be part of an innovative team dedicated to productionizing machine learning applications and systems at scale.You'll participate in the detailed technical design, development, and...


  • New York, New York, United States Arcesium Full time

    Arcesium seeks a seasoned senior software architect to lead the development of its data platform. This individual will design and implement cutting-edge technologies that power the company's data-intensive applications.Key ResponsibilitiesArchitect and implement the next-generation data platformDesign and develop innovative data productsDrive solutions for...


  • New York, New York, United States Capital One Careers Full time

    Company Overview:Capital One is a leading financial institution that utilizes artificial intelligence to create personalized customer experiences. With a strong commitment to innovation, Capital One invests in cutting-edge technology infrastructure and attracts world-class talent to drive its success.About the Role:We are seeking an experienced Senior AI...