Principal Engineer for Large-Scale Data Systems
2 days ago
Company Overview
We are a leading technology company dedicated to revolutionizing the way people experience music. Our Engineering org is at the forefront of this innovation, and we're looking for a talented Principal Engineer to join our team.
About the Role
The estimated salary for this position is $140,000 - $180,000 per year, depending on location and experience.
We're seeking an experienced Software Engineer with a strong background in data systems and distributed architecture. As a Principal Engineer, you will design, develop, and deploy large-scale data pipelines using Scalding, Scio, Storm, Spark, and the Google Cloud Platform. You will also work on architecting and operating services that support millions of users.
Key Responsibilities
- Design and implement complex data pipelines with high-volume heterogeneous data, leveraging distributed systems such as Hadoop, BigTable, and Cassandra.
- Develop distributed, high-volume services in Java or Scala, ensuring scalability, reliability, and performance.
- Collaborate with cross-functional teams to drive optimization, testing, and tooling to improve data and system quality.
- Leverage best practices in continuous integration and delivery, ensuring seamless deployment and operation of services.
Requirements
- At least 5 years of professional experience working in a product-driven environment, preferably with large-scale data systems and distributed architecture.
- Deep understanding of system design, data structures, and algorithms, with expertise in data modeling, data access, and data storage techniques.
- Familiarity with agile software processes, data-driven development, reliability, and responsible experimentation.
- Excellent collaboration skills, with experience working in cross-functional teams to achieve common goals.
What We Offer
We are proud to foster a workplace free from discrimination and promote diversity of experience, perspectives, and background. This is something we value deeply and encourage everyone to come be a part of changing the way the world listens to music.
-
Senior Data Engineer
19 hours ago
New York, New York, United States Amazon Full timeAbout the OpportunityWe are seeking a highly skilled Senior Data Engineer to join our ADSP Product Analytics team. As a key member of this team, you will be responsible for building and maintaining large-scale data processing systems that integrate across multiple sources.
-
Data Architect
17 hours ago
New York, New York, United States Harnham Full timeJob Summary:We are seeking a highly experienced Data Architect to join our team in a large scale solutions environment. The successful candidate will design and develop Azure data warehouses and data pipelines for ML model execution.Design and develop Azure data warehouses and data pipelines for ML model executionCollaborate in a cross-functioning team and...
-
New York, New York, United States Scale AI Full timeAbout ScaleAt Scale AI, our mission is to accelerate the development of AI applications. We are a leading AI data foundry, helping fuel the most exciting advancements in AI, including generative AI, defense applications, and autonomous vehicles. With our recent funding, we're accelerating the abundance of frontier data to pave the road to Artificial General...
-
AI Data Engine Software Engineer
17 hours ago
New York, New York, United States Scale AI Full timeAbout Scale AIAt Scale, our mission is to accelerate the development of AI applications that transform industries and improve lives. Our data foundry powers some of the world's most advanced LLMs and generative models through innovative approaches like Reinforcement Learning with Human Feedback (RLHF) and human data generation.About Our Horizontal Task...
-
Senior Data Engineer for Large-Scale Analytics
3 hours ago
New York, New York, United States Jobot Full timeAs a Senior Data Engineer at Jobot, you will be part of a fast-growing SaaS company that offers stability and excellent leadership.This role is ideal for an experienced engineer who can build out data pipelines and storage procedures for large amounts of data.We are looking for someone with experience working with Large Language Models (LLMs) such as OpenAi,...
-
AI Systems Engineer
1 hour ago
New York, New York, United States Scale AI Full timeJob Title: AI Systems EngineerAt Scale AI, we're pushing the boundaries of artificial intelligence to transform industries and improve lives. As an AI Systems Engineer, you'll be instrumental in designing and developing cutting-edge AI systems that power the world's most advanced LLMs and generative models.Your Role:* Design and develop foundational...
-
Senior Data Engineer for Large-Scale Analytics
11 minutes ago
New York, New York, United States Jobot Full timeCompany Overview:We are an innovative analytics company that has recently been acquired by a leading industry giant. This acquisition has brought us the financial stability of a publicly traded company while still allowing us to operate independently.We work in the public space and have developed/are developing cutting-edge apps that redefine how public...
-
New York, New York, United States Datadog Full timeJob SummaryDatadog is seeking a skilled Cybersecurity Engineer to join our team in protecting our large-scale system infrastructure. As a key member of our Vulnerability Governance program, you will play a critical role in identifying and remediating vulnerabilities across our multi-provider ecosystem.About the RoleIn this position, you will be responsible...
-
New York, New York, United States Lilt Full timeAbout LiltLilt is a cutting-edge machine learning company that specializes in large-scale language translation systems. Our team invests heavily in workflow and backend AI systems, prioritizing usability and interface design to provide seamless experiences for our users.Salary and BenefitsWe offer a competitive salary, with a range of $150,000 - $200,000 per...
-
New York, New York, United States Scale AI Full time**About Us**Solidify the future of artificial intelligence by joining Scale AI's Operator Group team.We're accelerating the development of AI applications, leveraging our expertise to power the world's most advanced LLMs and generative models. Our mission is to make this transition happen faster across every industry.As a Senior Software Engineer and Data...
-
Senior Project Manager
20 hours ago
New York, New York, United States Constellation Energy Full timeJob Title: Senior Project Manager - Large Scale ProjectsConstellation Energy is seeking a Senior Project Manager to lead large-scale projects in the energy sector. About the RolePlan, direct, and coordinate project activities to ensure timely completion within budget and to contractual requirements.Manage all parties involved and ensure professional project...
-
New York, New York, United States Capital One Full timeTransforming Banking through Cutting-Edge TechnologyWe are seeking a highly skilled Lead Software Engineer - Java to lead the charge in transforming our banking systems. With your expertise in Java and passion for innovation, you will drive the development of large-scale projects that meet regulatory needs and deliver robust cloud-based solutions.The ideal...
-
AI Model Quality Engineer
2 weeks ago
New York, New York, United States Scale AI Full timeAbout ScaleAccelerate AI application development with our 8-year AI data foundry. Our Generative AI, defense applications, autonomous vehicles, and frontier data for Artificial General Intelligence (AGI) enable enterprise customers and governments to deepen their capabilities and offerings.About Data EngineWe develop the world's most advanced LLMs and...
-
Senior Systems Software Engineer
2 weeks ago
New York, New York, United States Dstillery Full timeAbout DstilleryDstillery is a leading custom audience solutions company that empowers brands and their agencies to maximize the value of customer data and transform the way they connect with their audiences.We're a group of relentlessly curious data scientists, engineers, and marketing and advertising professionals solving companies' toughest problems in the...
-
Senior AI Software Engineer
4 hours ago
New York, New York, United States Scale AI Full timeAbout ScaleAt Scale, we believe that the transition from traditional software to artificial intelligence is one of the most significant shifts of our time. Our mission is to accelerate this process across every industry, and our team is transforming how organizations build and deploy AI. SolutionsOur products power the world's most advanced large language...
-
Data Systems Engineer
2 hours ago
New York, New York, United States Center for Justice Innovation Full timeAbout the Center for Justice InnovationThe Center for Justice Innovation is a community justice organization that prioritizes safety and racial justice. Our organization has been driving justice nationwide in innovative, powerful, and durable ways since our founding in 1996.Job OpportunityWe are seeking a highly skilled Data Engineer to contribute to the...
-
Biological Systems Engineer
20 hours ago
New York, New York, United States Output Biosciences Full timeJob SummaryOutput Biosciences is seeking a talented Biological Systems Engineer to join our team. As a key member of our team, you will be responsible for designing and implementing advanced machine learning algorithms to enhance model performance and biological understanding.Develop and fine-tune generative models for biological applications, exploring...
-
New York, New York, United States Capital One Full timeTransforming Banking through Artificial Intelligence">At Capital One, we are committed to revolutionizing the banking industry by leveraging the power of artificial intelligence. Our team of experts is dedicated to designing, developing, and deploying cutting-edge AI solutions that enhance customer experiences and drive business growth.">We are seeking a...
-
Data Engineer for Material Catalog Systems
42 minutes ago
New York, New York, United States Material Bank Full timeAt Material Bank, we're revolutionizing the way architects and designers discover and sample materials.We're seeking a highly skilled Data Engineer to join our team. In this role, you'll play a critical part in designing and implementing scalable database systems that support our comprehensive material catalog, driving business growth and efficiency.About...
-
Principal Data Scientist
2 weeks ago
New York, New York, United States Spotify Full timeJob Title: Senior Machine Learning EngineerAbout the Role:Spotify is seeking a highly skilled Senior Machine Learning Engineer to join our team.Key Responsibilities:Collaborate with a cross-functional agile team to build new product features.Prototype new algorithms, evaluate with small-scale experiments, and implement solutions at scale.Build feature...