Senior Data Engineer, Data Ingestion

2 weeks ago

New York County New York, United States Sirius XM Full time

Responsibilities:

Who We Are:


SiriusXM and its brands (Pandora, SiriusXM Media, AdsWizz, Simplecast, and SiriusXM Connected Vehicle Services) are leading a new era of audio entertainment and services by delivering the most compelling subscription and ad-supported audio entertainment experience for listeners in the car, at home, and anywhere on the go with connected devices.

Our vision is to shape the future of audio, where everyone can be effortlessly connected to the voices, stories, and music they love wherever they are.


This is the place where a diverse group of emerging talent and legends alike come to share authentic and purposeful songs, stories, sounds and insights through some of the best programming and technology in the world.

Our critically acclaimed, industry-leading audio entertainment encompasses music, sports, comedy, news, talk, live events, and podcasting.

No matter their individual role, each of our employees plays a vital part in bringing SiriusXM's vision to life every day.


SiriusXM is the leading audio entertainment company in North America, and the premier programmer and platform for subscription and digital advertising-supported audio products.

SiriusXM's platforms collectively reach approximately 150 million listeners, the largest digital audio audience across paid and free tiers in North America, and deliver music, sports, talk, news, comedy, entertainment, and podcasts.

Pandora, a subsidiary of SiriusXM, is the largest ad-supported audio entertainment streaming service in the U.S. SiriusXM's subsidiaries Simplecast and AdsWizz make it a leader in podcast hosting, production, distribution, analytics, and monetization.

The Company's advertising sales organization, which operates as SiriusXM Media, leverages its scale, cross-platform sales organization, and ad tech capabilities to deliver results for audio creators and advertisers.

SiriusXM, through SiriusXM Canada Holdings, Inc., also offers satellite radio and audio entertainment in Canada. In addition to its audio entertainment businesses, SiriusXM offers connected vehicle services to automakers.

How you'll make an impact:


In this role you will be a member of a team responsible for designing and developing a data ecosystem to promote an environment of data democratization and utilization across SiriusXM and Pandora.

This role will report to a Director of Data Engineering.

What you'll do:
Build cloud-based data pipeline frameworks and operations to power business intelligence.

Build and improve workflow orchestration tooling to support efficient data pipelines. E.g. airflow plugins, systems integration, deployments.


Implement data governance through proper structure, access controls, and safeguards Build command line tools that improve user experience and encourage best practices in the cloud.

Build monitoring dashboards for stakeholders to better understand the health, performance, and cost of the platform.

Write documentation to encourage adoption of platform tools and support users in their use.

Strengthen corporate best practices around data engineering software development processes.

What you'll need:
5+ years' experience developing data ETL pipelines and data tools in Scala and/or Python.

BS/MS or above in Computer Science or relevant experience

Experience with data warehouse technologies:
MapReduce, HDFS, Hive, Tez, Spark, Sqoop.

Experience with streaming technologies - Kafka, Kafka Connect, KStreams, KSQL, Beam, Flink, Spark.

Experience developing SQL applications of significant complexity

Experience with cloud computing - Google Cloud Platform, Amazon Web Services.

Experience developing for Linux-based deployment platforms, developing scalable, multithreaded server-side software for deployment.

Experience developing service-oriented architectures / orchestration.

Experience with API design/development – RPC, REST, JSON.

Experience with unit and integration testing frameworks.

Experience with CI/CD, build and deployment technologies such as Jenkins.

Experience with Data Visualization or Data Notebook tools (i.e Zeppelin, Tableau, etc.).

Experience working in a Cloud Environment (AWS, GCP, etc.).

Experience developing and deploying machine learning algorithms.

Experience developing with additional languages - R, Scala.

Experience with workflow tools – Airflow/Composer/Luigi.

Experience with data serialization system - Avro, Protobuf.

Good public speaking and presentation skills.

Interpersonal skills and ability to interact and work with staff at all levels.

Excellent written and verbal communication skills.

Ability to work independently and in a team environment.

Ability to pay attention to details and be organized.

Ability to project professionalism over the phone and in person.

Ability to handle multiple tasks in a fast-paced environment.

Commitment to "internal client" and customer service principles.

Willingness to take initiative and to follow through on projects.

Creative writing ability.


Excellent time management skills, with the ability to prioritize and multi-task, and work under shifting deadlines in a fast-paced environment.

Must have legal right to work in the U.S.

At SiriusXM, we carefully consider a wide range of factors when determining compensation, including your background and experience. These considerations can cause your compensation to vary.

We expect the base salary for this position to be in the range of $128,000 to $170,000 and will depend on your skills, qualifications, and experience.

Additionally, this role might be eligible for discretionary short-term and long-term incentives. We encourage all interested candidates to apply.

Our goal at SiriusXM is to provide and maintain a work environment that fosters mutual respect, professionalism and cooperation.

SiriusXM is an equal opportunity employer that does not discriminate on the basis of actual or perceived race, creed, color, religion, national origin, ancestry, alienage or citizenship status, age, disability or handicap, sex, gender identity, marital status, familial status, veteran status, sexual orientation or any other characteristic protected by applicable federal, state or local laws.


The requirements and duties described above may be modified or waived by the Company in its sole discretion without notice.

  • Senior Data Engineer

    15 hours ago

    New York, United States Net2source Full time

    Job Title: Data Engineer Location: NEW YORK NY 10019 (2 days onsite) Duration: 6+ Months Contract (possibility of Extension) Job description: As a Senior Data Engineer, you will be responsible for the full development life cycle of complex data projects requiring integrations and transformations including analysis, design, development, and support of complex...

  • Senior Data Engineer

    5 days ago

    New York, United States A-Line Staffing Solutions Full time

    Job DescriptionJob DescriptionTitle: Senior Data EngineerLocation: New York City – Midtown Manhattan (2-days onsite, 3-days remote Hybrid Schedule; open to fully remote for the right candidate)Schedule: Mon – Fri, 8:00AM – 5:00PM ESTNote: C2C & 3rd Party Candidates will NOT be consideredWe are seeking a Senior Data Engineer to work with our technical...

  • Data Engineering

    4 weeks ago

    New York, United States Understood Full time

    **About Understood**: Understood is a nonprofit focused on shaping the world for difference. We raise awareness of the challenges and strengths of people who learn and think differently. Our resources help people navigate challenges, gain confidence, and find support and community so they can thrive. Having a shared commitment to our values is a key factor...

  • Senior Data Engineer

    2 weeks ago

    New York, United States Quilt Software LLC Full time

    Job DescriptionJob DescriptionAbout Quilt Software: Quilt LLC is PSG Equity's latest vertical software and integrated payments platform, similar to their successful EverCommerce investment which recently went public. Quilt provides specialty inventory and POS software through a family of vertically focused, independently managed subsidiaries. See...

  • Senior Data Engineer

    1 week ago

    New York, United States Russell Tobin & Associates Full time

    What are we looking for in our Senior Data Engineer? Responsibilities Create scalable and secure data pipelines enabling the ingestion, transformation, and transfer of large quantities of structured and unstructured data from various databases and sources. Build complex database logic and APIs to automatically fetch and store data in...

  • Senior Data Engineer

    7 days ago

    New York, United States Net2Source Inc. Full time

    Job Title: Data Engineer Location: NEW YORK NY 10019 (2 days onsite) Duration: 6+ Months Contract (possibility of Extension) Job description: As a Senior Data Engineer, you will be responsible for the full development life cycle of complex data projects requiring integrations and transformations including analysis, design, development, and support of...

  • Senior Data Engineer

    4 weeks ago

    New York, United States 5P Consulting Full time

    Job DescriptionJob Description5P Consulting is recruiting a staff augmentation role for a client in NYC (Manhattan) onsite 5 days a week for 6-12 months. This role will play an integral part in leading data activities and reporting to the CIO at 5P Consulting and the client organization's VP of Technology. The client is in the clean energy space.5P...

  • Senior Data Engineer

    1 week ago

    New York, United States MASHPOINT LLC Full time

    Job DescriptionJob DescriptionJob Title: Senior Data EngineerJob Location: New York, NY, 10019 - HYBRIDDuration: 5+ Months (Possibility of extension)**Hybrid with 2 days per week in the office. Fully remote is acceptable for the right candidate.Job Summary:As a Senior Data Engineer, you will oversee the entire development lifecycle of complex data projects,...

  • Senior GCP Data Engineers

    4 weeks ago

    New York, United States Tech Tammina LLC Full time

    Job DescriptionJob DescriptionSenior GCP Data EngineersNew YorkSummary The ideal candidate should have extensive experience in IT and data engineering, particularly with GCP in the financial sector. They should be proficient in managing and optimizing data storage, ensuring data security, and using Python and SQL for data manipulation. They must also have a...

  • Big Data Engineer

    5 days ago

    New York, United States Saxon Global Full time

    Big Data Engineer Hybrid-Atlanta GA 12+ Months Contract Phone and Skype Visa: OPT/H4-EAD/GC-EAD/GC/USC Job Description Client Corporation is currently seeking an experienced Data Engineer - Big Data individual for their Midtown office in Atlanta, GA. The successful candidate must have Big Data engineering experience and must demonstrate an affinity...

  • Senior Data Engineer

    6 days ago

    New York, United States Rose International Full time

    **Only those lawfully authorized to work in the designated country associated with the position will be considered.** **Please note that all Position start dates and duration are estimates and may be reduced or lengthened based upon a client’s business needs and requirements.**We are seeking a Senior Data Engineer who thrives in a...

  • Lead Data Engineer

    3 weeks ago

    New York, United States 3Cloud Full time

    Are you looking for a role that motivates and challenges you? Are you ready for an opportunity for growth? Do you want to work on teams where people roll up their sleeves to take on tough problems together, and regularly blow the doors off our clients with their outstanding teamwork? If you answered yes to those questions, 3Cloud might just be for you!At...

  • Senior Data Engineer

    3 weeks ago

    New York, United States Sun Pharma Full time

    As a member of our Software Engineering Group, we look first and foremost for people passionate about solving business problems through innovation and engineering practices. You'll be required to apply your depth of knowledge and expertise to all aspects of the software development lifecycle and partner continuously with your many stakeholders daily to stay...

  • Senior Data Engineer, Analytics

    1 month ago

    New York, New York, United States Paramount Full time

    OVERVIEW & RESPONSIBILITIESThis role will be responsible for growing and optimizing the Studio's data and data pipeline architecture, monitoring and running backend infrastructure, as well as automating data processes for the Global Analytics and Data Science team. We seek a candidate with a passion for data and technology, for optimization of data...

  • Senior Systems Engineer

    1 month ago

    New York, United States VAST Data Full time

    VAST Data is looking for a Senior Systems Engineer to join our growing team! This is a great opportunity to be part of one of the fastest-growing infrastructure companies in history, an organization that is in the center of the hurricane being created by the revolution in artificial intelligence. "VAST's data management vision is the future of the...

  • Senior Data Engineer:

    12 hours ago

    New York, United States Akraya Full time

    Primary Skills: SQL, Scala, Spark, Snowflake, Airflow Contract Type: W2 Duration: 12+ Months Contract Location: New York, NY (#LI-Hybrid) Pay Range: $75 - $80 Per Hour W2 #DP JOB RESPONSIBILITIES: Contribute to maintaining, updating, and expanding existing Core Data platform data pipelines in Scala and Python / Spark while maintaining strict uptime SLAs...

  • Data Engineer

    2 weeks ago

    New York, New York, United States Action Tech Full time

    This is a full time, direct hire position that requires 3 to 4 days a week onsite in NYCAll applicants must be local to the NY, NJ, CT areaWe are looking for an outstanding Data Engineer to join our New York-based team who can help build the infrastructure to make data a central part of the company. Data driven decisions are very critical, as a result, we...

  • Data Engineer

    4 weeks ago

    New York, United States Strata Infosys Full time

    Requirements Must have 5 years minimum hands-on experience with the following • Writes complex SQL queries required to perform Data Acquisition and Ingestion required for Data pipelines • Builds Data pipelines and does data engineering activities using technologies like Python Hadoop Spark etc. • Ensures the upkeep of the Hadoop Data Lake Platform...

  • Lead Data Consultant

    2 weeks ago

    New York, United States 3Cloud Full time

    Are you looking for a role that motivates and challenges you? Are you ready for an opportunity for growth? Do you want to work on teams where people roll up their sleeves to take on tough problems together, and regularly blow the doors off our clients with their outstanding teamwork? If you answered yes to those questions, 3Cloud might just be for you!At...

  • Data Engineer

    4 weeks ago

    New York, New York, United States Strata Infosys Full time

    Requirements Must have 5 years minimum hands-on experience with the following Writes complex SQL queries required to perform Data Acquisition and Ingestion required for Data pipelines Builds Data pipelines and does data engineering activities using technologies like Python Hadoop Spark etc. Ensures the upkeep of the Hadoop Data Lake Platform by monitoring...