Senior Data Engineer

1 month ago


New York, New York, United States Hulu Full time

Job Posting Title:

Senior Data Engineer - Identity DataReq ID:
Job Description:


Disney Entertainment & ESPN TechnologyOn any given day at Disney Entertainment & ESPN Technology, we're reimagining ways to create magical viewing experiences for the world's most beloved stories while also transforming Disney's media business for the future.

Whether that's evolving our streaming and digital products in new and immersive ways, powering worldwide advertising and distribution to maximize flexibility and efficiency, or delivering Disney's unmatched entertainment and sports content, every day is a moment to make a difference to partners and to hundreds of millions of people around the world.

A few reasons why we think you'd love working for Disney Entertainment & ESPN TechnologyBuilding the future of Disney's media business:

DE&E Technologists are designing and building the infrastructure that will power Disney's media, advertising, and distribution businesses for years to come.


Reach & Scale:
The products and platforms this group builds and operates delight millions of consumers every minute of every day from Disney
and Hulu, to ABC News and Entertainment, to ESPN and ESPN+, and much more.

Innovation:


We develop and execute groundbreaking products and techniques that shape industry norms and enhance how audiences experience sports, entertainment & news.

The Product & Data Engineering team is responsible for end to end development for Disney's world-class consumer-facing products, including streaming platforms Disney+, Hulu, and ESPN+, and digital products & experiences across ESPN, Marvel, Disney Studios, NatGeo, and ABC News.

The team drives innovation at scale for millions of consumers around the world across Apple, Android, Smart TVs, game consoles, and the web, with our platforms powering core experiences like personalization, search, messaging and data.

Job

Summary:


We contribute to the Company's success by partnering with business, analytics and infrastructure teams in designing and building data pipelines for our foundational data sets related to Identity, Account, Profile and Device data.

We support downstream teams by providing data and data related services to consumers across all of the Disney companies.

Collaborating across teams, we define technical requirements, identify internal/external data sources, design table structure, define ETL strategy, implement and automate data quality checks and alerting.

As a Senior Data Engineer within Identity Data Engineering, You will help build systems which can elastically scale to handle extensive amounts of data.

You will be exposed to all phases of the software development process.
From business use-case refinement, architecture, implementation, testing, deployment to support.
In addition, You will partner with upstream/downstream providers of data from internal teams to external vendors.
Work with other tech teams in architecture, infrastructure/platform, DevOps, SecOps, QA, data analysts and data science.

Lastly, collaborate with Technical Project Manager(s) and Product Owners on task definition, estimation and refinementOur team builds on cloud-based technology often pushing the edge of what is available and solving for scalability, reliability, resilience and performance.

Our engineers have opportunities to work on challenges and problems not found in most companies due to volume, scale, near-real-time and latency requirements.


Responsibilities and Duties of the Role:
Design table structures and implement ETL pipelines to build performant data solutions that are reliable and scalable in a fast growing data ecosystem, including defining data quality checks and validations, orchestration of pipelines using AirflowWriting code, researching, solving and resolving issues and improving applicationsSupport several legacy applications as we migrate functionality to new applicationsImprove existing pipelines with optimizations, deprecations, new technologyResearch data and data issuesRequired Education, Experience/Skills/Training:
Basic Qualifications 5
years of relevant experience4
years professional programming experience with w/Java, Python and/or Scala3
years of data engineering experience developing large data pipelines with MapReduce/Spark/PySpark and hands-on experience with AWSStrong communication skills written and verbal presentations and able to communicate effectively at all levelsPreferred Qualifications Ability to describe highly technical detail in terms the audience will understandFamiliarity with Agile Scrum principles and ceremonies4
years experience using analytic SQL working with traditional relational databases and/or distributed systems such as Hadoop/Hive, BigQuery, Snowflake/Redshift2
years of experience with data orchestration/ETL tools such as Airflow, NifiFamiliarity with data exploration / data visualizationExposure to Graph Databases and query languages (Neptune, Janus, Neo4j, Gremlin/Cypher)Experience with messaging and/or streaming systems (Kafka, Kinesis, Spark Streaming)Required Education:

Bachelor's Degree in Computer Science, Information Systems or related field, or equivalent work experienceMaster's Degree a plusThe hiring range for this position in Santa Monica, California is $136,038 to $182,490 per year, in Bristol, Connecticut is $136,038 to $182,490 per year, in Seattle, Washington is $142,516 to $191,180 per year.

in New York City, NY is $142.
516 to $191,180 per year, and in San Francisco, California is $149,000 to $199,000 per year.

The base pay actually offered will take into account internal equity and also may vary depending on the candidate's geographic region, job-related knowledge, skills, and experience among other factors.

A bonus and/or long-term incentive units may be provided as part of the compensation package, in addition to the full range of medical, financial, and/or other benefits, dependent on the level and position offered.


Job Posting Segment:

Product & Data EngineeringJob Posting Primary Business:

PDE - Data Platform EngineeringPrimary Job Posting Category:

Data EngineeringEmployment Type:

Full timePrimary City, State, Region, Postal Code:

Seattle, WA, USAAlternate City, State, Region, Postal Code:
USA - CA Broadway, USA - CA - Market St, USA - CT - ESPN North Campus - 383 Middle St, USA - NY Avenue of the AmericasDate Posted:

SummaryLocation:
Seattle, WA, USA; San Francisco, CA, USA; New York, NY, USA; Bristol, CT, USA; Santa Monica, CA, USAType:
Full time.

Estimated Salary:
$20 to $28 per hour based on qualifications.
  • Senior Data Engineer

    2 months ago


    New York, New York, United States Tickets Full time

    , an MLB company, delivers innovative, cutting-edge technologies to enable frictionless and unforgettable fan experiences in venues across the globe. Together with MLB, is changing the landscape of the live sports and entertainment industry, delivering new digital venue and ticketing experiences to millions of fans. Our Technology team builds platforms and...


  • New York, New York, United States Tickets Full time

    , an MLB company, delivers innovative, cutting-edge technologies to enable frictionless and unforgettable fan experiences in venues across the globe. Together with MLB, is changing the landscape of the live sports and entertainment industry, delivering new digital venue and ticketing experiences to millions of fans. Our Technology team builds platforms and...

  • Senior Data Engineer

    2 months ago


    New York, New York, United States Bloomberg Full time

    Senior Data Engineer - Artificial Intelligence GroupNew York, NYBloomberg's Engineering AI department has 300+ AI practitioners building highly sought after products and features that often require novel innovations. We are investing in AI to build better search, discovery, and workflow solutions using technologies such as transformers, gradient boosted...

  • Senior Data Engineer

    2 months ago


    New York, New York, United States Hulu Full time

    Job Posting Title:Senior Data EngineerReq ID:Job Description:Disney Entertainment & ESPN TechnologyOn any given day at Disney Entertainment & ESPN Technology, we're reimagining ways to create magical viewing experiences for the world's most beloved stories while also transforming Disney's media business for the future.Whether that's evolving our streaming...

  • Data Engineer

    4 days ago


    New York, New York, United States NTT DATA Services Full time

    Req ID: NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a Data Engineer to join our team in New York, New York (US-NY), United States (US). Responsibilities:- Expand and optimize the...

  • Senior Data Engineer

    3 weeks ago


    New York, New York, United States Hulu Full time

    Job Posting Title:Senior Data EngineerReq ID:Job Description:Disney Entertainment & ESPN TechnologyOn any given day at Disney Entertainment & ESPN Technology, we're reimagining ways to create magical viewing experiences for the world's most beloved stories while also transforming Disney's media business for the future.Whether that's evolving our streaming...

  • Senior Data Engineer

    4 weeks ago


    New York, New York, United States Tatari Full time

    Tatari is on a mission to revolutionize TV advertising. We work with some of your favorite disruptor brands—like Calm, Vuori, Rocket Money, and hundreds more—to grow their business using linear and streaming TV ads. Our platform combines sophisticated media buying with proprietary analytics to turn TV advertising into an automated, digital-like...

  • Senior Data Engineer

    2 weeks ago


    New York, New York, United States American Express Full time

    You Lead the Way.We've Got Your Back.With the right backing, people and businesses have the power to progress in incredible ways.When you join Team Amex, you become part of a global and diverse community of colleagues with an unwavering commitment to back our customers, communities and each other.Here, you'll learn and grow as we help you create a career...

  • Senior Data Engineer

    2 weeks ago


    New York, New York, United States Method Full time

    Method is a global design and engineering consultancy founded in 1999. We believe that innovation should be meaningful, beautiful and human. We craft practical, powerful digital experiences that improve lives and transform businesses. Our teams [based in New York, Charlotte, Atlanta, London, Bengaluru, and remote] work with a wide range of organizations in...


  • New York, New York, United States Fora Travel Full time

    About ForaHi, we're Fora. We're reimagining the travel advisor industry with fresh eyes, and building a travel agency that is modern, inclusive, tech-enabled and well, cool.Fora is a next-generation travel platform that, through training and tools, enables anyone to become a travel agent. Fora's mission is to empower 100,000 entrepreneurs to transform their...


  • New York, New York, United States tapwage Full time

    Impact you will makeThe ideal candidate will have a natural curiosity about solving problems – familiar with the complexity of healthcare datasets. They will be critical thinkers with advanced problem solving, data mining, and data engineering skills that enables them to answer ambiguous questions in data that help leaders make great data driven...

  • Data Engineer

    3 months ago


    New York, New York, United States TopEdge Technology Full time

    Job DescriptionPosition Data Engineer Duration 12 months Location New Jersey Remote Work Permitted Due to COVID-19 the client has agreed to allow the selected candidate to work remotely for the time being. However the selected candidate must be available to report onsite as directed by the client.Position Data EngineerJob DescriptionThe Senior Data Engineer...

  • Senior Data Engineer

    2 months ago


    New York, New York, United States Tatari Full time

    Tatari is on a mission to revolutionize TV advertising. We work with some of your favorite disruptor brands—like Calm, Fiverr, and RocketMoney—to grow their business through linear and streaming TV. We combine a sophisticated media buying platform with proprietary analytics to turn TV advertising into an automated, digital-like experience.Named one of...


  • New York, New York, United States Zendesk Full time

    ZendeskRemote, Germany R27602Job DescriptionThis role will work on the exciting Zendesk AI Agent (Ultimate) product.Ultimate were acquired by Zendesk in March 2024, we've become even more powerful. Together with Zendesk we're joining forces to build the world's most advanced AI agents in CX.Role:Data and Analytics are at the core of our product strategy....


  • New York, New York, United States Atechstar Full time

    BASIC QUALIFICATIONS7 years of relevant(data) engineering experience 2 years of people management experience managing data engineers Experience in partnering with product and program management teams Bachelors degree in Engineering Computer Science or a related technical field 2 years of experience owning a program/product/feature scoping requirements...


  • New York, New York, United States Crux Informatics Full time

    Responsibilities:Own the development and maintenance of data pipelines, ETL processes, and data workflows at scale.Mentor and lead multiple high-performing data engineers.Provide strategic direction and leadership to the data engineering team.Drive a culture of continuous improvement in Crux's data engineering methodology.Foster a collaborative and...

  • Sr. Data Engineer

    2 months ago


    New York, New York, United States Vimeo Full time

    Vimeo is looking for an experienced Senior Data Engineer - Analytics to join our Data Architecture and Analytics Engineering team and work closely with Data Analysts and Data Scientists to create and maintain robust, scalable, and sustainable data models that provide decision-making insights for senior leadership including executives. The ideal candidate is...

  • Data Engineer

    1 month ago


    New York, New York, United States Epoch Capital Full time

    A little bit about Epoch...Epoch is one of Australia's leading international proprietary trading firms with its headquarters based in Sydney CBD and offices in London and New York. We have distinguished ourselves from our peers in the industry by maintaining world-class technology in an innovative and collaborative team culture. Epoch's culture of teamwork...

  • Senior Data Engineer

    4 weeks ago


    New York, New York, United States tapwage Full time

    About ZepzZepz is powering two leading global payments brands: WorldRemit and Sendwave. We represent brands that disrupted an industry previously dominated by offline legacy players by taking international money transfers online - making global digital payments fairer, faster, and more flexible.Our brands currently send from 50 to 130 countries, operate in...

  • Senior Data Engineer

    3 months ago


    New York, New York, United States Atechstar Full time

    What Youll Do Collaborate with and across Agile teams to design develop test implement and support technical solutions in full-stack development tools and technologies Work with a team of developers with deep experience in machine learning distributed microservices and full stack systems Utilize programming languages like Java Scala Python and Open Source...