Lead Software Engineer, Data Platforms

3 weeks ago


Seattle, Washington, United States Hulu Full time
About the Role

We are seeking a highly motivated Software Engineer to join our Big Data Applications team. The successful candidate will be responsible for designing and building systems to process data at scale, solving challenging problems in both batch and real-time data processing, and working across software and data disciplines to engineer solutions.

Responsibilities
  • Contribute to maintaining, updating, and expanding the existing Data Capture platform including the Spark data pipelines while maintaining strict uptime SLAs
  • Extend functionality of current Data Capture platform offerings, including metadata parsing, extending the metastore API, and building new integrations with APIs both internal and external to the Data organization
  • Implement the Lakehouse architecture, working with customers, partners, and stakeholders to shift towards a Lakehouse centric data platform
  • Architect, design, and code shared libraries in Scala and Python that abstract complex business logic to allow consistent functionality across the Data organization
  • Collaborate with product managers, architects, and other engineers to drive the success of the Data Capture platform
  • Lead the developing and documenting both internal and external standards and best practices for pipeline configurations, naming conventions, partitioning strategies, and more
  • Ensure high operational efficiency and quality of the Data Capture platform datasets to ensure our solutions meet SLAs and project reliability and accuracy to all our stakeholders (Engineering, Data Science, Operations, and Analytics teams)
  • Be an active participant and advocate of agile/scrum ceremonies to collaborate and improve processes for our team
  • Engage with and understand our customers, forming relationships that allow us to understand and prioritize both innovative new offerings and incremental platform improvements
  • Maintain detailed documentation of your work and changes to support data quality and data governance requirements
  • Provide mentorship and guidance for team members; evangelize the platform, best-practices, data driven decisions; identify new use cases and features and drive adoption


  • Seattle, Washington, United States TikTok Full time

    About the RoleTikTok is the leading destination for short-form mobile video, inspiring creativity and bringing joy to hundreds of millions of users worldwide. As a senior software engineer in the data platform team, you will have the opportunity to build, optimize, and grow one of the largest data platforms in the world.Key ResponsibilitiesDesign and...


  • Seattle, Washington, United States TikTok Full time

    About the RoleTikTok is a leading destination for short-form mobile video, and we're looking for a talented Senior Software Engineer to join our Data Platform team. As a key member of our team, you'll have the opportunity to build, optimize, and grow one of the largest data platforms in the world.Key ResponsibilitiesDesign and implement reliable, scalable,...


  • Seattle, Washington, United States Abnormal Security Full time

    About the RoleAbnormal Security's cloud products rely on data-intensive SaaS applications that require reliable, scalable, and secure access to data. Our Data Platform team enables efficient, reliable, and scalable data processing across real-time and offline processing systems. We're looking for a Software Engineer II to join our team and help us stop...

  • Senior Data Engineer

    2 weeks ago


    Seattle, Washington, United States PitchBook Data Full time

    About the RolePitchBook Data is seeking a highly skilled Senior Data Engineer to join our Enterprise Data Platform team. As a key member of our team, you will be responsible for designing, developing, and maintaining our data pipelines, ensuring the accuracy, reliability, and scalability of our data infrastructure.You will work closely with our...

  • Senior Data Engineer

    4 weeks ago


    Seattle, Washington, United States PitchBook Data Full time

    About the RolePitchBook Data is seeking a highly skilled Senior Data Engineer to join our Enterprise Data Platform team. As a key member of our team, you will be responsible for designing, developing, and maintaining our data pipelines, ensuring the accuracy, reliability, and scalability of our data infrastructure.You will work closely with our...

  • Data Engineer

    2 weeks ago


    Seattle, Washington, United States Intelliswift Software Full time

    Job Title: Data EngineerWe are seeking a highly skilled Data Engineer to join our team at Intelliswift Software. As a Data Engineer, you will play a critical role in designing, implementing, and supporting a platform that provides secured access to large datasets.Responsibilities:Design and implement data pipelines to source data from internal/external ERP...

  • Data Engineering Lead

    3 weeks ago


    Seattle, Washington, United States Saxon Global Full time

    Job Title: Tech LeadSaxon Global is seeking a highly skilled Tech Lead to lead a team of software engineers in an initiative to migrate an on-premises large-scale data warehouse and associated data pipelines to Azure.Key Responsibilities:Lead a team of software engineers in the migration of a large-scale data warehouse and associated data...


  • Seattle, Washington, United States Amazon Services LLC Full time

    About the RoleWe are seeking a highly skilled Software Development Engineer to join our AWS Fintech Data Platform team. As a key member of our team, you will be responsible for designing and developing managed solutions that enable AWS Fintech services to facilitate global financial transactions worth billions annually.Key ResponsibilitiesDesign and deliver...


  • Seattle, Washington, United States PitchBook Data Full time

    About the Role:PitchBook is a leading provider of data and software solutions for the private equity and venture capital industries. We are seeking a highly skilled Staff Software Development Engineer to join our Product and Engineering team.As a Staff Software Development Engineer, you will be responsible for architecting and delivering the next suite of...


  • Seattle, Washington, United States GEICO Full time

    Data Lakehouse Platform EngineerGEICO is seeking an experienced Data Lakehouse Platform Engineer to join our team. As a key member of our engineering staff, you will help drive our insurance business transformation by building high-performance, low-maintenance, zero-downtime platforms and core data infrastructure.Position DescriptionOur Data Lakehouse...


  • Seattle, Washington, United States PitchBook Data Full time

    About the RolePitchBook Data is seeking a highly skilled Staff Software Development Engineer to join our Product and Engineering team. As a key member of our team, you will be responsible for architecting and delivering the next suite of services that power our platform.You will work closely with our team of big thinkers, innovators, and problem solvers to...


  • Seattle, Washington, United States LevelTen Energy Full time

    Job Title: Lead Software EngineerLevelTen Energy is seeking an experienced Lead Software Engineer to join our team in Seattle, WA. As a key member of our software development team, you will be responsible for leading the design, development, and deployment of our cloud-based software platform.Job Summary:We are looking for a highly skilled and experienced...

  • Senior Data Engineer

    4 weeks ago


    Seattle, Washington, United States Intelliswift Software Full time

    Job Title: Senior Data EngineerLocation: Remote (100% ONSITE)Pay Rate Range: $65/hr. to $70/hr. on W2Duration: 12+ Months Contract (High Possibility of Extension)Job Description:We are seeking a highly skilled Senior Data Engineer to join our team at Intelliswift Software. As a Senior Data Engineer, you will be responsible for designing, implementing, and...


  • Seattle, Washington, United States PitchBook Data Full time

    About the RoleWe are seeking a highly skilled Staff Software Development Engineer to join our Product and Engineering team at PitchBook Data. As a key member of our team, you will be responsible for architecting and delivering the next suite of services that power our platform.Key ResponsibilitiesArchitect, design, develop, and maintain components of our...


  • Seattle, Washington, United States PitchBook Data Full time

    About the RolePitchBook Data is seeking a highly skilled Staff Software Development Engineer to join our Product and Engineering team. As a key member of our team, you will be responsible for architecting and delivering the next suite of services that power our platform.You will work closely with our team of big thinkers, innovators, and problem solvers to...


  • Seattle, Washington, United States Expedia , Inc. Full time

    About the RoleWe are seeking a highly skilled and experienced Senior Data Engineer to join our Customer Data Platform team at Expedia Group. As a key member of our team, you will be responsible for defining and implementing the technical vision for our next generation of traveler data products.Key Responsibilities:Define and own the technical vision and...


  • Seattle, Washington, United States Abnormal Security Full time

    About the RoleAbnormal Security is seeking a skilled Software Engineer II to join the Platform Security team. The ideal candidate will have a strong background in software development and a passion for security and privacy.Key ResponsibilitiesDesign, develop, and release secure service-to-service communication frameworks and toolings.Integrate customer data...


  • Seattle, Washington, United States Social Finance, Inc. (SoFi) Full time

    About the RoleWe are seeking a highly skilled Senior Software Engineer to join our team at Social Finance, Inc. (SoFi) and contribute to the development of our Commercial Payments platform.As a Senior Software Engineer, you will be responsible for architecting new systems, implementing functionality, fixing bugs, and maintaining the health of our systems....


  • Seattle, Washington, United States Tik Tok Full time

    About UsTikTok is a global platform that inspires creativity and brings joy to over 1 billion users. Our mission is to create a community where people can express themselves and connect with others. We're committed to diversity, equity, and inclusion, and we strive to create a workplace that reflects the communities we serve.Job SummaryWe're seeking a...


  • Seattle, Washington, United States JobRialto Full time

    Job Title: Azure Cloud Data Platform Engineering ArchitectJobRialto is seeking an experienced Azure Cloud Data Platform Engineering Architect to design, implement, and manage data solutions on the Microsoft Azure cloud platform.Key Responsibilities:Design and implement data pipelines, data storage solutions, data processing, and data integration to enable...