Principal Data Engineer

4 days ago


Market St San Francisco CA USA, United States Autodesk Full time
Job Title: Principal Data Engineer

At Autodesk, we're seeking a highly skilled Principal Data Engineer to join our Digital Experiences team. As a key member of our engineering team, you will be responsible for designing, developing, and implementing scalable data pipelines using Kappa architecture and event stream processing technologies.

Key Responsibilities:
  • Architect and implement scalable data pipelines using Kappa architecture and event stream processing technologies
  • Lead the development of data solutions that directly enhance conversion metrics and improve user experience across digital platforms
  • Collaborate with data scientists, product managers, and other team members to define data requirements and ensure data quality and integrity
  • Implement real-time data processing and analytics solutions using technologies like Apache Kafka, Apache Flink, Apache Spark, and similar tools
  • Use big data frameworks such as Hadoop, HDFS, and Hive for large-scale data processing
  • Improve data architecture and processes to support high availability, scalability, and performance
  • Mentor senior and junior data engineers, promoting a culture of learning and improvement
  • Ensure compliance with enterprise security, performance, and scalability standards in all data engineering projects
  • Contribute to the execution of data projects aligned with team goals
  • Collaborate with teams to lead enterprise-wide data projects
Requirements:
  • 8+ years of experience in an enterprise environment
  • Advanced technical expertise in data engineering and event stream processing
  • Experience deploying code in AWS, Azure, or Google Cloud environments
What We Offer:
  • Competitive salary and benefits package
  • Opportunities for professional growth and development
  • Collaborative and dynamic work environment


  • San Diego, CA, United States Northrop Grumman Full time

    Category: Engineering Shift: 1st Shift (United States of America) Travel Required: Yes, 10% of the Time Relocation Assistance: Relocation assistance may be available Positions Available: 1 At Northrop Grumman, our employees have incredible opportunities to work on revolutionary systems that impact people's lives around the world today,...


  • Market St #, San Francisco, CA , USA, United States At-Bay Full time

    About At-BayAt-Bay is a leading provider of cyber insurance solutions, designed to help businesses tackle cyber risk head-on. With a unique combination of industry-leading insurance and world-class cybersecurity technology, At-Bay offers end-to-end prevention and protection for the digital age.Job OverviewWe are seeking a highly skilled Principal Data...


  • San Diego County, CA, United States Northrop Grumman Full time

    Category: Engineering - Shift: 1st Shift (United States of America) - Travel Required: Yes, 10% of the Time - Relocation Assistance: Relocation assistance may be available - At Northrop Grumman, our employees have incredible opportunities to work on revolutionary systems that impact people's lives around the world today, and for generations to come. Our...


  • San Francisco, California, United States SmithRx Full time

    Job Title: Principal Data EngineerSmithRx is a rapidly growing Health-Tech company that is transforming the pharmacy benefit management (PBM) sector with a cutting-edge platform. We are seeking an experienced Principal Data Engineer to lead the design and development of robust data architectures that support scalable, secure, and efficient data pipelines.Key...


  • San Francisco, United States LHH Full time

    About the Company: LHH is seeking a Principal Data Scientist to join our client's team in San Francisco, CA (hybrid). We are looking for an experienced Principal Data Engineer with a strong background in machine learning and a proven track record in the AdTech sector. The ideal candidate will lead our data engineering efforts, focusing on developing and...


  • San Francisco, United States LHH Full time

    About the Company: LHH is seeking a Principal Data Scientist to join our client's team in San Francisco, CA (hybrid). We are looking for an experienced Principal Data Engineer with a strong background in machine learning and a proven track record in the AdTech sector. The ideal candidate will lead our data engineering efforts, focusing on developing and...


  • san francisco, United States LHH Full time

    About the Company: LHH is seeking a Principal Data Scientist to join our client's team in San Francisco, CA (hybrid). We are looking for an experienced Principal Data Engineer with a strong background in machine learning and a proven track record in the AdTech sector. The ideal candidate will lead our data engineering efforts, focusing on developing and...


  • San Francisco, California, United States Autodesk Full time

    Job Title: Principal Data ScientistAt Autodesk, we're seeking a highly skilled Principal Data Scientist to join our team. As a key member of our data science team, you will be responsible for developing and implementing advanced data analytics and machine learning solutions to drive business growth and improve customer experiences.Responsibilities:Design and...


  • Market St #, San Francisco, CA , USA, United States Unity Technologies Full time

    Job Title: Senior Data EngineerWe are seeking a highly skilled Senior Data Engineer to join our team at Unity Technologies. As a Senior Data Engineer, you will be responsible for designing, developing, and maintaining large-scale data systems that support our business operations.Key Responsibilities:Design and implement data pipelines to collect, process,...


  • Market St #, San Francisco, CA , USA, United States Atlassian Full time

    About the RoleWe are seeking a highly skilled Senior Data Engineer to join our Data Engineering Team at Atlassian. As a Senior Data Engineer, you will play a key role in designing, building, and maintaining our data infrastructure, ensuring that our data is accurate, reliable, and easily accessible to our stakeholders.ResponsibilitiesPartner with the data...


  • San Francisco, California, United States Project44 Full time

    About the RoleAs a Principal Software Engineer - Data Engineering at project44, you will have the opportunity to work on the latest technologies to streamline Machine Learning & AI Operations, build scalable data infrastructure, and democratize data access.Key ResponsibilitiesWork with software architecture and design as part of your job, leveraging and...


  • Market St #, San Francisco, CA , USA, United States Oracle Corporation Full time

    Job DescriptionOracle is seeking a highly skilled Senior Principal Software Engineer to join our Cloud Engineering Infrastructure Development team. As a key member of this team, you will be responsible for designing, implementing, and operating cloud services that enable streaming providers to shift their workloads to Oracle Cloud Infrastructure (OCI).Key...


  • San Diego, California, United States Northrop Grumman Full time

    Job Title: Data Center Engineer/Principal Data Center EngineerWe are seeking a highly skilled Data Center Engineer/Principal Data Center Engineer to join our team at Northrop Grumman. This role will be responsible for integrating and testing software/hardware systems in complex IT systems.Key Responsibilities:Developing engineering documentation for system...


  • San Diego, California, United States Northrop Grumman Full time

    Job Title: Data Center Engineer/Principal Data Center EngineerWe are seeking a highly skilled Data Center Engineer/Principal Data Center Engineer to join our team at Northrop Grumman. This role will be responsible for integrating and testing software/hardware systems in complex IT systems.Key Responsibilities:Developing engineering documentation for system...


  • San Francisco, California, United States SmithRx Full time

    Transforming Pharmacy Benefit Management with Data Engineering ExpertiseAt SmithRx, we're revolutionizing the pharmacy benefit management industry with cutting-edge technology and innovative solutions. As a Principal Data Engineer, you'll play a pivotal role in driving this transformation by designing and developing robust data architectures that support...


  • San Francisco, California, United States Autodesk Full time

    Job Title: Principal Engineer, Central Data Lake LeadAutodesk's Platform Services and Emerging Technology (PSET) team is seeking a highly skilled Principal Engineer to lead the development and operation of a robust and scalable data platform.This exciting role involves automating large-scale cloud infrastructure services, designing and developing highly...


  • San Francisco, California, United States Lee Hecht Harrison Nederland B.V. Full time

    About the RoleWe are seeking a seasoned Principal Machine Learning Engineer to join our team at Lee Hecht Harrison Nederland B.V. in San Francisco, CA. This is a hybrid schedule position that requires extensive experience in machine learning and a strong background in the AdTech industry.Key ResponsibilitiesLead Data Engineering Initiatives: Spearhead the...


  • San Diego, California, United States Northrop Grumman Full time

    Job DescriptionJob Title: Data Center Engineer/Principal Data Center EngineerJob Summary:We are seeking a highly skilled Data Center Engineer/Principal Data Center Engineer to join our team at Northrop Grumman. The selected candidate will be responsible for integrating and testing software/hardware systems in complex IT systems.Key...

  • Software Engineer

    3 days ago


    Market St #, San Francisco, CA , USA, United States Watershed Technology Full time

    About WatershedWatershed is a software platform that empowers organizations to measure and reduce their carbon footprint. Our mission is to help businesses achieve a world-class climate program by providing a comprehensive suite of tools and services. We're looking for talented individuals who share our passion for sustainability and are eager to join our...


  • San Francisco, California, United States Genentech Full time

    Job Title: Principal Automation EngineerGenentech is seeking a highly skilled Principal Automation Engineer to join our team. As a key member of our Site Operations organization, you will be responsible for designing, implementing, and maintaining critical automation systems for our facilities.Key Responsibilities:Design and implement Building Automation...