Current jobs related to Principal Engineer, Central Data Lake Lead - San Francisco, California - Autodesk
-
Principal Software Engineer
4 weeks ago
San Francisco, California, United States Autodesk Full timeJob Title: Principal Software Engineer - Data Lake LeadAutodesk's Platform Services and Emerging Technology (PSET) team is seeking a highly skilled Principal Software Engineer to lead the development of our Central Data Lake. As a key member of our team, you will be responsible for designing, developing, and operating a highly reliable large-scale data...
-
Principal Software Engineer
3 weeks ago
San Francisco, California, United States Autodesk Full timeJob SummaryAutodesk's Platform Services and Emerging Technology (PSET) team is seeking a highly skilled Principal Software Engineer to lead the development and operation of a robust and scalable data platform.As a Principal Software Engineer, you will design, develop, and operate large-scale data lake infrastructure, partnering closely with Product teams to...
-
Principal Data Engineer
4 weeks ago
San Francisco, California, United States Index Exchange Full timeAbout the RoleWe are seeking a highly experienced Principal Data Engineer to lead our data systems team and drive strategic outcomes for our organization. As a key member of our technology team, you will be responsible for providing strategic leadership across multiple domains, collaborating with cross-functional teams to achieve business objectives.Key...
-
Principal Software Engineer
3 weeks ago
San Francisco, California, United States Fivetran Full timeAbout the RoleFivetran is a leading provider of cloud-based data integration solutions. We're seeking a highly skilled Principal Software Engineer to lead the technical architecture, design, and development of our Data Lake product offering.The successful candidate will have a deep understanding of high-performance relational data management systems, as well...
-
Principal Data Engineer
3 weeks ago
San Francisco, California, United States UNITY Full timeJob Title: Principal Data Engineer - Machine Learning ExpertWe are seeking a highly skilled Principal Data Engineer to lead our data engineering efforts in machine learning and AdTech. The ideal candidate will have a strong background in machine learning and a proven track record in the AdTech sector.The successful candidate will be responsible for...
-
Principal Data Scientist
3 weeks ago
San Francisco, California, United States DaVita Full timeJob Title: Principal Data ScientistAt SoFi, we're shaping a brighter financial future with our members. We're a next-generation financial services company and national bank using innovative, mobile-first technology to help our millions of members reach their goals.We're seeking a Principal Data Scientist with strong engineering skills to lead the domain of...
-
Principal Software Engineer
2 weeks ago
San Francisco, California, United States project44 Full timeAbout the RoleAs a Principal Software Engineer - Data Engineering at project44, you will have opportunities to work on the latest technologies to streamline Machine Learning & AI Operations, build scalable data infrastructure, and democratize data access.Key Responsibilities:Work with software architecture and design as part of your job, leveraging and...
-
Data Engineer
2 weeks ago
San Francisco, California, United States Saxon Global Full timeData Engineer Role at Saxon GlobalSaxon Global is seeking a highly skilled Data Engineer to join our team. As a Data Engineer, you will be responsible for designing, implementing, and operating next-generation data lakes containing complex Genentech data from various business areas. You will work in a global environment, conceptualizing and owning the...
-
San Francisco, California, United States Social Finance Ltd Full timeShape the Future of Financial ServicesAt Social Finance Ltd, we're on a mission to revolutionize the way people interact with personal finance. As a Principal Data Scientist with strong engineering skills, you'll play a critical role in shaping our decision science and experimentation domain.About the RoleWe're seeking a highly skilled professional to lead...
-
Principal Software Engineer Data
2 weeks ago
San Francisco, California, United States Autodesk Full timeJob SummaryAutodesk is seeking a highly skilled Principal Software Engineer to join our Network team. As a key member of our team, you will be responsible for the development and maintenance of our graph database, which powers our pre-construction bidding application.Key ResponsibilitiesImplement new features for end-users and data consumersIntegrate new...
-
Principal Data Architect
2 weeks ago
San Francisco, California, United States SmithRx Full timeJob OverviewSmithRx is revolutionizing the pharmacy benefit management industry with a cutting-edge platform that delivers real-time insights, cost efficiencies, and exceptional customer experiences. As we continue to expand, we are seeking an experienced Principal Data Engineer to drive innovation and lead the technology strategy for modern data...
-
Principal Automation Engineer
1 month ago
San Francisco, California, United States F. Hoffmann-La Roche Gruppe Full timeJob SummaryWe are seeking a highly skilled Principal Automation Engineer to join our Site Services team. As a key member of our Facility Systems & Plant Engineering (FSPE) team, you will provide technical support to ensure the safe, efficient, and reliable operation of automation systems owned and supported by Site Services at Genentech's South San Francisco...
-
Principal Energy Engineer
4 weeks ago
San Francisco, California, United States Roche Holdings Inc. Full timeJob Summary:We are seeking a highly experienced and skilled Principal Energy Engineer to lead and support energy management initiatives across our organization.The successful candidate will spearhead projects focused on energy efficiency, retro-commissioning, heat pump design and implementation, and sustainability strategies for new building projects.In...
-
Principal Civil Engineer
4 weeks ago
San Francisco, California, United States City of Arcadia, CA Full timeJob Title: Principal Civil EngineerJoin the City of Arcadia, CA team as a Principal Civil Engineer and take on a challenging role that requires expertise in civil engineering and project management.About the Role:We are seeking a highly skilled and experienced Principal Civil Engineer to lead our Engineering Division in the Public Works Services Department....
-
Principal Automation Engineer, Site Services
3 weeks ago
San Francisco, California, United States F. Hoffmann-La Roche Gruppe Full timeJob Summary:The Principal Automation Engineer is a key member of the Site Operations organization, responsible for providing technical support to ensure the safe, efficient, and reliable operation of automation systems owned and supported by Site Services at Genentech's South San Francisco and Dixon sites.Key Responsibilities:As a Technical System Owner, the...
-
Data Engineer
2 weeks ago
San Francisco, California, United States Bayone Full timeJob Title: Data EngineerCompany Overview:At Bayone, we strive to create an environment where people are valued, and differences are celebrated. Our purpose is to empower our teams and inspire our customers to become the best versions of themselves.The Opportunity:Our technology team works fast and smart, developing the latest in mobile technologies, scalable...
-
Senior Data Engineer
4 weeks ago
San Francisco, California, United States Thumbtack Full timeAbout ThumbtackThumbtack is a digital marketplace that connects homeowners with professionals for various services. We're building a platform that makes it easy for people to find and hire the right professionals for their home projects.The Data Platform TeamThe Data Platform team is a central team of software engineers who work on building and maintaining...
-
Principal Software Engineer
2 weeks ago
San Francisco, California, United States Salesforce Inc Full timeAt Salesforce, we're seeking a highly skilled Principal Member of Technical Staff to join our team in San Francisco, CA.The ideal candidate will have a Master's degree in Computer Science, Engineering, or a related quantitative discipline, and two years of experience in software development, data engineering, or a related field.Key responsibilities...
-
Database Engine Principal
4 weeks ago
San Francisco, California, United States SingleStore, Inc. Full timeJob Title: Principal Engineer, Database EngineAt SingleStore, Inc., we're seeking a highly skilled Principal Engineer to join our Database Engine team. As a key member of our team, you will be responsible for designing, developing, and maintaining the core database engine that powers our cloud-native database.Key Responsibilities:Lead technical decisions and...
-
Principal Data Scientist
4 weeks ago
San Francisco, California, United States DaVita Full timeAbout the RoleWe are seeking a highly skilled Principal Data Scientist to lead our decision science domain, including experimentation and causal methods. As a key member of our team, you will report directly to the VP of Data and drive high-impact work across multiple teams, divisions, and organizations.Key ResponsibilitiesServe as the technical lead and...
Principal Engineer, Central Data Lake Lead
2 months ago
Autodesk's Platform Services and Emerging Technology (PSET) team is seeking a highly skilled Principal Engineer to lead the development and operation of a robust and scalable data platform.
This exciting role involves automating large-scale cloud infrastructure services, designing and developing highly reliable large-scale data lakes, and partnering closely with Product teams to understand requirements and design new capabilities.
The successful candidate will have experience with Apache Iceberg, Parquet, Spark, Hive, Presto, Trino, and Avro, as well as experience provisioning and managing orchestration tools like Airflow.
Key Responsibilities:
- Design, develop, and operate highly reliable large-scale data lakes.
- Partner closely with Product teams to understand requirements and design new capabilities.
- Build and scale data infrastructure that powers batch and real-time data processing of billions of records daily.
- Automate and administer big data applications and services on cloud.
- Help drive observability into the health of our data infrastructure and understanding of system behavior.
- Guide initiatives to enable best practices across infrastructure, deployments, automation, and accessibility.
- Set technical directions and influence cross-functional teams.
- Ensure operational excellence of the services and meet the commitments to our customers regarding reliability, availability, and performance.
- Develop and implement security best practices at the data, application, infrastructure, and network layers.
Requirements:
- 10+ years of hands-on direct internal experience in large-scale data intensive distributed systems.
- Experience with Apache Iceberg, Parquet, Spark, Hive, Presto, Trino, and Avro.
- Experience provisioning and managing orchestration tools like Airflow.
- Excellent coding skills and experience in Python, Unix shell scripting.
- Experience building, implementing and automating APIs.
- Experience building code-driven infrastructure on AWS through end-to-end automation including integration tests and unit tests.
- Experience with Self-service platform offering by building APIs to deploy Cloud resources.
- Experience with observability tools (such as, Hive, Spark, Presto, Jenkins, CloudOS, Datadog).
- Experience communicating solutions and resolutions with technical and non-technical audiences.
What We Offer:
- A competitive salary range of $141,400 to $228,800.
- A comprehensive benefits package.
- Opportunities for professional development and growth.
- A diverse and inclusive work environment.
At Autodesk, we're committed to building a diverse workplace and an inclusive culture to give more people the chance to imagine, design, and make a better world.
We're an equal opportunity employer and consider all qualified applicants for employment without regard to race, color, religion, age, sex, sexual orientation, gender, gender identity, national origin, disability, veteran status or any other legally protected characteristic.
