Technical Lead for Large-Scale Data Engineering
2 days ago
Tecton Corporation is a leader in the field of artificial intelligence, helping companies unlock the full potential of their data. We are seeking a Technical Lead for Large-Scale Data Engineering to join our team. As a staff-level engineer on the Batch Compute team, you'll play a critical role in architecting, designing, and scaling the core compute engines and storage architecture used by every Tecton customer. You'll contribute to the performance of our query optimizer, from parsing & optimization to plan selection. This role is a unique opportunity that combines customer-obsessed product focus with platform and data engineering innovation and helps companies accelerate their path to real-time AI.
The estimated US base salary range for this position is $216,000 - $258,000 annually. In addition to base salary, we offer competitive equity & comprehensive benefits such as medical, dental, vision, life, 401(K), flexible paid time off, 10 paid holidays each calendar year, sick time, leave of absence as per the FMLA and other relevant leave laws. We value diversity and are an equal opportunity employer committed to creating an inclusive environment for all employees and applicants without regard to race, color, religion, national origin, gender, sexual orientation, age, marital status, veteran status, disability status, or other applicable legally protected characteristics.
About the Role:
This role is a unique opportunity that combines customer-obsessed product focus with platform and data engineering innovation. You will lead large technical domains, drive efforts to improve engineering practices, tooling, and processes, develop a deep understanding of the fundamental problems our customers face in building ML systems, and work in one or more of the following areas to build the next generation of Tecton infrastructure: Distributed compute and resource management, Query optimization and distributed execution, Cross-platform integrations with state-of-the-art data platforms. Responsibilities include owning and leading large technical domains, leading multi-engineer projects of strategic importance to Tecton, driving efforts to improve engineering practices, tooling, and processes, and developing a deep understanding of the fundamental problems our customers face in building ML systems.
Key Qualifications:
- Experience working in large Python, Java, Kotlin, or Go codebases and running cloud-native Spark systems (e.g. AWS EMR, Databricks, GCP Dataproc)
- Experience in performance tuning of Spark, Ray, Maestro, or Airflow jobs
- Knowledge of data formats such as Parquet, Avro, Arrow, Iceberg, or Delta Lake and object storage (e.g. S3, GCS)
- Expertise with cloud-scale query performance, query optimization, query planning, heuristic query execution techniques, and cost-driven optimizations
- Strong communication skills and ability to write detailed technical specifications
-
Data Engineer for Large-Scale Data Pipelines
2 weeks ago
New York, New York, United States ASCENDING Full timeJob DescriptionData Engineer for Large-Scale Data PipelinesWe're seeking a skilled data engineer with 3-7 years of experience to join our team at ASCENDING. This role centers on ensuring the robustness and reliability of large-scale data pipelines, from inception through deployment.Key Responsibilities:Conduct thorough testing of SQL-centric applications to...
-
Data Architect
2 weeks ago
New York, New York, United States Harnham Full timeJob Summary:We are seeking a highly experienced Data Architect to join our team in a large scale solutions environment. The successful candidate will design and develop Azure data warehouses and data pipelines for ML model execution.Design and develop Azure data warehouses and data pipelines for ML model executionCollaborate in a cross-functioning team and...
-
Principal Engineer for Large-Scale Data Systems
2 weeks ago
New York, New York, United States StartUs GmbH Full timeCompany OverviewWe are a leading technology company dedicated to revolutionizing the way people experience music. Our Engineering org is at the forefront of this innovation, and we're looking for a talented Principal Engineer to join our team.About the RoleThe estimated salary for this position is $140,000 - $180,000 per year, depending on location and...
-
New York, New York, United States StubHub Full timeJob OverviewWe are seeking a skilled Senior Data Engineer to join our team at StubHub. Our mission is to redefine the live event experience on a global scale.Role SummaryThe ideal candidate will be responsible for designing and building large-scale data systems and pipelines that facilitate data centralization, analysis, and reporting. This role requires...
-
New York, New York, United States Capital One Full timeJob SummaryWe are seeking an experienced Senior Manager, Technical Program Management to lead our technical program management team in developing large-scale products and platforms. As a key member of our organization, you will be responsible for overseeing the development of these products and ensuring they meet the required standards.About the RoleThis...
-
Software Engineer for Large-Scale Systems
8 hours ago
New York, New York, United States RIT Solutions, Inc. Full timeAbout Our TeamRIT Solutions, Inc. is a leading provider of software solutions that cater to the needs of our clients across various industries. We are committed to delivering high-quality software solutions that meet our clients' expectations. To achieve this goal, we have assembled a talented team of software engineers, data scientists, and project managers...
-
AI Data Engine Software Engineer
2 weeks ago
New York, New York, United States Scale AI Full timeAbout Scale AIAt Scale, our mission is to accelerate the development of AI applications that transform industries and improve lives. Our data foundry powers some of the world's most advanced LLMs and generative models through innovative approaches like Reinforcement Learning with Human Feedback (RLHF) and human data generation.About Our Horizontal Task...
-
New York, New York, United States EliseAI Full timeAbout EliseAIWe're seeking a highly skilled Senior Data Engineer to join our team, focusing on developing and maintaining cutting-edge data solutions and large-scale data pipelines. This individual will be instrumental in driving our mission to leverage data as a strategic asset.Key Responsibilities:Design, implement, and maintain high-quality data solutions...
-
Senior Data Engineer
2 weeks ago
New York, New York, United States Amazon Full timeAbout the OpportunityWe are seeking a highly skilled Senior Data Engineer to join our ADSP Product Analytics team. As a key member of this team, you will be responsible for building and maintaining large-scale data processing systems that integrate across multiple sources.
-
New York, New York, United States Hulu Full timeAbout the Role: Disney Entertainment & ESPN Technology is seeking a highly skilled Technical Project Manager to lead large-scale programs in our Software Engineering area. As a key member of the Global Program Management team, you will be responsible for executing complex projects from initiation through closure.Key Responsibilities:
-
New York, New York, United States Scale AI Full timeAbout ScaleAt Scale AI, our mission is to accelerate the development of AI applications. We are the leading AI data foundry, helping fuel the most exciting advancements in AI, including generative AI, defense applications, and autonomous vehicles. With our recent Series F round, we're accelerating the abundance of frontier data to pave the road to Artificial...
-
New York, New York, United States Scale AI Full timeAbout ScaleAt Scale AI, our mission is to accelerate the development of AI applications. We are a leading AI data foundry, helping fuel the most exciting advancements in AI, including generative AI, defense applications, and autonomous vehicles. With our recent funding, we're accelerating the abundance of frontier data to pave the road to Artificial General...
-
New York, New York, United States Scale AI Full timeAbout ScaleAt Scale, our mission is to accelerate the development of AI applications. With 8 years of experience as a leading AI data foundry, we've helped drive advancements in AI, including generative AI, defense applications, and autonomous vehicles.We're accelerating the abundance of frontier data to pave the road to Artificial General Intelligence (AGI)...
-
New York, New York, United States Oscar Health Full timeAbout Oscar HealthOscar is a health insurance company that utilizes technology to provide innovative healthcare solutions. We strive to create an environment where our members feel valued and supported.Job OverviewWe are seeking a Senior Software Engineer II, Payment Integrity to join our Engineering team. This role will involve working with the Chief...
-
Data Engineering Lead Professional
2 days ago
New York, New York, United States adMarketplace Full timeWe are seeking an experienced Data Engineering Lead to join our team at adMarketplace. As a leader in our data engineering group, you will be responsible for designing and implementing large-scale data systems and pipelines that drive business growth.About the RoleThe ideal candidate will have a strong background in data engineering, with experience in...
-
Head of Large-Scale Manufacturing Operations
1 week ago
New York, New York, United States Monumental Labs Full timeJob DescriptionWe are seeking a highly experienced and dynamic Head of Large-Scale Manufacturing Operations to oversee daily operations at our state-of-the-art stone carving facility in NYC.This role requires a proven track record in managing large-scale manufacturing operations, particularly those involving advanced CNC technology. The ideal candidate will...
-
Senior Data Engineer for Large-Scale Analytics
2 weeks ago
New York, New York, United States Jobot Full timeCompany Overview:We are an innovative analytics company that has recently been acquired by a leading industry giant. This acquisition has brought us the financial stability of a publicly traded company while still allowing us to operate independently.We work in the public space and have developed/are developing cutting-edge apps that redefine how public...
-
Senior Data Engineer for Large-Scale Analytics
2 weeks ago
New York, New York, United States Jobot Full timeAs a Senior Data Engineer at Jobot, you will be part of a fast-growing SaaS company that offers stability and excellent leadership.This role is ideal for an experienced engineer who can build out data pipelines and storage procedures for large amounts of data.We are looking for someone with experience working with Large Language Models (LLMs) such as OpenAi,...
-
Cloud-Scale Data Engineering Lead
8 hours ago
New York, New York, United States Magnite Full timeJob DescriptionWe are seeking a Cloud-Scale Data Engineering Lead to join our team in New York City or Boston. As a key member of our Data Engineering team, you'll be responsible for designing and building scalable data pipelines that empower our business. You'll work closely with our engineering team to define data architecture and ensure data consistency...
-
Large-Scale Software Solutions Architect
8 hours ago
New York, New York, United States Amazon Full timeAmazon is seeking a skilled Large-Scale Software Solutions Architect to join our Devices and Services Trust and Security team. As a key member of our team, you'll play a critical role in designing and developing medium to large software solutions to secure customer experiences and data.You'll work closely with our product managers and designers to translate...
