Lead Data Engineer
4 months ago
Position Overview: As the Lead Data Engineer, you'll be responsible for leading our data engineering efforts and driving the design, development, and maintenance of our data infrastructure and pipelines. You'll lead a team of talented data engineers and collaborate closely with cross-functional teams to deliver end-to-end data solutions that support the needs of our data-driven organization. If you're a seasoned data engineer with expertise in data engineering technologies and a track record of leading successful data projects, we want you on our team.
Requirements
Key Responsibilities:
- Technical Leadership: Lead a team of data engineers, providing guidance, mentorship, and technical leadership in data engineering best practices and technologies.
- Data Infrastructure Design: Lead the design and architecture of our data infrastructure, including data warehouses, data lakes, and data pipelines, ensuring scalability, reliability, and performance.
- Data Pipeline Development: Lead the development of scalable and efficient data pipelines for ingesting, processing, and transforming large volumes of structured and unstructured data from diverse sources.
- Data Modeling: Lead the design and implementation of data models and schemas to support analytical and operational requirements, ensuring data integrity, consistency, and performance.
- Data Governance: Establish and enforce data governance policies and best practices to ensure data quality, security, and compliance with regulatory requirements.
- Performance Optimization: Lead efforts to optimize data pipelines and queries for performance and efficiency, identifying and addressing bottlenecks and inefficiencies to improve system scalability and reliability.
- Monitoring and Alerting: Lead the implementation of monitoring and alerting systems to track data pipeline performance and health, detecting and mitigating issues proactively to minimize downtime and data loss.
- Documentation and Best Practices: Define and promote best practices for data engineering, documentation, and usage, ensuring clear and comprehensive documentation to facilitate understanding and collaboration among team members.
- Collaboration: Collaborate with cross-functional teams, including data scientists, software engineers, and business stakeholders, to understand requirements and deliver data solutions that meet business needs.
- Mentorship and Development: Mentor junior engineers, providing guidance, support, and opportunities for growth and development in their data engineering careers.
Qualifications:
- Bachelor's degree or higher in Computer Science, Engineering, Mathematics, or related field.
- 7+ years of experience in data engineering, with a focus on designing, building, and maintaining data infrastructure and pipelines.
- Leadership experience, with a demonstrated ability to lead and mentor a team of engineers.
- Proficiency in programming languages such as Python, Java, or Scala, and experience with data engineering frameworks and tools such as Apache Spark, Apache Kafka, Apache Airflow, or similar.
- Strong understanding of data modeling concepts and techniques, with experience designing and implementing data models and schemas for relational and non-relational databases.
- Experience with cloud platforms such as AWS, Azure, or Google Cloud Platform, and familiarity with cloud-based data services such as Amazon Redshift, Google BigQuery, or Azure Synapse Analytics.
- Experience with SQL and NoSQL databases, data warehousing, and ETL/ELT processes.
- Strong problem-solving skills and analytical thinking, with the ability to troubleshoot complex data issues and optimize system performance.
- Excellent communication and collaboration skills, with the ability to work effectively in cross-functional teams and communicate technical concepts to non-technical stakeholders.
- Competitive salary: The industry standard salary for Lead Data Engineers typically ranges from $200,000 to $300,000 per year, depending on experience and qualifications.
- Comprehensive health, dental, and vision insurance plans.
- Flexible work hours and remote work options.
- Generous vacation and paid time off.
- Professional development opportunities, including access to training programs, conferences, and workshops.
- State-of-the-art technology environment with access to cutting-edge tools and resources.
- Vibrant and inclusive company culture with opportunities for growth and advancement.
- Exciting projects with real-world impact at the forefront of data-driven innovation.
Join Us: Ready to lead the charge in data engineering? Apply now to join our team and shape the future of data-driven innovation
-
Lead Data Engineer
3 weeks ago
san francisco, United States Unreal Gigs Full timeDescriptionCompany Overview: Welcome to the forefront of data-driven innovation! Our company is dedicated to harnessing the power of data to drive transformative change and solve complex problems across industries. We're committed to building scalable and reliable data infrastructure that enables advanced analytics, machine learning, and business...
-
Software Engineering Lead
2 days ago
San Francisco, California, United States People Data Labs Full timeRole OverviewWe are seeking an exceptional Software Engineering Lead to join our team at People Data Labs. This role is a fantastic opportunity to drive our self-serve product offerings, grow new revenue, and develop innovative data products.
-
Lead Big Data Engineer
3 weeks ago
san francisco, United States Unreal Gigs Full timeDescriptionCompany Overview: Welcome to the forefront of data-driven innovation! Our company is dedicated to leveraging the power of big data to drive transformative change and solve complex problems across industries. We're committed to building cutting-edge big data solutions that enable advanced analytics, machine learning, and business intelligence. Join...
-
Lead Data Science Architect
6 days ago
San Francisco, California, United States Windfall Data, Inc. Full timeWindfall Data, Inc. is seeking a seasoned data professional to play a pivotal role in developing and scaling our foundational predictive models.This is a highly impactful position where you will influence the core of our data product offerings and collaborate with cross-functional teams to maintain the highest standards of model performance.We're on a...
-
Lead Data Engineer
1 week ago
San Francisco, United States Windfall Full timeWindfall is seeking a Lead Data Engineer to join our core data team. As a Lead Data Engineer on our core data team, you will be building out the core data asset that everything else at Windfall is built on top of. Communication and collaboration are at the heart of Windfall, and you will work closely with our product, data science, and other engineering...
-
Data Engineering Lead
2 weeks ago
San Francisco, United States LexisNexis Risk Solutions Full timeJOB DESCRIPTION:Lead small teams in the development and execution of automated operations for large or multiple diverse projects to successfully and consistently enable delivery of high-quality services on time, on budget, and to specification, reacting quickly to changes in priorities or circumstances to meet business needs.Serve as resource manager for...
-
Data Engineer Architect Lead
6 days ago
San Francisco, California, United States DoorDash USA Full time**About DoorDash USA**We are a technology company at heart, using data to fuel our mission of connecting people with the food they love. Our Data Engineering team plays a critical role in this mission, building scalable database solutions for various use cases.About the Role:We are seeking a highly experienced Staff Software Engineer, Data to join our Data...
-
Lead Big Data Engineer
10 hours ago
San Francisco, CA, United States Unreal Gigs Full timeDescriptionCompany Overview: Welcome to the forefront of data-driven innovation! Our company is dedicated to leveraging the power of big data to drive transformative change and solve complex problems across industries. We're committed to building cutting-edge big data solutions that enable advanced analytics, machine learning, and business intelligence. Join...
-
Lead Data Engineer
18 hours ago
San Francisco, CA, United States Unreal Gigs Full timeCompany Overview: Welcome to the forefront of data-driven innovation! Our company is dedicated to harnessing the power of data to drive transformative change and solve complex problems across industries. We're committed to building scalable and reliable data infrastructure that enables advanced analytics, machine learning, and business intelligence. Join us...
-
Lead Data Engineer
1 week ago
San Francisco, United States Nuna Inc Full timeAt Nuna, our mission is to make high-quality healthcare affordable and accessible for everyone. We are dedicated to tackling one of our nation's biggest problems with ingenuity, creativity, and a keen moral compass. Nuna is committed to simple principles: a rigorous understanding of data, modern technology, and most importantly, compassion and care for our...
-
Data Engineering Team Lead
6 days ago
San Francisco, California, United States Peregrine Technologies Full timeAbout Peregrine TechnologiesPeregrine Technologies is a leading provider of innovative software solutions for public safety agencies across the United States. With a strong foundation in technology and a passion for making a difference, we empower our customers to improve operations and make better decisions in the moments that matter.We are a team of public...
-
Strategic Data Engineering Lead
6 days ago
San Francisco, California, United States WEX, Inc. Full timeAbout WEX, Inc.We are a leading provider of B2B payment processing and business solutions. Our data team is responsible for building big data technologies, platforms, systems, and tools that enable our customers and internal teams to unlock business value.Job DescriptionThe Senior Software Engineer position is available in our Data team at WEX, Inc. As a key...
-
Data Engineering Lead for Analytics Platform
6 days ago
San Francisco, California, United States Amplitude Full timeAmplitude is a leading digital analytics platform that helps companies drive business growth through data-driven decision making. Our platform empowers teams to capture reliable data, uncover valuable insights about customer behavior, and take swift action.We're seeking an experienced Data Engineering Lead to join our Query team. As a key member of this...
-
Staff Data Scientist
2 days ago
San Francisco, United States Data Masked Full timeThis range is provided by Harnham. Your actual pay will be based on your skills and experience — talk with your recruiter to learn more. Base pay range $200,000.00/yr - $250,000.00/yr Additional compensation types Annual Bonus and RSUs Data Science Focused Recruitment Consultant Title: Staff Data Scientist Location: Company based in SF, CA - willing to...
-
San Francisco, United States Amazon Data Services, Inc. Full timeThis unique vantage point allows the Design Managers to maintain a close connection with project details and drive project outcomes.You will have an impact on the design direction and ability to improve design delivery for an entire region, while establishing design procedures and protocols for the development of future systems.Responsibilities...
-
San Francisco, California, United States Braintrust Data Full timeAbout Braintrust DataWe are a cutting-edge developer platform for building world-class AI products. Our innovative approach combines code and datasets, incrementally refining both using frequent evaluations. We provide a rich set of tools to visualize changes and interrogate failures, empowering developers to integrate our platform into their continuous...
-
San Francisco, California, United States USM Business Systems Full timeJob Title: Senior Data Engineer + Big Data/HadoopJob Summary:The Data Architect and Engineer will be an integral member of the team within Data Services. This is a highly technical and hands-on role with responsibility to lead design, implement and support data architecture deliverables for multiple data integration, data management, data warehousing,...
-
Lead Data Analytics Engineer
6 days ago
San Francisco, California, United States salesforce, inc. Full timeAs a Lead Data Analytics Engineer at Salesforce, Inc., you will have the opportunity to work on cutting-edge AI-powered tools and solutions that enhance developer productivity.The ideal candidate will have a strong foundation in machine learning, deep learning, and software engineering. You will work on state-of-the-art AI models, optimize infrastructure for...
-
Data Engineering Lead
4 days ago
San Diego, California, United States Indotronix International Corporation Full timeWe are seeking an experienced Data Engineering Lead to join our team at Indotronix International Corporation.About the Role:The successful candidate will be responsible for leading a team of data engineers in designing, building, and maintaining high-performance software systems to manage analytical data pipelines. This position requires extensive hands-on...
-
San Francisco, California, United States Tbwa ChiatDay Inc Full timeAt Reddit, we're building a platform that's home to the most open and authentic conversations on the internet. Our team is now looking for a talented Data Engineering Lead to accelerate our efforts in Ads data science. As part of this role, you will collaborate with cross-functional teams like product, marketing, sales, engineering, and operations to develop...
