Senior Data Engineering Lead
2 days ago
We are seeking a highly skilled Senior Data Engineering Lead to join our team at MillenniumSoft Inc.
About the RoleThis is a full-time position that will lead a team of data engineers in designing, building, and maintaining high-performance software systems to manage analytical data pipelines.
The ideal candidate will have extensive hands-on experience in system design and coding, as well as expertise in modern data pipeline technologies such as AWS Step Functions, Prefect, Airflow, Luigi, Python, Spark, and SQL.
- Be responsible for the overall architecture of specific modules within our product, perform design and assist implementation considering system characteristics to produce optimal performance, reliability, and maintainability.
- Provide technical guidance to team members, ensuring they are working towards the product's architectural goals.
- Create and manage RFCs (Request for Comments) and ADRs (Architecture Decision Records), Design notes, and technical documentation for your module, following the architecture governance processes.
- Lead a team of data engineers, providing mentorship, setting priorities, and ensuring alignment with business goals.
Skill Requirements:
- Extensive hands-on experience in system design and coding.
- Expertise in modern data pipeline technologies such as AWS Step Functions, Prefect, Airflow, Luigi, Python, Spark, and SQL.
- Strong programming experience in PySpark, SQL, and Python.
- Database design skills including normalization/de-normalization and data warehouse design.
- Knowledge and understanding of relevant legal and regulatory requirements, such as SOX, PCI, HIPAA, and Data Protection.
Salary Range:$180,000 - $220,000 per year.
Education and Experience:
- Bachelor's or Master's in Computer Science, Information Systems, or an engineering field or relevant experience.
- 10+ years of related experience in developing data solutions and data movement.
-
Senior Software Engineering Manager
2 weeks ago
San Diego, California, United States Tactical Engineering Analysis Full timeTactical Engineering Analysis is seeking a highly skilled Senior Software Engineering Manager to lead our software development team. This is a challenging and rewarding role that requires strong technical leadership skills, as well as the ability to guide a team of developers in creating cutting-edge software solutions.The estimated salary for this position...
-
Data Engineering Lead
2 weeks ago
San Diego, California, United States Empirical Full timeAbout EmpiricalEmpirical is a company that empowers early and growth stage tech companies to create the right products in the right way. To achieve this, we provide two pivotal services: Product & Technology Leadership and Product Development Teams.Our client is seeking a highly motivated Senior Data Engineer to join their fast-paced data team. The ideal...
-
Data Engineering Lead
1 week ago
San Diego, California, United States Indotronix International Corporation Full timeWe are seeking an experienced Data Engineering Lead to join our team at Indotronix International Corporation.About the Role:The successful candidate will be responsible for leading a team of data engineers in designing, building, and maintaining high-performance software systems to manage analytical data pipelines. This position requires extensive hands-on...
-
Senior Databricks Engineer Lead
2 weeks ago
San Diego, California, United States ZipRecruiter Full timeJob DescriptionWe are seeking a highly experienced Senior Databricks Engineer Lead to join our team in San Diego, CA.About the Role:The ideal candidate will have 12+ years of experience in leading teams and managing large-scale data engineering projects using AWS and Databricks. You will be responsible for establishing and maintaining positive relationships...
-
Senior Lead Engineer
1 week ago
San Diego, California, United States Northrop Grumman Full timeJob Summary:Northrop Grumman is seeking a highly skilled and experienced Senior Lead Engineer to join our team in San Diego, CA. As a key member of our Systems Engineering organization, you will be responsible for providing technical direction and oversight to assigned capabilities within the Increment 2 development effort.About the Role:We are looking for...
-
Senior Data Engineering Lead + Big Data/Hadoop
2 weeks ago
San Francisco, California, United States USM Business Systems Full timeJob Title: Senior Data Engineer + Big Data/HadoopJob Summary:The Data Architect and Engineer will be an integral member of the team within Data Services. This is a highly technical and hands-on role with responsibility to lead design, implement and support data architecture deliverables for multiple data integration, data management, data warehousing,...
-
Senior Data Engineer
2 weeks ago
San Francisco, California, United States WEX, Inc. Full timeJob Overview:WEX, Inc. is seeking a highly motivated and experienced Senior Data Engineer to join our Data team. As a key member of the team, you will be responsible for designing, developing, and implementing large-scale data platforms and systems that support business-critical applications.About the Role:In this role, you will work closely with...
-
Senior Digital Design Engineer Lead
2 weeks ago
San Diego, California, United States Northrop Grumman Full timeDynamic Career Opportunity in San DiegoWe are seeking a highly skilled Senior Digital Design Engineer Lead to join our Advanced Digital Engineering organization in San Diego, California.About the Role:As a Senior Digital Design Engineer Lead, you will be responsible for leading a team of engineers in the design and development of digital systems associated...
-
Senior System Engineer Lead
2 weeks ago
San Diego, California, United States ADVANTEDGE TECHNOLOGY, INC. Full time**Job Summary** We are seeking a highly experienced Senior System Engineer to join our team at ADVANTEDGE TECHNOLOGY, INC. in San Diego. **About the Role** This is a full-time Systems Engineer position supporting the NSWC PHD – San Diego Detachment, Combat Systems Installation Division. The ideal candidate will have a strong background in Navy Combat...
-
Senior Data Architect
2 weeks ago
San Diego, California, United States Vets Hired Full timeAbout the JobDescriptionThe Senior Data Engineer is responsible for designing, developing, and optimizing data pipelines that drive analytic solutions at Vets Hired. The ideal candidate will have expertise in SQL, data analysis, and experience with at least one programming language. They will work closely with the analytics team to deliver insights that help...
-
Senior Data Engineer
2 weeks ago
San Francisco, California, United States Unity Full timeAbout the RoleWe are seeking a highly skilled Senior Data Engineer to join our Data & ML Platform team at Unity. This role involves designing and optimizing large-scale data platforms and machine learning infrastructure systems for efficiency, reliability, and cost-effectiveness.Key ResponsibilitiesDesign and optimize large-scale data platforms and machine...
-
Senior Data Engineer for AI and Machine Learning
2 weeks ago
San Diego, California, United States Inland Rivers, Ports & Terminals, INC. Full timeJob DescriptionThis Senior Data Engineer role at Trabus Technologies involves working on complex data science projects that leverage AI and machine learning algorithms to drive business outcomes. As a key member of our team, you will design, develop, and deploy scalable data systems that can handle large datasets and provide real-time insights.The ideal...
-
Software Engineering Lead for Data Quality
2 weeks ago
San Diego, California, United States CoStar Group, Inc. Full timeAbout UsCoStar Group, Inc. is a leading global provider of commercial and residential real estate information, analytics, and online marketplaces.We empower our people and customers to succeed through innovative solutions, a collaborative culture, and generous compensation and performance-based incentives.OverviewThe Analytics team at CoStar Group is...
-
San Diego, California, United States Unlimit Ventures Full timeUnlimit Ventures is a forward-thinking company that combines innovative technologies with environmental awareness. We are seeking an experienced Senior Data Science Engineer to join our team in San Diego, CA. The successful candidate will be responsible for developing and implementing cutting-edge machine learning models and algorithms that drive business...
-
Senior Data Architect
2 weeks ago
San Diego, California, United States ASML US, LLC Full time**Job Summary**We are seeking a highly skilled **Senior Data Architect** to join our team at ASML US, LLC. As a key member of our organization, you will be responsible for designing and implementing complex data systems that meet the needs of our customers.**Responsibilities*** Manage the specification and analysis of at least one Business Driver and/or...
-
Data Architect Lead, Systems Engineer
2 weeks ago
San Diego, California, United States ASML US, LLC Full timeCompany Overview">ASML US, LLC is a leading developer and manufacturer of lithography machines for the semiconductor industry. With headquarters in Veldhoven, Netherlands, and 18 office locations across the United States, we bring together creative minds in science and technology to develop innovative solutions.Job Summary">We are seeking an experienced Data...
-
Senior Data Scientist
21 hours ago
San Francisco, California, United States Salesforce, Inc. Full timeJob DescriptionWe are seeking a highly skilled Senior Data Scientist to lead our Machine Learning Engineering team at Salesforce, Inc.In this role, you will design and lead high-scale machine learning services, drive microservices architecture, and take ownership of core technology related to orchestrated machine learning APIs.You will also lead high-impact...
-
Software Engineering Lead
1 week ago
San Francisco, California, United States People Data Labs Full timeRole OverviewWe are seeking an exceptional Software Engineering Lead to join our team at People Data Labs. This role is a fantastic opportunity to drive our self-serve product offerings, grow new revenue, and develop innovative data products.
-
Electronics Systems Engineering Lead
2 weeks ago
San Diego, California, United States Northrop Grumman Full timeJob OverviewNorthrop Grumman is seeking a skilled Senior Principal Electronics Engineer to lead our team in the design and delivery of large data centers. As a key member of our Avionics Integration Organization, you will oversee the lifecycle of these complex systems from inception to delivery.The ideal candidate will have extensive experience in...
-
Strategic Data Engineering Lead
2 weeks ago
San Francisco, California, United States WEX, Inc. Full timeAbout WEX, Inc.We are a leading provider of B2B payment processing and business solutions. Our data team is responsible for building big data technologies, platforms, systems, and tools that enable our customers and internal teams to unlock business value.Job DescriptionThe Senior Software Engineer position is available in our Data team at WEX, Inc. As a key...