Lead Data Engineer

5 months ago


Foster City, United States InterSources Full time
Job Title: Lead Data Engineer
job Location: Foster City, CA
Job Type: Fulltime
Job Mode: Onsite


Required Skills:
Minimum 10 years experience in Data Engineering and Lead experience atleast 3-4 years.
Experience with Hadoop ecosystem (HDFS, Hive, Yarn, File formats like Avro/Parquet), Kafka, Spark Streaming, PySpark, Airflow.
Experience with programming in languages Python, and scripting tools like Bash, KSH.
Digital payments or financial domain will be plus.

About Us:
InterSources Inc, a Certified Diverse Supplier, was founded in 2007 and offers innovative solutions to help clients with Digital Transformations across various domains and industries. Our history spans over 16 years and today we are an Award-Winning Global Software Consultancy solving complex problems with technology. We recognize that our employees and our clients are our strengths as the diverse talents and opportunities they bring to the table enable us to grow as a global platform and they are causally linked with our success. We provide strategic and technical advice, and we have expertise in areas covering Artificial Intelligence, Cloud Migration, Custom Software Development, Data Analytics Infrastructure & Cloud Solutions, Cyber Security Services, etc. We make reasonable accommodations for clients and employees and we do not discriminate based on any protected attribute including race, religion, color, national origin, gender sexual orientation, gender identity, age, or marital status. We also are a Google Cloud partner company. We align strategy with execution and provide secure service solutions by developing and using the latest technologies that thrive our resources to deliver industry-leading capabilities to our clients and customers, making it convenient for our clients to do business with InterSources Inc. Our teams also drive growth by refining technology-driven client experiences that put the users first, providing an unparalleled experience. This results in strengthening the core technologies of clients, enabling them to scale with flexibility, create seamless digital experiences and build lifelong relationships.

  • Foster City, United States CV Library Full time

    Job DescriptionAbout the Team:GenAI Knowledge Assets is a new initiative within the Data and AI Platform organization. The Lead Data Engineer will play a key role in designing and developing an enterprise-level solution for GenAI Knowledge Assets. This includes developing a business strategy, building knowledge management orchestration, and leading metadata...

  • Data Engineer

    2 weeks ago


    Foster City, United States Replit Full time

    As a Data Engineer, your job is to facilitate data analytics and measurement at scale at Replit. You'll work with product and business teams to help build data pipelines and transformations to enable us to understand and measure product usage. You'll also work to make our data scientists and analysts -- and the business decisions that depend on them-- more...


  • Foster City, California, United States InterSources Full time

    About the Opportunity We are seeking a Senior Engineering Manager - Data to join our team. As a senior leader, you will be responsible for managing a team of data engineers and ensuring that our data infrastructure is scalable, secure, and reliable. With a minimum of 10 years of experience in data engineering and at least 3-4 years of lead experience, you...

  • Lead Data Engineer

    1 month ago


    Kansas City, United States Capstone IT Staffing Full time

    Capstone IT is seeking an experienced Lead Data Engineer to join one of clients' Data Platform team to build scalable enterprise data solutions that drive strategic business outcomes. As the Lead Data Engineer, you will partner with Product Owners on strategic initiatives, understand business and functional requirements on projects, provide hands-on...

  • Service Metrics Lead

    2 weeks ago


    Foster City, California, United States A Society Group, Inc. Full time

    Job DescriptionWe are seeking a highly skilled Service Metrics Lead to join our team at A Society Group, Inc. This role is responsible for managing and optimizing the metrics used to evaluate our driving and service performance. The ideal candidate will excel in both data-driven analysis and effective communication, ensuring that insights translate into...


  • Kansas City, Missouri, United States CloudBC Labs Full time

    Job Summary:CloudBC Labs is hiring a talented Data Engineer to lead our cloud-based data engineering initiatives. The ideal candidate will have expertise in designing, developing, and deploying scalable data solutions using Azure services, such as Data Lake and Data Factory, as well as SQL Server and SSIS.About the Role:In this position, you will be...


  • Foster City, United States Zoox Full time

    In this Role, You Will... Build large-scale data pipelines and data entities, essential to efficient decision making Assist in designing, building, and maintaining data pipelines Collaborate with data scientists and analysts to improve data accessibility Participate in data quality assurance and validation processes Assist in optimizing database performance...


  • Kansas City, Missouri, United States Spring Venture Group Full time

    Job Description: Enterprise Data Engineer Lead About the Role:We are seeking an experienced Enterprise Data Engineer Lead to join our team at Spring Venture Group. As an Enterprise Data Engineer Lead, you will be responsible for leading the development and implementation of large-scale data engineering projects that support our business operations.About the...

  • Data Analyst Lead

    2 weeks ago


    Foster City, California, United States US Tech Solutions Full time

    **Job Title:** Business AnalystLocation: Remote or On-site (USA)Estimated Salary:$120,000 - $180,000 per yearAt US Tech Solutions, we're looking for a highly skilled Data Analyst Lead to join our team. As a key member of our organization, you'll be responsible for analyzing complex datasets to extract actionable insights and drive business improvements.The...


  • Foster City, United States Zoox Full time

    As a Senior Data Storage Engineer at Zoox, you will be pivotal in designing, implementing, maintaining, and scaling our petabyte-scale, high-performance, software-defined storage systems. Additionally you will architect and build data solutions to support our robotics and AI research, balancing optimal performance and cost for demanding globally distributed...


  • Jersey City, New Jersey, United States Axelon Full time

    Job Title: Senior Data Engineering LeadWe are seeking a highly skilled Senior Data Engineering Lead to join our team at Axelon in Jersey City, NJ. This role will oversee the design and implementation of architecture and infrastructures for data integration, ensuring seamless data flow processes.About the Role:Design and implement scalable data warehouses to...


  • Jersey City, United States SysMind Tech Full time

    Responsibilities Lead the Azure Data Ingestion and Integration activities from onshore for the on-off team of around 8 people Collaborate with the WAB Data Architects and Lead Data Engineers in data pipeline design Co-ordinate across the data engineering workstreams happening in parallel including reviews of work from the team Help PM/Scrum Master with...


  • Foster City, California, United States Maintec Technologies Full time

    About the RoleMaintec Technologies is seeking a talented Lead Big Data Administrator to join our team. This is a full-time contract opportunity in Foster City, CA.As a Lead Big Data Administrator, you will oversee the implementation and administration of big data solutions, including Hadoop. Your key responsibilities will include cluster management,...


  • Foster City, United States Zoox Full time

    As a Senior Data Storage Engineer at Zoox, you will be pivotal in designing, implementing, maintaining, and scaling our petabyte-scale, high-performance, software-defined storage systems. Additionally, you will architect and build data solutions to support our robotics and AI research, balancing optimal performance and cost for demanding globally distributed...


  • Jersey City, New Jersey, United States Tiger Analytics Full time

    Job Title: Data Engineering Team LeadEstimated Salary: $180,000 - $250,000 per annumCompany OverviewTiger Analytics is a fast-growing advanced analytics consulting firm with deep expertise in Data Science, Machine Learning, and AI. We are the trusted analytics partner for multiple Fortune 500 companies, enabling them to generate business value from data.Job...


  • Jersey City, New Jersey, United States NielsenIQ Full time

    Job Title: Senior Data Engineering LeadAbout the Role:At NielsenIQ, we are seeking a highly skilled Senior Data Engineering Lead to join our team. The ideal candidate will have hands-on experience with Python, Pyspark, Jupyter Notebooks, and a strong background in big data architecture and engineering.Responsibilities:* Design and develop proof of...


  • Redwood City, California, United States Bear Robotics, Inc. Full time

    Bear Robotics, Inc. is a cutting-edge robotics company focused on developing innovative automation solutions for various industries. Our products, including robot devices, cloud services, and public APIs, are designed to help businesses operate more efficiently and effectively.We are seeking an experienced Data Engineering Technical Lead to lead the design,...

  • Data Engineering Lead

    4 weeks ago


    Redwood City, California, United States Bear Robotics, Inc. Full time

    Job Title: Data Engineering LeadDepartment: Software EngineeringJob Level: L4FLSA: ExemptJob Summary:Bear Robotics, Inc. is a cutting-edge robotics company focused on developing innovative automation solutions for various industries. Our products, including robot devices, cloud services, and public APIs, are designed to help businesses operate more...


  • Redwood City, California, United States Chan Zuckerberg Initiative Full time

    Data Engineering Team LeadWe are seeking a seasoned Data Engineering Team Lead to lead our team of engineers in designing and implementing cutting-edge data solutions that drive innovation in biomedical research. As a leader, you will be responsible for:Overseeing the design and development of robust data pipelines that integrate data ingestion,...


  • Kansas City, Missouri, United States Spring Venture Group Full time

    Job OverviewWe are seeking a highly skilled Data Engineer III to join our team at Spring Venture Group.Company OverviewSpring Venture Group is a leading digital direct-to-consumer sales and marketing company with product offerings focused on the senior market. We specialize in distributing Medicare Supplement, Medicare Advantage, and related products via our...