Senior Technical Lead for Big Data Solutions

3 weeks ago


San Francisco, California, United States WEX, Inc. Full time
About the Role

We are seeking a highly experienced Senior Technical Lead to join our team at WEX, Inc. as we continue to drive innovation and growth in the field of big data solutions. This role offers an exciting opportunity to leverage your technical expertise and leadership skills to deliver high-quality results and drive business impact.

Key Responsibilities
  • Design and implement scalable, reliable, and cost-effective data architectures, including data lakes, lake houses, and data warehouses, to support analytics, real-time processing, and AI/ML applications.
  • Built and optimized high-throughput data ingestion frameworks for diverse data types (structured and unstructured) using tools like Kafka, Spark, AWS Glue, and Apache NiFi, with strong ETL/ELT proficiency.
  • Developed and implemented efficient data modeling and schema design for analytical and transactional data, focusing on optimal data retrieval and storage practices.
  • Leveraged event-driven and streaming architectures to enable real-time data processing and responsive data products.
Requirements
  • Bachelor's degree in Computer Science, Software Engineering, or a related field, OR demonstrable equivalent deep understanding, experience, and capability. A Master's or PhD degree in Computer Science (or related field) is a plus.
  • 10+ years of experience in large-scale software engineering.
  • A technically deep, innovative, empathetic, and passionate technical leader capable of delivering on business needs.
  • Strong problem-solving skills, with excellent communication and collaboration abilities.
  • Highly self-motivated and eager to learn, consistently adopting new technologies to improve productivity and the quality of deliverables.
Benefits

This position offers a competitive salary range of $156,000 - $208,000 per year, commensurate with experience.


  • Technical Lead

    3 weeks ago


    San Francisco, California, United States Omni Inclusive Full time

    About Omni InclusiveOmni Inclusive is a leading company in the industry, known for delivering scalable and reliable systems and frameworks that cut across the product development organization.We are looking for a talented Sr. Java Developer - Hadoop and Kafka Expert to join our Big Data team. The successful candidate will be responsible for creating scalable...


  • San Diego, California, United States Agile Enterprise Solutions Inc. Full time

    About Agile Enterprise Solutions Inc.Agile Enterprise Solutions (AES) is a software development and consulting company with three offices in the US, offering a range of services including ERP solutions for Oracle and SAP, Microsoft technologies, and web technologies. Our team consists of over 200 experienced consultants serving clients across the United...


  • San Francisco, California, United States SS&C Full time

    About UsSS&C is a leading provider of financial services and healthcare technology solutions with a global presence. Our team is dedicated to delivering high-quality products and services that meet the evolving needs of our clients.Job SummaryWe are seeking an experienced Senior Data Engineer to join our team and lead the design and implementation of our...


  • San Francisco, California, United States WEX Full time

    About the JobWe are looking for a Big Data Solutions Architect to join our team at WEX. As a key member of our Data Engineering organization, you will be responsible for designing, developing, and implementing scalable data architectures and systems.Your primary focus will be on leading the technical architecture and development of our unified, scalable data...


  • San Francisco, California, United States USM Business Systems Full time

    Job DescriptionSenior Data Modeler/Data Architect + Big Data/HadoopAbout the RoleThis highly technical and hands-on position is an integral part of the Digital Insights & Architecture team within USM Business Systems. The successful candidate will lead the design, implementation, and support of data architecture deliverables for multiple projects.The role...

  • Big Data Specialist

    3 weeks ago


    San Francisco, California, United States Jacobs Full time

    Jacobs is seeking a talented Senior Data Engineer to lead data engineering projects and help productize data products and algorithms into our scalable analytics platform. As a key member of our team, you will work closely with cross-functional teams to understand data needs and develop customized solutions for customers.The ideal candidate will have a strong...


  • San Francisco, California, United States Databricks Full time

    About the RoleWe are seeking an experienced sales professional to join our team as an Enterprise Account Executive - Databricks. As a key member of our sales organization, you will be responsible for driving revenue growth by identifying and pursuing new business opportunities with large enterprises.Your Key ResponsibilitiesPresent a territory plan within...


  • San Bruno, California, United States Tredence Full time

    About the Company:Tredence is a global analytics services and solutions company that has been recognized as one of the fastest-growing private companies in the country for three consecutive years. Our unique selling proposition lies in our ability to build scalable big data solutions on-premises, GCP, or Azure clouds at a very cost-effective and easily...


  • San Jose, California, United States SAMSUNG SDS Full time

    Job OverviewWe are seeking a seasoned senior software architect with at least 8 years of experience in designing and implementing scalable, distributed systems to join the Data Analytics Team at Samsung SDS. The ideal candidate will have a strong background in data analytics platform design and architecture, as well as expertise in big data technologies such...


  • San Francisco, California, United States WEX Full time

    This is an exciting opportunity to join WEX's Data technology org as a Senior Engineering Manager for Data Platforms. We are looking for a highly motivated and technically deep engineering leader to lead and manage a group of high-performing engineers.About the RoleDevelop and implement a data engineering technology roadmap that aligns with the company's...


  • San Francisco, California, United States Technical Concept GmbH Full time

    Job OverviewA world where people can belong anywhere is a reality with the help of data science. We're seeking a technical, hands-on, and mission-driven Senior Data Science Program Lead to partner with our data science, engineering & product teams in building/enhancing data driven decision making across multiple areas.

  • Technical Lead

    1 month ago


    San Francisco, California, United States Rise Technical Recruitment Limited Full time

    Rise Technical Recruitment Limited is a renowned recruitment agency specializing in tech talent acquisition.Based in the San Francisco Bay Area, this award-winning company is dedicated to helping businesses find top data science professionals like yourself.We are currently seeking an exceptional Head of Data Science to join our client's innovative team. This...

  • Big Data Specialist

    3 weeks ago


    San Francisco, California, United States Unity Technologies Full time

    About UsWe are Unity Technologies, the world's leading platform for creating real-time 3D content. Our company overview highlights our commitment to innovation and customer satisfaction. We offer a dynamic work environment where you can grow your skills and advance your career.">This is an exciting opportunity to join our Unity Ads Data Engineering team as a...


  • San Jose, California, United States TikTok Full time

    At TikTok, we're committed to creating an inclusive environment where creativity and innovation thrive. Our mission is to inspire users worldwide with our short-form mobile video platform.About the RoleWe're seeking a skilled Senior Big Data Architect to join our Data Platform team. As a key member of this team, you'll play a vital role in building and...

  • Big Data Developer

    4 weeks ago


    San Francisco, California, United States Omega Solutions Inc Full time

    Job DescriptionWe are seeking a highly skilled Big Data Developer to join our team at Omega Solutions Inc.Key Responsibilities:Design and develop large-scale data processing systems using Hadoop, Spark, and Hive technologies.Maintain and optimize existing data pipelines on AWS cloud infrastructure.Develop and implement data science solutions using Python and...


  • San Francisco, California, United States WEX Full time

    About the PositionWe are seeking a highly skilled Cloud Data Architect to join our team at WEX. The ideal candidate will have extensive experience in designing and implementing cloud-based data solutions, with a strong focus on scalability, performance, and data governance.The successful candidate will be responsible for leading the design and implementation...


  • San Jose, California, United States TikTok Full time

    About TikTokTikTok is a leading destination for short-form mobile video, driven by our mission to inspire creativity and bring joy. Our platform connects people from across the globe, and so does our workplace.Our Ads Data PlatformThe ads data platform team works closely with product managers and data analysts to build state-of-the-art streaming and batch...


  • San Francisco, California, United States Eppo, Inc Full time

    About Eppo, Inc.We are revolutionizing the way companies make decisions by harnessing the power of experimentation. Our innovative platform combines the modern data stack with high-velocity experimentation, empowering customers to unlock new insights and drive growth.Job OverviewThis role is ideal for a seasoned software engineer who is passionate about...


  • San Francisco, California, United States Rackspace, Inc. Full time

    Job OverviewRackspace, Inc. is seeking an experienced Cloud Data Solutions Architect to lead our Data Engineering practice and drive innovation in Big Data solutions design and implementation.The ideal candidate will have a solid professional services background and proven strategic acumen in managing Data modernization projects with a spotlight on Big...


  • San Francisco, California, United States Hinge Health Full time

    **Technical Data Solutions Leader**We are seeking an experienced Technical Data Solutions Leader to join our team at Hinge Health. As a key member of our data leadership team, you will be responsible for developing and implementing data strategy, leading data engineering teams, and driving data-driven decision-making across the organization.In this role, you...