Sr. Data Infrastructure Engineer, Search

2 months ago

San Mateo, California, United States Slickdeals Full time


About Slickdeals:

On a mission to bring the joy of discovering a great deal to shoppers, Slickdeals thrives on the active participation of its 12-million-strong community. Users share, upvote, and uncover the best prices on popular products from trustworthy brands.
With a robust track record of 24 years in business, marked by profitability and a thriving community that has saved more than $10 billion, Slickdeals is currently undergoing a transformation. As we evolve into a daily shopping destination for millions more, joining Slickdeals presents an exciting opportunity for entrepreneurially-minded builders to create an innovative deal discovery platform.

The Purpose:

We are building a new search, discovery, and shopping graph platform that powers the suite of Slickdeals product lines. We're looking for top-notch search engineering talents in the area of information retrieval, search indexing, Elasticsearch, Lucene, algorithms, relevance & ranking, data mining, machine learning, data analysis & metrics, query processing, multi-lingual search and multi-modal search.

In this role, you will be part of our unique Search and Discovery team. We are looking for someone with expertise in information retrieval and a passion for creating exceptional search experiences. The ideal candidate will have a strong technical background and a deep understanding of search algorithms and systems. As an individual contributor to the Search and Discovery Team, you will play a crucial role in enhancing our search and recommendation capabilities and driving the discovery of deals and content for our users. You will be building products using technologies such as AWS SageMaker, Tensforflow, Pytorch, LLM, Elastic Search, REST web services, SQS/Kafka, Vector Database, HBase, Machine Learning, and more.

What You'll Do:

  • This role will work across the entire data lifecycle (collection, ingestion, storage, querying, retrieval) and work with product and engineering team to design and develop use cases for Search, Discovery, Recommendation and Personalization.
  • Develop and deploy event-driven pipelines using extract, load and transform (ELT) architecture focused on distributed ingestion
  • Build features to tune processing pipeline for fast data ingestion and indexing depending on customer's needs and workloads.
  • Develop and deploy high-quality software using modern tooling and frameworks
  • Encourage change, especially in support of data engineering best practices, and maintain a high standard of excellence
  • Scale and operationalize big data technologies like Spark, Kafka, Presto, Flink, and Hadoop in both on-premise and AWS environments
  • Ensure data infrastructure offers reliable, high-quality data with consistent SLAs, sound monitoring, alerting, incident response, and continual investment to reduce tech debt
  • Write code and documentation, participate in code reviews, and mentor other engineers

What We're Looking For:

  • 8+ years or more relevant professional experience.
  • Experience with large-scale open source data processing frameworks such as Spark, Kafka, Airflow, Flink, Hudi, etc. (5+ yrs)
  • Experience managing Kubernetes clusters and running distributed applications in a Kubernetes environment.
  • Knowledge of the open source landscape with judgment on when to choose open source versus build in-house.
  • Strong knowledge of data concepts, including experience in using a big data warehouse.
  • Expertise with modern programming languages (Python, Java, C++, GoLang, etc.).
  • Experience with enterprise software, including on-prem and/or cloud environments.
  • Deep knowledge of data quality, data profiling and cleansing techniques.
  • Experience with data infrastructure design and implementation capabilities.
  • Experience working with AWS or similar cloud infrastructure (5+ yrs)
  • Able to debug complex issues in large-scale distributed systems.
  • Passion for building infrastructure that is reliable, easy to use, and easy to maintain.
  • Excellent communication and collaboration skills.

LOCATION: San Mateo, CA


Hybrid schedule visiting our San Mateo office three days a week (Tues-Thurs).



Slickdeals Compensation, Benefits, Perks:

  • Competitive salary and equity
  • Competitive paid time off in addition to holiday time off
  • A variety of healthcare insurance plans to give you the best care for your needs
  • 401K matching above the industry standard
  • Professional Development Reimbursement Program and LinkedIn Learning Membership


Work Authorization
Candidates must be eligible to work in the United States.
Slickdeals is an Equal Opportunity Employer; employment is governed on the basis of merit, competence and qualifications and will not be influenced in any manner by race, color, religion, gender (including pregnancy, childbirth, or related medical conditions), national origin/ethnicity, veteran status, disability status, age, sexual orientation, gender identity, marital status, mental or physical disability or any other protected status. Slickdeals will consider qualified applicants with criminal histories consistent with the "Ban the Box" legislation. We may access publicly available information as part of your application.

Slickdeals participates in E-Verify. For more information, please refer to E-Verify Participation and Right to Work.

Slickdeals does not accept unsolicited resumes from agencies and is not responsible for related fees.

  • Lead Search Infrastructure Engineer

    6 days ago

    San Francisco, California, United States Perplexity AI Full time

    Position OverviewPerplexity AI is on the lookout for a seasoned Search Engineer to redefine the architecture of our search framework that underpins our offerings. If you are passionate about innovation and making a substantial difference, this position may be the perfect fit for you.Key ResponsibilitiesDeveloping and constructing extensive infrastructure to...

  • Lead Search Infrastructure Engineer

    6 days ago

    San Francisco, California, United States Perplexity AI Full time

    Position OverviewPerplexity AI is on the lookout for a seasoned Search Engineer to revolutionize the search framework that underpins our innovative products. If you are passionate about advancing technology and making a substantial difference, this opportunity is tailored for you.Key ResponsibilitiesDeveloping and architecting extensive infrastructure to...

  • Sr. Data Engineer

    3 months ago

    San Francisco, California, United States iTvorks Inc Full time

    Role Sr. Data Engineer (8+ years) Location SFO CA Duration Long TermExperience & Skills Extensive experience with Hadoop (or similar) Ecosystem (Map Reduce HDFS Hive Spark Pig HBase) Proficient in at least one of the SQL languages (MySQL PostgreSQL SqlServer Oracle) Good understanding of SQL Engine and able to conduct advanced performance tuning Strong...

  • Sr. Solutions Engineer

    2 months ago

    San Francisco, California, United States Transcend Full time

    Transcend believes everyone should be in control of their personal information. We're pioneering Data Privacy Infrastructure—a powerful technology that lets individuals reclaim control of their data and ensures companies can easily comply with global data privacy laws. Our platform enables companies like Robinhood, Patreon, and Indiegogo to provide...

  • Lead Infrastructure Engineer

    6 days ago

    San Jose, California, United States TikTok Full time

    About TikTokTikTok stands as the premier platform for short-form mobile video, dedicated to fostering creativity and delivering joy. With a global presence, our offices span major cities worldwide.Our MissionAt TikTok, creation is at the heart of our purpose. We strive to empower imaginations and inspire creativity. This ethos is reflected in our teams, who...

  • Infrastructure Systems Engineer

    6 days ago

    San Jose, California, United States Genesis Global Workforce Solutions Full time

    Infrastructure Systems EngineerGenesis Global Workforce SolutionsJob OverviewGenesis Global Workforce Solutions is in search of a skilled Infrastructure Systems Engineer with a strong background in networking, virtualization, and on-premises server management. This role is essential for the development and upkeep of our IT systems, enabling the efficient...

  • Senior Infrastructure Software Engineer

    9 hours ago

    San Francisco, California, United States Anthropic Limited Full time

    Position Overview:Anthropic Limited is in search of skilled and seasoned Infrastructure Engineers to enhance our capabilities in developing, scaling, and maintaining innovative AI systems. By becoming part of our Infrastructure division, you will engage with pioneering AI technologies and play a significant role in advancing frontier models, furthering...

  • Senior Infrastructure Software Engineer

    8 hours ago

    San Francisco, California, United States Anthropic Limited Full time

    Position Overview:Anthropic Limited is in search of skilled and seasoned Infrastructure Engineers to enhance our capabilities in developing, scaling, and maintaining advanced AI systems. By becoming a part of our Infrastructure division, you will engage with pioneering AI technologies and play a vital role in advancing frontier models, aligning with...

  • Staff Software Engineer

    2 days ago

    San Francisco, California, United States Tbwa ChiatDay Inc Full time

    Job SummaryWe are seeking a highly skilled Staff Software Engineer to join our Data Infrastructure team at Tbwa Chiat/Day Inc. As a key member of our team, you will be responsible for designing and developing large-scale data solutions that drive business growth and innovation.Key ResponsibilitiesLead the design and development of our data infrastructure...

  • Sr. Data Scientist, Business Analytics

    1 month ago

    San Mateo, California, United States Slickdeals Full time

    About Slickdeals:On a mission to bring the joy of discovering a great deal to shoppers, Slickdeals thrives on the active participation of its 12-million-strong community. Users share, upvote, and uncover the best prices on popular products from trustworthy brands. With a robust track record of 24 years in business, marked by profitability and a thriving...

  • Infrastructure Solutions Engineer

    5 days ago

    San Ramon, California, United States Dew Software Full time

    Job OverviewDew Software, a distinguished leader in the Digital Transformation sector, is in search of a talented Infrastructure Engineer to enhance their operations. With a steadfast dedication to quality and excellence, Dew Software partners with Fortune 500 organizations, aiding them in their digital evolution.As an Infrastructure Engineer, you will be...

  • Infrastructure Solutions Engineer

    5 days ago

    San Ramon, California, United States Dew Software Full time

    Job OverviewDew Software, a distinguished leader in the Digital Transformation sector, is in search of a talented Infrastructure Engineer to enhance their workforce. With a steadfast dedication to quality and excellence, Dew Software partners with Fortune 500 companies, aiding them in their digital transformation initiatives.As an Infrastructure Engineer,...

  • Lead Search Systems Engineer

    6 days ago

    San Francisco, California, United States Perplexity AI Full time

    Position OverviewPerplexity AI is on the lookout for a seasoned Search Engineer to revolutionize the search framework that drives our innovative products. If you are passionate about advancing technology and making a substantial difference, this opportunity is tailored for you.Key Responsibilities Architecting and developing extensive infrastructure to...

  • Infrastructure Engineer

    1 month ago

    San Francisco, California, United States Byterat Full time

    About ByteratByterat is the modern data platform for battery science. We give battery teams at companies like Panasonic or Tesla the core data platform they need to innovate, securely at scale.We're a well-funded, VC-backed start-up with customers and recurring revenue. We're backed by world-class investors like Y Combinator, Giant Ventures and Collaborative...

  • Infrastructure Reliability Engineer

    6 days ago

    San Francisco, California, United States Swish Analytics Full time

    About Swish AnalyticsSwish Analytics is a pioneering organization in the realm of sports analytics, betting, and fantasy, dedicated to developing cutting-edge predictive analytics solutions for sports data. Our PhilosophyWe view the art of oddsmaking as a complex challenge that intertwines engineering, mathematics, and sports betting knowledge, rather than...

  • Senior Software Engineer, Infrastructure Solutions

    9 hours ago

    San Francisco, California, United States Anthropic Limited Full time

    Position Overview:Anthropic Limited is in search of skilled and seasoned Infrastructure Engineers to enhance our capabilities in developing, scaling, and maintaining innovative AI systems. By becoming part of our Infrastructure division, you will engage with pioneering AI technologies and play a vital role in advancing frontier models, aligning with...

  • Lead Software Engineer, Search Solutions

    5 days ago

    San Francisco, California, United States Turo Inc Full time

    Senior Staff Software Engineer, Search PlatformAbout Turo: Turo operates as the premier car-sharing marketplace, enabling users to find the ideal vehicle for their travel needs from a dynamic network of reliable hosts across various countries including the US, UK, Canada, Australia, and France. Whether you're arriving from a distance or seeking a vehicle...

  • Infrastructure Software Engineer

    4 hours ago

    San Francisco, California, United States Seesaw Full time

    Position Overview:Seesaw is in search of a skilled back-end Software Engineer with a focus on infrastructure to become a vital member of our Core Platform Engineering division. In this capacity, you will significantly influence the underlying architecture of our platform, building the essential layers that empower our various product teams to efficiently...

  • Search Algorithm Engineer

    8 hours ago

    San Francisco, California, United States OpenAI Full time

    Join our innovative team at OpenAI We are dedicated to advancing AI technology through our groundbreaking products, such as ChatGPT and the OpenAI API. Our commitment lies in ensuring responsible and equitable deployment of AI solutions. Position Summary We are looking for a skilled machine learning engineer to address retrieval and search...

  • Infrastructure Software Engineer

    5 days ago

    San Francisco, California, United States Seesaw Full time

    Position Overview:Seesaw is in search of a skilled back-end Software Engineer with a focus on infrastructure to enhance our Core Platform Engineering division. In this role, you will be instrumental in establishing the core architecture of our platform, enabling various product teams to efficiently deliver outstanding user experiences at scale. Your duties...