Staff Software Engineer

3 days ago

San Mateo, CA, United States Fanatics Full time
Job Description

The Streaming Data Platform team is responsible for building, managing complex stream processing topologies using the latest open-source tech stack, build metrics and visualizations on the generated streams and create varied data sets for different forms of consumption and access patterns. We're looking for a seasoned Staff Software engineer to help us build and scale the next generation of streaming platforms and infrastructure at Fanatics Commerce.

Responsibilities

  1. Design and build real-time streaming data platforms that enable sub-second data availability to MPP databases (StarRocks, Apache Pinot, Apache Druid)
  2. Architect and implement data pipelines that handle complex data skews and leverage data colocation strategies for optimal query performance
  3. Fine-tune Apache Iceberg table parameters including compaction policies, partition evolution, file sizing, and snapshot management for streaming workloads
  4. Provide technical leadership on streaming architectures, guiding teams on optimal patterns for real-time data ingestion, processing, and materialization into MPP systems
  5. Contribute to open-source MPP database projects (StarRocks, Apache Pinot, Apache Druid) with performance improvements, bug fixes, and feature enhancements
  6. Design data distribution strategies and bucketing schemes to minimize shuffle operations and maximize colocation benefits in distributed queries
  7. Optimize existing streaming infrastructure through profiling, identifying bottlenecks in data skew handling, and implementing dynamic rebalancing strategies
Qualifications
  1. 8+ years of software development experience
  2. Proven experience building production-grade streaming pipelines to MPP databases (StarRocks/Pinot/Druid) with consistent sub-second latency
  3. Strong understanding of data skew patterns and mitigation techniques including salting, bucketing, adaptive partitioning, and custom key distribution
  4. Hands-on experience with data colocation strategies in distributed systems to optimize for local joins and reduce network shuffles
  5. Expert-level knowledge of Apache Iceberg for streaming workloads: snapshot isolation, file format tuning, compaction strategies, partition evolution, and metadata management
  6. Demonstrated open-source contributions to MPP databases or adjacent projects (commits, PRs, design proposals, community engagement)
  7. Proficiency in Java and/or C++
  8. Deep expertise in SQL optimization, distributed query planning, and physical execution plans in MPP systems
  9. Experience with optimizations like: tablet distribution, bucketing, colocation groups, materialized views, and primary key models

  • Staff Software Engineer

    4 days ago

    San Mateo, CA, United States PlayStation Global Full time

    Why PlayStation? PlayStation isn't just the Best Place to Play - it's also the Best Place to Work. Today, we're recognized as a global leader in entertainment producing The PlayStation family of products and services including PlayStation®5, PlayStation®4, PlayStation®VR, PlayStation®Plus, acclaimed PlayStation software titles from PlayStation Studios,...

  • Senior Software Engineer

    2 days ago

    San Diego, CA, United States Top Engineer Full time

    TOP ENGINEER JOB POST!!! CONFIDENTIAL SEARCH FOR AN AEROSPACE LEADER Industry: Aerospace / Defense / Software Degree: BS in CS, CE, or EE (MS Preferred) Experience: 5-15 Years Role: Senior Embedded Software Engineer Join an established company with great technology to design and develop high-reliability embedded software for cutting-edge, space-based...

  • Senior Software Engineer

    2 days ago

    San Diego, CA, United States Top Engineer Full time

    TOP ENGINEER JOB POST!!! CONFIDENTIAL SEARCH FOR AN AEROSPACE LEADER Industry: Aerospace / Defense / Software Degree: BS in CS, CE, or EE (MS Preferred) Experience: 5-15 Years Role: Senior Embedded Software Engineer Join an established company with great technology to design and develop high-reliability embedded software for cutting-edge, space-based...

  • Staff Software Engineer

    4 days ago

    San Mateo, CA, United States Skydio Full time

    Skydio is the leading US drone company and the world leader in autonomous flight, the key technology for the future of drones and aerial mobility. The Skydio team combines deep expertise in artificial intelligence, best-in-class hardware and software product development, operational excellence, and customer obsession to empower a broader, more diverse...

  • Staff Fullstack Software Engineer

    2 days ago

    San Mateo, CA, United States Notable Full time

    Notable is the leading healthcare AI platform for transforming workforce productivity. Health systems, hospitals, and payers use Notable to improve healthcare quality, close gaps in patient care, drive member enrollment, and patient acquisition, retention, and reimbursement, scaling growth without hiring more staff. We are on a mission to improve the lives...

  • Staff Software Engineer

    6 days ago

    San Mateo, CA, United States Skydio Full time

    Skydio is the leading US drone company and the world leader in autonomous flight, the key technology for the future of drones and aerial mobility. The Skydio team combines deep expertise in artificial intelligence, best-in-class hardware and software product development, operational excellence, and customer obsession to empower a broader, more diverse...

  • Staff Software Engineer

    6 days ago

    San Mateo, CA, United States Skydio Full time

    Skydio is the leading US drone company and the world leader in autonomous flight, the key technology for the future of drones and aerial mobility. The Skydio team combines deep expertise in artificial intelligence, best-in-class hardware and software product development, operational excellence, and customer obsession to empower a broader, more diverse...

  • Staff Software Engineer

    4 days ago

    San Mateo, CA, United States Skydio Full time

    Skydio is the leading US drone company and the world leader in autonomous flight, the key technology for the future of drones and aerial mobility. The Skydio team combines deep expertise in artificial intelligence, best-in-class hardware and software product development, operational excellence, and customer obsession to empower a broader, more diverse...

  • Staff Software Engineer

    3 hours ago

    San Mateo, CA, United States Skydio Full time

    Skydio is the leading US drone company and the world leader in autonomous flight, the key technology for the future of drones and aerial mobility. The Skydio team combines deep expertise in artificial intelligence, best-in-class hardware and software product development, operational excellence, and customer obsession to empower a broader, more diverse...

  • Staff Software Engineer

    2 weeks ago

    San Mateo, CA, United States Homeward Full time

    Homeward is rearchitecting the delivery of health and care in partnership with communities everywhere, starting in rural America. Today, 60 million Americans living in rural communities are facing a crisis of access to care. In the U.S. healthcare system, rural Americans experience significantly poorer clinical outcomes. This trend is rapidly accelerating as...