Principal Software Engineer for Data Pipelines

6 days ago


San Francisco, California, United States Spire Full time

Spire Global, a leading space-to-cloud analytics company, is seeking an experienced Principal Software Engineer to lead the development of its data pipelines.

The Role:

This is a critical position that requires expertise in designing, implementing, and maintaining robust and scalable data pipelines using Apache Flink and Java. As a key member of the US Government Engineering team, you will collaborate with cross-functional teams to deliver high-quality software solutions on time and within budget.

Your primary responsibilities will include:

  • Designing and implementing complex data pipelines using Apache Flink and Java
  • Collaborating with other engineers and scientists to plan, develop, test, and deploy data pipelines
  • Ensuring the reliability, scalability, and performance of data pipelines
  • Contributing to the design and implementation of message queueing systems using Kafka
  • Providing technical guidance and support to junior engineers and Scientists

To be successful in this role, you must have:

  • 3+ years' experience developing software in Java using Apache Flink
  • Degree in Computer Science or an equivalent subject
  • Power-user capabilities with Linux
  • Strong understanding of SQL and related relational databases
  • Experience with AWS cloud computing services
  • Robust initiative and the ability to work with minimal oversight

We offer a competitive salary range of $145,000 to $190,000, based on location, skills, experience, and qualifications. This role may also be eligible for annual equity awards and our employee benefits program, including vacation, sick, and personal time off; optional medical, dental, vision, life, and disability coverage; a 401(K) plan; health and wellness reimbursement program; and participation in Spire's Employee Stock Purchase Plan.

We are proud to be an equal opportunity employer and are committed to equal employment opportunity regardless of race, color, ancestry, religion, sex, national origin, sexual orientation, age, marital status, disability, gender identity or veteran status.



  • San Francisco, California, United States Trunk Full time

    We're on a mission to empower software organizations to deliver high-quality projects quickly. Our unique approach enables engineering teams to stay focused on designing and implementing software, leading to the creation of magical projects and happier teams.Our team is growing rapidly, with our founders leveraging their experience from some of the world's...


  • San Francisco, California, United States WEX Inc Full time

    Job OverviewWe are seeking a highly skilled Sr. Principal Data Software Engineer to join our team at WEX Inc.About the Role:As a key member of our data engineering team, you will be responsible for designing and implementing scalable, reliable, and cost-effective data architectures.You will work closely with stakeholders to understand business requirements...


  • San Francisco, California, United States ZipRecruiter Full time

    At ZipRecruiter, we're seeking a highly skilled Data Pipeline Architect to join our team. As a key member of our data engineering team, you'll be responsible for designing and implementing scalable data pipelines that support robust data architectures and facilitate seamless data flow.The ideal candidate will have experience with cloud data platforms such as...


  • San Francisco, California, United States Gridware Full time

    At Gridware, we're seeking a skilled Principal Data Infrastructure Architect to join our team. This role plays a pivotal part in designing, building, and optimizing data pipelines and infrastructure to support real-time grid monitoring systems.The successful candidate will be responsible for handling large-scale sensor data, ensuring data integrity, and...

  • Software Engineer

    1 week ago


    San Francisco, California, United States Tbwa ChiatDay Inc Full time

    Principal Software Engineer, BackendCHAOS Inc. is a technology company specializing in defense and critical industrial sectors. The company has developed next-generation capabilities and is known for its mission-focused culture, dedicated to solving complex technical challenges. Its unique agile engineering approach enables rapid prototyping, while...


  • San Francisco, California, United States Aditi Consulting LLC Full time

    About Aditi Consulting LLCAditi Consulting LLC is a leading provider of consulting services, focusing on data engineering and analytics. Our team of experts helps clients build and manage complex data pipelines.


  • San Francisco, California, United States HackerWeb Full time

    Software Architect Job OverviewWe are seeking a highly skilled Principal Software Architect to join our team at HackerWeb. This is an excellent opportunity for someone looking to build high-volume LLM pipelines that help physicians effectively review giant medical records.The successful candidate will have the ability to own projects end-to-end, including...


  • San Francisco, California, United States Tubi Full time

    About the RoleTubi is a leading entertainment company with a global presence and a strong commitment to providing accessible entertainment for all. With over 250,000 premium movies and TV episodes, as well as over 300 exclusive originals, Tubi offers the largest collection of on-demand content in the industry.The Data Platform team is at the heart of Tubi's...


  • San Jose, California, United States Tik Tok Full time

    About the RoleAs a Principal Software Architect for Risk Engineering at TikTok, you will play a crucial role in building industry-leading risk control systems that prioritize user experience and establish trust between customers and business service providers.Job ResponsibilitiesDesign and develop highly scalable systems, including ad fraud detection, risk...


  • San Francisco, California, United States CHAOS Industries Full time

    Job OverviewCHAOS Industries is a global technology company delivering cutting-edge solutions to the defense and critical industrial sectors. We're seeking a highly skilled and motivated Software Engineer to join our team supporting our product engineering.This is a highly-collaborative role which will allow you to wear multiple hats and work very closely...


  • San Francisco, California, United States Gridware Full time

    Company Overview:Gridware is a pioneering company in the field of grid management, dedicated to enhancing and protecting the electrical grid. Our team engineers advanced sensing systems to analyze both electrical and mechanical behavior of grid assets, identifying faults and enabling preemptive mitigation.We are headquartered in the Bay Area, California, and...


  • San Francisco, California, United States Airtable Full time

    Transforming Business Processes with DataAirtable empowers organizations to accelerate their most critical business processes without relying on traditional software development. With over 500,000 clients worldwide, including 80% of the Fortune 100, Airtable has revolutionized how work gets done.We're passionate about democratizing software creation and...


  • San Jose, California, United States IBM Full time

    About the RoleWe are seeking a highly skilled Principal Software Engineer to join our team and contribute to the development of enterprise-level software solutions. As a key member of our engineering team, you will be responsible for designing, implementing, and delivering scalable micro-services that handle massive amounts of data.ResponsibilitiesYou will...


  • San Diego, California, United States Indotronix International Corporation Full time

    Are you a seasoned professional looking to leverage your expertise in cloud-based data pipelines to drive business growth? Do you have a passion for leading high-performing teams and designing scalable data architectures?We are seeking an experienced Data Architect to join our team at Indotronix International Corporation. As a key member of our data...


  • San Diego, California, United States RADAR Full time

    Join RADAR's Innovative Team as a Principal Software EngineerRADAR, a pioneering startup revolutionizing retail customer experience through precise inventory identification and AI-driven technologies, is seeking an exceptional Principal Software Engineer - Comprehensive Systems Tester. This role requires a strategic leader who can design and execute...


  • San Francisco, California, United States University of California - San Francisco Campus and Health Full time

    Job SummaryThe senior software engineer will lead the development, implementation, and maintenance of computing and data infrastructure to support the deployment and monitoring of Machine Learning (ML) and generative Artificial Intelligence (AI) tools at UCSF Health.This includes leading the Health IT Platform for Advanced Computing (HIPAC), a cloud...


  • San Jose, California, United States Adobe Full time

    About the RoleAdobe is seeking a highly skilled Principal Data Scientist to join our AI Engineering team. This individual will play a key role in designing, architecting, and building data insight dashboards and visualizations.The ideal candidate will have expertise in one or more data science tools such as Pandas, Numpy, Octave, R, and experience building...


  • San Francisco, California, United States Autodesk Full time

    About the Role:Autodesk is seeking an experienced Principal Software Engineer to lead the evolution of our Salesforce platform and enhance our business processes. This hybrid role in the San Francisco Bay Area requires a blend of advanced technical skills and strategic thinking.Key Responsibilities:Lead and mentor a team of Salesforce developers and...


  • San Francisco, California, United States TEKsystems Full time

    About the RoleWe are seeking a highly skilled Senior Data Engineer to join our team in supporting our data platform.This is a 6-month contract-to-hire opportunity with excellent growth prospects.Key ResponsibilitiesSupport our data platform, responsible for collecting, storing, processing, and analyzing vast amounts of data across the organization.Work...


  • San Francisco, California, United States People Data Labs Full time

    Role OverviewWe are seeking an exceptional Software Engineering Lead to join our team at People Data Labs. This role is a fantastic opportunity to drive our self-serve product offerings, grow new revenue, and develop innovative data products.