Senior Distributed Systems Engineer

2 weeks ago

Scottsdale, United States Phoenix Staff Inc Full time
Job DescriptionJob Description

Title: Senior Distributed Systems Engineer
Location: Scottsdale, AZ (Remote)

Our client is seeking a Senior Distributed Systems Engineer with expertise in distributed systems to lead the re-engineering of our data ingestion pipeline. This pivotal role focuses on transitioning from a traditional ETL model to a real-time streaming architecture that can handle high data volumes and provide real-time insights across our platform. You will play a hands-on role in defining and implementing the technical future of our data infrastructure. You will have a significant influence on the direction of our client’s product’s data architecture, collaborating closely with developers and product leaders. While this is a highly technical role, you’ll also be a critical voice in shaping the future of our data infrastructure, working with cutting-edge tools and technology.

Your Role:

  • Design, develop, and implement a data streaming platform from the ground up to replace our current ETL-based pipeline.
  • Architect stream-based data pipelines that enable applications to listen to and process data as it flows through the infrastructure.
  • Lead the selection, deployment, and ongoing management of distributed data systems, with a focus on Apache Kafka or similar technologies.
  • Collaborate closely with developers and stakeholders to align the data streaming architecture with business and technical goals.
  • Provide technical leadership and guidance to a small team, ensuring effective deployment and optimization of the data streaming solution.
  • Implement and maintain CI/CD processes for continuous improvement and scalability of the streaming platform.
  • Ensure basic security practices are followed within the data pipeline architecture.

What You Bring:

  • 3+ years of hands-on experience in distributed systems development, deployment, and management.
  • Expertise in stream processing technologies like Apache Kafka, Google Pub/Sub, Amazon Kinesis, or Azure Event Bus, with Kafka being strongly preferred.
  • Strong experience in Unix/Linux-based systems (particularly Ubuntu), with familiarity in Windows environments.
  • Proven experience designing and building real-time data pipelines for high-volume data ingestion, ideally within smaller companies where you’ve led the project end-to-end.
  • Proficiency in Python and scripting languages (Bash, Perl) for system automation and data processing.
  • Hands-on experience in deploying solutions, not just conceptualizing or leading from a distance—this is a role for a doer.
  • Strong collaborator with the ability to communicate technical concepts and sell ideas to both developers and non-technical stakeholders.
  • Broad technical background, including exposure to various technologies beyond SQL and relational databases.
  • Experience with cloud infrastructure, though we are not tied to any specific cloud vendor.
  • Basic understanding of information security as it relates to data infrastructure.
  • Bachelor’s degree in computer science, engineering, or a related field is preferred.

 

 

Company DescriptionWe believe that finding the right candidate shouldn’t be so hard. Neither should finding a job you love. By taking the time to understand your specific needs, we make the perfect placements and build relationships that last long after the position is filled. We’re fanatical about the right fit, and we look forward to finding yours.Company DescriptionWe believe that finding the right candidate shouldn’t be so hard. Neither should finding a job you love. By taking the time to understand your specific needs, we make the perfect placements and build relationships that last long after the position is filled. We’re fanatical about the right fit, and we look forward to finding yours.

  • Senior Advanced Systems Engineer

    4 weeks ago

    Scottsdale, Arizona, United States GeoLogics Corporation Full time

    Job Title: Senior Advanced Systems EngineerJob Summary: We are seeking a highly skilled Senior Advanced Systems Engineer to join our team at GeoLogics Corporation. As a Senior Advanced Systems Engineer, you will be responsible for developing and deploying state-of-the-art ground operational systems.Key Responsibilities:Design and develop ground operational...

  • Water Distribution Engineer

    4 weeks ago

    Scottsdale, Arizona, United States City Of Scottsdale Full time

    Water Distribution Engineer Job OpportunityThe City of Scottsdale is seeking a skilled Water Distribution Engineer to join our team. This role involves leading a crew in the installation, maintenance, and repair of water lines in the distribution system and occasionally sewer lines in the collection system. As a Water Distribution Engineer, you will be...

  • Senior Digital Signal Processing Systems Engineer

    4 weeks ago

    Scottsdale, Arizona, United States General Dynamics Full time

    Job SummaryWe are seeking a highly skilled Senior Digital Signal Processing Systems Engineer to join our team at General Dynamics Mission Systems. As a key member of our SIS Core Engineering team, you will be responsible for developing and modeling algorithms, verifying their implementations, and analyzing their performance on a range of...

  • Senior Site Reliability Engineer

    4 weeks ago

    Scottsdale, Arizona, United States CVS Health Full time

    Transforming Healthcare with TechnologyAt CVS Health, we're committed to delivering enhanced human-centric healthcare for a rapidly changing world. As a Senior Site Reliability Engineer, you'll play a critical role in shaping our technology landscape and driving innovation.Key ResponsibilitiesIdentify and implement critical metrics for system health,...

  • Senior Software Engineer, Data

    2 weeks ago

    Scottsdale, United States SKYTOUCH Solutions Full time

    Software Engineer, Senior (Data) Who are we looking for? SkyTouch Technology is an early innovator of cloud-based, mobile-enabled property management system (PMS) solutions for the hospitality industry. Over the last 10+ years, our PMS software, SkyTouch Hotel OS®, has been successfully implemented in over 6,500 properties worldwide. With our proven track...

  • Senior System Engineer

    2 days ago

    Scottsdale, United States Staffing Science Full time

    We are hiring a Systems Engineer to play a pivotal role in modernizing and scaling our IT infrastructure. This position is primarily remote, but candidates must reside in the Phoenix metro area. The first 10-30 days will require on-site work, with periodic on-site presence (1-2 days per month or as needed for critical data center operations). The ideal...

  • Senior Software Engineer, Data

    2 weeks ago

    Scottsdale, United States Choice Hotels Full time

    Software Engineer, Senior (Data) Who are we looking for? SkyTouch Technology is an early innovator of cloud-based, mobile-enabled property management system (PMS) solutions for the hospitality industry. Over the last 10+ years, our PMS software, SkyTouch Hotel OS®, has been successfully implemented in over 6,500 properties worldwide. With our proven track...

  • Senior Mechanical Engineer

    4 weeks ago

    Scottsdale, Arizona, United States STRM Recruiting Full time

    Job DescriptionSTRM Recruiting is seeking a highly skilled Senior Mechanical Engineer to join our team. As a key member of our engineering team, you will be responsible for the analysis and design of mechanical systems that meet our high standards and client expectations.Key Responsibilities:Design and develop mechanical systems for various...

  • Senior Advanced Systems Engineer

    4 weeks ago

    Scottsdale, Arizona, United States APR Consulting Full time

    Job Summary:We are seeking a highly skilled Senior Advanced Systems Engineer to join our team in Scottsdale, AZ. As a member of a cross-functional team, you will be responsible for developing and deploying state-of-the-art ground operational systems. Key Responsibilities:- Develop and deploy ground operational systems- Collaborate with cross-functional...

  • Senior Cloud Engineer

    1 month ago

    Scottsdale, Arizona, United States Early Warning Services, LLC Full time

    Job Title: Senior Cloud EngineerAt Early Warning Services, LLC, we're committed to innovation and excellence in the financial services industry. As a Senior Cloud Engineer, you'll play a critical role in shaping our cloud strategy and delivering cutting-edge solutions to our customers.Key Responsibilities:Design and implement scalable cloud architectures to...

  • Senior Field Engineer

    1 month ago

    Scottsdale, United States GTN Technical Staffing Full time

    Senior Field Engineer HIGHLIGHTS Location: Arizona Job Type: FullTime (Onsite with overtime opportunities) Relocation: Offered for qualified candidates Residency Status: US Citizen or Green Card Holder ONLY Our client is looking for a Senior Field Engineer to join their team! Job Summary: Our client in the semiconductor...

  • Senior Field Engineer

    1 month ago

    Scottsdale, United States GTN Technical Staffing Full time

    Senior Field Engineer HIGHLIGHTS Location: Arizona Job Type: FullTime (Onsite with overtime opportunities) Relocation: Offered for qualified candidates Residency Status: US Citizen or Green Card Holder ONLY Our client is looking for a Senior Field Engineer to join their team! Job Summary: Our client in the semiconductor...

  • Senior Director of Quality Management Systems

    4 weeks ago

    Scottsdale, Arizona, United States Innovative Health LLC Full time

    The Senior Director of Quality Management Systems at Innovative Health LLC is responsible for establishing a Quality System that meets FDA and ISO requirements, customer expectations, and drives business growth. This leader champions continuous improvement efforts to establish an effective Quality System, providing quality leadership to all levels of the...

  • Strategic Systems Inc | Peoplesoft HCM Functional Analyst | scottsdale, az

    6 days ago

    scottsdale, United States Strategic Systems Inc Full time

    Under general supervision of the Lead Senior PeopleSoft Analyst represents and supports user requirements for the PeopleSoft (PS) HCM modules. Works to support the user community in the day-to-day operations of the human resources applications. Requires a functional understanding of the PS Core HR and other HCM modules, as well as analysis and...

  • Strategic Systems Inc | Peoplesoft HCM Functional Analyst | scottsdale, az

    2 days ago

    scottsdale, United States Strategic Systems Inc Full time

    Under general supervision of the Lead Senior PeopleSoft Analyst represents and supports user requirements for the PeopleSoft (PS) HCM modules. Works to support the user community in the day-to-day operations of the human resources applications. Requires a functional understanding of the PS Core HR and other HCM modules, as well as analysis and...

  • Senior Cybersecurity Engineer

    4 weeks ago

    Scottsdale, Arizona, United States CVS Health Full time

    Job SummaryWe are seeking a highly skilled Senior Security Engineer to join our team at CVS Health. The successful candidate will work in a highly dynamic team supporting Endpoint and Networking security infrastructure leadership, including Zero Trust Framework NIST, EDR, NIDS, HIDS, NAC, XDR, and Advanced WAF systems to protect and guard company assets from...

  • Senior Software Engineer

    4 months ago

    Scottsdale, United States HEAT Software Full time

    HEAT Software and LANDESK are now Ivanti!  With more than 1,600 employees in 23 countries and over 22,000 broadly diversified customers across all industries.  From patch and asset management to IT service delivery and security, our software is everything an organization needs to take their IT operations to the next level.”  Ivanti provides integrated...

  • Senior Network Architect for High-Performance Systems

    4 weeks ago

    Scottsdale, Arizona, United States General Dynamics Full time

    We are seeking a highly skilled Senior Network Architect to join our team at General Dynamics in Scottsdale, Arizona.As a Senior Network Architect, you will be responsible for designing, developing, and deploying high-performance network systems to support the SDA GMI program.The ideal candidate will have a strong background in network engineering, with...

  • Senior Mechanical Engineer

    2 weeks ago

    Scottsdale, United States KFI Engineers Full time

    POSITION SPECIFICATIONPosition: Senior Mechanical EngineerDepartment: Medical & Clean Manufacturing (MCM)Reporting Relationship: Senior Project Manager, MCM COMPANY BACKGROUNDKFI Engineers is a recognized industry leader in facility infrastructure design and performance. Since 1996, our culture of collaboration and unique capabilities have allowed us to make...

  • Systems Engineering Specialist

    4 weeks ago

    Scottsdale, Arizona, United States Belcan Full time

    Job Summary:We are seeking a skilled Systems Engineering Specialist to join our team at Belcan. In this role, you will be responsible for participating in requirements analysis and management, functional analysis, performance analysis, system design, trade studies, systems integration and test (verification) in the development and evaluation of networks and...