Data Streaming Engineer
3 weeks ago
Title: Data Streaming Architect & Engineer
Location: Scottsdale, AZ (Remote)
Our client is seeking a Data Streaming Engineer with expertise in distributed systems to lead the re-engineering of our data ingestion pipeline. This pivotal role focuses on transitioning from a traditional ETL model to a real-time streaming architecture that can handle high data volumes and provide real-time insights across our platform. You will play a hands-on role in defining and implementing the technical future of our data infrastructure. You will have a significant influence on the direction of our client’s product’s data architecture, collaborating closely with developers and product leaders. While this is a highly technical role, you’ll also be a critical voice in shaping the future of our data infrastructure, working with cutting-edge tools and technology.
Your Role:
- Design, develop, and implement a data streaming platform from the ground up to replace our current ETL-based pipeline.
- Architect stream-based data pipelines that enable applications to listen to and process data as it flows through the infrastructure.
- Lead the selection, deployment, and ongoing management of distributed data systems, with a focus on Apache Kafka or similar technologies.
- Collaborate closely with developers and stakeholders to align the data streaming architecture with business and technical goals.
- Provide technical leadership and guidance to a small team, ensuring effective deployment and optimization of the data streaming solution.
- Implement and maintain CI/CD processes for continuous improvement and scalability of the streaming platform.
- Ensure basic security practices are followed within the data pipeline architecture.
What You Bring:
- 3+ years of hands-on experience in distributed systems development, deployment, and management.
- Expertise in stream processing technologies like Apache Kafka, Google Pub/Sub, Amazon Kinesis, or Azure Event Bus, with Kafka being strongly preferred.
- Strong experience in Unix/Linux-based systems (particularly Ubuntu), with familiarity in Windows environments.
- Proven experience designing and building real-time data pipelines for high-volume data ingestion, ideally within smaller companies where you’ve led the project end-to-end.
- Proficiency in Python and scripting languages (Bash, Perl) for system automation and data processing.
- Hands-on experience in deploying solutions, not just conceptualizing or leading from a distance—this is a role for a doer.
- Strong collaborator with the ability to communicate technical concepts and sell ideas to both developers and non-technical stakeholders.
- Broad technical background, including exposure to various technologies beyond SQL and relational databases.
- Experience with cloud infrastructure, though we are not tied to any specific cloud vendor.
- Basic understanding of information security as it relates to data infrastructure.
- Bachelor’s degree in computer science, engineering, or a related field is preferred.
Company DescriptionWe believe that finding the right candidate shouldn’t be so hard. Neither should finding a job you love. By taking the time to understand your specific needs, we make the perfect placements and build relationships that last long after the position is filled. We’re fanatical about the right fit, and we look forward to finding yours.Company DescriptionWe believe that finding the right candidate shouldn’t be so hard. Neither should finding a job you love. By taking the time to understand your specific needs, we make the perfect placements and build relationships that last long after the position is filled. We’re fanatical about the right fit, and we look forward to finding yours.
-
Senior Distributed Systems Engineer
3 weeks ago
Scottsdale, United States Phoenix Staff Inc Full timeJob DescriptionJob DescriptionTitle: Senior Distributed Systems EngineerLocation: Scottsdale, AZ (Remote)Our client is seeking a Senior Distributed Systems Engineer with expertise in distributed systems to lead the re-engineering of our data ingestion pipeline. This pivotal role focuses on transitioning from a traditional ETL model to a real-time streaming...
-
Data Engineer
2 weeks ago
scottsdale, United States LTIMindtree Full timeAbout Us:LTIMindtree is a global technology consulting and digital solutions company that enables enterprises across industries to reimagine business models, accelerate innovation, and maximize growth by harnessing digital technologies. As a digital transformation partner to more than 700+ clients, LTIMindtree brings extensive domain and technology expertise...
-
Data Engineer
2 weeks ago
scottsdale, United States LTIMindtree Full timeAbout Us:LTIMindtree is a global technology consulting and digital solutions company that enables enterprises across industries to reimagine business models, accelerate innovation, and maximize growth by harnessing digital technologies. As a digital transformation partner to more than 700+ clients, LTIMindtree brings extensive domain and technology expertise...
-
Data Engineer
2 weeks ago
Scottsdale, United States LTIMindtree Full timeAbout Us:LTIMindtree is a global technology consulting and digital solutions company that enables enterprises across industries to reimagine business models, accelerate innovation, and maximize growth by harnessing digital technologies. As a digital transformation partner to more than 700+ clients, LTIMindtree brings extensive domain and technology expertise...
-
GCP Data Engineer
21 hours ago
Scottsdale, United States MSR Technology Group Full timeRole: GCP Data EngineerExp: 12+Location: Scottsdale, ArizonaDescription:A solid experience and understanding of considerations for largescale solutioning and operationalization of data warehouses data lakes and analytics platforms on GCP is a mustMonitors the Data Lake constantly and ensures that the appropriate support teams are engaged at the right...
-
Senior Software Engineer, Data
2 weeks ago
Scottsdale, United States SKYTOUCH Solutions Full timeSoftware Engineer, Senior (Data) Who are we looking for? SkyTouch Technology is an early innovator of cloud-based, mobile-enabled property management system (PMS) solutions for the hospitality industry. Over the last 10+ years, our PMS software, SkyTouch Hotel OS®, has been successfully implemented in over 6,500 properties worldwide. With our proven track...
-
Senior Software Engineer, Data
3 weeks ago
Scottsdale, United States Choice Hotels Full timeSoftware Engineer, Senior (Data) Who are we looking for? SkyTouch Technology is an early innovator of cloud-based, mobile-enabled property management system (PMS) solutions for the hospitality industry. Over the last 10+ years, our PMS software, SkyTouch Hotel OS®, has been successfully implemented in over 6,500 properties worldwide. With our proven track...
-
Data Observeability Engineer
4 weeks ago
Scottsdale, United States Persistent Systems Full timeAbout PersistentWe are a trusted Digital Engineering and Enterprise Modernization partner, combining deep technical expertise and industry experience to help our clients anticipate what’s next. Our offerings and proven solutions create a unique competitive advantage for our clients by giving them the power to see beyond and rise above. We work with many...
-
Data Observeability Engineer
4 weeks ago
scottsdale, United States Persistent Systems Full timeAbout PersistentWe are a trusted Digital Engineering and Enterprise Modernization partner, combining deep technical expertise and industry experience to help our clients anticipate what’s next. Our offerings and proven solutions create a unique competitive advantage for our clients by giving them the power to see beyond and rise above. We work with many...
-
Specialist - Software Engineering
4 weeks ago
Scottsdale, United States Futran Tech Solutions Pvt. Ltd. Full timeJob Title: Specialist - Software Engineering Work Location: Scottsdale, AZ Job Description: PRINCIPAL DUTIES AND RESPONSIBILITIES: • Responsible for the application architecture, work with different teams, engineers and third parties as necessary • Writing code and unit tests, automation, code reviews and testing • Applying design patterns in...
-
Data Scientist
7 days ago
Scottsdale, United States Ket Software Full timeData Science or AI/ML Engineer at Scottsdale, AZ, for 1+ year.7+ yearsResponsibilities:GCP, Data, Vertex AI, MLOps, LLMOps, Gen AI, Predictive Modeling, Python, Docker7+ year’s experience in AI/ML technologies5+ year’s experience in Google Cloud technologiesP4 - Data & AI > Data Science and Machine Learning > Machine LearningP4 - Data Architecture...
-
scottsdale, United States MSR Technology Group Full timeRole: GCP Data EngineerExp: 12+Location: Scottsdale, ArizonaDescription:A solid experience and understanding of considerations for largescale solutioning and operationalization of data warehouses data lakes and analytics platforms on GCP is a mustMonitors the Data Lake constantly and ensures that the appropriate support teams are engaged at the right...
-
Software Engineering
4 weeks ago
Scottsdale, United States Futran Tech Solutions Pvt. Ltd. Full time• Bachelor's degree in computer sciences or equivalent • 5 years of Java/ functional programming experience is a must. • Eexperience with Cloud stack, Microsoft Azure etc. is a must • 5 years of experience in using Version Control tools like Git and Tools like Jira is a must • Hands on experience in Kotlin • Strong experience in No SQL...
-
Data Observeability Engineer
3 weeks ago
Scottsdale, AZ, United States Persistent Systems Full timeAbout PersistentWe are a trusted Digital Engineering and Enterprise Modernization partner, combining deep technical expertise and industry experience to help our clients anticipate what’s next. Our offerings and proven solutions create a unique competitive advantage for our clients by giving them the power to see beyond and rise above. We work with many...
-
Data Solutions Analyst
4 weeks ago
scottsdale, United States Solü Technology Partners Full timeEmployment RequirementsThis is a 6 MONTH CONTRACT TO HIRE OPPORTUNITYThis opportunity is not open to C2C relationships or visa sponsorship.This opportunity is for local candidates only.Job DescriptionOur client’s industry leading workforce is passionate about creating data solutions that are secure, reliable and efficient in support of our mission to...
-
Data Solutions Analyst
4 weeks ago
Scottsdale, United States Solü Technology Partners Full timeEmployment RequirementsThis is a 6 MONTH CONTRACT TO HIRE OPPORTUNITYThis opportunity is not open to C2C relationships or visa sponsorship.This opportunity is for local candidates only.Job DescriptionOur client’s industry leading workforce is passionate about creating data solutions that are secure, reliable and efficient in support of our mission to...
-
Data Solutions Analyst
4 weeks ago
scottsdale, United States Solü Technology Partners Full timeEmployment RequirementsThis is a 6 MONTH CONTRACT TO HIRE OPPORTUNITYThis opportunity is not open to C2C relationships or visa sponsorship.This opportunity is for local candidates only.Job DescriptionOur client’s industry leading workforce is passionate about creating data solutions that are secure, reliable and efficient in support of our mission to...
-
Treasury Data Analyst
4 months ago
Scottsdale, United States Omni Inclusive Full timeJD: 5+ years of experience in data mapping techniques. 3+ years of working with finance and treasury functions with expertise in translating functional requirements to technical specifications. 3+ years of strong experience Working with GCP, and its native cloud services will be an added advantage. Working knowledge of Reporting technologies...
-
scottsdale, United States Ket Software Full timeData Science or AI/ML Engineer at Scottsdale, AZ, for 1+ year.7+ yearsResponsibilities:GCP, Data, Vertex AI, MLOps, LLMOps, Gen AI, Predictive Modeling, Python, Docker7+ year’s experience in AI/ML technologies5+ year’s experience in Google Cloud technologiesP4 - Data & AI > Data Science and Machine Learning > Machine LearningP4 - Data Architecture...
-
scottsdale, United States Ket Software Full timeData Science or AI/ML Engineer at Scottsdale, AZ, for 1+ year.7+ yearsResponsibilities:GCP, Data, Vertex AI, MLOps, LLMOps, Gen AI, Predictive Modeling, Python, Docker7+ year’s experience in AI/ML technologies5+ year’s experience in Google Cloud technologiesP4 - Data & AI > Data Science and Machine Learning > Machine LearningP4 - Data Architecture...
