Data Streaming Engineer

4 weeks ago

Scottsdale, United States Phoenix Staff Inc Full time
Job DescriptionJob Description

Title: Data Streaming Engineer
Location: Scottsdale, AZ

We are seeking a Data Streaming Engineer specializing in Distributed Systems to design and build software for distributed systems management. This role involves developing internal automation scripts, system software for component interaction and management, and infrastructure for data streaming and publish/subscribe architectures. You will play a pivotal part in defining our client’s technological future.


Your role:

  • Manage and enhance scripts for RSIM, the company’s optimization engine.
  • Lead the selection, deployment, and ongoing support of a new data streaming platform.
  • Contribute to and maintain stream-based data pipelines.
  • Provide training and support to developers.

 


What you’ve got:

  • Minimum of 3 years of hands-on experience in developing or managing distributed systems.
  • A bachelor’s degree in computer science, engineering, or a related field is preferred.
  • Proven expertise with at least one of the following: Apache Kafka, Google Pub/Sub, Amazon Kinesis, or Azure Event Bus, with Kafka preferred.
  • Proficiency in Unix-based systems, particularly Ubuntu Linux.
  • Strong understanding of data marshalling and inter-process communication protocols.
  • Familiarity with cloud infrastructure management (preferably GCP) and agile development tools (git and Atlassian suite).
  • Scripting expertise in languages such as Bash, Python, or Perl, with a preference for Python.
  • Knowledge of information security practices.
  • Experience with integration and performance testing.

 


Preferred Skills:

  • Windows system administration experience.
  • Proficiency in programming languages like C, C#, or Python.
  • Database management and data science experience.
  • Advanced knowledge in information security.

 


To find more great tech-centric jobs, please visit www.phoenixstaff.com.

 

 

Company DescriptionWe believe that finding the right candidate shouldn’t be so hard. Neither should finding a job you love. By taking the time to understand your specific needs, we make the perfect placements and build relationships that last long after the position is filled. We’re fanatical about the right fit, and we look forward to finding yours.Company DescriptionWe believe that finding the right candidate shouldn’t be so hard. Neither should finding a job you love. By taking the time to understand your specific needs, we make the perfect placements and build relationships that last long after the position is filled. We’re fanatical about the right fit, and we look forward to finding yours.

  • Senior Data Engineer

    2 weeks ago

    Scottsdale, Arizona, United States RiverPoint Full time

    Job Title: Senior Data EngineerRiverPoint is seeking a highly skilled Senior Data Engineer to lead the design, development, and implementation of our Enterprise Analytics platform. As a key member of our team, you will be responsible for architecting and developing large-scale ETL pipelines, data processing frameworks, and distributed data warehouse...

  • Senior Data Engineer

    4 days ago

    Scottsdale, Arizona, United States Early Warning Services, LLC Full time

    Job SummaryEarly Warning Services, LLC is seeking a highly skilled Sr. Software Engineer to join our team. As a trusted name in payments, we partner with thousands of institutions to increase access to financial services and protect transactions for hundreds of millions of consumers and small businesses. Key ResponsibilitiesDevelops, documents, tests,...

  • Senior Data Architect

    1 month ago

    Scottsdale, Arizona, United States RiverPoint Full time

    Job Title: Senior Data EngineerRiverPoint is seeking a highly skilled Senior Data Engineer to lead the design, development, and implementation of our Enterprise Analytics platform. This is a direct hire/FTE position that requires a strong background in data engineering, architecture, and analytics.Key Responsibilities:Design and develop large-scale ETL...

  • Senior Data Architect

    3 weeks ago

    Scottsdale, Arizona, United States Goli Tech Full time

    Job Title: Lead Data EngineerWe are seeking a highly skilled Lead Data Engineer to join our team at Goli Tech. As a key member of our data engineering team, you will be responsible for designing and implementing large-scale data pipelines, collaborating with architects to solve complex problems, and leading other data engineers to deliver high-quality...

  • Data Engineer

    1 month ago

    Scottsdale, Arizona, United States Sectigo, Inc. Full time

    Job Title: Data EngineerWe are seeking a highly skilled Data Engineer to join our team at Sectigo, Inc. As a Data Engineer, you will be responsible for designing, developing, and maintaining our data warehouse infrastructure.Key Responsibilities:Design and implement scalable data warehouse architectures using Snowflake.Develop and optimize ETL processes...

  • Data Engineer

    2 weeks ago

    Scottsdale, Arizona, United States Cardone Ventures Full time

    Job Title: Data EngineerAt Cardone Ventures, we are seeking a highly skilled Data Engineer to join our team. As a Data Engineer, you will play a critical role in designing and implementing data products that add value to our organization.Key Responsibilities:Collaborate with cross-functional teams to scope solutions and make project decisions.Design and...

  • Data Engineer

    3 weeks ago

    Scottsdale, Arizona, United States Cardone Ventures Full time

    Job Title: Data EngineerCardone Ventures is seeking a highly skilled Data Engineer to join our team. As a Data Engineer, you will be responsible for designing and implementing data products that add value to our organization.Key Responsibilities:Collaborate with cross-functional teams to scope solutions and make project decisions.Design and implement data...

  • Data Engineer

    1 month ago

    Scottsdale, Arizona, United States Cardone Ventures Full time

    Job Title: Data EngineerJob Summary:The Data Engineer role at Cardone Ventures requires a skilled professional to design, build, and maintain large-scale data systems. The ideal candidate will have a strong understanding of data engineering principles, including data transformation, data quality, and data security.Key Responsibilities:Collaborate with...

  • Senior Automation Engineer

    5 days ago

    Scottsdale, Arizona, United States InterSources Full time

    Job Overview:We are seeking a highly skilled Senior Automation Engineer to join our team at InterSources Inc. As a key member of our engineering team, you will be responsible for designing, developing, and implementing automated testing solutions for our clients.Key Responsibilities:Design and develop automated testing frameworks using Java and...

  • Senior Automation Engineer

    1 week ago

    Scottsdale, Arizona, United States InterSources Full time

    Job Description:We are seeking a highly skilled Senior Automation Engineer to join our team at InterSources Inc. The ideal candidate will have a strong background in Java and AWS, with experience in automation testing and data migration.Key Responsibilities:Design and implement automated testing frameworks using Java and GroovyDevelop and maintain...

  • Data Engineer

    2 months ago

    Scottsdale, United States Cardone Ventures Full time

    POSITION SUMMARYThe Data Engineer role requires robust data engineering capabilities to efficiently manage data flows from operational systems into a lakehouse architecture. The ideal candidate will understand the theory and mechanics behind data transformation, ensuring data adds more value as it transitions from bronze to silver to gold stages. Ultimately,...

  • Data Engineer

    2 weeks ago

    Scottsdale, Arizona, United States Nationwide Full time

    Job DescriptionNationwide is seeking a highly skilled Data Engineer to join our team. As a Data Engineer, you will be responsible for designing, developing, and implementing data products that support our business goals.Key Responsibilities:Consult on complex data product projects by analyzing end-to-end data product requirements and existing business...

  • Senior Software Quality Assurance Engineer

    5 days ago

    Scottsdale, Arizona, United States InterSources Full time

    Job Summary:We are seeking a highly skilled Senior Software Quality Assurance Engineer to join our team at InterSources Inc. As a key member of our team, you will be responsible for designing, developing, and implementing automated testing solutions for our clients.Key Responsibilities:Design and develop automated testing frameworks using Java and...

  • Contract Only

    2 weeks ago

    Scottsdale, United States Corporate Biz Solutions Inc Full time

    DATA Program Manager Scottsdale AZ onsiteContractData architecture experience 3-4 years of working experience on Azure DatabricksHaving at least 1 project implementation experience on Azure DatabricksStrong in SQL and Data Analysis skillsShould have knowledge on platform setupShould have good undertanding of batch streaming data flowsShould have knowledge on...

  • Data Engineer

    5 days ago

    Scottsdale, Arizona, United States True Food Kitchen Full time

    Job Title: Data Engineer - Power BI DeveloperAbout the Role:We are seeking a highly skilled Data Engineer to join our team at True Food Kitchen. As a Data Engineer, you will play a key role in designing and delivering comprehensive data solutions using On-Premises SQL Server, Azure cloud technologies, and Power BI. Your primary responsibility will be to...

  • SAP Data Analytics Engineer

    1 month ago

    Scottsdale, United States GROM Consulting Full time

    Title/Position: SAP SAC Data EngineerLocation: AZ areaDuration: multi-yearStart Date: October, 2024Preferred SkillsExpertise in SAP Analytics Cloud (SAC) and planning functionalities.Strong background in financial and workforce planning processes.Proficiency in data integration and real-time data access.Experience with SAP S/4HANA and SAP BW.Knowledge of...

  • SAP Data Analytics Engineer

    1 month ago

    scottsdale, United States GROM Consulting Full time

    Title/Position: SAP SAC Data EngineerLocation: AZ areaDuration: multi-yearStart Date: October, 2024Preferred SkillsExpertise in SAP Analytics Cloud (SAC) and planning functionalities.Strong background in financial and workforce planning processes.Proficiency in data integration and real-time data access.Experience with SAP S/4HANA and SAP BW.Knowledge of...

  • SAP Data Analytics Engineer

    1 month ago

    Scottsdale, United States GROM Consulting Full time

    Title/Position: SAP SAC Data EngineerLocation: AZ areaDuration: multi-yearStart Date: October, 2024Preferred SkillsExpertise in SAP Analytics Cloud (SAC) and planning functionalities.Strong background in financial and workforce planning processes.Proficiency in data integration and real-time data access.Experience with SAP S/4HANA and SAP BW.Knowledge of...

  • Technical Data Project Manager

    3 weeks ago

    Scottsdale, United States AxiusTek Full time

    Role : Technical Data Project ManagerDuration : Long term contract Job description :Very good communication skills, should be able to coordinate with different business stakeholders, understand the requirements translate into technical documents.Should be able to resolve any delays or clarifications required with business team.Should understand the data...

  • Senior Automation Engineer

    1 week ago

    Scottsdale, Arizona, United States InterSources Full time

    Job Summary:We are seeking a highly skilled Senior Automation Engineer to join our team at InterSources Inc. As a key member of our digital transformation team, you will be responsible for designing, developing, and implementing automated testing solutions for our clients.Key Responsibilities:Design and develop automated testing frameworks using Java and...