Real-Time Data Processing Engineer

1 day ago


Irvine, California, United States JobRialto Full time
System Architect Position

We are seeking a skilled Golang Expert System Architect to join our team. This role involves designing and developing scalable backend systems using Golang and collaborating with cross-functional teams to integrate and optimize solutions using technologies such as Kafka, Postgres, and AWS Neptune. As a Golang Expert System Architect, you will play a key role in shaping the technical direction of our company and delivering robust and scalable solutions.

Key Responsibilities:
  • Design and develop scalable backend systems using Golang.
  • Collaborate with cross-functional teams to convert legacy batch processing systems into real-time streaming architectures.
  • Implement, manage, and optimize data pipelines utilizing Kafka or other streaming technologies.
  • Work with PostgreSQL to ensure high performance and reliability for data storage and access.
  • Design, implement, and optimize GraphQL APIs for seamless data access and integration.
  • Evaluate AWS services like Lambda, Fargate, SQS/SNS, and DynamoDB for optimization opportunities.

Estimated Salary: $140,000 - $200,000 per year

Required Qualifications:
  • Golang Expertise: Strong proficiency in Golang with proven experience in building and maintaining backend systems.
  • Real-Time Streaming: Hands-on experience with Kafka or other real-time streaming technologies.
  • Database Management: Experience with PostgreSQL and solid knowledge of data modeling and best practices in database design.
  • GraphQL: Familiarity with GraphQL or similar web API frameworks.
  • DevOps: Proficiency in CI/CD processes, cloud infrastructure (AWS), and containerization tools such as Docker and Kubernetes.
  • AWS Experience: Familiarity with AWS services like Lambda, Fargate, SQS/SNS, and DynamoDB.

Preferred Qualifications:
  • Graph Databases: Familiarity with AWS Neptune or other graph databases.
  • Microservices Architecture: Experience working with microservices architecture and distributed systems.
  • Cloud Infrastructure: Experience with cloud infrastructure and deployment, particularly within AWS.


  • Irvine, California, United States Cogility Full time

    About the RoleCogility Software is looking for a highly skilled Senior Software Engineer to join our team. As a key member of our engineering department, you will play a vital role in shaping the future of our products.Key ResponsibilitiesArchitect interfaces for customer use, focusing on solving complex problems and delivering high-quality solutions.Design...


  • Irvine, California, United States TRL11, Inc. Full time

    About TRL11, Inc.TRL11, Inc. is a cutting-edge deep tech startup in Irvine, CA, pioneering video technology for Aerospace applications. We seek an experienced Senior Video Processing Engineer with expertise in Artificial Intelligence to design, develop, and implement advanced computer vision pipelines.Responsibilities:Develop and integrate computer vision...


  • Irvine, California, United States Better Debt Solutions Full time

    Job OverviewBetter Debt Solutions is a forward-thinking organization dedicated to creating a culture of compassion and empowerment. As a Data Engineer, you will play a vital role in expanding and optimizing our data architecture, building robust data pipelines, and ensuring efficient data flow across the organization.Key ResponsibilitiesData Infrastructure...


  • Irvine, California, United States eTeam Full time

    Job Description:eTeam seeks an experienced Systems Process Engineer to join our team. In this role, you will be responsible for the application of process and tool engineering to the framework of systems engineering.In this dynamic position, you will support project architecture discussions with teams, providing expertise on tool integration and data...


  • Irvine, California, United States Insight Global Full time

    Job Title: Data Engineer LeaderAbout the Role:We are seeking a seasoned Data Engineer Leader to join our team at Insight Global. As a key member of our data engineering team, you will be responsible for designing and implementing data lakes within the Azure ecosystem.About You:To be successful in this role, you should have 5+ years of relevant professional...


  • Irvine, California, United States IPS-Integrated Project Services, LLC Full time

    Process Engineering LeaderWe are seeking a skilled Process Engineering Leader to join our team at IPS-Integrated Project Services, LLC. This individual will be responsible for producing conceptual design deliverables, estimating utility requirements, and generating process P&IDs.Key Responsibilities:Develops conceptual design deliverables such as Process...


  • Irvine, California, United States Jacobs Full time

    We are seeking a highly skilled Biopharmaceutical Process Engineering Expert to join our team in San Francisco or Irvine. This role offers an exciting opportunity to work on state-of-the-art projects that drive the heart of our clients' business.The ideal candidate will have at least 8 years of experience working on manufacturing projects within the...


  • Irvine, California, United States ASCENDING Full time

    At ASCENDING, we are looking for a talented Data Engineering and QA Specialist to support our Senior Director in the Quality Assurance space.We process north of 250 Billion market events/day in our Big Data department. This group handles massive amounts of financial data and is expanding into the Crypto/Blockchain space.This person will need to be able to do...


  • Irvine, California, United States JobRialto Full time

    Role DescriptionJobRialto is looking for a talented Go developer to build and enhance scalable backend systems. In this role, you will migrate batch processing systems to real-time streaming architectures, develop robust data pipelines, and work with cross-functional teams to integrate and optimize solutions using technologies like Golang, Kafka, and...


  • Irvine, California, United States Amazon Full time

    Key ResponsibilitiesDrive shared understanding among business, engineering, and science teams of domain knowledge of processes, system structures, and business requirements.Apply domain knowledge to identify product roadmap, growth, engagement, and retention opportunities; quantify impact; and inform prioritization.Advocate technical solutions to business...


  • Irvine, California, United States Entegee Full time

    Job SummaryWe are seeking a highly skilled and experienced Senior Manufacturing Process Optimization Engineer to join our team at Entegee.About the RoleThis is a fantastic opportunity for a talented engineer with expertise in manufacturing process optimization to take their career to the next level. As a Senior Manufacturing Process Optimization Engineer,...


  • Irvine, California, United States Verizon Communications Full time

    We are looking for a seasoned Data Engineering Lead to oversee the management of enterprise-wide datastax and open-source Cassandra database environments at Verizon Communications.As a Data Engineering Lead, you will be responsible for managing the SDLC life cycle for multiple applications, being responsible for production/development engagement, emerging...


  • Irvine, California, United States Futran Tech Solutions Pvt. Ltd. Full time

    Job Title: Master Data Management Architect with Informatica ExpertiseFutran Tech Solutions Pvt. Ltd. is seeking an experienced Informatica MDM Developer to join our team.Estimated Salary: ₹1,500,000 - ₹2,500,000 per annumThis role involves designing and implementing complex business applications that involve data management and utilization heavily using...


  • Irvine, California, United States Jobot Full time

    Unlock Endless Career Opportunities with Our Thriving Healthcare CompanyWe are seeking a highly skilled Sr Engineer, Data Integrations & Analytics to join our Accounting & Finance team in Irvine. This exciting role offers a competitive salary of $165,000 - $195,000 per year, plus a 15% bonus, exceptional benefits, and unparalleled career advancement...

  • Data Engineer

    3 weeks ago


    Irvine, California, United States Better Debt Solutions Full time

    Job OverviewBetter Debt Solutions is a leading provider of compassionate debt solutions, driven by tailored strategies and transparent practices. As a Data Engineer, you will play a crucial role in expanding our data architecture, building robust data pipelines, and ensuring efficient data flow across the organization.About the RoleThis exciting opportunity...


  • Irvine, California, United States Alliant Insurance Services Full time

    We are seeking an Enterprise Data Engineer to join our team at Alliant Insurance Services.The successful candidate will have extensive experience in administering Microsoft SQL server, Windows O/S, and various replication technologies.This role involves implementing database maintenance best practices, developing backups, recovery, and verification...


  • Irvine, California, United States Futran Tech Solutions Pvt. Ltd. Full time

    Job Summary:Futran Tech Solutions Pvt. Ltd. is a leading provider of data management solutions. We are seeking an experienced Sr Informatica MDM Developer to join our team and help us deliver innovative solutions to our clients. The successful candidate will have excellent technical skills, strong communication abilities, and a passion for delivering...


  • Irvine, California, United States 174 Power Global Full time

    About 174 Power GlobalWe are a FORTUNE Global 500 firm and one of the eight largest business enterprises in South Korea. Our mission is to deliver utility-grade energy solutions, leveraging best-of-world technology and expertise. As a member of Hanwha Group, we bring a decade of global leadership in renewable energy to North America.Job DescriptionThis role...


  • Irvine, California, United States JobRialto Full time

    Job DescriptionWe are seeking a skilled Real-Time Data Processing Engineer to build and enhance scalable backend systems using Golang. This role involves migrating batch processing systems to real-time streaming architectures and developing robust data pipelines using Kafka or other streaming technologies. As a Real-Time Data Processing Engineer, you will...


  • Irvine, California, United States The Judge Group Full time

    The Judge Group is seeking a skilled Senior Real Estate Project Coordinator to join our team in Southern California.About the Role:We are looking for an experienced professional to manage real estate entitlements, support wireless network enhancements, and collaborate with internal partners. This role requires strong organizational skills, attention to...