Tech Lead for Scalable Data Streaming Solutions

5 days ago


San Jose, California, United States ZipRecruiter Full time

About This Role

We're seeking a skilled Tech Lead to spearhead our efforts in developing cutting-edge data streaming solutions at Canonical. As part of our engineering team, you'll be responsible for architecting scalable service APIs and designing robust data governance systems within our telemetry platform.

Key Responsibilities

  • Collaborate with a globally distributed team to develop data streaming capabilities using Python and Golang.
  • Develop data management and auditing systems within our telemetry platform.
  • Work with our infrastructure team to create a cloud-based SaaS offering and containerised on-prem solution.
  • Design and implement new features and enhancements from spec to production and ongoing operations at scale.
  • Review code and technical designs produced by other engineers.

Requirements

  1. You have a broad technology base but favour backend code and infrastructure.
  2. You have a good understanding of cybersecurity and the challenges of the IoT environment when it comes to connectivity and data streaming.
  3. You have knowledge and experience of telemetry and connectivity systems and platforms including data streaming technologies (MQTT, Kafka, RabbitMQ), observability (OpenTelemetry), industrial/engineering data exchange protocols (OPC-UA, ModBus), and the application of data governance/IAM models to such systems.
  4. You have proficiency in the design and implementation of back-end web services, messaging/data pipelines, and REST APIs using Python and/or Golang.
  5. You are familiar with Ubuntu as a development and deployment platform.
  6. You have a Bachelor's or equivalent in Computer Science, STEM or similar degree.

About Us

Canonical is a growing international software company that works with the open-source community to deliver Ubuntu, the world's best free software platform. Our services help businesses worldwide reduce costs, improve efficiency and enhance security with Ubuntu.

What We Offer

  • Competitive salary range: $120,000 - $180,000 per annum.
  • Learning and development allowances.
  • Generous annual leave.
  • Paid maternity, paternity and sick leave.
  • Priority Pass for travel.


  • San Jose, California, United States Tik Tok Full time

    TikTok is seeking a highly skilled Big Data Streaming Solutions Developer to join its team. In this role, you will design and develop scalable and efficient data processing systems that enable real-time analytics and drive business growth.RequirementsDeep understanding of computer principles, data structures, and algorithmsExperience with streaming computing...


  • San Jose, California, United States Braintree Full time

    Company OverviewBraintree, a PayPal company, has been revolutionizing commerce for over two decades. Our mission is to empower businesses and consumers globally through innovative payment solutions.We operate a robust, two-sided network that connects merchants and consumers worldwide. Our platform enables secure, seamless transactions, whether online or...


  • San Francisco, California, United States Amazon Full time

    About the RoleWe are seeking a highly skilled AWS Streaming Data Solutions Architect to join our team. As a key member of our Worldwide Specialist Organization (WWSO), you will work closely with customers to architect and implement scalable, flexible, and resilient technical solutions using Amazon Web Services (AWS) managed services such as Managed Streaming...


  • San Jose, California, United States HireIO Inc Full time

    About the Job:HireIO Inc is seeking a talented Tech Lead Machine Learning Engineer to join our Brand Ads team. This role offers the opportunity to lead the development of new monetization products, working on everything from ads ranking to forecasting and bidding algorithms.Key Responsibilities:Lead the development of innovative ad products to drive user...


  • San Jose, California, United States Glint Tech Solutions LLC Full time

    About UsGlint Tech Solutions LLC develops cutting-edge technologies to empower businesses worldwide. Our team specializes in building high-performance ad systems, focusing on scalability, reliability, and user engagement.


  • San Francisco, California, United States Amazon Full time

    About the RoleAmazon Web Services (AWS) is seeking a highly skilled Streaming Data Solutions Architect to join our team. As a Specialist Solutions Architect, you will be responsible for helping customers leverage AWS managed services such as Managed Streaming for Apache Kafka (MSK), Amazon Kinesis Data Streams, Amazon Data Firehose, and Amazon Managed...


  • San Jose, California, United States Unreal Gigs Full time

    At Unreal Gigs, we're at the forefront of artificial intelligence research and development. Our mission is to develop AI technologies that benefit humanity, tackling some of the most challenging problems across various domains.About the RoleWe're seeking a Senior Full-Stack Engineer to join our team as an AI Engineering Innovator. This role combines creative...


  • San Jose, California, United States Tik Tok Full time

    Job OverviewTikTok is a leading destination for short-form mobile video. Our mission is to inspire creativity and bring joy. We have global offices in Los Angeles, New York, London, Paris, Berlin, Dubai, Singapore, Jakarta, Seoul, and Tokyo.We are the Generative AI team under Monetization Technology. Our team focuses on developing cutting-edge Generative AI...


  • San Francisco, California, United States Akraya Full time

    Company OverviewAkraya is a leading IT staffing firm recognized for its commitment to excellence and a thriving work environment. As a seasoned Data Engineer, you will play a pivotal role in developing high-scalable web and cloud solutions, focusing on data warehousing, analytics, and database management to support our marketing strategies.">Salary and...


  • San Francisco, California, United States Rackspace, Inc. Full time

    About the Role:Rackspace Technology is seeking a highly skilled Senior Streaming Engineer to join our dynamic team. The ideal candidate will have a strong background in Java, developing and scaling both stream and batch processing systems, and a solid understanding of public cloud technologies, especially GCP.This role involves working in a remote...


  • San Francisco, California, United States Unreal Gigs Full time

    We are seeking a seasoned Data Architect to lead the design and implementation of scalable cloud-based data solutions at Unreal Gigs. In this role, you will be responsible for architecting and building data pipelines that support ETL processes in cloud platforms such as AWS, GCP, or Azure.Key Responsibilities:Data Pipeline Architecture: Design and build...

  • Data Engineering Lead

    2 weeks ago


    San Jose, California, United States Tik Tok Full time

    As a key member of the TikTok Ads Creative & Ecosystem team, you will play a critical role in solving the dilemma of creating effective yet difficult-to-produce ads creative experiences at scale. With your expertise in software engineering, you will help build industry-leading tech solutions for ads creative/landing page understanding, production/generation,...


  • San Jose, California, United States Tik Tok Full time

    Are you passionate about building scalable and efficient data systems? Do you want to make a meaningful impact on a global platform? As a Real-Time Data Engineering Lead at TikTok, you will design and develop high-performance data pipelines that drive real-time insights and inform business decisions.ResponsibilitiesDevelop and optimize TikTok's commercial...


  • San Bruno, California, United States Tredence Full time

    About the Company:Tredence is a global analytics services and solutions company that has been recognized as one of the fastest-growing private companies in the country for three consecutive years. Our unique selling proposition lies in our ability to build scalable big data solutions on-premises, GCP, or Azure clouds at a very cost-effective and easily...


  • San Jose, California, United States SAMSUNG SDS Full time

    Job OverviewWe are seeking a seasoned senior software architect with at least 8 years of experience in designing and implementing scalable, distributed systems to join the Data Analytics Team at Samsung SDS. The ideal candidate will have a strong background in data analytics platform design and architecture, as well as expertise in big data technologies such...


  • San Jose, California, United States Tik Tok Full time

    About the RoleStreaming Data Engineer, Large-Scale Systems is a critical position in our ad data platform team. You will work closely with product managers and data analysts to build state-of-the-art streaming and batch data processing solutions. The entire data pipeline supports both the TikTok ads platform and our internal business intelligence...


  • San Jose, California, United States Tik Tok Full time

    About the TeamThe Ads Measurement Signal team is responsible for developing advertiser-facing product solutions that ensure successful signal lifecycle and build our signal infrastructure. We are looking for a highly skilled Senior Software Engineer to join our team and contribute to our mission.As a Senior Software Engineer on this team, you will be...


  • San Jose, California, United States McAfee Full time

    **Job Title:** Cloud Architect for Scalable Solutions**About the Role:** We seek a highly skilled and experienced senior cloud architect to join our dynamic team. As a cloud architect, you will design, implement, and manage scalable, secure, and cost-effective cloud solutions using Amazon Web Services (AWS).**Key Responsibilities:** Design and architect...

  • Tech Lead

    4 weeks ago


    San Francisco, California, United States Voltage Park Inc. Full time

    Unlock the Future of Machine LearningVoltage Park Inc. is revolutionizing the world of artificial intelligence by making machine learning infrastructure accessible to all.We operate a massive fleet of 24,000 fully-owned NVIDIA GPUs across four top-tier data centers, offering transparent, market-based pricing and long-term reserve contracts for our...


  • San Francisco, California, United States Omni Inclusive Full time

    Job Description:We are seeking a highly skilled Big Data Engineer III - Scalable Systems to join our team. The ideal candidate will have a strong background in Java, Hadoop, and Kafka, and experience in designing and developing scalable systems for big data processing.The role will involve working closely with our technology team to create effective...