Tech Lead for Scalable Data Streaming Solutions
5 days ago
About This Role
We're seeking a skilled Tech Lead to spearhead our efforts in developing cutting-edge data streaming solutions at Canonical. As part of our engineering team, you'll be responsible for architecting scalable service APIs and designing robust data governance systems within our telemetry platform.
Key Responsibilities
- Collaborate with a globally distributed team to develop data streaming capabilities using Python and Golang.
- Develop data management and auditing systems within our telemetry platform.
- Work with our infrastructure team to create a cloud-based SaaS offering and containerised on-prem solution.
- Design and implement new features and enhancements from spec to production and ongoing operations at scale.
- Review code and technical designs produced by other engineers.
Requirements
- You have a broad technology base but favour backend code and infrastructure.
- You have a good understanding of cybersecurity and the challenges of the IoT environment when it comes to connectivity and data streaming.
- You have knowledge and experience of telemetry and connectivity systems and platforms including data streaming technologies (MQTT, Kafka, RabbitMQ), observability (OpenTelemetry), industrial/engineering data exchange protocols (OPC-UA, ModBus), and the application of data governance/IAM models to such systems.
- You have proficiency in the design and implementation of back-end web services, messaging/data pipelines, and REST APIs using Python and/or Golang.
- You are familiar with Ubuntu as a development and deployment platform.
- You have a Bachelor's or equivalent in Computer Science, STEM or similar degree.
About Us
Canonical is a growing international software company that works with the open-source community to deliver Ubuntu, the world's best free software platform. Our services help businesses worldwide reduce costs, improve efficiency and enhance security with Ubuntu.
What We Offer
- Competitive salary range: $120,000 - $180,000 per annum.
- Learning and development allowances.
- Generous annual leave.
- Paid maternity, paternity and sick leave.
- Priority Pass for travel.
-
Big Data Streaming Solutions Developer
7 days ago
San Jose, California, United States Tik Tok Full timeTikTok is seeking a highly skilled Big Data Streaming Solutions Developer to join its team. In this role, you will design and develop scalable and efficient data processing systems that enable real-time analytics and drive business growth.RequirementsDeep understanding of computer principles, data structures, and algorithmsExperience with streaming computing...
-
Enterprise Data Architect Lead
2 weeks ago
San Jose, California, United States Braintree Full timeCompany OverviewBraintree, a PayPal company, has been revolutionizing commerce for over two decades. Our mission is to empower businesses and consumers globally through innovative payment solutions.We operate a robust, two-sided network that connects merchants and consumers worldwide. Our platform enables secure, seamless transactions, whether online or...
-
AWS Streaming Data Solutions Architect
4 weeks ago
San Francisco, California, United States Amazon Full timeAbout the RoleWe are seeking a highly skilled AWS Streaming Data Solutions Architect to join our team. As a key member of our Worldwide Specialist Organization (WWSO), you will work closely with customers to architect and implement scalable, flexible, and resilient technical solutions using Amazon Web Services (AWS) managed services such as Managed Streaming...
-
Lead Developer of Scalable Ads Solutions
7 days ago
San Jose, California, United States HireIO Inc Full timeAbout the Job:HireIO Inc is seeking a talented Tech Lead Machine Learning Engineer to join our Brand Ads team. This role offers the opportunity to lead the development of new monetization products, working on everything from ads ranking to forecasting and bidding algorithms.Key Responsibilities:Lead the development of innovative ad products to drive user...
-
Data Science and Engineering Lead
3 weeks ago
San Jose, California, United States Glint Tech Solutions LLC Full timeAbout UsGlint Tech Solutions LLC develops cutting-edge technologies to empower businesses worldwide. Our team specializes in building high-performance ad systems, focusing on scalability, reliability, and user engagement.
-
Streaming Data Solutions Architect
4 weeks ago
San Francisco, California, United States Amazon Full timeAbout the RoleAmazon Web Services (AWS) is seeking a highly skilled Streaming Data Solutions Architect to join our team. As a Specialist Solutions Architect, you will be responsible for helping customers leverage AWS managed services such as Managed Streaming for Apache Kafka (MSK), Amazon Kinesis Data Streams, Amazon Data Firehose, and Amazon Managed...
-
San Jose, California, United States Unreal Gigs Full timeAt Unreal Gigs, we're at the forefront of artificial intelligence research and development. Our mission is to develop AI technologies that benefit humanity, tackling some of the most challenging problems across various domains.About the RoleWe're seeking a Senior Full-Stack Engineer to join our team as an AI Engineering Innovator. This role combines creative...
-
Senior Data Scientist
2 days ago
San Jose, California, United States Tik Tok Full timeJob OverviewTikTok is a leading destination for short-form mobile video. Our mission is to inspire creativity and bring joy. We have global offices in Los Angeles, New York, London, Paris, Berlin, Dubai, Singapore, Jakarta, Seoul, and Tokyo.We are the Generative AI team under Monetization Technology. Our team focuses on developing cutting-edge Generative AI...
-
Data Engineer: Scalable Solutions
1 week ago
San Francisco, California, United States Akraya Full timeCompany OverviewAkraya is a leading IT staffing firm recognized for its commitment to excellence and a thriving work environment. As a seasoned Data Engineer, you will play a pivotal role in developing high-scalable web and cloud solutions, focusing on data warehousing, analytics, and database management to support our marketing strategies.">Salary and...
-
San Francisco, California, United States Rackspace, Inc. Full timeAbout the Role:Rackspace Technology is seeking a highly skilled Senior Streaming Engineer to join our dynamic team. The ideal candidate will have a strong background in Java, developing and scaling both stream and batch processing systems, and a solid understanding of public cloud technologies, especially GCP.This role involves working in a remote...
-
Data Architect for Scalable Cloud Solutions
4 weeks ago
San Francisco, California, United States Unreal Gigs Full timeWe are seeking a seasoned Data Architect to lead the design and implementation of scalable cloud-based data solutions at Unreal Gigs. In this role, you will be responsible for architecting and building data pipelines that support ETL processes in cloud platforms such as AWS, GCP, or Azure.Key Responsibilities:Data Pipeline Architecture: Design and build...
-
Data Engineering Lead
2 weeks ago
San Jose, California, United States Tik Tok Full timeAs a key member of the TikTok Ads Creative & Ecosystem team, you will play a critical role in solving the dilemma of creating effective yet difficult-to-produce ads creative experiences at scale. With your expertise in software engineering, you will help build industry-leading tech solutions for ads creative/landing page understanding, production/generation,...
-
Real-Time Data Engineering Lead
7 days ago
San Jose, California, United States Tik Tok Full timeAre you passionate about building scalable and efficient data systems? Do you want to make a meaningful impact on a global platform? As a Real-Time Data Engineering Lead at TikTok, you will design and develop high-performance data pipelines that drive real-time insights and inform business decisions.ResponsibilitiesDevelop and optimize TikTok's commercial...
-
Big Data Solutions Engineer
1 week ago
San Bruno, California, United States Tredence Full timeAbout the Company:Tredence is a global analytics services and solutions company that has been recognized as one of the fastest-growing private companies in the country for three consecutive years. Our unique selling proposition lies in our ability to build scalable big data solutions on-premises, GCP, or Azure clouds at a very cost-effective and easily...
-
San Jose, California, United States SAMSUNG SDS Full timeJob OverviewWe are seeking a seasoned senior software architect with at least 8 years of experience in designing and implementing scalable, distributed systems to join the Data Analytics Team at Samsung SDS. The ideal candidate will have a strong background in data analytics platform design and architecture, as well as expertise in big data technologies such...
-
Streaming Data Engineer, Large-Scale Systems
1 week ago
San Jose, California, United States Tik Tok Full timeAbout the RoleStreaming Data Engineer, Large-Scale Systems is a critical position in our ad data platform team. You will work closely with product managers and data analysts to build state-of-the-art streaming and batch data processing solutions. The entire data pipeline supports both the TikTok ads platform and our internal business intelligence...
-
Tech Lead for Data Signal Infrastructure
7 days ago
San Jose, California, United States Tik Tok Full timeAbout the TeamThe Ads Measurement Signal team is responsible for developing advertiser-facing product solutions that ensure successful signal lifecycle and build our signal infrastructure. We are looking for a highly skilled Senior Software Engineer to join our team and contribute to our mission.As a Senior Software Engineer on this team, you will be...
-
Cloud Architect for Scalable Solutions
4 weeks ago
San Jose, California, United States McAfee Full time**Job Title:** Cloud Architect for Scalable Solutions**About the Role:** We seek a highly skilled and experienced senior cloud architect to join our dynamic team. As a cloud architect, you will design, implement, and manage scalable, secure, and cost-effective cloud solutions using Amazon Web Services (AWS).**Key Responsibilities:** Design and architect...
-
Tech Lead
4 weeks ago
San Francisco, California, United States Voltage Park Inc. Full timeUnlock the Future of Machine LearningVoltage Park Inc. is revolutionizing the world of artificial intelligence by making machine learning infrastructure accessible to all.We operate a massive fleet of 24,000 fully-owned NVIDIA GPUs across four top-tier data centers, offering transparent, market-based pricing and long-term reserve contracts for our...
-
Big Data Engineer III
1 week ago
San Francisco, California, United States Omni Inclusive Full timeJob Description:We are seeking a highly skilled Big Data Engineer III - Scalable Systems to join our team. The ideal candidate will have a strong background in Java, Hadoop, and Kafka, and experience in designing and developing scalable systems for big data processing.The role will involve working closely with our technology team to create effective...