Senior Data Pipeline Engineer
4 weeks ago
We are seeking a highly skilled Data Pipeline Engineer to join our team at CyberTec. As a key member of our engineering team, you will be responsible for designing and developing business-critical data pipelines using Kafka, DynamoDB, and related AWS technologies.
Key Responsibilities- Collaborate with engineers to understand business requirements for data pipelines, data enrichments, and aggregations needed to implement business features.
- Work with data source teams to identify data ingestion use cases, schema details, data validation requirements, and the types of data source connectors needed to ingest data.
- Understand how datastores are used by Web Service APIs and work with consumer API developers to provide details of the data sources to be used.
- Troubleshoot and fix issues in the data flows and communicate the details with stakeholders.
More than 7 years of experience in owning the design and development activities of business-critical data pipelines using Kafka, DynamoDB, OpenSearch, NoSQL databases, and related AWS technologies.
Experience in collaborating with engineers to understand business requirements for data pipelines, data enrichments, and aggregations needed to implement business features.
Experience in working with data source teams to identify the data ingestion use cases, schema details, data validation requirements, and the types of data source connectors needed to ingest data.
Experience in understanding how the datastores are used by Web Service APIs and working with consumer API developers to provide details of the data sources to be used.
Experience in troubleshooting and fixing issues in the data flows and communicating the details with stakeholders.
-
Senior Data Engineer
2 weeks ago
San Francisco, California, United States Discord Full timeWe are seeking a highly skilled Senior Data Engineer to join our Data team at Discord. As a Senior Data Engineer, you will collaborate with data science and engineering teams to build and support foundational high-leverage data sets that power tools, analyses, and models.The data sets built by our team directly inform how we identify opportunities, measure...
-
Senior Data Pipeline Engineer
3 weeks ago
San Francisco, California, United States CyberTec Full timeAbout the RoleCyberTec is seeking a highly skilled Data Pipeline Engineer to join our team. As a key member of our engineering team, you will be responsible for designing and developing business-critical data pipelines using Kafka, DynamoDB, and related AWS technologies.Key ResponsibilitiesCollaborate with engineers to understand business requirements for...
-
Senior Data Pipeline Architect
2 weeks ago
San Francisco, California, United States Unreal Gigs Full timeJob Title: Senior Data Pipeline DeveloperAt Unreal Gigs, we're committed to building cutting-edge data pipeline solutions that enable efficient data ingestion, processing, and delivery. We're seeking a seasoned Senior Data Pipeline Developer to join our dynamic team and play a critical role in designing, building, and optimizing our data pipeline...
-
Senior Data Engineer
2 weeks ago
San Francisco, California, United States Discord Full timeJob DescriptionWe are seeking an experienced Senior Data Engineer to join our Data team at Discord. As a Senior Data Engineer, you will collaborate with data science and engineering teams to build and support foundational high-leverage data sets that power tools, analyses, and models.The data sets built by our team directly inform how we identify...
-
Senior Data Pipeline Developer
1 week ago
San Francisco, California, United States CyberTec Full timeJob Summary:As a Senior Data Pipeline Developer at CyberTec, you will be responsible for designing and developing business-critical data pipelines using Kafka, DynamoDB, and related AWS technologies. With over 7 years of experience in this field, you will collaborate with engineers to understand business requirements for data pipelines, data enrichments, and...
-
Senior Data Pipeline Architect
2 weeks ago
San Francisco, California, United States Unreal Gigs Full timeCompany Overview:Welcome to Unreal Gigs, a pioneering company at the forefront of data-driven innovation. Our mission is to harness the power of data to drive transformative change and solve complex problems across industries.We're committed to building cutting-edge data pipeline solutions that enable efficient data ingestion, processing, and delivery. Our...
-
Senior Data Engineer
2 weeks ago
South San Francisco, California, United States Mytra Full timeAbout MytraWe're revolutionizing the way industries move and store materials by applying robotics and distributed software to create innovative products for the $1T market. Our focus is on the supply chain industry, which is facing significant challenges due to e-commerce growth, rising costs, and supply chain disruptions.Role OverviewMytra's software team...
-
Senior Data Engineer
4 weeks ago
San Francisco, California, United States Apex Systems, Inc. Full timeJob Title: Senior Data EngineerWe are seeking a highly skilled Senior Data Engineer to join our team at Apex Systems, Inc. As a Senior Data Engineer, you will be responsible for designing, developing, and maintaining large-scale data systems and pipelines.Key Responsibilities:Lead the development of data pipelines for machine learning use casesDesign and...
-
Senior Data Engineer
2 weeks ago
San Francisco, California, United States Syntricate Technologies Full timeJob Title: Senior Data EngineerAbout the Role:We are seeking a highly skilled Senior Data Engineer to join our team at Syntricate Technologies. As a Senior Data Engineer, you will be responsible for designing, implementing, and maintaining large-scale data pipelines using SQL and Snowflake. You will work closely with our data team to ensure the smooth...
-
Data Engineer
2 weeks ago
San Francisco, California, United States Figma Full timeJoin Figma's Data Engineering TeamFigma is a leading design and development platform that empowers teams to create innovative products. We're seeking an experienced Data Engineer to join our team and help us scale our data pipelines.As a Data Engineer at Figma, you'll be responsible for designing, building, and maintaining scalable data pipelines that...
-
Data Engineer
1 week ago
San Francisco, California, United States Factory Full timeJob Description:Factory is seeking a highly skilled Data Engineer to join our team. As a Data Engineer, you will be responsible for designing, building, and maintaining optimal data pipelines that support a variety of data consumers.Key Responsibilities:Design and implement robust data warehousing solutions to ensure secure and efficient data storage and...
-
Senior Data Engineer
2 weeks ago
San Francisco, California, United States Unreal Gigs Full timeJob OverviewUnreal Gigs is seeking a highly skilled Senior Data Engineer to join our team. As a key member of our data engineering team, you will be responsible for designing, building, and maintaining our data infrastructure and pipelines.Key Responsibilities:Design and implement scalable and efficient data pipelines for ingesting, processing, and...
-
Data Engineer
2 weeks ago
San Francisco, California, United States Factory Full timeFactory is seeking a highly skilled Data Engineer to design, build, and maintain optimal data pipelines that support various data consumers. This role requires collaboration with software engineers, AI researchers, and business stakeholders to deliver scalable data solutions.Key Responsibilities:Design and implement robust data warehousing solutions for...
-
Senior Data Engineer
2 weeks ago
San Francisco, California, United States Gridware Full timeJob Title: Senior Data EngineerGridware is a leading provider of advanced sensing systems for the electrical grid. Our team is responsible for designing, building, and optimizing data pipelines and infrastructure to support real-time grid monitoring systems.The Senior Data Engineer will be responsible for handling large-scale sensor data, ensuring data...
-
Senior Data Engineer
2 weeks ago
San Francisco, California, United States Archipelago Analytics Full timeArchipelago Analytics: Transforming Commercial Property InsuranceWelcome to Archipelago Analytics, where we're revolutionizing the commercial property insurance industry with our cutting-edge AI-powered data network.We're seeking a highly skilled Senior Data Engineer to join our team and help us take our document processing pipeline to the next level.As a...
-
Senior Data Engineer
2 weeks ago
San Francisco, California, United States Unreal Gigs Full timeUnreal Gigs is seeking a highly skilled Senior Data Engineer to join our team. As a key member of our data engineering team, you will be responsible for designing, building, and maintaining our data infrastructure and pipelines.Key Responsibilities:* Design and implement scalable and efficient data pipelines for ingesting, processing, and transforming large...
-
Data Engineer
1 week ago
San Francisco, California, United States Figma Full timeAbout the RoleFigma is seeking an experienced Data Engineer to partner with our Data Science and Data Infrastructure teams to own and scale our data pipelines. As a Data Engineer at Figma, you will play a critical role in building the metrics and self-serve reporting capabilities to unlock Figma's next phase of growth.Key Responsibilities- Own, build, and...
-
Senior Data Engineer
2 weeks ago
San Francisco, California, United States Crunchyroll Full timeAbout the RoleCrunchyroll is growing and changing, presenting unique challenges and opportunities to support millions of anime fans around the world. The Data Engineering team provides seamless help to our internal stakeholders, ensuring an exceptional experience for all Crunchyroll fans.As a Senior Data Engineer, you will play a pivotal role in designing,...
-
Senior Data Engineer
2 weeks ago
San Diego, California, United States CoStar Realty Information, Inc. Full timeJob DescriptionWe are seeking a highly skilled Senior Data Engineer to join our team at CoStar Realty Information, Inc. This is a unique opportunity to work on cloud-based data pipelines for machine learning, data processing with Apache Spark, and database development.ResponsibilitiesDesigning, building, testing, and deploying scalable, reusable, and...
-
Senior Data Engineer II
2 weeks ago
San Francisco, California, United States Cruise Full timeAbout the RoleWe're seeking a highly skilled Senior Data Engineer to join our team at Cruise, a self-driving service designed for the cities we love. As a Senior Data Engineer, you will be responsible for architecting and automating end-to-end data processing and data management lifecycle on Google Cloud Platform (GCP).You will collaborate with...