Highly Skilled Cloud Data Engineer

3 days ago


San Francisco, California, United States SherlockTalent Full time

At SherlockTalent, we are seeking an experienced AI DevOps Data Ingestion Engineer to design and develop scalable data ingestion pipelines that collect and process data from diverse sources.

Key Responsibilities
  • We are looking for a talented professional who can automate infrastructure provisioning and pipeline deployments using Infrastructure as Code (IaC) tools like Terraform, Ansible, or CloudFormation.
  • The ideal candidate will implement and manage CI/CD pipelines to support the deployment and monitoring of data systems.
  • They will collaborate with data scientists and analysts to ensure data integrity, normalization, and transformation meet analytics needs.
  • Our team requires someone who can optimize data ingestion workflows for performance, scalability, and reliability in cloud environments like AWS, GCP, or Azure.
  • We need a skilled engineer who can monitor data pipelines, troubleshoot issues, and maintain high availability and fault tolerance across systems.
  • The selected candidate will ensure security and compliance for data systems by implementing best practices for access control, encryption, and monitoring.
Required Skills and Qualifications
  • A strong experience with cloud platforms (AWS, GCP, Azure) and associated data services (e.g., S3, BigQuery, Redshift, or similar).
  • Expertise in building data ingestion pipelines using tools like Apache Kafka, Apache NiFi, or AWS Glue.
  • Hands-on experience with CI/CD tools such as Jenkins, GitLab CI/CD, or GitHub Actions.
  • Proficiency in scripting and programming languages such as Python, Bash, or Go for automation.
  • Familiarity with containerization and orchestration tools like Docker and Kubernetes.
  • Strong knowledge of database systems (SQL and NoSQL) and data transformation techniques.
  • Solid understanding of monitoring and logging tools such as Prometheus, Grafana, or ELK stack.
About Our Offer

We offer a competitive salary range of $200,000+ per year, along with founders-level equity. The location of this role is the Bay Area, CA. We thrive on innovation, collaboration, and delivering excellence. If you're passionate about designing scalable data pipelines and ensuring robust infrastructure for seamless data flow, we encourage you to apply.


  • Cloud Data Engineer

    1 week ago


    San Francisco, California, United States eTeam Inc. Full time

    eTeam Inc. is seeking a highly skilled Cloud Data Engineer to join our team. As a key member of our cloud data engineering team, you will be responsible for designing, developing, and managing large-scale data pipelines and workflows using Trino SQL/Spark SQL warehoused in HDFS datasets in a cloud environment.We offer a competitive salary of $110,000 -...


  • San Francisco, California, United States Diverse Lynx Full time

    About the Role:We are looking for a highly motivated and experienced Cloud Data Engineering Specialist to join our team at Diverse Lynx LLC. As a key member of our cloud engineering team, you will be responsible for designing, building, and maintaining scalable and efficient cloud-based data platforms using various cloud data engineering technologies such as...


  • San Francisco, California, United States Unity Full time

    Welcome to Unity, the world's leading platform of tools for creators to build and grow real-time games, apps, and experiences across multiple platforms. As a highly skilled data and machine learning (ML) infrastructure engineer, you will play a crucial role in designing and optimizing large-scale data platforms and ML infrastructure systems for efficiency,...


  • San Francisco, California, United States Instacart Full time

    Instacart is looking for an experienced Senior Software Engineer to join our infrastructure team. With a focus on scalability, reliability, and innovation, this role will play a crucial part in shaping our cloud infrastructure.About the RoleWe are seeking a talented engineer with a strong background in cloud computing and infrastructure management. The ideal...

  • Cloud Data Engineer

    1 week ago


    San Francisco, California, United States Syntricate Technologies Full time

    Job Title: Cloud Data EngineerAbout Syntricate TechnologiesWe are a rapidly growing company that specializes in data solutions, and we're looking for a skilled Cloud Data Engineer to join our team. As a Cloud Data Engineer, you will play a key role in designing and implementing data architectures on the cloud using Snowflake. You'll work closely with our...


  • San Francisco, California, United States ZipRecruiter Full time

    At ZipRecruiter, we are seeking a highly skilled Data Engineer for Cloud Data Platforms to join our team. This role will be responsible for designing and building scalable data pipelines that support ETL processes in cloud platforms such as AWS, GCP, or Azure.With a strong background in cloud data engineering and experience with data pipeline orchestration...


  • San Francisco, California, United States Amplitude Full time

    Unlock the Power of Real-Time AnalyticsAt Amplitude, we are seeking a highly skilled Senior Cloud Data Engineer to join our team and help drive innovation in the field of digital analytics. Our company is a leading provider of product analytics solutions, trusted by over 3,200 customers worldwide, including household names such as Atlassian, Jersey...


  • San Francisco, California, United States Early Warning Services LLC Full time

    Early Warning Services LLC is a leading provider of cutting-edge solutions for the U.S. financial system, empowering institutions to increase access to financial services and protect transactions for millions of consumers and small businesses.The company's hybrid work model allows for a collaborative working environment, with positions located in Scottsdale,...

  • Data Engineer

    1 week ago


    San Francisco, California, United States MongoDB Full time

    MongoDB empowers innovators to create, transform, and disrupt industries by unleashing the power of software and data. Our industry-leading developer data platform, MongoDB Atlas, is a globally distributed, multi-cloud database available in over 115 regions across AWS, Google Cloud, and Microsoft Azure. We enable organizations of all sizes to easily build,...

  • Cloud Data Engineer

    1 week ago


    San Francisco, California, United States Parabola Full time

    Company OverviewAt Parabola, we're revolutionizing the way businesses manage their data. Our unique flow-based calculation engine enables high-throughput and availability, making us a leader in the industry. We're proud to serve companies like Flexport, Sonos, Uber Freight, Brooklinen, and Chubbies, and backed by top investors such as OpenView Partners,...

  • Data Cloud Engineer

    1 week ago


    San Diego, California, United States Apple Full time

    About the RoleWe're looking for a highly motivated Software Engineer to join our Data Cloud team and contribute to the development of our analytics platform. As a Senior Software Engineer, you'll work closely with cross-functional teams to design and implement scalable data systems and cloud services that drive business value.ResponsibilitiesDesign and...


  • San Francisco, California, United States Cisco Systems, Inc. Full time

    Cloud Engineer for Highly Available FedRAMP EnvironmentWe are seeking a highly skilled Cloud Engineer to join our team and work on designing, implementing, and managing FedRAMP-compliant infrastructure and systems.As a Cloud Engineer, you will be responsible for ensuring the reliability, performance, and security of our infrastructure, working closely with...


  • San Francisco, California, United States Instrinsic Full time

    Intrinsic is at the forefront of harnessing innovative technologies to address some of the digital age's most complex problems. As a Senior Data Engineer, you'll have the opportunity to contribute to the development of our data platform, which enables Trust & Safety teams to focus on high-priority tasks and safeguard their communities from abuse.You'll be...


  • San Francisco, California, United States Tbwa ChiatDay Inc Full time

    About the Role:We are seeking an experienced Cloud Data Analytics Engineer to join our team. As a key member of our engineering group, you will be responsible for designing and building scalable data analytics solutions using cloud-based technologies.The ideal candidate will have a strong background in computer science, experience with cloud platforms such...


  • San Diego, California, United States Sapient Logic Full time

    About the RoleWe are seeking a highly skilled Cloud Platform Engineer to join our team at Sapient Logic. As a key member of our cloud engineering team, you will play a critical role in designing, implementing, and maintaining scalable, secure, and efficient cloud-based platforms.Key Responsibilities:Design and implement cloud infrastructure using...


  • San Francisco, California, United States Eventual Computing Full time

    We are looking for a skilled Cloud and Big Data Engineer to join our team at Eventual Computing. You will be working on core features of our open-sourced data engine Daft across the entire stack from the Daft frontend API and dashboard to its distributed scheduler and low-level Rust execution engine.Your responsibilities will include tinkering with...


  • San Francisco, California, United States Unreal Gigs Full time

    Are you a cloud data expert looking for a new challenge? We're seeking a skilled Cloud Data Solutions Architect to join our team at Unreal Gigs. In this role, you'll have the opportunity to design and develop scalable cloud-based data infrastructures that support business growth and innovation.About the Role:We're looking for a highly motivated and...

  • Cloud Engineer

    1 week ago


    San Francisco, California, United States WEX Full time

    Your Role at WEXWe're seeking a skilled Cloud Engineer to join our Data, AI, and Risk Technology (DART) organization. As a key member of this dynamic team, you'll harness the power of cloud technologies to deliver scalable, secure, and user-friendly platforms and tools for data, AI, and risk applications.


  • San Francisco, California, United States Spellbrush Full time

    At Spellbrush, we're on a mission to revolutionize the anime game industry by leveraging cutting-edge technology. As a highly skilled data engineer, you'll play a crucial role in building and maintaining our advanced data pipelines.About the RoleWe're seeking a talented generalist engineer who can work closely with our world-class AI researchers to design,...


  • San Francisco, California, United States SS&C Technologies Full time

    SS&C Technologies is a leading global provider of investment and financial services and software for the financial services and healthcare industries. With a strong presence in over 90 offices in 35 countries, our company has been named to the Fortune 1000 list as a top U.S. company based on revenue. As a Senior Data Engineer at SS&C, you will be part of a...