Senior Cloud Data Engineer

3 weeks ago


San Francisco, United States Unreal Gigs Full time

Company Overview: Welcome to the forefront of data-driven innovation Our company is dedicated to harnessing the power of data to drive transformative change and solve complex problems across industries. We're committed to building cutting-edge cloud data solutions that leverage the scalability, flexibility, and power of cloud platforms. Join us and be part of a dynamic team shaping the future of cloud data engineering.

Position Overview: As a Senior Cloud Data Engineer, you'll play a crucial role in designing, building, and optimizing our cloud data solutions. You'll work on challenging projects, from data ingestion and storage to processing and analysis, to support the needs of our data-driven organization. If you're a seasoned engineer with expertise in cloud data technologies and a passion for building scalable and reliable data systems, we want you on our team.

Requirements

Key Responsibilities:

  1. Cloud Data Architecture: Design and implement cloud data architectures on platforms such as AWS, Azure, or Google Cloud Platform (GCP), leveraging cloud-native services to build scalable, reliable, and cost-effective data solutions.
  2. Data Ingestion: Develop and maintain data ingestion pipelines to collect data from various sources, including databases, APIs, files, and streaming sources, ensuring efficient and reliable data ingestion into cloud storage.
  3. Data Storage: Design and implement data storage solutions using cloud-native storage services such as Amazon S3, Azure Data Lake Storage, or Google Cloud Storage, optimizing data storage for performance, cost, and scalability.
  4. Data Processing: Develop and maintain data processing pipelines using cloud-native data processing frameworks such as Apache Spark, Apache Flink, or Google Dataflow, enabling real-time and batch data processing and analysis.
  5. Data Integration: Integrate data from diverse sources and systems into cloud data solutions, ensuring seamless data flow and interoperability across different data sources and formats.
  6. Data Governance: Implement data governance policies and procedures to ensure data quality, security, and compliance with regulatory requirements in cloud data environments.
  7. Performance Optimization: Optimize data pipelines and processing workflows for performance and scalability, leveraging cloud-native features and techniques to maximize efficiency and minimize costs.
  8. Monitoring and Alerting: Implement monitoring and alerting solutions to track data pipeline performance and health, proactively identifying and resolving issues to minimize downtime and data loss.
  9. Documentation and Best Practices: Document cloud data architectures, pipelines, and best practices, providing clear and comprehensive documentation to facilitate understanding and collaboration among team members.
  10. Collaboration: Collaborate with cross-functional teams, including data engineers, data scientists, and business analysts, to understand requirements and deliver cloud data solutions that meet business needs.
  11. Mentorship and Development: Mentor junior engineers, sharing expertise and best practices in cloud data engineering, and facilitate knowledge sharing sessions within the team.

Qualifications:

  • Bachelor's degree or higher in Computer Science, Engineering, Mathematics, or related field.
  • 5+ years of experience in data engineering, with a focus on cloud data technologies.
  • Proficiency in cloud platforms such as AWS, Azure, or GCP, and services like Amazon S3, Azure Data Lake Storage, or Google Cloud Storage.
  • Strong programming skills in languages such as Python, Java, or Scala, with experience in data processing frameworks like Apache Spark or Apache Flink.
  • Experience with cloud-native data processing services such as AWS Glue, Azure Data Factory, or Google Dataflow.
  • Strong understanding of data integration concepts and techniques, with experience integrating data from diverse sources and systems in cloud environments.
  • Strong problem-solving skills and analytical thinking, with the ability to design and troubleshoot complex cloud data solutions.
  • Excellent communication and collaboration skills, with the ability to work effectively in cross-functional teams and communicate technical concepts to non-technical stakeholders.

Benefits

  • Competitive salary: The industry standard salary for Senior Cloud Data Engineers typically ranges from $170,000 to $230,000 per year, depending on experience and qualifications.
  • Comprehensive health, dental, and vision insurance plans.
  • Flexible work hours and remote work options.
  • Generous vacation and paid time off.
  • Professional development opportunities, including access to training programs, conferences, and workshops.
  • State-of-the-art technology environment with access to cutting-edge tools and resources.
  • Vibrant and inclusive company culture with opportunities for growth and advancement.
  • Exciting projects with real-world impact at the forefront of data-driven innovation.

Join Us: Ready to shape the future of cloud data engineering? Apply now to join our team and be part of the data revolution



  • San Francisco, United States Unreal Gigs Full time

    Job DescriptionJob DescriptionCompany Overview: Welcome to the forefront of data-driven innovation! Our company is dedicated to harnessing the power of data to drive transformative change and solve complex problems across industries. We're committed to building cutting-edge cloud data solutions that leverage the scalability, flexibility, and power of...


  • San Francisco, United States Unreal Gigs Full time

    Job DescriptionJob DescriptionCompany Overview: Welcome to the forefront of data-driven innovation! Our company is dedicated to harnessing the power of data to drive transformative change and solve complex problems across industries. We're committed to building cutting-edge cloud data solutions that leverage the scalability, flexibility, and power of...


  • San Diego, United States Kforce Full time

    RESPONSIBILITIES: Kforce has a client in San Diego, CA that is seeking a Senior Cloud Data Engineer to be Hybrid - 3 days onsite in La Jolla, CA area. Responsibilities and Duties: * Senior Data Cloud Engineer will create data systems used in the company's products * Working closely with a diverse group of hardware & software engineers, systems engineers, and...


  • San Diego, United States Kforce Full time

    RESPONSIBILITIES: Kforce has a client in San Diego, CA that is seeking a Senior Cloud Data Engineer to be Hybrid - 3 days onsite in La Jolla, CA area. Responsibilities and Duties: * Senior Data Cloud Engineer will create data systems used in the company's products * Working closely with a diverse group of hardware & software engineers, systems engineers,...


  • San Diego, United States Kforce Full time

    RESPONSIBILITIES: Kforce has a client in San Diego, CA that is seeking a Senior Cloud Data Engineer to be Hybrid - 3 days onsite in La Jolla, CA area. Responsibilities and Duties: * Senior Data Cloud Engineer will create data systems used in the company's products * Working closely with a diverse group of hardware & software engineers, systems engineers, and...

  • Cloud Data Engineer

    3 weeks ago


    San Francisco, United States Unreal Gigs Full time

    Company Overview: Welcome to the forefront of cloud data engineering! At our company, we're dedicated to leveraging the power of cloud technology to drive data-driven innovation. Our mission is to develop scalable and robust cloud data solutions that enable organizations to harness the full potential of their data. Join us and be part of a dynamic team...

  • Cloud Data Engineer

    4 weeks ago


    San Francisco, United States Unreal Gigs Full time

    Job DescriptionJob DescriptionCompany Overview: Welcome to the forefront of cloud data engineering! At our company, we're dedicated to leveraging the power of cloud technology to drive data-driven innovation. Our mission is to develop scalable and robust cloud data solutions that enable organizations to harness the full potential of their data. Join us...

  • Cloud Data Engineer

    4 days ago


    San Francisco, United States Unreal Gigs Full time

    Company Overview: Welcome to the forefront of cloud data engineering! At our company, we're dedicated to leveraging the power of cloud technology to drive data-driven innovation. Our mission is to develop scalable and robust cloud data solutions that enable organizations to harness the full potential of their data. Join us and be part of a dynamic team...

  • Cloud Data Engineer

    1 week ago


    San Francisco, United States Unreal Gigs Full time

    Job DescriptionJob DescriptionCompany Overview: Welcome to the forefront of cloud data engineering! At our company, we're dedicated to leveraging the power of cloud technology to drive data-driven innovation. Our mission is to develop scalable and robust cloud data solutions that enable organizations to harness the full potential of their data. Join us...


  • San Francisco, United States Unreal Gigs Full time

    Job DescriptionJob DescriptionCompany Overview: Welcome to the forefront of data-driven innovation! Our company is a trailblazer in leveraging the power of data to drive transformative change and solve complex problems across industries. We're committed to building cutting-edge cloud data solutions that harness the scalability, flexibility, and power of...


  • San Francisco, United States Unreal Gigs Full time

    Job DescriptionJob DescriptionCompany Overview: Welcome to the forefront of data-driven innovation! Our company is a trailblazer in leveraging the power of data to drive transformative change and solve complex problems across industries. We're committed to building cutting-edge cloud data solutions that harness the scalability, flexibility, and power of...


  • San Francisco, United States Unreal Gigs Full time

    Company Overview: Welcome to the forefront of data-driven innovation! Our company is a trailblazer in leveraging the power of data to drive transformative change and solve complex problems across industries. We're committed to building cutting-edge cloud data solutions that harness the scalability, flexibility, and power of cloud platforms. Join us and lead...


  • San Francisco, United States Unreal Gigs Full time

    Company Overview: Welcome to the forefront of data-driven innovation! Our company is a trailblazer in leveraging the power of data to drive transformative change and solve complex problems across industries. We're committed to building cutting-edge cloud data solutions that harness the scalability, flexibility, and power of cloud platforms. Join us and lead...


  • San Francisco, United States Unreal Gigs Full time

    Job DescriptionJob DescriptionCompany Overview: Welcome to the forefront of data-driven innovation! Our company is a trailblazer in leveraging the power of data to drive transformative change and solve complex problems across industries. We're committed to building cutting-edge cloud data solutions that harness the scalability, flexibility, and power of...

  • Senior Data Engineer

    3 weeks ago


    San Francisco, United States People Data Labs Full time

    Job DescriptionJob DescriptionAbout UsAt People Data Labs, we're committed to democratizing access to high-quality B2B data and leading the emerging DaaS economy. We empower developers, engineers, and data scientists to create innovative, compliant data products at scale with our clean, easy-to-use datasets of resume, company, location, and education...


  • San Francisco, United States People Data Labs Full time

    Job DescriptionJob DescriptionAbout UsAt People Data Labs, we're committed to democratizing access to high-quality B2B data and leading the emerging DaaS economy. We empower developers, engineers, and data scientists to create innovative, compliant data products at scale with our clean, easy-to-use datasets of resume, company, location, and education...


  • San Francisco, United States People Data Labs Full time

    Job DescriptionJob DescriptionAbout UsAt People Data Labs, we're committed to democratizing access to high-quality B2B data and leading the emerging DaaS economy. We empower developers, engineers, and data scientists to create innovative, compliant data products at scale with our clean, easy-to-use datasets of resume, company, location, and education...

  • Senior Data Engineer

    4 weeks ago


    San Francisco, United States Unreal Gigs Full time

    Job DescriptionJob DescriptionCompany Overview: Welcome to the forefront of data-driven innovation! Our company is dedicated to harnessing the power of data to drive transformative change and solve complex problems across industries. We're committed to building scalable and reliable data infrastructure that enables advanced analytics, machine learning,...


  • San Francisco, United States Unreal Gigs Full time

    Job DescriptionJob DescriptionCompany Overview: Welcome to the forefront of data-driven innovation! Our company is dedicated to harnessing the power of data to drive transformative change and solve complex problems across industries. We're committed to building scalable and reliable data infrastructure that enables advanced analytics, machine learning,...


  • San Francisco, California, United States Nightfall AI Full time

    Nightfall AI ) is the unified platform that prevents data leaks and enables secure collaboration by protecting sensitive data and controlling how it's shared. For decades, legacy data leak prevention (DLP) solutions have failed to adequately protect sensitive information. Traditional DLP is outdated, intrusive, and complex - it wasn't designed for today's...