Senior Cloud Data Engineer

4 weeks ago


San Francisco, United States Unreal Gigs Full time
Job DescriptionJob Description

Company Overview: Welcome to the forefront of data-driven innovation Our company is dedicated to harnessing the power of data to drive transformative change and solve complex problems across industries. We're committed to building cutting-edge cloud data solutions that leverage the scalability, flexibility, and power of cloud platforms. Join us and be part of a dynamic team shaping the future of cloud data engineering.

Position Overview: As a Senior Cloud Data Engineer, you'll play a crucial role in designing, building, and optimizing our cloud data solutions. You'll work on challenging projects, from data ingestion and storage to processing and analysis, to support the needs of our data-driven organization. If you're a seasoned engineer with expertise in cloud data technologies and a passion for building scalable and reliable data systems, we want you on our team.

Requirements

Key Responsibilities:

  1. Cloud Data Architecture: Design and implement cloud data architectures on platforms such as AWS, Azure, or Google Cloud Platform (GCP), leveraging cloud-native services to build scalable, reliable, and cost-effective data solutions.
  2. Data Ingestion: Develop and maintain data ingestion pipelines to collect data from various sources, including databases, APIs, files, and streaming sources, ensuring efficient and reliable data ingestion into cloud storage.
  3. Data Storage: Design and implement data storage solutions using cloud-native storage services such as Amazon S3, Azure Data Lake Storage, or Google Cloud Storage, optimizing data storage for performance, cost, and scalability.
  4. Data Processing: Develop and maintain data processing pipelines using cloud-native data processing frameworks such as Apache Spark, Apache Flink, or Google Dataflow, enabling real-time and batch data processing and analysis.
  5. Data Integration: Integrate data from diverse sources and systems into cloud data solutions, ensuring seamless data flow and interoperability across different data sources and formats.
  6. Data Governance: Implement data governance policies and procedures to ensure data quality, security, and compliance with regulatory requirements in cloud data environments.
  7. Performance Optimization: Optimize data pipelines and processing workflows for performance and scalability, leveraging cloud-native features and techniques to maximize efficiency and minimize costs.
  8. Monitoring and Alerting: Implement monitoring and alerting solutions to track data pipeline performance and health, proactively identifying and resolving issues to minimize downtime and data loss.
  9. Documentation and Best Practices: Document cloud data architectures, pipelines, and best practices, providing clear and comprehensive documentation to facilitate understanding and collaboration among team members.
  10. Collaboration: Collaborate with cross-functional teams, including data engineers, data scientists, and business analysts, to understand requirements and deliver cloud data solutions that meet business needs.
  11. Mentorship and Development: Mentor junior engineers, sharing expertise and best practices in cloud data engineering, and facilitate knowledge sharing sessions within the team.

Qualifications:

  • Bachelor's degree or higher in Computer Science, Engineering, Mathematics, or related field.
  • 5+ years of experience in data engineering, with a focus on cloud data technologies.
  • Proficiency in cloud platforms such as AWS, Azure, or GCP, and services like Amazon S3, Azure Data Lake Storage, or Google Cloud Storage.
  • Strong programming skills in languages such as Python, Java, or Scala, with experience in data processing frameworks like Apache Spark or Apache Flink.
  • Experience with cloud-native data processing services such as AWS Glue, Azure Data Factory, or Google Dataflow.
  • Strong understanding of data integration concepts and techniques, with experience integrating data from diverse sources and systems in cloud environments.
  • Strong problem-solving skills and analytical thinking, with the ability to design and troubleshoot complex cloud data solutions.
  • Excellent communication and collaboration skills, with the ability to work effectively in cross-functional teams and communicate technical concepts to non-technical stakeholders.

Benefits

  • Competitive salary: The industry standard salary for Senior Cloud Data Engineers typically ranges from $170,000 to $230,000 per year, depending on experience and qualifications.
  • Comprehensive health, dental, and vision insurance plans.
  • Flexible work hours and remote work options.
  • Generous vacation and paid time off.
  • Professional development opportunities, including access to training programs, conferences, and workshops.
  • State-of-the-art technology environment with access to cutting-edge tools and resources.
  • Vibrant and inclusive company culture with opportunities for growth and advancement.
  • Exciting projects with real-world impact at the forefront of data-driven innovation.

Join Us: Ready to shape the future of cloud data engineering? Apply now to join our team and be part of the data revolution



  • San Francisco, United States Unreal Gigs Full time

    Job DescriptionJob DescriptionCompany Overview: Welcome to the forefront of data-driven innovation! Our company is dedicated to harnessing the power of data to drive transformative change and solve complex problems across industries. We're committed to building cutting-edge cloud data solutions that leverage the scalability, flexibility, and power of...


  • San Francisco, United States Manifest Solutions Full time

    Job DescriptionJob DescriptionManifest Solutions is currently seeking a Senior Azure Cloud Data Engineer for a position in San Francisco, CA.Strong background in Power BI, Azure Data Factory (ADF) and SQL. Responsible for designing, developing, and implementing data integration solutions in the Azure cloud environment. Design and implement ETL processes...

  • Cloud Data Engineer

    4 weeks ago


    San Francisco, United States Unreal Gigs Full time

    Job DescriptionJob DescriptionCompany Overview: Welcome to the forefront of cloud data engineering! At our company, we're dedicated to leveraging the power of cloud technology to drive data-driven innovation. Our mission is to develop scalable and robust cloud data solutions that enable organizations to harness the full potential of their data. Join us...

  • Cloud Data Engineer

    3 months ago


    San Francisco, United States Unreal Gigs Full time

    Job DescriptionJob DescriptionCompany Overview: Welcome to the forefront of cloud data engineering! At our company, we're dedicated to leveraging the power of cloud technology to drive data-driven innovation. Our mission is to develop scalable and robust cloud data solutions that enable organizations to harness the full potential of their data. Join us...

  • Senior Cloud Engineer

    17 hours ago


    San Francisco, California, United States Vend Limited. Full time

    About the RoleVendia is seeking a highly skilled Senior Cloud Engineer to join our team and leverage their expertise in building and operating cloud-native applications. As a Senior Cloud Engineer, you will play a critical role in delivering critical features across our distributed data platform.This is a unique opportunity to work with a rapidly growing,...


  • San Francisco, United States Unreal Gigs Full time

    Job DescriptionJob DescriptionCompany Overview: Welcome to the forefront of data-driven innovation! Our company is a trailblazer in leveraging the power of data to drive transformative change and solve complex problems across industries. We're committed to building cutting-edge cloud data solutions that harness the scalability, flexibility, and power of...


  • San Francisco, United States Unreal Gigs Full time

    Job DescriptionJob DescriptionCompany Overview: Welcome to the forefront of data-driven innovation! Our company is a trailblazer in leveraging the power of data to drive transformative change and solve complex problems across industries. We're committed to building cutting-edge cloud data solutions that harness the scalability, flexibility, and power of...


  • San Francisco, United States Unreal Gigs Full time

    Company Overview: Welcome to the forefront of data-driven innovation! Our company is a trailblazer in leveraging the power of data to drive transformative change and solve complex problems across industries. We're committed to building cutting-edge cloud data solutions that harness the scalability, flexibility, and power of cloud platforms. Join us and lead...


  • San Francisco, United States Logic Software Solutions Full time

    Job DescriptionJob DescriptionTitle: Senior Data EngineerLocation:Job Type:& Full-TimeAbout Us:& Logic Hire Software Solutions is an innovative data-centric organization committed to leveraging advanced analytics and data engineering practices to inform strategic business decisions and improve client engagement. We are seeking a seasoned Senior Data Engineer...

  • Senior Data Engineer

    2 months ago


    San Francisco, United States People Data Labs Full time

    Job DescriptionJob DescriptionAbout UsAt People Data Labs, we're committed to democratizing access to high-quality B2B data and leading the emerging DaaS economy. We empower developers, engineers, and data scientists to create innovative, compliant data products at scale with our clean, easy-to-use datasets of resume, company, location, and education...

  • Senior NLP Engineer

    2 weeks ago


    San Francisco, United States Big Cloud Full time

    Would you like to help build out state-of-the-art NLP features?Are you excited by the prospect of guiding and growing an ML team?We're looking for a hybrid-working Senior NLP Engineer with strong deep learning capabilities and familiarity with cloud services.This is a rapidly-growing healthtech company (Series A: $30m) providing automated EHR workflow...

  • Senior NLP Engineer

    8 hours ago


    San Francisco, United States Big Cloud Full time

    Would you like to help build out state-of-the-art NLP features?Are you excited by the prospect of guiding and growing an ML team?We're looking for a hybrid-working Senior NLP Engineer with strong deep learning capabilities and familiarity with cloud services.This is a rapidly-growing healthtech company (Series A: $30m) providing automated EHR workflow...

  • Senior Data Engineer

    4 weeks ago


    San Francisco, United States Unreal Gigs Full time

    Job DescriptionJob DescriptionCompany Overview: Welcome to the forefront of data-driven innovation! Our company is dedicated to harnessing the power of data to drive transformative change and solve complex problems across industries. We're committed to building scalable and reliable data infrastructure that enables advanced analytics, machine learning,...

  • Senior Data Engineer

    3 months ago


    San Francisco, United States Unreal Gigs Full time

    Job DescriptionJob DescriptionCompany Overview: Welcome to the forefront of data-driven innovation! Our company is dedicated to harnessing the power of data to drive transformative change and solve complex problems across industries. We're committed to building scalable and reliable data infrastructure that enables advanced analytics, machine learning,...


  • San Francisco, California, United States Capital One Full time

    About the RoleWe are seeking a highly skilled Senior Data Engineer to join our team at Capital One. As a pioneer in technology, you will have the opportunity to drive a major transformation within our organization.Key ResponsibilitiesCollaborate with Agile teams to design, develop, test, implement, and support technical solutions in full-stack development...


  • San Francisco, California, United States Rippling Full time

    About the RoleRippling is a leading provider of cloud-based HR, IT, and Finance solutions for businesses. We're seeking a highly experienced Senior Engineering Manager to lead our IT Cloud product suite.Key ResponsibilitiesCollaborate with cross-functional teams to understand business needs and growth objectives.Champion a culture of innovation and technical...


  • San Francisco, California, United States Figure Full time

    About FigureFigure is revolutionizing the vast financial services sector through the application of blockchain technology.Over the past six years, Figure has introduced a range of fintech innovations utilizing the Provenance blockchain for various services including loan origination, equity management, private fund administration, banking, and payment...

  • Senior Data Engineer

    1 month ago


    San Francisco, United States Unreal Gigs Full time

    Join us and be part of a dynamic team shaping the future of data engineering.If you're a seasoned engineer with expertise in data engineering technologies and a passion for building robust data systems, we want you on our team.Establish and enforce data governance policies and best practices to ensure data quality, security, and compliance with...

  • Senior Data Engineer

    1 month ago


    San Francisco, California, United States Unreal Gigs Full time

    Join us and be part of a dynamic team shaping the future of data engineering.If you're a seasoned engineer with expertise in data engineering technologies and a passion for building robust data systems, we want you on our team.Establish and enforce data governance policies and best practices to ensure data quality, security, and compliance with regulatory...


  • San Francisco, California, United States Genentech Full time

    About the Role**Senior Machine Learning Engineer**We are seeking a highly skilled Senior Machine Learning Engineer to join our Data Science Team at Genentech. As a key member of our team, you will be responsible for designing, enhancing, scaling, and maintaining machine learning solutions from conception to deployment in a production environment.Key...