Current jobs related to Big Data Engineering Lead - San Francisco, California - Unreal Gigs


  • San Francisco, California, United States Unreal Gigs Full time

    Job OverviewWelcome to Unreal Gigs, a leading company in data-driven innovation. We're committed to harnessing the power of big data to drive transformative change and solve complex problems across industries.As a Senior Big Data Engineer, you'll play a pivotal role in designing, building, and maintaining our big data infrastructure and pipelines. You'll...

  • Big Data Engineer

    1 month ago


    San Francisco, California, United States Unreal Gigs Full time

    Unlock the Power of Data with Unreal GigsWe're on a mission to harness the transformative power of data and turn it into actionable insights that can change the world. As a Big Data Engineer at Unreal Gigs, you'll play a pivotal role in our journey to navigate, analyze, and innovate in an ocean of bytes.What You'll Be Doing:Design and Deploy Scalable Big...

  • Big Data Engineer

    3 weeks ago


    San Francisco, California, United States Unreal Gigs Full time

    Unreal GigsCompany Overview:Welcome to Unreal Gigs, a leading innovator in harnessing the power of big data to drive insights and innovation. Our mission is to develop scalable and robust big data solutions that empower organizations to extract value from their data at scale.Position Overview:As a Big Data Engineer at Unreal Gigs, you'll play a pivotal role...

  • Big Data Engineer

    2 weeks ago


    San Francisco, California, United States Unreal Gigs Full time

    Unlock the Power of DataAt Unreal Gigs, we're on a mission to harness the transformative power of data. As a Big Data Engineer, you'll play a pivotal role in our journey to turn vast amounts of information into actionable insights that can change the world. Our data isn't just big; it's colossal, and we need your skills to help us navigate, analyze, and...


  • San Francisco, California, United States Unreal Gigs Full time

    Job Title: Lead Big Data EngineerAt Unreal Gigs, we're seeking a highly skilled Lead Big Data Engineer to join our team. As a key member of our data engineering team, you'll be responsible for designing, building, and maintaining our big data infrastructure and pipelines.Key Responsibilities:Technical Leadership: Lead a team of big data engineers, providing...

  • Big Data Engineer

    2 weeks ago


    San Francisco, California, United States Unreal Gigs Full time

    Unlock the Power of Data with Unreal GigsWe believe in the transformative power of data. As a Big Data Engineer at Unreal Gigs, you'll play a pivotal role in our mission to harness vast amounts of information, turning it into actionable insights that can change the world.Our data isn't just big; it's colossal, and we need your skills to help us navigate,...

  • Big Data Architect

    3 weeks ago


    San Francisco, California, United States Unreal Gigs Full time

    Job OverviewUnreal Gigs is seeking a visionary Big Data Architect to spearhead the design and construction of our cutting-edge data solutions. As a key member of our team, you will be responsible for crafting the blueprint for tomorrow's innovations, leveraging colossal data sets to solve real-world problems.Key Responsibilities:Architect and refine our big...

  • Big Data Architect

    2 weeks ago


    San Francisco, California, United States Unreal Gigs Full time

    Unreal Gigs is seeking a highly skilled Big Data Architect to design and develop scalable and reliable big data infrastructure and platforms. As a key member of our team, you will work closely with cross-functional teams of data scientists, analysts, and software engineers to ensure the reliability, scalability, and efficiency of our big data pipelines and...

  • Data Engineer

    2 weeks ago


    San Francisco, California, United States Unreal Gigs Full time

    Unlock the Power of Big DataAt Unreal Gigs, we're on a mission to harness the transformative power of data. As a Big Data Engineer, you'll play a pivotal role in our journey to unlock the potential of vast amounts of information, turning it into actionable insights that can change the world.What You'll Be Doing:Designing and deploying scalable big data...

  • Big Data Architect

    3 weeks ago


    San Francisco, California, United States Unreal Gigs Full time

    Job Title: Big Data ArchitectAt Unreal Gigs, we're seeking a highly skilled Big Data Architect to join our team. As a key member of our data engineering team, you'll be responsible for designing and building scalable and reliable big data infrastructure and platforms.Key Responsibilities:Design and architect big data infrastructure and platforms, including...

  • Data Engineer

    2 weeks ago


    San Francisco, California, United States Unreal Gigs Full time

    Unlock the Power of DataAt Unreal Gigs, we're on a mission to harness the transformative power of data. As a Big Data Engineer, you'll play a pivotal role in our journey to turn vast amounts of information into actionable insights that can change the world. Our data isn't just big; it's colossal, and we need your expertise to help us navigate, analyze, and...

  • Big Data Architect

    3 weeks ago


    San Francisco, California, United States Unreal Gigs Full time

    Shape the Future of DataWe're not just collecting data; we're crafting the blueprint for tomorrow's innovations. As a Big Data Architect, you'll spearhead our efforts to design and construct the infrastructure that underpins our cutting-edge data solutions.Your vision will pave the way for breakthroughs that leverage colossal data sets to solve real-world...

  • Big Data Architect

    2 weeks ago


    San Francisco, California, United States Unreal Gigs Full time

    Unlock the Power of Data with Unreal GigsWe believe in the transformative power of data and are seeking a talented Big Data Architect to join our team.As a key member of our data engineering team, you will play a pivotal role in designing and deploying scalable big data infrastructures that support groundbreaking AI and machine learning projects.Working with...

  • Big Data Developer

    2 months ago


    San Francisco, California, United States Sigmaways Inc Full time

    About Sigmaways Inc.Sigmaways Inc. is a leading provider of innovative data solutions, and we're seeking a highly skilled Big Data Developer to join our team.Key Responsibilities:Design and Develop Data Solutions: Utilize open-source, modern data lake, and enterprise data warehouse technologies (Hadoop, Spark, Cloud, etc.) to create end-to-end data...


  • San Francisco, California, United States Unreal Gigs Full time

    Unlock the Power of Big DataWelcome to Unreal Gigs, where we're harnessing the potential of big data to drive innovation and solve complex problems. As a Senior Big Data Engineer, you'll play a pivotal role in designing, building, and maintaining our big data infrastructure and pipelines.Key Responsibilities:Big Data Infrastructure Design: Design, architect,...


  • San Jose, California, United States Zoom Full time

    About the Role:We are seeking a highly skilled Big Data Infrastructure Engineer to join our team at Zoom. As a key member of our Big Data Team, you will work closely with other engineers to ensure seamless data ingestion and transformation.Your primary responsibility will be to design and implement large-scale data processing platforms, leveraging your...


  • San Jose, California, United States Zoom Full time

    About the RoleWe are seeking a highly skilled Big Data Infrastructure Engineer to join our team at Zoom. As a key member of our Big Data Team, you will play a critical role in designing and implementing smooth data pipelines.Key ResponsibilitiesDesign and implement large-scale data processing platformsProvide solutions for building data infrastructure and...

  • Big Data Architect

    3 weeks ago


    San Jose, California, United States Tik Tok Full time

    Job DescriptionAt TikTok, we're building a cutting-edge big data infrastructure to support our core products and businesses. We're seeking a talented Big Data Architect to join our Data Engine team.Key Responsibilities:Design and build the industry-leading 10 EB level big data platformOptimize and enhance big data system kernels, including Spark SQL, Presto,...

  • Big Data Developer

    1 month ago


    San Francisco, California, United States Sigmaways Inc Full time

    About the RoleWe are seeking a highly skilled Big Data Developer to contribute to the development of high-quality technology solutions that address business needs. As a key member of our team, you will be responsible for designing and implementing large-scale data applications using Big Data technologies.Key ResponsibilitiesDesign and develop data...


  • San Jose, California, United States Zoom Full time

    About the RoleWe are seeking a highly skilled Big Data Infrastructure Engineer to join our team at Zoom. As a key member of our Big Data Team, you will play a crucial role in designing and implementing smooth data pipelines.Key ResponsibilitiesDesign and implement large-scale data processing platformsDevelop automated methods for building and updating Big...

Big Data Engineering Lead

2 months ago


San Francisco, California, United States Unreal Gigs Full time
Job Title: Lead Big Data Engineer

At Unreal Gigs, we're seeking a highly skilled Lead Big Data Engineer to join our team and drive the future of data-driven innovation.

Job Summary

We're looking for a seasoned engineer with expertise in big data technologies and a track record of leading successful data projects. As the Lead Big Data Engineer, you'll be responsible for leading a team of big data engineers, designing and architecting big data infrastructure, and developing scalable and efficient data pipelines.

Key Responsibilities
  • Technical Leadership: Provide guidance, mentorship, and technical leadership in big data engineering best practices and technologies.
  • Big Data Infrastructure Design: Lead the design and architecture of our big data infrastructure, including data lakes, data warehouses, and streaming data platforms.
  • Data Pipeline Development: Lead the development of scalable and efficient data pipelines for ingesting, processing, and transforming large volumes of structured and unstructured data.
  • Data Modeling: Lead the design and implementation of data models and schemas to support analytical and operational requirements.
  • Data Integration: Lead efforts to integrate data from disparate sources and systems.
  • Performance Optimization: Lead optimization efforts for data pipelines and queries.
  • Monitoring and Alerting: Lead the implementation of monitoring and alerting systems to track big data platform performance and health.
  • Security and Compliance: Lead efforts to implement security controls and data governance policies.
  • Documentation and Best Practices: Define and promote best practices for big data engineering, documentation, and usage.
  • Collaboration: Collaborate with cross-functional teams to understand requirements and deliver big data solutions.
  • Mentorship and Development: Mentor junior engineers and provide opportunities for growth and development.
Qualifications
  • Bachelor's degree or higher in Computer Science, Engineering, Mathematics, or related field.
  • 7+ years of experience in big data engineering, with a focus on designing, building, and maintaining big data infrastructure and pipelines.
  • Leadership experience, with a demonstrated ability to lead and mentor a team of engineers.
  • Proficiency in programming languages such as Java, Scala, or Python, and expertise with big data technologies such as Hadoop, Spark, Kafka, Hive, HBase, and more.
  • Strong understanding of distributed systems and parallel processing, with experience designing and optimizing data pipelines for performance and scalability.
  • Experience with cloud platforms such as AWS, Azure, or Google Cloud Platform, and familiarity with cloud-based big data services.
  • Experience with SQL and NoSQL databases, data warehousing, and ETL/ELT processes.
  • Strong problem-solving skills and analytical thinking, with the ability to troubleshoot complex data issues and optimize system performance.
  • Excellent communication and collaboration skills, with the ability to work effectively in cross-functional teams and communicate technical concepts to non-technical stakeholders.
Benefits
  • Competitive salary: The industry standard salary for Lead Big Data Engineers typically ranges from $200,000 to $300,000 per year, depending on experience and qualifications.
  • Comprehensive health, dental, and vision insurance plans.
  • Flexible work hours and remote work options.
  • Generous vacation and paid time off.
  • Professional development opportunities, including access to training programs, conferences, and workshops.
  • State-of-the-art technology environment with access to cutting-edge tools and resources.
  • Vibrant and inclusive company culture with opportunities for growth and advancement.
  • Exciting projects with real-world impact at the forefront of big data innovation.