Senior Data Engineer

1 day ago

San Francisco, California, United States Unreal Gigs Full time
Job Overview

Unreal Gigs is seeking a highly skilled Senior Data Engineer to join our team. As a key member of our data engineering team, you will be responsible for designing, building, and maintaining our data infrastructure and pipelines.

Key Responsibilities:

  1. Design and implement scalable and efficient data pipelines for ingesting, processing, and transforming large volumes of structured and unstructured data.
  2. Develop and maintain data models and schemas to support analytical and operational requirements.
  3. Design and optimize data warehouses and data lakes to store and manage structured and unstructured data for analytics and reporting purposes.
  4. Integrate data from disparate sources and systems, ensuring data consistency, quality, and completeness throughout the data lifecycle.
  5. Establish and enforce data governance policies and best practices to ensure data quality, security, and compliance with regulatory requirements.
  6. Optimize data pipelines and queries for performance and efficiency, identifying and addressing bottlenecks and inefficiencies to improve system scalability and reliability.
  7. Implement monitoring and alerting systems to track data pipeline performance and health, detecting and mitigating issues proactively to minimize downtime and data loss.
  8. Document data infrastructure and pipelines, providing clear and comprehensive documentation to facilitate understanding and collaboration among team members.
  9. Collaborate with cross-functional teams, including data scientists, software engineers, and business stakeholders, to understand requirements and deliver data solutions that meet business needs.
  10. Mentor junior engineers, providing guidance, support, and technical leadership in data engineering best practices and technologies.

Requirements:

  • Bachelor's degree or higher in Computer Science, Engineering, Mathematics, or related field.
  • 5+ years of experience in data engineering, with a focus on designing, building, and maintaining data infrastructure and pipelines.
  • Proficiency in programming languages such as Python, Java, or Scala, and experience with data engineering frameworks and tools such as Apache Spark, Apache Kafka, Apache Airflow, or similar.
  • Strong understanding of data modeling concepts and techniques, with experience designing and implementing data models and schemas for relational and non-relational databases.
  • Experience with cloud platforms such as AWS, Azure, or Google Cloud Platform, and familiarity with cloud-based data services such as Amazon Redshift, Google BigQuery, or Azure Synapse Analytics.
  • Experience with SQL and NoSQL databases, data warehousing, and ETL/ELT processes.
  • Strong problem-solving skills and analytical thinking, with the ability to troubleshoot complex data issues and optimize system performance.
  • Excellent communication and collaboration skills, with the ability to work effectively in cross-functional teams and communicate technical concepts to non-technical stakeholders.

Benefits:

  • Competitive salary: The industry standard salary for Senior Data Engineers typically ranges from $170,000 to $230,000 per year, depending on experience and qualifications.
  • Comprehensive health, dental, and vision insurance plans.
  • Flexible work hours and remote work options.
  • Generous vacation and paid time off.
  • Professional development opportunities, including access to training programs, conferences, and workshops.
  • State-of-the-art technology environment with access to cutting-edge tools and resources.
  • Vibrant and inclusive company culture with opportunities for growth and advancement.
  • Exciting projects with real-world impact at the forefront of data-driven innovation.

  • Senior Systems Engineer

    1 month ago

    San Francisco, California, United States VAST Data Full time

    About the RoleVAST Data is seeking a highly skilled Senior Systems Engineer to contribute to our innovative team.This is an exceptional opportunity to be part of a pioneering company that is revolutionizing the data storage industry with its Universal Storage platform.As a key member of our team, you will play a crucial role in shaping the future of data...

  • Senior Data Engineer

    2 weeks ago

    San Francisco, California, United States Apex Systems, Inc. Full time

    Job Title: Senior Data EngineerWe are seeking a highly skilled Senior Data Engineer to join our team at Apex Systems, Inc. As a Senior Data Engineer, you will be responsible for designing, developing, and maintaining large-scale data systems and pipelines.Key Responsibilities:Lead the development of data pipelines for machine learning use casesDesign and...

  • Senior Data Engineer

    16 hours ago

    San Francisco, California, United States Syntricate Technologies Full time

    Job Title: Senior Data EngineerAbout the Role:We are seeking a highly skilled Senior Data Engineer to join our team at Syntricate Technologies. As a Senior Data Engineer, you will be responsible for designing, implementing, and maintaining large-scale data pipelines using SQL and Snowflake. You will work closely with our data team to ensure the smooth...

  • Senior Data Engineer

    1 month ago

    San Francisco, California, United States BigSpring, Inc Full time

    Job Title: Senior Data EngineerBigSpring, Inc is seeking a highly skilled Senior Data Engineer to join our team.Job Summary:We are looking for a talented Senior Data Engineer to design, develop, and implement large-scale data platforms and pipelines using various technologies and programming languages. The ideal candidate will have a strong background in...

  • Senior Data Engineer

    3 weeks ago

    San Francisco, California, United States Hulu Full time

    Job Title: Senior Data EngineerJoin our team at Disney Entertainment & ESPN Technology as a Senior Data Engineer and play a key role in building the future of Disney's media business.About the RoleWe are seeking an experienced Senior Data Engineer to join our Search Machine Learning team. As a Senior Data Engineer, you will be responsible for designing and...

  • Senior Data Engineer

    3 weeks ago

    San Francisco, California, United States Capital One Full time

    About the RoleWe are seeking a highly skilled Senior Data Engineer to join our team at Capital One. As a Senior Data Engineer, you will play a key role in designing, developing, and implementing technical solutions in full-stack development tools and technologies.Key ResponsibilitiesCollaborate with Agile teams to design, develop, test, implement, and...

  • Senior Data Engineer

    2 weeks ago

    San Francisco, California, United States SS&C Technologies Full time

    Senior Data EngineerSS&C Technologies is a leading provider of investment and financial services and software for the financial services and healthcare industries. As a Senior Data Engineer, you will be part of a team responsible for creating a cutting-edge cloud platform using the latest big data, cloud native, and machine learning technologies.Key...

  • Senior Data Engineer

    2 days ago

    San Francisco, California, United States Webologix Ltd INC Full time

    Role: Senior Data EngineerLocation: Dallas, TX / San Francisco, CA / Seattle, WAType of hiring: FTEJob Overview:We are seeking a highly skilled Senior Data Engineer to join our team at Webologix Ltd/ INC. As a key member of our data engineering team, you will be responsible for designing, developing, and implementing large-scale data engineering solutions on...

  • Senior Data Engineer

    2 weeks ago

    San Francisco, California, United States SS&C Technologies Full time

    Senior Data EngineerSS&C Technologies is a leading provider of investment and financial services and software for the financial services and healthcare industries. As a Senior Data Engineer, you will be part of a team responsible for creating a cutting-edge cloud platform using the latest big data, cloud native, and machine learning technologies.Key...

  • Senior Data Engineer

    15 hours ago

    San Francisco, California, United States SS&C Technologies Full time

    Job DescriptionSS&C Technologies is seeking a highly skilled Senior Data Engineer to join our team in San Francisco, California. As a Senior Data Engineer, you will be responsible for designing and implementing a leading cloud platform using the latest big data, cloud native, and machine learning technologies.The ideal candidate will have a strong background...

  • Senior Data Engineer

    19 hours ago

    San Francisco, California, United States Gridware Full time

    Job Title: Senior Data EngineerGridware is a leading provider of advanced sensing systems for the electrical grid. Our team is responsible for designing, building, and optimizing data pipelines and infrastructure to support real-time grid monitoring systems.The Senior Data Engineer will be responsible for handling large-scale sensor data, ensuring data...

  • Senior Data Engineer

    3 weeks ago

    San Francisco, California, United States Atlassian Full time

    About the RoleWe are seeking a highly skilled Senior Data Engineer to join our Data Engineering Team at Atlassian. As a Senior Data Engineer, you will play a key role in building world-class data solutions and applications that power crucial business decisions throughout the organisation.Key ResponsibilitiesPartner with the product analytics and data...

  • Senior Data Engineer

    2 days ago

    San Francisco, California, United States Thumbtack Full time

    About ThumbtackThumbtack is a digital marketplace that connects homeowners with professionals for various services. We're building a platform that makes it easy for people to find and hire the right professionals for their home projects.The Data Platform TeamThe Data Platform team is a central team of software engineers who work on building and maintaining...

  • Senior Data Engineer

    3 weeks ago

    San Francisco, California, United States ZoomInfo Technologies LLC Full time

    Job Title: Senior Data EngineerWe are seeking a highly skilled Senior Data Engineer to join our team at ZoomInfo Technologies LLC. As a Senior Data Engineer, you will be responsible for designing, developing, and maintaining large-scale data processing systems to support our business needs.Key Responsibilities:Design and implement data pipelines using...

  • Senior Data Engineer

    15 hours ago

    San Francisco, California, United States Archipelago Analytics Full time

    Archipelago Analytics: Transforming Commercial Property InsuranceWelcome to Archipelago Analytics, where we're revolutionizing the commercial property insurance industry with our cutting-edge AI-powered data network.We're seeking a highly skilled Senior Data Engineer to join our team and help us take our document processing pipeline to the next level.As a...

  • Senior Data Engineer

    4 weeks ago

    San Francisco, California, United States Thumbtack Full time

    About ThumbtackThumbtack is a leading digital marketplace that connects homeowners with professionals for various home services. With a strong focus on innovation and customer satisfaction, Thumbtack is revolutionizing the way people manage their homes.Job DescriptionWe are seeking an experienced Senior Software Engineer to join our Data Platform team. As a...

  • Senior Data Engineer

    1 month ago

    San Francisco, California, United States Thumbtack Full time

    About ThumbtackThumbtack is a leading digital marketplace that connects homeowners with professionals for various home services. With a strong focus on innovation and customer satisfaction, we're building a platform that makes home care effortless.Job SummaryWe're seeking a highly skilled Senior Software Engineer to join our Data Platform team. As a key...

  • Senior Data Operations Engineer

    2 weeks ago

    San Francisco, California, United States TEKsystems Full time

    Job Title: Senior Data Operations EngineerTEKsystems is seeking a highly skilled Senior Data Operations Engineer to support our data platform. The ideal candidate will have experience with Ab-Initio, Teradata, and Unix scripting, as well as a strong understanding of big data technologies.Key Responsibilities:Design and implement data pipelines using...

  • Senior Data Operations Engineer

    2 weeks ago

    San Francisco, California, United States TEKsystems Full time

    Job Title: Senior Data Operations EngineerTEKsystems is seeking a highly skilled Senior Data Operations Engineer to support our data platform. The ideal candidate will have experience with Ab-Initio, Teradata, and Unix scripting, as well as a strong understanding of big data technologies.Key Responsibilities:Design and implement data pipelines using...

  • Senior Data Engineer

    3 weeks ago

    San Francisco, California, United States Thumbtack Full time

    About ThumbtackThumbtack is a leading digital marketplace that connects homeowners with professionals for various home services. With a strong focus on innovation and customer satisfaction, Thumbtack is revolutionizing the way people manage their homes.Job SummaryWe are seeking a highly skilled Senior Software Engineer to join our Data Platform team. As a...