Data Engineer

18 hours ago

San Francisco, California, United States Unreal Gigs Full time
Job Title: Data Engineer

At Unreal Gigs, we're revolutionizing data-driven innovation. As a Data Engineer, you'll play a crucial role in designing, building, and maintaining scalable and reliable data infrastructure that powers our analytics and machine learning initiatives.

Key Responsibilities:

  1. Design and implement scalable data pipelines for ingesting, processing, and transforming large volumes of data from diverse sources.
  2. Develop and maintain data models and schemas to support analytics, reporting, and machine learning applications, ensuring data quality, consistency, and performance.
  3. Integrate data from internal and external sources, including databases, APIs, and streaming platforms, ensuring data consistency and integrity across systems.
  4. Implement data transformation and cleansing processes to standardize and enrich data for analysis and modeling, using tools and frameworks such as Apache Spark or Apache Beam.
  5. Manage data storage solutions, including data lakes, data warehouses, and NoSQL databases, optimizing for performance, cost, and scalability.
  6. Implement data governance policies and security controls to ensure compliance with regulatory requirements and protect sensitive data.
  7. Monitor data pipelines and systems for performance, reliability, and efficiency, proactively identifying and addressing issues to minimize downtime and optimize resource utilization.
  8. Document data infrastructure and processes, including data dictionaries, data lineage, and workflow diagrams, and collaborate with cross-functional teams to ensure alignment and transparency.

Qualifications:

  • Bachelor's degree or higher in Computer Science, Engineering, or related field.
  • Strong background in data engineering, with hands-on experience in designing, building, and maintaining data pipelines and systems.
  • Proficiency in programming languages such as Python, Java, or Scala, and experience with data processing frameworks such as Apache Spark or Apache Beam.
  • Experience with data modeling and database design, including relational databases (e.g., PostgreSQL, MySQL) and NoSQL databases (e.g., MongoDB, Cassandra).
  • Familiarity with data integration tools and technologies, such as Apache Kafka, AWS Glue, or Google Dataflow.
  • Strong problem-solving abilities and analytical thinking, with a keen attention to detail and a passion for tackling complex technical challenges.
  • Excellent communication and collaboration skills, with the ability to work effectively in cross-functional teams and communicate technical concepts to non-technical stakeholders.

Benefits:

  • Competitive salary: The industry standard salary for Data Engineers typically ranges from $140,000 to $210,000 per year, depending on experience and qualifications.
  • Comprehensive health, dental, and vision insurance plans.
  • Flexible work hours and remote work options.
  • Generous vacation and paid time off.
  • Professional development opportunities, including access to training programs, conferences, and workshops.
  • State-of-the-art technology environment with access to cutting-edge tools and resources.
  • Vibrant and inclusive company culture with team-building activities and social events.
  • Opportunities for career growth and advancement within the company.
  • Exciting projects with real-world impact across diverse industries.
  • Chance to work alongside top talent and industry experts in the field of data engineering.

  • Senior Systems Engineer

    1 month ago

    San Francisco, California, United States VAST Data Full time

    About the RoleVAST Data is seeking a highly skilled Senior Systems Engineer to contribute to our innovative team.This is an exceptional opportunity to be part of a pioneering company that is revolutionizing the data storage industry with its Universal Storage platform.As a key member of our team, you will play a crucial role in shaping the future of data...

  • Data Engineer

    1 week ago

    San Francisco, California, United States REQ Solutions Full time

    Job Title: Data EngineerREQ Solutions is seeking a highly skilled Data Engineer to join our team. As a Data Engineer, you will be responsible for designing, building, and maintaining large-scale data systems that power our business.Key Responsibilities:Design and implement data pipelines to extract, transform, and load data from various sources.Develop and...

  • Data Engineer

    4 days ago

    San Francisco, California, United States REQ Solutions Full time

    Job Title: Data EngineerWe are seeking a highly skilled Data Engineer to join our team at REQ Solutions. As a Data Engineer, you will be responsible for designing, building, and maintaining large-scale data systems that support our business operations.Key Responsibilities:Design and implement data pipelines using cloud-based technologies such as AWS.Develop...

  • Data Engineer

    23 hours ago

    San Francisco, California, United States Syntricate Technologies Full time

    Job Title: Data EngineerJob Description:We are seeking a skilled Data Engineer to join our team at Syntricate Technologies. As a Data Engineer, you will be responsible for designing, implementing, and maintaining large-scale data pipelines using Snowflake and SQL. You will work closely with our team to ensure the smooth operation of our data infrastructure...

  • Data Engineer

    3 weeks ago

    San Francisco, California, United States Unreal Gigs Full time

    Job Title: Data EngineerAt Unreal Gigs, we're revolutionizing the way businesses harness data to drive insights and make informed decisions. As a Data Engineer, you'll play a pivotal role in designing, building, and maintaining the data infrastructure that powers our analytics and machine learning initiatives.Key Responsibilities:Data Pipeline Development:...

  • Data Engineer

    4 weeks ago

    San Francisco, California, United States Legalist Full time

    Job Title: Data EngineerWe are seeking a highly skilled Data Engineer to join our team at Legalist, an institutional alternative asset management firm. As a Data Engineer, you will play a critical role in designing and developing scalable data pipelines to collect, process, and analyze large volumes of data efficiently.Key Responsibilities:Design and develop...

  • Data Engineer

    1 day ago

    San Francisco, California, United States Brex Full time

    Transforming Data into InsightsBrex is a leading AI-powered spend platform that helps companies spend with confidence. As a Data Engineer at Brex, you will play a critical role in transforming raw data into actionable insights for various departments across the organization.You will collaborate closely with Data Scientists, Software Engineers, and business...

  • Data Center Operations Specialist

    21 hours ago

    San Francisco, California, United States Amazon Data Services, Inc. Full time

    About the RoleWe are seeking a highly skilled Data Center Operations Specialist to join our team at Amazon Data Services, Inc. As a key member of our Data Center Engineering Operations team, you will play a critical role in maintaining and operating our critical infrastructure systems to ensure 99.999% uptime of our cloud computing portfolio.Key...

  • Data Engineer

    24 hours ago

    San Francisco, California, United States Airbyte Full time

    Role OverviewAirbyte is seeking a highly skilled Data Engineer to join our Data Team. As a Data Engineer, you will be responsible for designing, building, and maintaining robust data pipelines and analytics infrastructure to support our product development initiatives.Key ResponsibilitiesDesign and develop scalable and efficient data pipelines using...

  • Senior Data Engineer

    4 days ago

    San Francisco, California, United States Veterans Sourcing Group Full time

    {"h1": "Data Engineer - Hybrid Role", "p": "We are seeking a highly skilled Data Engineer to join our team at Veterans Sourcing Group. As a Data Engineer, you will be responsible for designing, building, and maintaining large-scale data systems that power our business. You will work closely with our product designers, product managers, and engineers to...

  • Lead Data Engineer

    4 weeks ago

    San Francisco, California, United States Unreal Gigs Full time

    Job Title: Lead Big Data EngineerAt Unreal Gigs, we're seeking a highly skilled Lead Big Data Engineer to join our team. As a key member of our data engineering team, you'll be responsible for designing, building, and maintaining our big data infrastructure and pipelines.Key Responsibilities:Lead a team of big data engineers, providing guidance, mentorship,...

  • Data Engineering Manager

    19 hours ago

    San Francisco, California, United States STONE Resource Group Full time

    Unlock Your Potential as a Data Engineering ManagerWe are seeking a seasoned Data Engineering Manager to lead our data engineering team in designing, building, and maintaining scalable data infrastructure and pipelines. As a key member of our team, you will oversee the development of robust data solutions that support analytics, reporting, and business...

  • Data Engineer II

    22 hours ago

    San Francisco, California, United States Ross Full time

    Job SummaryWe are seeking a highly skilled Data Engineer II to join our team at Ross. The successful candidate will play a critical role in engineering data solutions that support Ross reporting and analytic needs.The ideal candidate will have at least 7 years of experience in data engineering, with a strong background in designing and modeling data...

  • Senior Data Engineer

    1 day ago

    San Francisco, California, United States Unreal Gigs Full time

    Unreal Gigs is seeking a highly skilled Senior Data Engineer to join our team. As a key member of our data engineering team, you will be responsible for designing, building, and maintaining our data infrastructure and pipelines.Key Responsibilities:* Design and implement scalable and efficient data pipelines for ingesting, processing, and transforming large...

  • Senior Data Engineer

    4 days ago

    San Francisco, California, United States Thumbtack Full time

    About ThumbtackThumbtack is a digital marketplace that connects homeowners with professionals for various services. We're building a platform that makes it easy for people to find and hire the right professionals for their home projects.The Data Platform TeamThe Data Platform team is a central team of software engineers who work on building and maintaining...

  • Senior Data Engineer

    22 hours ago

    San Francisco, California, United States Thumbtack Full time

    Data Engineer OpportunityThumbtack is seeking a skilled Data Engineer to join our Data Platform team. As a Data Engineer, you will play a critical role in designing, building, and maintaining our data systems, ensuring they are scalable, efficient, and secure.About the RoleYou will work closely with our Data Science and Machine Learning teams to develop and...

  • Data Engineer

    3 days ago

    San Francisco, California, United States Forhyre Full time

    Job Title: Data EngineerWe are seeking a skilled Data Engineer to join our team at Forhyre. As a Data Engineer, you will play a crucial role in transforming data into actionable insights that drive business decisions.Key Responsibilities:Design and develop ETL processes using Python/Pyspark within the Azure platformDevelop analysis and reporting capabilities...

  • Data Engineer/Scientist

    4 weeks ago

    San Francisco, California, United States Freemind Solutions Full time

    Founding Data Engineer/ScientistWe are seeking a highly skilled and experienced Founding Data Engineer/Scientist to join our core team at Freemind Solutions. This unique role will blend the responsibilities of data engineering and data science, allowing you to make a significant impact on both the infrastructure and the insights derived from our data.Key...

  • Senior Data Engineer

    3 weeks ago

    San Francisco, California, United States Apex Systems, Inc. Full time

    Job Title: Senior Data EngineerWe are seeking a highly skilled Senior Data Engineer to join our team at Apex Systems, Inc. As a Senior Data Engineer, you will be responsible for designing, developing, and maintaining large-scale data systems and pipelines.Key Responsibilities:Lead the development of data pipelines for machine learning use casesDesign and...

  • Senior Data Engineer

    3 days ago

    San Francisco, California, United States Unreal Gigs Full time

    Job OverviewUnreal Gigs is seeking a highly skilled Senior Data Engineer to join our team. As a key member of our data engineering team, you will be responsible for designing, building, and maintaining our data infrastructure and pipelines.Key Responsibilities:Design and implement scalable and efficient data pipelines for ingesting, processing, and...