Data Engineer

1 week ago

South San Francisco, California, United States Advanced Software Talent Full time
Job Title: Sr Cloud Data Engineer

We are seeking a highly skilled and motivated Sr Cloud Data Engineer to join our growing data team at Advanced Software Talent.

The ideal candidate will have a strong background in developing data pipelines, implementing data models, and executing best practices for developing data products.

Key Responsibilities:
  • Develop Data Pipelines: Design, develop, and maintain robust, scalable, and efficient ETL/ELT pipelines to support diverse data sources and large-scale data processing.
  • Data Modeling: Create and maintain data models and data architecture to ensure data integrity and optimum performance.
  • Best Practices Implementation: Apply industry best practices in data warehousing, data governance, and data lifecycle management.
  • Collaboration: Work closely with data scientists, analysts, and other stakeholders to gather requirements and deliver high-quality data products.
  • Automation and CI/CD: Implement CI/CD pipelines using GitLab for automated testing, deployment, and integration of data workflows.
  • Database Management: Manage and optimize Snowflake databases for performance, scalability, and cost-effectiveness.
  • Coding and Scripting: Write efficient SQL queries and Python scripts to extract, load, and transform data.
  • Version Control: Utilize Git for version control, ensuring traceable and manageable code changes.
  • Orchestration: Utilize orchestration tools like Airflow and AutoMateNow to manage and automate data workflows.
  • Data Governance: Implement and manage data governance and data observability solutions using technologies like Monte Carlo and Collibra.
  • Monitoring and Optimization: Monitor data pipeline performance and troubleshoot issues to ensure reliability and efficiency.
  • Documentation: Maintain comprehensive documentation for data pipelines, models, and processes.
Qualifications:
  • Education: Bachelor s degree in Computer Science, Information Technology, Data Science, or a related field.
  • Experience: Minimum 5 years of experience in data engineering or a similar role.
  • Technical Skills: Proficiency in designing and implementing CI/CD pipelines with GitLab, experience with dbt (data build tool) for transforming data within the warehouse, strong knowledge of Snowflake with hands-on experience in data warehousing solutions, expertise in SQL for data querying, manipulation, and optimization, proficiency in Python for scripting and automation tasks, familiarity with DevOps practices and tools, experience with orchestrators like Airflow and AutoMateNow, knowledge of data governance and observability tools such as Monte Carlo and Collibra, and strong working knowledge of Git for version control.
  • Soft Skills: Strong problem-solving and analytical skills, excellent communication skills, both written and verbal, ability to work collaboratively in a fast-paced, dynamic environment, high attention to detail and commitment to producing high-quality work.

We are looking for a highly skilled and motivated Sr Cloud Data Engineer to join our growing data team at Advanced Software Talent. If you have a strong background in developing data pipelines, implementing data models, and executing best practices for developing data products, we encourage you to apply for this exciting opportunity.

  • Senior Data Engineer

    3 weeks ago

    South San Francisco, California, United States Character Biosciences Full time

    Job Title: Senior Data EngineerCharacter Biosciences is seeking a highly skilled Senior Data Engineer to join our team. As a Senior Data Engineer, you will be responsible for developing and maintaining our data science and ML infrastructure.Key Responsibilities:Collaborate with our DS, Genetics, and Engineering leads to execute on our vision for cutting-edge...

  • Senior Systems Engineer

    1 month ago

    San Francisco, California, United States VAST Data Full time

    About the RoleVAST Data is seeking a highly skilled Senior Systems Engineer to contribute to our innovative team.This is an exceptional opportunity to be part of a pioneering company that is revolutionizing the data storage industry with its Universal Storage platform.As a key member of our team, you will play a crucial role in shaping the future of data...

  • Data Engineer

    1 week ago

    San Francisco, California, United States REQ Solutions Full time

    Job Title: Data EngineerREQ Solutions is seeking a highly skilled Data Engineer to join our team. As a Data Engineer, you will be responsible for designing, building, and maintaining large-scale data systems that power our business.Key Responsibilities:Design and implement data pipelines to extract, transform, and load data from various sources.Develop and...

  • Data Engineer

    4 days ago

    San Francisco, California, United States REQ Solutions Full time

    Job Title: Data EngineerWe are seeking a highly skilled Data Engineer to join our team at REQ Solutions. As a Data Engineer, you will be responsible for designing, building, and maintaining large-scale data systems that support our business operations.Key Responsibilities:Design and implement data pipelines using cloud-based technologies such as AWS.Develop...

  • Data Engineer

    1 day ago

    San Francisco, California, United States Syntricate Technologies Full time

    Job Title: Data EngineerJob Description:We are seeking a skilled Data Engineer to join our team at Syntricate Technologies. As a Data Engineer, you will be responsible for designing, implementing, and maintaining large-scale data pipelines using Snowflake and SQL. You will work closely with our team to ensure the smooth operation of our data infrastructure...

  • Senior Data Engineer

    9 hours ago

    South San Francisco, California, United States Mytra Full time

    About MytraWe're revolutionizing the way industries move and store materials by applying robotics and distributed software to create innovative products for the $1T market. Our focus is on the supply chain industry, which is facing significant challenges due to e-commerce growth, rising costs, and supply chain disruptions.Role OverviewMytra's software team...

  • Data Engineer

    4 weeks ago

    San Francisco, California, United States Unreal Gigs Full time

    Job Title: Data EngineerAt Unreal Gigs, we're revolutionizing the way businesses harness data to drive insights and make informed decisions. As a Data Engineer, you'll play a pivotal role in designing, building, and maintaining the data infrastructure that powers our analytics and machine learning initiatives.Key Responsibilities:Data Pipeline Development:...

  • Data Engineer

    4 weeks ago

    San Francisco, California, United States Legalist Full time

    Job Title: Data EngineerWe are seeking a highly skilled Data Engineer to join our team at Legalist, an institutional alternative asset management firm. As a Data Engineer, you will play a critical role in designing and developing scalable data pipelines to collect, process, and analyze large volumes of data efficiently.Key Responsibilities:Design and develop...

  • Data Engineer

    2 days ago

    San Francisco, California, United States Brex Full time

    Transforming Data into InsightsBrex is a leading AI-powered spend platform that helps companies spend with confidence. As a Data Engineer at Brex, you will play a critical role in transforming raw data into actionable insights for various departments across the organization.You will collaborate closely with Data Scientists, Software Engineers, and business...

  • Data Center Operations Specialist

    1 day ago

    San Francisco, California, United States Amazon Data Services, Inc. Full time

    About the RoleWe are seeking a highly skilled Data Center Operations Specialist to join our team at Amazon Data Services, Inc. As a key member of our Data Center Engineering Operations team, you will play a critical role in maintaining and operating our critical infrastructure systems to ensure 99.999% uptime of our cloud computing portfolio.Key...

  • Data Engineer

    2 days ago

    San Francisco, California, United States Airbyte Full time

    Role OverviewAirbyte is seeking a highly skilled Data Engineer to join our Data Team. As a Data Engineer, you will be responsible for designing, building, and maintaining robust data pipelines and analytics infrastructure to support our product development initiatives.Key ResponsibilitiesDesign and develop scalable and efficient data pipelines using...

  • Senior Data Engineer

    4 days ago

    San Francisco, California, United States Veterans Sourcing Group Full time

    {"h1": "Data Engineer - Hybrid Role", "p": "We are seeking a highly skilled Data Engineer to join our team at Veterans Sourcing Group. As a Data Engineer, you will be responsible for designing, building, and maintaining large-scale data systems that power our business. You will work closely with our product designers, product managers, and engineers to...

  • Lead Data Engineer

    4 weeks ago

    San Francisco, California, United States Unreal Gigs Full time

    Job Title: Lead Big Data EngineerAt Unreal Gigs, we're seeking a highly skilled Lead Big Data Engineer to join our team. As a key member of our data engineering team, you'll be responsible for designing, building, and maintaining our big data infrastructure and pipelines.Key Responsibilities:Lead a team of big data engineers, providing guidance, mentorship,...

  • Data Engineering Manager

    1 day ago

    San Francisco, California, United States STONE Resource Group Full time

    Unlock Your Potential as a Data Engineering ManagerWe are seeking a seasoned Data Engineering Manager to lead our data engineering team in designing, building, and maintaining scalable data infrastructure and pipelines. As a key member of our team, you will oversee the development of robust data solutions that support analytics, reporting, and business...

  • Data Engineer II

    1 day ago

    San Francisco, California, United States Ross Full time

    Job SummaryWe are seeking a highly skilled Data Engineer II to join our team at Ross. The successful candidate will play a critical role in engineering data solutions that support Ross reporting and analytic needs.The ideal candidate will have at least 7 years of experience in data engineering, with a strong background in designing and modeling data...

  • Senior Data Engineer

    2 days ago

    San Francisco, California, United States Unreal Gigs Full time

    Unreal Gigs is seeking a highly skilled Senior Data Engineer to join our team. As a key member of our data engineering team, you will be responsible for designing, building, and maintaining our data infrastructure and pipelines.Key Responsibilities:* Design and implement scalable and efficient data pipelines for ingesting, processing, and transforming large...

  • Senior Data Engineer

    4 days ago

    San Francisco, California, United States Thumbtack Full time

    About ThumbtackThumbtack is a digital marketplace that connects homeowners with professionals for various services. We're building a platform that makes it easy for people to find and hire the right professionals for their home projects.The Data Platform TeamThe Data Platform team is a central team of software engineers who work on building and maintaining...

  • Senior Data Engineer

    14 hours ago

    San Francisco, California, United States Crunchyroll Full time

    About the RoleCrunchyroll is growing and changing, presenting unique challenges and opportunities to support millions of anime fans around the world. The Data Engineering team provides seamless help to our internal stakeholders, ensuring an exceptional experience for all Crunchyroll fans.As a Senior Data Engineer, you will play a pivotal role in designing,...

  • Senior Data Engineer

    1 day ago

    San Francisco, California, United States Thumbtack Full time

    Data Engineer OpportunityThumbtack is seeking a skilled Data Engineer to join our Data Platform team. As a Data Engineer, you will play a critical role in designing, building, and maintaining our data systems, ensuring they are scalable, efficient, and secure.About the RoleYou will work closely with our Data Science and Machine Learning teams to develop and...

  • Data Engineer

    3 days ago

    San Francisco, California, United States Forhyre Full time

    Job Title: Data EngineerWe are seeking a skilled Data Engineer to join our team at Forhyre. As a Data Engineer, you will play a crucial role in transforming data into actionable insights that drive business decisions.Key Responsibilities:Design and develop ETL processes using Python/Pyspark within the Azure platformDevelop analysis and reporting capabilities...