Data Engineer
1 week ago
We are seeking a highly skilled and motivated Sr Cloud Data Engineer to join our growing data team at Advanced Software Talent.
The ideal candidate will have a strong background in developing data pipelines, implementing data models, and executing best practices for developing data products.
Key Responsibilities:- Develop Data Pipelines: Design, develop, and maintain robust, scalable, and efficient ETL/ELT pipelines to support diverse data sources and large-scale data processing.
- Data Modeling: Create and maintain data models and data architecture to ensure data integrity and optimum performance.
- Best Practices Implementation: Apply industry best practices in data warehousing, data governance, and data lifecycle management.
- Collaboration: Work closely with data scientists, analysts, and other stakeholders to gather requirements and deliver high-quality data products.
- Automation and CI/CD: Implement CI/CD pipelines using GitLab for automated testing, deployment, and integration of data workflows.
- Database Management: Manage and optimize Snowflake databases for performance, scalability, and cost-effectiveness.
- Coding and Scripting: Write efficient SQL queries and Python scripts to extract, load, and transform data.
- Version Control: Utilize Git for version control, ensuring traceable and manageable code changes.
- Orchestration: Utilize orchestration tools like Airflow and AutoMateNow to manage and automate data workflows.
- Data Governance: Implement and manage data governance and data observability solutions using technologies like Monte Carlo and Collibra.
- Monitoring and Optimization: Monitor data pipeline performance and troubleshoot issues to ensure reliability and efficiency.
- Documentation: Maintain comprehensive documentation for data pipelines, models, and processes.
- Education: Bachelor s degree in Computer Science, Information Technology, Data Science, or a related field.
- Experience: Minimum 5 years of experience in data engineering or a similar role.
- Technical Skills: Proficiency in designing and implementing CI/CD pipelines with GitLab, experience with dbt (data build tool) for transforming data within the warehouse, strong knowledge of Snowflake with hands-on experience in data warehousing solutions, expertise in SQL for data querying, manipulation, and optimization, proficiency in Python for scripting and automation tasks, familiarity with DevOps practices and tools, experience with orchestrators like Airflow and AutoMateNow, knowledge of data governance and observability tools such as Monte Carlo and Collibra, and strong working knowledge of Git for version control.
- Soft Skills: Strong problem-solving and analytical skills, excellent communication skills, both written and verbal, ability to work collaboratively in a fast-paced, dynamic environment, high attention to detail and commitment to producing high-quality work.
We are looking for a highly skilled and motivated Sr Cloud Data Engineer to join our growing data team at Advanced Software Talent. If you have a strong background in developing data pipelines, implementing data models, and executing best practices for developing data products, we encourage you to apply for this exciting opportunity.
-
Senior Data Engineer
3 weeks ago
South San Francisco, California, United States Character Biosciences Full timeJob Title: Senior Data EngineerCharacter Biosciences is seeking a highly skilled Senior Data Engineer to join our team. As a Senior Data Engineer, you will be responsible for developing and maintaining our data science and ML infrastructure.Key Responsibilities:Collaborate with our DS, Genetics, and Engineering leads to execute on our vision for cutting-edge...
-
Senior Systems Engineer
1 month ago
San Francisco, California, United States VAST Data Full timeAbout the RoleVAST Data is seeking a highly skilled Senior Systems Engineer to contribute to our innovative team.This is an exceptional opportunity to be part of a pioneering company that is revolutionizing the data storage industry with its Universal Storage platform.As a key member of our team, you will play a crucial role in shaping the future of data...
-
Data Engineer
1 week ago
San Francisco, California, United States REQ Solutions Full timeJob Title: Data EngineerREQ Solutions is seeking a highly skilled Data Engineer to join our team. As a Data Engineer, you will be responsible for designing, building, and maintaining large-scale data systems that power our business.Key Responsibilities:Design and implement data pipelines to extract, transform, and load data from various sources.Develop and...
-
Data Engineer
4 days ago
San Francisco, California, United States REQ Solutions Full timeJob Title: Data EngineerWe are seeking a highly skilled Data Engineer to join our team at REQ Solutions. As a Data Engineer, you will be responsible for designing, building, and maintaining large-scale data systems that support our business operations.Key Responsibilities:Design and implement data pipelines using cloud-based technologies such as AWS.Develop...
-
Data Engineer
1 day ago
San Francisco, California, United States Syntricate Technologies Full timeJob Title: Data EngineerJob Description:We are seeking a skilled Data Engineer to join our team at Syntricate Technologies. As a Data Engineer, you will be responsible for designing, implementing, and maintaining large-scale data pipelines using Snowflake and SQL. You will work closely with our team to ensure the smooth operation of our data infrastructure...
-
Senior Data Engineer
9 hours ago
South San Francisco, California, United States Mytra Full timeAbout MytraWe're revolutionizing the way industries move and store materials by applying robotics and distributed software to create innovative products for the $1T market. Our focus is on the supply chain industry, which is facing significant challenges due to e-commerce growth, rising costs, and supply chain disruptions.Role OverviewMytra's software team...
-
Data Engineer
4 weeks ago
San Francisco, California, United States Unreal Gigs Full timeJob Title: Data EngineerAt Unreal Gigs, we're revolutionizing the way businesses harness data to drive insights and make informed decisions. As a Data Engineer, you'll play a pivotal role in designing, building, and maintaining the data infrastructure that powers our analytics and machine learning initiatives.Key Responsibilities:Data Pipeline Development:...
-
Data Engineer
4 weeks ago
San Francisco, California, United States Legalist Full timeJob Title: Data EngineerWe are seeking a highly skilled Data Engineer to join our team at Legalist, an institutional alternative asset management firm. As a Data Engineer, you will play a critical role in designing and developing scalable data pipelines to collect, process, and analyze large volumes of data efficiently.Key Responsibilities:Design and develop...
-
Data Engineer
2 days ago
San Francisco, California, United States Brex Full timeTransforming Data into InsightsBrex is a leading AI-powered spend platform that helps companies spend with confidence. As a Data Engineer at Brex, you will play a critical role in transforming raw data into actionable insights for various departments across the organization.You will collaborate closely with Data Scientists, Software Engineers, and business...
-
Data Center Operations Specialist
1 day ago
San Francisco, California, United States Amazon Data Services, Inc. Full timeAbout the RoleWe are seeking a highly skilled Data Center Operations Specialist to join our team at Amazon Data Services, Inc. As a key member of our Data Center Engineering Operations team, you will play a critical role in maintaining and operating our critical infrastructure systems to ensure 99.999% uptime of our cloud computing portfolio.Key...
-
Data Engineer
2 days ago
San Francisco, California, United States Airbyte Full timeRole OverviewAirbyte is seeking a highly skilled Data Engineer to join our Data Team. As a Data Engineer, you will be responsible for designing, building, and maintaining robust data pipelines and analytics infrastructure to support our product development initiatives.Key ResponsibilitiesDesign and develop scalable and efficient data pipelines using...
-
Senior Data Engineer
4 days ago
San Francisco, California, United States Veterans Sourcing Group Full time{"h1": "Data Engineer - Hybrid Role", "p": "We are seeking a highly skilled Data Engineer to join our team at Veterans Sourcing Group. As a Data Engineer, you will be responsible for designing, building, and maintaining large-scale data systems that power our business. You will work closely with our product designers, product managers, and engineers to...
-
Lead Data Engineer
4 weeks ago
San Francisco, California, United States Unreal Gigs Full timeJob Title: Lead Big Data EngineerAt Unreal Gigs, we're seeking a highly skilled Lead Big Data Engineer to join our team. As a key member of our data engineering team, you'll be responsible for designing, building, and maintaining our big data infrastructure and pipelines.Key Responsibilities:Lead a team of big data engineers, providing guidance, mentorship,...
-
Data Engineering Manager
1 day ago
San Francisco, California, United States STONE Resource Group Full timeUnlock Your Potential as a Data Engineering ManagerWe are seeking a seasoned Data Engineering Manager to lead our data engineering team in designing, building, and maintaining scalable data infrastructure and pipelines. As a key member of our team, you will oversee the development of robust data solutions that support analytics, reporting, and business...
-
Data Engineer II
1 day ago
San Francisco, California, United States Ross Full timeJob SummaryWe are seeking a highly skilled Data Engineer II to join our team at Ross. The successful candidate will play a critical role in engineering data solutions that support Ross reporting and analytic needs.The ideal candidate will have at least 7 years of experience in data engineering, with a strong background in designing and modeling data...
-
Senior Data Engineer
2 days ago
San Francisco, California, United States Unreal Gigs Full timeUnreal Gigs is seeking a highly skilled Senior Data Engineer to join our team. As a key member of our data engineering team, you will be responsible for designing, building, and maintaining our data infrastructure and pipelines.Key Responsibilities:* Design and implement scalable and efficient data pipelines for ingesting, processing, and transforming large...
-
Senior Data Engineer
4 days ago
San Francisco, California, United States Thumbtack Full timeAbout ThumbtackThumbtack is a digital marketplace that connects homeowners with professionals for various services. We're building a platform that makes it easy for people to find and hire the right professionals for their home projects.The Data Platform TeamThe Data Platform team is a central team of software engineers who work on building and maintaining...
-
Senior Data Engineer
14 hours ago
San Francisco, California, United States Crunchyroll Full timeAbout the RoleCrunchyroll is growing and changing, presenting unique challenges and opportunities to support millions of anime fans around the world. The Data Engineering team provides seamless help to our internal stakeholders, ensuring an exceptional experience for all Crunchyroll fans.As a Senior Data Engineer, you will play a pivotal role in designing,...
-
Senior Data Engineer
1 day ago
San Francisco, California, United States Thumbtack Full timeData Engineer OpportunityThumbtack is seeking a skilled Data Engineer to join our Data Platform team. As a Data Engineer, you will play a critical role in designing, building, and maintaining our data systems, ensuring they are scalable, efficient, and secure.About the RoleYou will work closely with our Data Science and Machine Learning teams to develop and...
-
Data Engineer
3 days ago
San Francisco, California, United States Forhyre Full timeJob Title: Data EngineerWe are seeking a skilled Data Engineer to join our team at Forhyre. As a Data Engineer, you will play a crucial role in transforming data into actionable insights that drive business decisions.Key Responsibilities:Design and develop ETL processes using Python/Pyspark within the Azure platformDevelop analysis and reporting capabilities...