Current jobs related to Data Engineer - San Francisco - DynPro Inc.
-
Data Engineer
4 days ago
San Francisco, California, United States Syntricate Technologies Full timeData EngineerJob Summary: We are seeking a highly skilled Data Engineer to join our team at Syntricate Technologies. As a Data Engineer, you will be responsible for designing, implementing, and maintaining large-scale data pipelines using Snowflake and other data engineering tools. You will work closely with our data team to ensure the accuracy and...
-
Data Engineer
2 weeks ago
San Francisco, California, United States REQ Solutions Full timeJob Title: Data EngineerREQ Solutions is seeking a highly skilled Data Engineer to join our team. As a Data Engineer, you will be responsible for designing, building, and maintaining large-scale data systems that power our business.Key Responsibilities:Design and implement data pipelines to extract, transform, and load data from various sources.Develop and...
-
Data Engineer
2 weeks ago
San Francisco, California, United States REQ Solutions Full timeJob Title: Data EngineerWe are seeking a highly skilled Data Engineer to join our team at REQ Solutions. As a Data Engineer, you will be responsible for designing, building, and maintaining large-scale data systems that support our business operations.Key Responsibilities:Design and implement data pipelines using cloud-based technologies such as AWS.Develop...
-
Data Engineer
1 week ago
San Francisco, California, United States Syntricate Technologies Full timeJob Title: Data EngineerJob Description:We are seeking a skilled Data Engineer to join our team at Syntricate Technologies. As a Data Engineer, you will be responsible for designing, implementing, and maintaining large-scale data pipelines using Snowflake and SQL. You will work closely with our team to ensure the smooth operation of our data infrastructure...
-
Data Engineer
5 days ago
San Francisco, California, United States Bayone Full timeJob Title: Data EngineerCompany Overview:At Bayone, we strive to create an environment where people are valued, and differences are celebrated. Our purpose is to empower our teams and inspire our customers to become the best versions of themselves.The Opportunity:Our technology team works fast and smart, developing the latest in mobile technologies, scalable...
-
Data Engineer
1 month ago
San Francisco, California, United States Unreal Gigs Full timeJob Title: Data EngineerAt Unreal Gigs, we're revolutionizing the way businesses harness data to drive insights and make informed decisions. As a Data Engineer, you'll play a pivotal role in designing, building, and maintaining the data infrastructure that powers our analytics and machine learning initiatives.Key Responsibilities:Data Pipeline Development:...
-
Data Engineer
1 month ago
San Francisco, California, United States Legalist Full timeJob Title: Data EngineerWe are seeking a highly skilled Data Engineer to join our team at Legalist, an institutional alternative asset management firm. As a Data Engineer, you will play a critical role in designing and developing scalable data pipelines to collect, process, and analyze large volumes of data efficiently.Key Responsibilities:Design and develop...
-
Data Engineer
1 week ago
San Francisco, California, United States Brex Full timeTransforming Data into InsightsBrex is a leading AI-powered spend platform that helps companies spend with confidence. As a Data Engineer at Brex, you will play a critical role in transforming raw data into actionable insights for various departments across the organization.You will collaborate closely with Data Scientists, Software Engineers, and business...
-
Data Center Operations Specialist
1 week ago
San Francisco, California, United States Amazon Data Services, Inc. Full timeAbout the RoleWe are seeking a highly skilled Data Center Operations Specialist to join our team at Amazon Data Services, Inc. As a key member of our Data Center Engineering Operations team, you will play a critical role in maintaining and operating our critical infrastructure systems to ensure 99.999% uptime of our cloud computing portfolio.Key...
-
Data Engineer
4 days ago
San Francisco, California, United States Airbyte Full timeWe are seeking a highly skilled and experienced Analytics Engineer to join the Data Team at Airbyte. In this role, you will work closely with product managers, engineers, and functional leads to build and maintain robust data pipelines and analytics infrastructure.Data Pipeline Development:Design, build, and maintain scalable and efficient data pipelines...
-
Data Engineer
1 week ago
San Francisco, California, United States Airbyte Full timeRole OverviewAirbyte is seeking a highly skilled Data Engineer to join our Data Team. As a Data Engineer, you will be responsible for designing, building, and maintaining robust data pipelines and analytics infrastructure to support our product development initiatives.Key ResponsibilitiesDesign and develop scalable and efficient data pipelines using...
-
Data Engineer
4 days ago
San Francisco, California, United States Saxon Global Full timeData Engineer Role at Saxon GlobalSaxon Global is seeking a highly skilled Data Engineer to join our team. As a Data Engineer, you will be responsible for designing, implementing, and operating next-generation data lakes containing complex Genentech data from various business areas. You will work in a global environment, conceptualizing and owning the...
-
Data Engineer
4 days ago
San Francisco, California, United States Factory Full timeJob Description:Factory is seeking a highly skilled Data Engineer to join our team. As a Data Engineer, you will be responsible for designing, building, and maintaining optimal data pipelines that support a variety of data consumers.Key Responsibilities:Design and implement robust data warehousing solutions to ensure secure and efficient data storage and...
-
Data Engineer
4 weeks ago
San Francisco, United States TEKsystems co Allegis Group Full timeDescription:The Data engineer will collaborate closely with the growth and data foundation teams to define and create foundational data tables, migrate test tables while adhering to EDW standards, and build self-serve ETL frameworks capable of handling streaming and batch processing. The engineer will also take ownership of ETL workflows, ensuring data...
-
Data Engineer
3 weeks ago
San Francisco, United States REQ Solutions Full timeJob Title: Data EngineerLocation: San Francisco, CA 94105 (Hybrid role)Duration: 6 Months contract with possibility of extensionMust have skills:Data Engineer, Python, SQLMinimum years of experience: 5 yearsMarketing backgroundJob Description:Data and Analytics Engineer, this job posting is specific for a "Data Engineer" with Strong Programming and SQL...
-
Data Engineer
1 week ago
San Francisco, United States REQ Solutions Full timeJob Title: Data EngineerLocation: San Francisco, CA 94105 (Hybrid role)Duration: 6 Months contract with possibility of extensionMust have skills:Data Engineer, Python, SQLMinimum years of experience: 5 yearsMarketing backgroundJob Description:Data and Analytics Engineer, this job posting is specific for a "Data Engineer" with Strong Programming and SQL...
-
Data Engineer
3 weeks ago
San Francisco, United States REQ Solutions Full timeJob Title: Data EngineerLocation: San Francisco, CA 94105 (Hybrid role)Duration: 6 Months contract with possibility of extensionMust have skills:Data Engineer, Python, SQLMinimum years of experience: 5 yearsMarketing backgroundJob Description:Data and Analytics Engineer, this job posting is specific for a "Data Engineer" with Strong Programming and SQL...
-
Data Engineer
1 week ago
san francisco, United States REQ Solutions Full timeJob Title: Data EngineerLocation: San Francisco, CA 94105 (Hybrid role)Duration: 6 Months contract with possibility of extensionMust have skills:Data Engineer, Python, SQLMinimum years of experience: 5 yearsMarketing backgroundJob Description:Data and Analytics Engineer, this job posting is specific for a "Data Engineer" with Strong Programming and SQL...
-
Senior Data Engineer
2 weeks ago
San Francisco, California, United States Veterans Sourcing Group Full time{"h1": "Data Engineer - Hybrid Role", "p": "We are seeking a highly skilled Data Engineer to join our team at Veterans Sourcing Group. As a Data Engineer, you will be responsible for designing, building, and maintaining large-scale data systems that power our business. You will work closely with our product designers, product managers, and engineers to...
-
Data Engineering Manager
1 week ago
San Francisco, California, United States STONE Resource Group Full timeUnlock Your Potential as a Data Engineering ManagerWe are seeking a seasoned Data Engineering Manager to lead our data engineering team in designing, building, and maintaining scalable data infrastructure and pipelines. As a key member of our team, you will oversee the development of robust data solutions that support analytics, reporting, and business...
Data Engineer
2 months ago
Job Title: Data Engineer
Location: Downtown San Francisco, CA / Remote
Type: Full-time/Contract
Job Summary:
We are seeking a highly skilled Data Engineer to join our client's team. This role involves designing, building, and maintaining robust data solutions. You will utilize a diverse set of technologies and tools to enhance our data infrastructure and enable high-performance analytics across the organization. The ideal candidate has experience with cloud data warehousing, ETL pipeline development, workflow orchestration, data governance, and master data management.
Key Responsibilities:
- Develop scalable and cost-effective data warehouse solutions in Snowflake.
- Leverage AWS cloud infrastructure to ensure optimal performance and scalability.
- Design, develop, and deploy high-performance data pipelines using tools like dbt™, Fivetran, and Matillion Cloud ETL.
- Ensure data pipelines are robust, maintainable, and scalable.
- Utilize Apache Airflow to orchestrate and automate data workflows.
- Ensure efficient scheduling and execution of data tasks.
- Develop and implement data privacy policies, including data encryption, anonymization, and access controls using techniques like masking.
- Establish and enforce data governance frameworks covering data classification, lineage, quality, and retention.
- Design and build highly redundant and scalable cloud infrastructure for data lakes and data labs using AWS services such as EMR, SageMaker, and S3.
- Manage and optimize data storage and processing solutions.
- Develop Python scripts for data enrichment and MDM.
- Integrate data from various B2B sources to maintain a consistent and accurate master dataset.
- Build and maintain CI/CD pipelines to streamline deployment processes.
- Ensure smooth integration of new features and updates into production environments.
- Work closely with cross-functional teams, including data scientists and analysts, to meet data requirements.
- Lead projects from conception to production, breaking down tasks and managing implementation effectively.
Preferred Technical Stack:
- Cloud Data Warehouse: Snowflake
- ETL Tools: Matillion Cloud ETL, Fivetran, dbt™ Cloud
- Programming Languages: Python, SQL
- Workflow Orchestration: Apache Airflow
- Cloud Platforms: AWS (including EMR, SageMaker, S3, Datalake)
- Infrastructure as Code: Terraform
- Big Data Technologies: Apache Spark, Hudi
- Data Storage: NoSQL databases like MongoDB and DynamoDB
- Data Visualization: Tableau
- Data Engineering and Operations: Data Marts, Data Warehousing, Data Governance, Data Privacy, MLOps
Qualifications:
- Bachelor’s or Master’s degree in Computer Science, Engineering, or a related field.
- Proven experience in data engineering, with a strong focus on cloud-based data solutions.
- Proficiency in Python and SQL.
- Hands-on experience with Snowflake and AWS services.
- Strong knowledge of ETL tools like Matillion, Fivetran, and dbt™.
- Experience with workflow orchestration tools like Apache Airflow.
- Familiarity with data governance and data privacy best practices.
- Experience with CI/CD pipeline creation and management.
- Excellent problem-solving skills and attention to detail.
- Strong communication and leadership skills.