Data Engineer

2 days ago


San Francisco Bay Area, United States Intelliswift Software Full time

Title: Data Engineer

Location: San Francisco, CA (1-2 Days onsite/Week)

Duration: 12+ Month Contract

Key Responsibilities:

• Design and implement scalable data pipelines using Databricks and Spark.

• Develop and maintain data processing applications in Scala and Python.

• Integrate and manage data streams using Kafka.

• Build and maintain microservices using Spring Boot.

• Collaborate with data scientists and analysts to understand data requirements and deliver solutions.

• Optimize and troubleshoot data workflows to ensure high performance and reliability.

• Ensure data quality and integrity across various data sources.

Required Skills and Qualifications:

• Bachelor’s degree in Computer Science, Engineering, or a related field.

• Proven experience as a Data Engineer or in a similar role.

• Proficiency in Databricks, Spark, Scala, Kafka, Python, and Spring Boot.

• Strong understanding of microservices architecture.

• Experience with cloud platforms (e.g., AWS, Azure, GCP) is a plus.

• Excellent problem-solving skills and attention to detail.

• Strong communication and teamwork abilities.


  • Data Engineer

    2 days ago


    San Francisco Bay Area, United States Vsolutions Technologies Full time

    The Senior Data Engineer will design, build, and implement data integration solutions, including data pipelines, data APl's, and ETL jobs, to meet the data needs of applications, services, data assets, and business intelligence and analytical tools.Working with business users, data architects, application development teams, data analytics teams, business...

  • Data Engineer

    2 days ago


    San Francisco Bay Area, United States Diligente Technologies Full time

    Title: Data Engineer(Databricks Azure)Location: San Francisco, CA(Remote)Contract ResponsibilitiesLead, design and implement innovative analytical solution using Tableau, SQL, and other Big Data related technologiesWork with product and engineering team to understand requirements, evaluate new features and architecture to help drive decisionsBuild...


  • San Francisco Bay Area, United States Amicus Full time

    Senior Data EngineerAmicus is currently working with an exciting start-up in the business intelligence space, who are looking to bolster their growing engineering team with the addition of an experienced Senior Data Engineer.Requirements:3-5 years’ experience as a data engineer.Experience with Python, Apache Airflow and GCP.Experience building ETL...

  • Sr. Data Engineer

    2 days ago


    San Francisco Bay Area, United States Flexton Inc. Full time

    Pay Rate: $80/hr to $90/hr on W2Type: ContractMust Haves:JavaPythonShellResponsibilities: -Design, develop, and manage data pipelines and workflows to enable efficient and accurate data processing using Trino SQL/Spark SQL warehoused in HDFS datasets. -Effectively performs code designs and reviews/approves test cases. -Implement data quality checks and...

  • AWS Data Engineer

    2 days ago


    San Francisco Bay Area, United States Incedo Inc. Full time

    Job Description:The role involves leading the design and management of data solutions in a cloud environment with a focus on AWS services.Responsibilities:Lead the design, implementation, and optimization of scalable data pipelines and architectures utilizing AWS Glue, Elastic MapReduce (EMR), Lambda, Redshift, Athena, DynamoDB, OpenSearch, and S3.Use Spark...

  • Data/ML engineer

    2 days ago


    San Francisco Bay Area, United States Intelliswift Software Full time

    Must Have skills: Databricks, python, spark, ML model, tensorflow/pytorch, LLM, Java, SpringbootJob DescriptionRequired Skills & Experience: • Hands-on code mindset with deep understanding in technologies skillset and an ability to understand larger picture. • Sound knowledge to understand Architectural Patterns, best practices and Non-Functional...

  • Sr. Data Engineer

    1 day ago


    San Francisco Bay Area, United States Acunor Full time

    Job Title: Senior Data EngineerLocation: San Francisco - onsite No. of years of experience: 8+ years’ What you’ll Do: Create and maintain optimal data pipeline architecture Build data pipelines that transform raw, unstructured data into formats that data analyst can use to for analysis Assemble large, complex data sets that meet functional /...


  • san francisco bay area, United States Vsolutions Technologies Full time

    The Senior Data Engineer will design, build, and implement data integration solutions, including data pipelines, data APl's, and ETL jobs, to meet the data needs of applications, services, data assets, and business intelligence and analytical tools.Working with business users, data architects, application development teams, data analytics teams, business...


  • Curtis Bay, Maryland, United States Pantheon Data Full time

    Job OverviewPantheon Data, a private company based in the Washington, DC area, is seeking a highly skilled Marine Mechanical Engineer to join our team. As a valued member of our organization, you will have the opportunity to work on exciting projects and contribute to the success of our clients.About the RoleWe are looking for an experienced Mechanical...


  • Bodega Bay, United States People Data Labs Full time

    Job DescriptionJob DescriptionAbout UsAt People Data Labs, we're committed to democratizing access to high-quality B2B data and leading the emerging DaaS economy. We empower developers, engineers, and data scientists to create innovative, compliant data products at scale with our clean, easy-to-use datasets of resume, company, location, and education...


  • san francisco bay area, United States Intelliswift Software Full time

    Title: Data EngineerLocation: San Francisco, CA (1-2 Days onsite/Week)Duration: 12+ Month Contract Key Responsibilities:• Design and implement scalable data pipelines using Databricks and Spark.• Develop and maintain data processing applications in Scala and Python.• Integrate and manage data streams using Kafka.• Build and maintain microservices...


  • san francisco bay area, United States Intelliswift Software Full time

    Title: Data EngineerLocation: San Francisco, CA (1-2 Days onsite/Week)Duration: 12+ Month Contract Key Responsibilities:• Design and implement scalable data pipelines using Databricks and Spark.• Develop and maintain data processing applications in Scala and Python.• Integrate and manage data streams using Kafka.• Build and maintain microservices...


  • san francisco bay area, United States Acunor Full time

    Job Title: Senior Data EngineerLocation: San Francisco - onsite No. of years of experience: 8+ years’ What you’ll Do: Create and maintain optimal data pipeline architecture Build data pipelines that transform raw, unstructured data into formats that data analyst can use to for analysis Assemble large, complex data sets that meet functional /...


  • san francisco bay area, United States Incedo Inc. Full time

    Job Description:The role involves leading the design and management of data solutions in a cloud environment with a focus on AWS services.Responsibilities:Lead the design, implementation, and optimization of scalable data pipelines and architectures utilizing AWS Glue, Elastic MapReduce (EMR), Lambda, Redshift, Athena, DynamoDB, OpenSearch, and S3.Use Spark...

  • Lead Data

    2 days ago


    San Francisco Bay Area, United States Diligente Technologies Full time

    Lead, design and implement innovative analytical solution using Tableau, SQL, and other Big Data related technologiesWork with product and engineering team to understand requirements, evaluate new features and architecture to help drive decisionsBuild collaborative partnerships with architects, technical leads and key individuals within other functional...


  • San Francisco, California, United States Braintrust Data Full time

    About Braintrust DataWe are a cutting-edge developer platform for building world-class AI products. Our innovative approach combines code and datasets, incrementally refining both using frequent evaluations. We provide a rich set of tools to visualize changes and interrogate failures, empowering developers to integrate our platform into their continuous...


  • san francisco bay area, United States Intelliswift Software Full time

    Must Have skills: Databricks, python, spark, ML model, tensorflow/pytorch, LLM, Java, SpringbootJob DescriptionRequired Skills & Experience: • Hands-on code mindset with deep understanding in technologies skillset and an ability to understand larger picture. • Sound knowledge to understand Architectural Patterns, best practices and Non-Functional...


  • San Francisco, California, United States VAST Data Full time

    About VAST DataVAST Data is a pioneering company in the field of data management, revolutionizing the way enterprises capture, catalog, refine, enrich, and protect massive datasets. As a leader in enterprise software infrastructure, we empower real-time data analysis and AI training and inference.We are driven by innovation, customer-centricity, and a...


  • San Francisco, United States Amazon Data Services, Inc. Full time

    This unique vantage point allows the Design Managers to maintain a close connection with project details and drive project outcomes.You will have an impact on the design direction and ability to improve design delivery for an entire region, while establishing design procedures and protocols for the development of future systems.Responsibilities...

  • Staff Data Scientist

    2 weeks ago


    San Francisco, United States Data Masked Full time

    This range is provided by Harnham. Your actual pay will be based on your skills and experience — talk with your recruiter to learn more. Base pay range $200,000.00/yr - $250,000.00/yr Additional compensation types Annual Bonus and RSUs Data Science Focused Recruitment Consultant Title: Staff Data Scientist Location: Company based in SF, CA - willing to...