Data Engineer
2 days ago
Title: Data Engineer
Location: San Francisco, CA (1-2 Days onsite/Week)
Duration: 12+ Month Contract
Key Responsibilities:
• Design and implement scalable data pipelines using Databricks and Spark.
• Develop and maintain data processing applications in Scala and Python.
• Integrate and manage data streams using Kafka.
• Build and maintain microservices using Spring Boot.
• Collaborate with data scientists and analysts to understand data requirements and deliver solutions.
• Optimize and troubleshoot data workflows to ensure high performance and reliability.
• Ensure data quality and integrity across various data sources.
Required Skills and Qualifications:
• Bachelor’s degree in Computer Science, Engineering, or a related field.
• Proven experience as a Data Engineer or in a similar role.
• Proficiency in Databricks, Spark, Scala, Kafka, Python, and Spring Boot.
• Strong understanding of microservices architecture.
• Experience with cloud platforms (e.g., AWS, Azure, GCP) is a plus.
• Excellent problem-solving skills and attention to detail.
• Strong communication and teamwork abilities.
-
Data Engineer
2 days ago
San Francisco Bay Area, United States Vsolutions Technologies Full timeThe Senior Data Engineer will design, build, and implement data integration solutions, including data pipelines, data APl's, and ETL jobs, to meet the data needs of applications, services, data assets, and business intelligence and analytical tools.Working with business users, data architects, application development teams, data analytics teams, business...
-
Data Engineer
2 days ago
San Francisco Bay Area, United States Diligente Technologies Full timeTitle: Data Engineer(Databricks Azure)Location: San Francisco, CA(Remote)Contract ResponsibilitiesLead, design and implement innovative analytical solution using Tableau, SQL, and other Big Data related technologiesWork with product and engineering team to understand requirements, evaluate new features and architecture to help drive decisionsBuild...
-
Senior Data Engineer
2 days ago
San Francisco Bay Area, United States Amicus Full timeSenior Data EngineerAmicus is currently working with an exciting start-up in the business intelligence space, who are looking to bolster their growing engineering team with the addition of an experienced Senior Data Engineer.Requirements:3-5 years’ experience as a data engineer.Experience with Python, Apache Airflow and GCP.Experience building ETL...
-
Sr. Data Engineer
2 days ago
San Francisco Bay Area, United States Flexton Inc. Full timePay Rate: $80/hr to $90/hr on W2Type: ContractMust Haves:JavaPythonShellResponsibilities: -Design, develop, and manage data pipelines and workflows to enable efficient and accurate data processing using Trino SQL/Spark SQL warehoused in HDFS datasets. -Effectively performs code designs and reviews/approves test cases. -Implement data quality checks and...
-
AWS Data Engineer
2 days ago
San Francisco Bay Area, United States Incedo Inc. Full timeJob Description:The role involves leading the design and management of data solutions in a cloud environment with a focus on AWS services.Responsibilities:Lead the design, implementation, and optimization of scalable data pipelines and architectures utilizing AWS Glue, Elastic MapReduce (EMR), Lambda, Redshift, Athena, DynamoDB, OpenSearch, and S3.Use Spark...
-
Data/ML engineer
2 days ago
San Francisco Bay Area, United States Intelliswift Software Full timeMust Have skills: Databricks, python, spark, ML model, tensorflow/pytorch, LLM, Java, SpringbootJob DescriptionRequired Skills & Experience: • Hands-on code mindset with deep understanding in technologies skillset and an ability to understand larger picture. • Sound knowledge to understand Architectural Patterns, best practices and Non-Functional...
-
Sr. Data Engineer
1 day ago
San Francisco Bay Area, United States Acunor Full timeJob Title: Senior Data EngineerLocation: San Francisco - onsite No. of years of experience: 8+ years’ What you’ll Do: Create and maintain optimal data pipeline architecture Build data pipelines that transform raw, unstructured data into formats that data analyst can use to for analysis Assemble large, complex data sets that meet functional /...
-
Vsolutions Technologies | Data Engineer
1 day ago
san francisco bay area, United States Vsolutions Technologies Full timeThe Senior Data Engineer will design, build, and implement data integration solutions, including data pipelines, data APl's, and ETL jobs, to meet the data needs of applications, services, data assets, and business intelligence and analytical tools.Working with business users, data architects, application development teams, data analytics teams, business...
-
Marine Mechanical Engineer for Pantheon Data
2 weeks ago
Curtis Bay, Maryland, United States Pantheon Data Full timeJob OverviewPantheon Data, a private company based in the Washington, DC area, is seeking a highly skilled Marine Mechanical Engineer to join our team. As a valued member of our organization, you will have the opportunity to work on exciting projects and contribute to the success of our clients.About the RoleWe are looking for an experienced Mechanical...
-
Senior Data Engineer
7 days ago
Bodega Bay, United States People Data Labs Full timeJob DescriptionJob DescriptionAbout UsAt People Data Labs, we're committed to democratizing access to high-quality B2B data and leading the emerging DaaS economy. We empower developers, engineers, and data scientists to create innovative, compliant data products at scale with our clean, easy-to-use datasets of resume, company, location, and education...
-
Intelliswift Software | Data Engineer
1 day ago
san francisco bay area, United States Intelliswift Software Full timeTitle: Data EngineerLocation: San Francisco, CA (1-2 Days onsite/Week)Duration: 12+ Month Contract Key Responsibilities:• Design and implement scalable data pipelines using Databricks and Spark.• Develop and maintain data processing applications in Scala and Python.• Integrate and manage data streams using Kafka.• Build and maintain microservices...
-
Intelliswift Software | Data Engineer
1 day ago
san francisco bay area, United States Intelliswift Software Full timeTitle: Data EngineerLocation: San Francisco, CA (1-2 Days onsite/Week)Duration: 12+ Month Contract Key Responsibilities:• Design and implement scalable data pipelines using Databricks and Spark.• Develop and maintain data processing applications in Scala and Python.• Integrate and manage data streams using Kafka.• Build and maintain microservices...
-
Acunor | Sr. Data Engineer
19 hours ago
san francisco bay area, United States Acunor Full timeJob Title: Senior Data EngineerLocation: San Francisco - onsite No. of years of experience: 8+ years’ What you’ll Do: Create and maintain optimal data pipeline architecture Build data pipelines that transform raw, unstructured data into formats that data analyst can use to for analysis Assemble large, complex data sets that meet functional /...
-
Incedo Inc. | AWS Data Engineer
1 day ago
san francisco bay area, United States Incedo Inc. Full timeJob Description:The role involves leading the design and management of data solutions in a cloud environment with a focus on AWS services.Responsibilities:Lead the design, implementation, and optimization of scalable data pipelines and architectures utilizing AWS Glue, Elastic MapReduce (EMR), Lambda, Redshift, Athena, DynamoDB, OpenSearch, and S3.Use Spark...
-
Lead Data
2 days ago
San Francisco Bay Area, United States Diligente Technologies Full timeLead, design and implement innovative analytical solution using Tableau, SQL, and other Big Data related technologiesWork with product and engineering team to understand requirements, evaluate new features and architecture to help drive decisionsBuild collaborative partnerships with architects, technical leads and key individuals within other functional...
-
San Francisco, California, United States Braintrust Data Full timeAbout Braintrust DataWe are a cutting-edge developer platform for building world-class AI products. Our innovative approach combines code and datasets, incrementally refining both using frequent evaluations. We provide a rich set of tools to visualize changes and interrogate failures, empowering developers to integrate our platform into their continuous...
-
Intelliswift Software | Data/ML engineer
1 day ago
san francisco bay area, United States Intelliswift Software Full timeMust Have skills: Databricks, python, spark, ML model, tensorflow/pytorch, LLM, Java, SpringbootJob DescriptionRequired Skills & Experience: • Hands-on code mindset with deep understanding in technologies skillset and an ability to understand larger picture. • Sound knowledge to understand Architectural Patterns, best practices and Non-Functional...
-
Data Platform Systems Architect
7 days ago
San Francisco, California, United States VAST Data Full timeAbout VAST DataVAST Data is a pioneering company in the field of data management, revolutionizing the way enterprises capture, catalog, refine, enrich, and protect massive datasets. As a leader in enterprise software infrastructure, we empower real-time data analysis and AI training and inference.We are driven by innovation, customer-centricity, and a...
-
San Francisco, United States Amazon Data Services, Inc. Full timeThis unique vantage point allows the Design Managers to maintain a close connection with project details and drive project outcomes.You will have an impact on the design direction and ability to improve design delivery for an entire region, while establishing design procedures and protocols for the development of future systems.Responsibilities...
-
Staff Data Scientist
2 weeks ago
San Francisco, United States Data Masked Full timeThis range is provided by Harnham. Your actual pay will be based on your skills and experience — talk with your recruiter to learn more. Base pay range $200,000.00/yr - $250,000.00/yr Additional compensation types Annual Bonus and RSUs Data Science Focused Recruitment Consultant Title: Staff Data Scientist Location: Company based in SF, CA - willing to...