Senior Data Engineer
3 weeks ago
Title: Senior Data Engineer
Duration: 2 years with possible extension
Location: Local candidates preferred. They have to come onsite in South San Francisco, CA.
Data Engineer in ACE @ gRED
Job Summary:
Our healthcare/pharmaceutical company is seeking a highly skilled Senior Data Engineer with expertise in software development, AWS cloud, Python programming language, Airflow/Kafka, and event-driven architecture to join our team. The successful candidate will work closely with AI scientists and data analysts to design, develop, and maintain data pipelines and systems that support clinical and operational data use-cases.
Key Responsibilities:
Design, develop and maintain scalable and efficient data pipelines and systems to support clinical and operational data use-cases
Utilize Airflow/Kafka and event-driven architecture to build efficient data pipelines that handle large amounts of data in real-time
Work collaboratively with AI scientists and data analysts to gather and analyze business requirements and ensure data solutions align with business needs
Develop and maintain data warehouse and ETL processes, ensuring data quality and integrity
Implement and maintain data security, data privacy, and compliance measures
Perform data analysis, troubleshoot data issues, and provide technical support to end-users
Collaborate with AI scientists and data analysts to integrate predictive models into the analytics platform
Continuously monitor and optimize data pipelines and systems to ensure optimal performance and scalability
Stay up-to-date with the latest technologies and trends in data engineering, AWS cloud, and healthcare/pharmaceutical industry.
Requirements:
Bachelor's degree in Computer Science, Information Technology, or related field
5 years of experience in software or data engineering
Proven experience in designing and developing data pipelines and systems in a cloud environment, preferably AWS
Strong proficiency in Python programming language and related frameworks/libraries
Expertise in Airflow/Kafka and event-driven architecture
Familiarity with database technologies such as SQL, NoSQL, and data warehousing concepts
Experience with data security, privacy, and compliance measures
Strong analytical and problem-solving skills
Excellent communication and collaboration skills
Knowledge of healthcare/pharmaceutical industry and related data standards and regulations is a plus.
If you meet these requirements and are passionate about data engineering, healthcare, and pharmaceuticals, we encourage you to apply for this exciting opportunity.
-
Senior Data Engineer
1 day ago
San Francisco, United States People Data Labs Full timeJob DescriptionJob DescriptionAbout UsAt People Data Labs, we're committed to democratizing access to high-quality B2B data and leading the emerging DaaS economy. We empower developers, engineers, and data scientists to create innovative, compliant data products at scale with our clean, easy-to-use datasets of resume, company, location, and education...
-
Senior Systems Engineer
3 weeks ago
San Francisco, United States VAST Data Full timeVAST Data is looking for a Senior Systems Engineer to join our growing team! This is a great opportunity to be part of the fastest-growing infrastructure company in history. In just a few short years, we’ve shaken up the industry by challenging traditional architecture models and introduced a revolutionary set of storage possibilities through our...
-
Senior Data Engineer
1 week ago
San Francisco, United States Unreal Gigs Full timeJob DescriptionJob DescriptionCompany Overview: Welcome to the forefront of data-driven innovation! Our company is dedicated to harnessing the power of data to drive transformative change and solve complex problems across industries. We're committed to building scalable and reliable data infrastructure that enables advanced analytics, machine learning,...
-
Senior Data Engineer
4 weeks ago
San Francisco, United States UpRecruit Full timeJob DescriptionJob DescriptionJob Details: Title: Sr. Data EngineerSalary: $180-$230K Requirements: 8+ years of software dev exp (Large Data Sets or Big Data)Location: 100% onsite (San Francisco Bay Area) Our client, a gaming startup, is seeking a Sr. Data Engineer to join their passionate team. The ideal candidate is an experienced engineer who will play a...
-
Senior Data Engineer
1 month ago
San Francisco, United States Sephora Full timeAt Sephora we inspire our customers, empower our teams, and help them become the best versions of themselves. We create an environment where people are valued, and differences are celebrated. Every day, our teams across the world bring to life our purpose: to expand the way the world sees beauty by empowering the ExtraOrdinary in each of us. We are...
-
Senior Data Engineer
4 days ago
San Francisco, United States Siri InfoSolutions Inc Full timeJob DescriptionJob DescriptionSenior Data Engineer 12 MonthsSFO, CA( Onsite)Need to be strong with object oriented programming languages Java, Scala, PythonNeed to have some frontend skills JavaScript or similar.Skill set Big Data: Scala, Databricks, Spark SQL, Spark Streaming ( Nice to Have ), Python ( Nice to Have ), PySpark ( Nice to Have )Cloud: Azure ,...
-
Senior Software Engineer, Data
3 hours ago
San Francisco, United States Social Finance Ltd Full timeWho we are: Shape a brighter financial future with us. Together with our members, we're changing the way people think about and interact with personal finance. We're a next-generation fintech company using innovative, mobile-first technology to help our millions of members reach their goals. The industry is going through an unprecedented transformation, and...
-
Senior Data Warehouse Engineer
1 week ago
San Francisco, United States Unreal Gigs Full timeJob DescriptionJob DescriptionCompany Overview: Welcome to the forefront of data-driven innovation! Our company is dedicated to leveraging the power of data to drive transformative change and solve complex problems across industries. We're committed to building scalable and efficient data warehousing solutions that enable advanced analytics, reporting,...
-
Senior Data Systems Engineer
1 week ago
San Francisco, United States Unreal Gigs Full timeCompany Overview: Welcome to the forefront of data-driven innovation! Our company is dedicated to harnessing the power of data to drive transformative change and solve complex problems across industries. We're committed to building cutting-edge data systems that enable efficient data management, processing, and analysis. Join us and be part of a dynamic team...
-
Senior Data Systems Engineer
1 week ago
San Francisco, United States Unreal Gigs Full timeCompany Overview: Welcome to the forefront of data-driven innovation! Our company is dedicated to harnessing the power of data to drive transformative change and solve complex problems across industries. We're committed to building cutting-edge data systems that enable efficient data management, processing, and analysis. Join us and be part of a dynamic team...
-
Senior Data Systems Engineer
1 week ago
San Francisco, United States Unreal Gigs Full timeJob DescriptionJob DescriptionCompany Overview: Welcome to the forefront of data-driven innovation! Our company is dedicated to harnessing the power of data to drive transformative change and solve complex problems across industries. We're committed to building cutting-edge data systems that enable efficient data management, processing, and analysis....
-
Senior Cloud Data Engineer
7 days ago
San Francisco, United States Unreal Gigs Full timeCompany Overview: Welcome to the forefront of data-driven innovation! Our company is dedicated to harnessing the power of data to drive transformative change and solve complex problems across industries. We're committed to building cutting-edge cloud data solutions that leverage the scalability, flexibility, and power of cloud platforms. Join us and be part...
-
Senior Cloud Data Engineer
1 week ago
San Francisco, United States Unreal Gigs Full timeJob DescriptionJob DescriptionCompany Overview: Welcome to the forefront of data-driven innovation! Our company is dedicated to harnessing the power of data to drive transformative change and solve complex problems across industries. We're committed to building cutting-edge cloud data solutions that leverage the scalability, flexibility, and power of...
-
Senior Big Data Engineer
1 week ago
San Francisco, United States Unreal Gigs Full timeJob DescriptionJob DescriptionCompany Overview: Welcome to the forefront of data-driven innovation! Our company is committed to harnessing the power of big data to drive transformative change and solve complex problems across industries. We're dedicated to building scalable and efficient big data solutions that enable advanced analytics, machine...
-
Senior Real-Time Data Engineer
1 week ago
San Francisco, United States Unreal Gigs Full timeJob DescriptionJob DescriptionCompany Overview: Welcome to the forefront of data-driven innovation! Our company is dedicated to harnessing the power of real-time data to drive transformative change and solve complex problems across industries. We're committed to building cutting-edge real-time data solutions that enable timely insights and actions. Join...
-
Senior Data Warehouse Engineer
1 week ago
San Francisco, United States TuneIn Full time**Senior Data Warehouse Engineer** San Francisco / Engineering Platform / Full-time Regular **Location: San Francisco, Los Angeles, New York, or Remote** At TuneIn, we are reinventing radio for a connected world, with live sports, up-to-the-minute news, curated music, millions of podcasts, and over 120,000 streaming radio stationsstreamed to tens of...
-
Data Engineer
3 weeks ago
South San Francisco, United States TALENT Software Services Full timeAre you an experienced Data Engineer with a desire to excel? If so, then Talent Software Services may have the job for you! Our client is seeking an experienced Data Engineer to work in Bloomington, MN(Remote).Position Summary: Looking for a Data Engineer to join our team and help us develop, maintain, and optimize ETL processes. This position requires a...
-
Data Engineer
3 weeks ago
South San Francisco, United States TALENT Software Services Full timeAre you an experienced Data Engineer with a desire to excel? If so, then Talent Software Services may have the job for you! Our client is seeking an experienced Data Engineer to work in Bloomington, MN(Remote).Position Summary: Looking for a Data Engineer to join our team and help us develop, maintain, and optimize ETL processes. This position requires a...
-
Data Analyst
2 hours ago
San Francisco, United States People Data Labs Full timeJob DescriptionJob DescriptionAbout UsAt People Data Labs, we're committed to democratizing access to high-quality B2B data and leading the emerging DaaS economy. We empower developers, engineers, and data scientists to create innovative, compliant data products at scale with our clean, easy-to-use datasets of resume, company, location, and education...
-
Senior Data Engineer
1 day ago
San Francisco, California, United States Gantri Full timeCompanyGantri is the world's first digital manufacturer for creative lighting. We help independent designers, studios, and influencers to develop original, sustainably made lighting designs and sell directly to consumers. We manufacture and fulfill all orders on-demand using 3D printing from innovative plant-based materials.Since launching in 2017, we've...