Senior Data Engineer

3 weeks ago


South San Francisco, United States Ask Staffing Full time

Title: Senior Data Engineer
Duration: 2 years with possible extension
Location: Local candidates preferred. They have to come onsite in South San Francisco, CA.

Data Engineer in ACE @ gRED

Job Summary:
Our healthcare/pharmaceutical company is seeking a highly skilled Senior Data Engineer with expertise in software development, AWS cloud, Python programming language, Airflow/Kafka, and event-driven architecture to join our team. The successful candidate will work closely with AI scientists and data analysts to design, develop, and maintain data pipelines and systems that support clinical and operational data use-cases.
Key Responsibilities:
Design, develop and maintain scalable and efficient data pipelines and systems to support clinical and operational data use-cases
Utilize Airflow/Kafka and event-driven architecture to build efficient data pipelines that handle large amounts of data in real-time
Work collaboratively with AI scientists and data analysts to gather and analyze business requirements and ensure data solutions align with business needs
Develop and maintain data warehouse and ETL processes, ensuring data quality and integrity
Implement and maintain data security, data privacy, and compliance measures
Perform data analysis, troubleshoot data issues, and provide technical support to end-users
Collaborate with AI scientists and data analysts to integrate predictive models into the analytics platform
Continuously monitor and optimize data pipelines and systems to ensure optimal performance and scalability
Stay up-to-date with the latest technologies and trends in data engineering, AWS cloud, and healthcare/pharmaceutical industry.
Requirements:
Bachelor's degree in Computer Science, Information Technology, or related field
5 years of experience in software or data engineering
Proven experience in designing and developing data pipelines and systems in a cloud environment, preferably AWS
Strong proficiency in Python programming language and related frameworks/libraries
Expertise in Airflow/Kafka and event-driven architecture
Familiarity with database technologies such as SQL, NoSQL, and data warehousing concepts
Experience with data security, privacy, and compliance measures
Strong analytical and problem-solving skills
Excellent communication and collaboration skills
Knowledge of healthcare/pharmaceutical industry and related data standards and regulations is a plus.
If you meet these requirements and are passionate about data engineering, healthcare, and pharmaceuticals, we encourage you to apply for this exciting opportunity.



  • San Francisco, United States People Data Labs Full time

    Job DescriptionJob DescriptionAbout UsAt People Data Labs, we're committed to democratizing access to high-quality B2B data and leading the emerging DaaS economy. We empower developers, engineers, and data scientists to create innovative, compliant data products at scale with our clean, easy-to-use datasets of resume, company, location, and education...


  • San Francisco, United States VAST Data Full time

    VAST Data is looking for a Senior Systems Engineer to join our growing team! This is a great opportunity to be part of the fastest-growing infrastructure company in history. In just a few short years, we’ve shaken up the industry by challenging traditional architecture models and introduced a revolutionary set of storage possibilities through our...


  • San Francisco, United States Unreal Gigs Full time

    Job DescriptionJob DescriptionCompany Overview: Welcome to the forefront of data-driven innovation! Our company is dedicated to harnessing the power of data to drive transformative change and solve complex problems across industries. We're committed to building scalable and reliable data infrastructure that enables advanced analytics, machine learning,...

  • Senior Data Engineer

    4 weeks ago


    San Francisco, United States UpRecruit Full time

    Job DescriptionJob DescriptionJob Details: Title: Sr. Data EngineerSalary: $180-$230K Requirements: 8+ years of software dev exp (Large Data Sets or Big Data)Location: 100% onsite (San Francisco Bay Area) Our client, a gaming startup, is seeking a Sr. Data Engineer to join their passionate team. The ideal candidate is an experienced engineer who will play a...

  • Senior Data Engineer

    1 month ago


    San Francisco, United States Sephora Full time

    At Sephora we inspire our customers, empower our teams, and help them become the best versions of themselves.  We create an environment where people are valued, and differences are celebrated. Every day, our teams across the world bring to life our purpose: to expand the way the world sees beauty by empowering the ExtraOrdinary in each of us. We are...


  • San Francisco, United States Siri InfoSolutions Inc Full time

    Job DescriptionJob DescriptionSenior Data Engineer 12 MonthsSFO, CA( Onsite)Need to be strong with object oriented programming languages Java, Scala, PythonNeed to have some frontend skills JavaScript or similar.Skill set Big Data: Scala, Databricks, Spark SQL, Spark Streaming ( Nice to Have ), Python ( Nice to Have ), PySpark ( Nice to Have )Cloud: Azure ,...


  • San Francisco, United States Social Finance Ltd Full time

    Who we are: Shape a brighter financial future with us. Together with our members, we're changing the way people think about and interact with personal finance. We're a next-generation fintech company using innovative, mobile-first technology to help our millions of members reach their goals. The industry is going through an unprecedented transformation, and...


  • San Francisco, United States Unreal Gigs Full time

    Job DescriptionJob DescriptionCompany Overview: Welcome to the forefront of data-driven innovation! Our company is dedicated to leveraging the power of data to drive transformative change and solve complex problems across industries. We're committed to building scalable and efficient data warehousing solutions that enable advanced analytics, reporting,...


  • San Francisco, United States Unreal Gigs Full time

    Company Overview: Welcome to the forefront of data-driven innovation! Our company is dedicated to harnessing the power of data to drive transformative change and solve complex problems across industries. We're committed to building cutting-edge data systems that enable efficient data management, processing, and analysis. Join us and be part of a dynamic team...


  • San Francisco, United States Unreal Gigs Full time

    Company Overview: Welcome to the forefront of data-driven innovation! Our company is dedicated to harnessing the power of data to drive transformative change and solve complex problems across industries. We're committed to building cutting-edge data systems that enable efficient data management, processing, and analysis. Join us and be part of a dynamic team...


  • San Francisco, United States Unreal Gigs Full time

    Job DescriptionJob DescriptionCompany Overview: Welcome to the forefront of data-driven innovation! Our company is dedicated to harnessing the power of data to drive transformative change and solve complex problems across industries. We're committed to building cutting-edge data systems that enable efficient data management, processing, and analysis....


  • San Francisco, United States Unreal Gigs Full time

    Company Overview: Welcome to the forefront of data-driven innovation! Our company is dedicated to harnessing the power of data to drive transformative change and solve complex problems across industries. We're committed to building cutting-edge cloud data solutions that leverage the scalability, flexibility, and power of cloud platforms. Join us and be part...


  • San Francisco, United States Unreal Gigs Full time

    Job DescriptionJob DescriptionCompany Overview: Welcome to the forefront of data-driven innovation! Our company is dedicated to harnessing the power of data to drive transformative change and solve complex problems across industries. We're committed to building cutting-edge cloud data solutions that leverage the scalability, flexibility, and power of...


  • San Francisco, United States Unreal Gigs Full time

    Job DescriptionJob DescriptionCompany Overview: Welcome to the forefront of data-driven innovation! Our company is committed to harnessing the power of big data to drive transformative change and solve complex problems across industries. We're dedicated to building scalable and efficient big data solutions that enable advanced analytics, machine...


  • San Francisco, United States Unreal Gigs Full time

    Job DescriptionJob DescriptionCompany Overview: Welcome to the forefront of data-driven innovation! Our company is dedicated to harnessing the power of real-time data to drive transformative change and solve complex problems across industries. We're committed to building cutting-edge real-time data solutions that enable timely insights and actions. Join...


  • San Francisco, United States TuneIn Full time

    **Senior Data Warehouse Engineer** San Francisco / Engineering Platform / Full-time Regular **Location: San Francisco, Los Angeles, New York, or Remote** At TuneIn, we are reinventing radio for a connected world, with live sports, up-to-the-minute news, curated music, millions of podcasts, and over 120,000 streaming radio stationsstreamed to tens of...

  • Data Engineer

    3 weeks ago


    South San Francisco, United States TALENT Software Services Full time

    Are you an experienced Data Engineer with a desire to excel? If so, then Talent Software Services may have the job for you! Our client is seeking an experienced Data Engineer to work in Bloomington, MN(Remote).Position Summary: Looking for a Data Engineer to join our team and help us develop, maintain, and optimize ETL processes. This position requires a...

  • Data Engineer

    3 weeks ago


    South San Francisco, United States TALENT Software Services Full time

    Are you an experienced Data Engineer with a desire to excel? If so, then Talent Software Services may have the job for you! Our client is seeking an experienced Data Engineer to work in Bloomington, MN(Remote).Position Summary: Looking for a Data Engineer to join our team and help us develop, maintain, and optimize ETL processes. This position requires a...

  • Data Analyst

    2 hours ago


    San Francisco, United States People Data Labs Full time

    Job DescriptionJob DescriptionAbout UsAt People Data Labs, we're committed to democratizing access to high-quality B2B data and leading the emerging DaaS economy. We empower developers, engineers, and data scientists to create innovative, compliant data products at scale with our clean, easy-to-use datasets of resume, company, location, and education...


  • San Francisco, California, United States Gantri Full time

    CompanyGantri is the world's first digital manufacturer for creative lighting. We help independent designers, studios, and influencers to develop original, sustainably made lighting designs and sell directly to consumers. We manufacture and fulfill all orders on-demand using 3D printing from innovative plant-based materials.Since launching in 2017, we've...