Senior Data Engineer

3 weeks ago


Los Angeles, United States YO HR CONSULTANCY Full time
Job DescriptionJob DescriptionSenior Data Engineer&
ExpertisePythonSQLNoSQLAWSAzureData ModelingKubernetesHIPAAApache Spark - 3 yearsPySparkSnowflake - 3 yearsApache AirflowData Engineer - 3 yearsSchema Design

Requirements: Bachelor’s or master’s degree in computer science, Engineering, or a related field. 5 - 10 years of experience in data engineering, with a strong background in Apache Spark and cloud-based databases such as Snowflake. Strong Knowledge in Big Data Technologies, PySpark, thorough in one or more programming language like Python Proven experience with AWS or Azure cloud services for data storage, processing, and analytics. Expertise in workflow management tools like Airflow and container orchestration systems such as Kubernetes. Strong knowledge of SQL and NoSQL databases, as well as data modeling and schema design principles. Familiarity with healthcare data standards, terminologies, and regulations, such as HIPAA and GDPR, is highly desirable. Excellent problem-solving, communication, and collaboration skills, with the ability to work effectively in cross-functional teams. Demonstrated ability to manage multiple projects, prioritize tasks, and meet deadlines in a fast-paced environment. A strong desire to learn, adapt, and contribute to a rapidly evolving data landscape.
Responsibilities: Design, develop, and maintain scalable, reliable, and secure data pipelines to process large volumes of structured and unstructured healthcare data using PySpark and cloud-based databases. Collaborate with data architects, data scientists, and analysts to understand data requirements and implement solutions that meet business and technical objectives. Leverage AWS or Azure cloud services for data storage, processing, and analytics, optimizing cost and performance. Utilize tools like Airflow for workflow management and Kubernetes for container orchestration to ensure seamless deployment, scaling, and management of data processing applications. Develop and implement data ingestion, transformation, and validation processes to ensure data quality, consistency, and reliability across various healthcare datasets. Monitor and troubleshoot data pipelines, proactively identifying and resolving issues to minimize downtime and ensure optimal performance. Establish and enforce data engineering best practices, ensuring compliance with data privacy and security regulations specific to the healthcare industry. Continuously evaluate and adopt new tools, technologies, and frameworks to improve the data infrastructure and drive innovation. Mentor and guide junior data engineers, fostering a culture of collaboration, learning, and growth within the team. Collaborate with cross-functional teams to align data engineering efforts with broader organizational goals and strategies. Is familiar with SOC 2 compliance and its impact on company policies and processes. Understands importance of adhering to SOC 2 requirements and maintains an effort to do so



  • Los Angeles, United States Winmaxcorp Full time

    **Senior Data Warehouse Engineer** **Aug 31, 2021Pasadena, California** **Senior Data Warehouse Engineer 6 Months contract Remote Workplace, CA** **Job Description: Senior Data Warehouse Engineer** This position will be essential for the continuous success of the Enterprise Data Warehouse team. Working side-by-side with existing data warehouse team...


  • Los Angeles, United States Brooksource Full time

    *Sr Data Engineer * *Los Angeles, CA – Hybrid * *6 month contract-to-hire * *Pay Rate: Flexible DOE $70-$85/hour * *About * Our Fortune 50 Broadcast, Media & Entertainment Client is seeing a Data Engineer to join the team in LA, California. As a senior data engineer you will have the opportunity to work with cutting edge technology to impact the way an...

  • Senior Data Engineer

    14 hours ago


    Los Angeles, United States Brooksource Full time

    *Sr Data Engineer * *Los Angeles, CA Hybrid * *6 month contract-to-hire * *Pay Rate: Flexible DOE $70-$85/hour * *About * Our Fortune 50 Broadcast, Media & Entertainment Client is seeing a Data Engineer to join the team in LA, California. As a senior data engineer you will have the opportunity to work with cutting edge technology to impact the way an...

  • Senior Data Engineer

    4 weeks ago


    Los Angeles, United States Motion Recruitment Full time

    A fintech -based automated investment company that handles billions in client funds is hiring a Senior Data Engineer to join the team. In this role you will excel if you have a software background and can develop APIs with python while building out new ETL pipelines to support key trading and portfolio investment systems. The main tech stack for this role...


  • Los Angeles, United States Motion Recruitment Full time

    A fintech -based automated investment company that handles billions in client funds is hiring a Senior Data Engineer to join the team. In this role you will excel if you have a software background and can develop APIs with python while building out new ETL pipelines to support key trading and portfolio investment systems. The main tech stack for this role...


  • Los Angeles, United States Slalom Full time

    Who You'll Work With As a modern technology company, we've never met a technical challenge we didn't like. We enable our clients to learn from their data, create incredible digital experiences, and make the most of new technologies. We blend design, engineering, and analytics expertise to build the future. We surround our technologists with interesting...

  • Senior ETL DEV

    2 months ago


    Los Angeles, United States Gold Coast Health Plan Full time

    Senior ETL DEV-Data Engineer Requisition ID: 1493 Salary Range: $100,406.00 To 167,344.00 Annually ( Mid-Range: $133,875 ) CA salary range posted. Please note: Salary range will vary for out of state remote work. The pay range above represents the minimum and maximum rate for this position in California. Factors that may be used to determine where newly...


  • Los Angeles, United States Metropolis Full time

    Job DescriptionJob DescriptionThe CompanyMetropolis develops advanced computer vision and machine learning technology that makes mobile commerce remarkable. Our platform is already deployed in hundreds of mobility facilities and industries with billions in opportunity. We're building the digital pipes through which the future of mobile commerce will...


  • Los Angeles, United States Metropolis Full time

    Job DescriptionJob DescriptionThe CompanyMetropolis is an artificial intelligence company that uses computer vision technology to enable frictionless, checkout-free experiences in the real world. Today, we are reimagining parking to enable millions of consumers to just "drive in and drive out." We envision a future where people transact in the real world...


  • Los Angeles, California, United States Motion Recruitment Full time

    Our client is an Investment Tech company in the Los Angeles area hiring for a Software/Data Engineer. They are looking for someone with 6+ years of experience in Software/Data Engineering coding in Python and building out ETL pipelines. Ideally, they need someone to come in make an immediate impact. If you are in the Los Angeles area looking to get out of...

  • Senior Data Engineer

    3 weeks ago


    Los Angeles, California, United States Motion Recruitment Full time

    Our client is an Investment Tech company in the Los Angeles area hiring for a Software/Data Engineer. They are looking for someone with 6+ years of experience in Software/Data Engineering coding in Python and building out ETL pipelines. Ideally, they need someone to come in make an immediate impact. If you are in the Los Angeles area looking to get out of...


  • Los Angeles, United States Arup Full time

    Senior Electrical Engineer - Data Centers Americas Region ? SAN0000W9Requisition # Dedicatedto sustainable development, Arup is a collective of designers, advisors and experts working globally. Founded to be humane and excellent, we collaborate with our clients and partners using imagination, technology, and rigor to shape a better world. Our West Geography...

  • Data Engineer

    1 week ago


    Los Angeles, United States Motion Recruitment Full time

    Our client, a global leader in media & entertainment is actively looking for a Data Engineer to join their team in Los Angeles, CA! ***This role is a hybrid position, working onsite 3 days/week. Candidates must be commutable to Hollywood, California***   Key Responsibilities: Build complex data engineering pipelines using Python and Airflow to...

  • Data Engineer

    3 weeks ago


    Los Angeles, United States Motion Recruitment Full time

    Our client, a global leader in media & entertainment is actively looking for a Data Engineer to join their team in Los Angeles, CA! ***This role is a hybrid position, working onsite 3 days/week. Candidates must be commutable to Hollywood, California***   Key Responsibilities: Build complex data engineering pipelines using Python and Airflow to...

  • Data Engineer

    4 weeks ago


    Los Angeles, United States Proliance Consulting Full time

    Data EngineerLength: until 10/31/24 (strong possibility of extension or conversion)Associate Vendors: We are accepting applications from candidates who are currently authorized to work in the US for any employer without sponsorship.Role & Responsibilities• Build complex data engineering pipelines using Python and Airflow to hydrate datamarts in Snowflake...

  • Data Engineer

    2 months ago


    Los Angeles, United States Proliance Consulting Full time

    Data EngineerLength: until 10/31/24 (strong possibility of extension or conversion)Associate Vendors: We are accepting applications from candidates who are currently authorized to work in the US for any employer without sponsorship.Role & Responsibilities• Build complex data engineering pipelines using Python and Airflow to hydrate datamarts in Snowflake...

  • Data Engineer

    1 week ago


    Los Angeles, United States Proliance Consulting Full time

    Data EngineerLength: until 10/31/24 (strong possibility of extension or conversion)Associate Vendors: We are accepting applications from candidates who are currently authorized to work in the US for any employer without sponsorship.Role & Responsibilities• Build complex data engineering pipelines using Python and Airflow to hydrate datamarts in Snowflake...

  • Data Engineer

    1 week ago


    Los Angeles, United States Proliance Consulting Full time

    Data EngineerLength: until 10/31/24 (strong possibility of extension or conversion)Associate Vendors: We are accepting applications from candidates who are currently authorized to work in the US for any employer without sponsorship.Role & Responsibilities• Build complex data engineering pipelines using Python and Airflow to hydrate datamarts in Snowflake...

  • Data Engineer

    2 months ago


    Los Angeles, United States Proliance Consulting Full time

    Data EngineerLength: until 10/31/24 (strong possibility of extension or conversion)Associate Vendors: We are accepting applications from candidates who are currently authorized to work in the US for any employer without sponsorship.Role & Responsibilities• Build complex data engineering pipelines using Python and Airflow to hydrate datamarts in Snowflake...

  • Senior Data Engineer

    4 weeks ago


    Los Angeles, United States Keeling Labs Full time

    Job DescriptionJob DescriptionOur MissionFounded in 2022, Keeling Labs was started as a place to develop and apply machine learning to solve the world's biggest problem—climate change. Our current priority is getting the grid to run on 100% clean energy, which is currently limited by battery storage (specifically, the algorithms that control...