Senior Data Engineer

2 weeks ago


Fort Lauderdale, United States CareerBuilder Full time

Job Description

We are seeking a highly skilled Senior Data Engineer with expertise in SQL, Python and PySpark, with extensive knowledge and practical experience in utilizing AWS services. The ideal candidate will have a strong background in data engineering, with a focus on building scalable and efficient data pipelines. The person in this role will work with a wide array of healthcare data for ingestion, processing and consumption including but not limited to eligibility, claims, payments and risk adjustment.

KEY DUTIES AND RESPONSIBILITIES:

Design, develop, and maintain robust data pipelines using Python and PySpark to process large volumes of healthcare data efficiently in a multitenant analytics platform.
Collaborate with cross-functional teams to understand data requirements, implement data models, and ensure data integrity throughout the pipeline.
Optimize data workflows for performance and scalability, considering factors such as data volume, velocity, and variety.
Implement best practices for data ingestion, transformation, and storage in AWS services such as S3, Glue, EMR, Athena, and Redshift.
Model data in relational databases (e.g., PostgreSQL, MySQL) and file-based databases to support data processing requirements.
Design and implement ETL processes using Python and PySpark to extract, transform, and load data from various sources into target databases.
Troubleshoot and enhance existing ETLs and processing scripts to improve efficiency and reliability of data pipelines.
Develop monitoring and alerting mechanisms to proactively identify and address data quality issues and performance bottlenecks.

EDUCATION AND EXPERIENCE:

Minimum of 5 years of experience in data engineering, with a focus on building and optimizing data pipelines.
Expertise in Python programming and hands-on experience with SQL and PySpark for data processing and analysis.
Proficiency in Python frameworks and libraries for scientific computing (e.g. Numpy, Pandas, SciPy, Pytorch, Pyarrow).
Strong understanding of AWS services and experience in deploying data solutions on cloud platforms.
Experience working with healthcare data, including but not limited to eligibility, claims, payments, and risk adjustment datasets.
Expertise in modeling data in relational databases (e.g., PostgreSQL, MySQL) and file-based databases, ETL processes and data warehousing concepts.
Proven track record of designing, implementing, and troubleshooting ETL processes and processing scripts using Python and PySpark.
Excellent problem-solving skills and the ability to work independently as well as part of a team.
Bachelor's or Master's degree in Computer Science, Data Engineering, or a related field.
Relevant certifications in AWS or data engineering would be a plus.

About Us

Convey is an analytics solution company focused on helping providers and health plans deliver improved financial and medical cost outcomes. Convey's Pareto IntelligenceTM was designed to help our health plan clients solve critical financial and business challenges in a post PPACA (Patient Protection and Affordable Care Act) world.
#J-18808-Ljbffr


  • Senior Data Engineer

    4 weeks ago


    Fort Worth, United States Robert Half Full time

    Senior Data Engineer If you’re looking for the DNA of a start-up with the financial stability of a larger corporation, then you’ll love this! Why Join us?Our success is driven by the collective talent, expertise and enthusiasm of each unique employee working toward a common goal of delivering a superior customer experience. Yet, in spite of having one...

  • Senior Data Engineer

    4 weeks ago


    Fort Worth, United States Robert Half Full time

    Senior Data Engineer If you’re looking for the DNA of a start-up with the financial stability of a larger corporation, then you’ll love this! Why Join us?Our success is driven by the collective talent, expertise and enthusiasm of each unique employee working toward a common goal of delivering a superior customer experience. Yet, in spite of having one...

  • Senior Data Engineer

    4 weeks ago


    Fort Worth, United States Robert Half Full time

    Senior Data Engineer If you’re looking for the DNA of a start-up with the financial stability of a larger corporation, then you’ll love this! Why Join us?Our success is driven by the collective talent, expertise and enthusiasm of each unique employee working toward a common goal of delivering a superior customer experience. Yet, in spite of having one...

  • Senior Data Engineer

    2 weeks ago


    Fort Lauderdale, United States Quess Full time

    5 years experience Top skills needed Python, PySpark , frameworks and libraries (e.g. Numpy, Pandas, SciPy, Pytorch, Pyarrow) Modeling data in relational databases (e.g., PostgreSQL, MySQL) and file-based databases, ETL processes and data warehousing concept AWS services such as S3, Glue, EMR, and Redshift, deploying data solutions on cloud platforms...


  • Fort Lauderdale, United States Optimize Search Group Full time

    Title: Senior Cloud Security Architect/Engineer Location: Fort Lauderdale, FL (Hybrid- 3 days onsite, 2 days remote) Duration: Full Time Overview: We are seeking a skilled and experienced Cloud Security Cloud Architect/Engineer to join our team. This role involves overseeing our zero-trust network implementation, primarily utilizing Palo Alto's Prisma Cloud...


  • Fort Lauderdale, United States Advanced Structural Solutions Inc Full time

    Job Description Job Description Senior Structural Designer - Join Our Growing Team at Advanced Structural Solutions! About Us: Advanced Structural Solutions is at the forefront of the engineering consulting world, rapidly growing thanks to our innovative solutions and structural design expertise. Specializing in the restoration of high-rise buildings and a...


  • Fort Lauderdale, United States Advanced Structural Solutions LLC Full time

    Job DescriptionJob DescriptionSenior Structural Designer - Join Our Growing Team at Advanced Structural Solutions!About Us:Advanced Structural Solutions is at the forefront of the engineering consulting world, rapidly growing thanks to our innovative solutions and structural design expertise. Specializing in the restoration of high-rise buildings and a broad...


  • Fort Lauderdale, United States Georgia IT Inc Full time

    Senior Quality Automation Engineer Location: Ft. Lauderdale, FL Duration: Contract to hire Rate: DOE NO third-party Corp to Corp accepted for this job Required Skills: Bachelor's degree in Computer Science, Software Engineering, or a related field At least 5 -7 years of experience in automation development and testing Strong experience in test automation...


  • Fort Mill, United States Lorven technologies Full time

    Job DescriptionJob DescriptionRole: Senior Software Engineer - Snowflake Data Engineer Location: Fort Mill , SC We are seeking a highly skilled and experienced Data Engineer to join our team. The ideal candidate will have expertise in the following areas: 1. Snowflake, Snowpark: The candidate should have a deep understanding of Snowflake data warehousing...


  • Fort Lauderdale, United States H&H Full time

    Job DescriptionJob DescriptionH&H is offering and exciting opportunity for a Senior Project Engineer/Leader in Fort Lauderdale, FL.H&H is a full-service infrastructure engineering firm with more than 130 years of experience steeped in solving complex engineering challenges. Consulting firms, contractors and infrastructure owners count on us when innovative...


  • Fort Lauderdale, United States Seacoast Bank Full time

    Description Hybrid work arrangement (3 days in the office/2 days remote). Location is flexible within the Seacoast footprint in Florida. JOB SUMMARY: The Senior End User Computing Engineer plays a critical role in ensuring the stability, security, and optimal performance of Seacoast's end user computing environment. This position requires advanced expertise...

  • Data Engineer

    2 weeks ago


    Fort Worth, United States Vantage Bank Full time

    JOB CLASSIFICATION Full / Part-time: Full-time Hours Per Week: 40 Location: 3131 West 7th Street Suite 200, Fort Worth TX 76107 The Data Engineer is part of a high-performing Data Engineering team that will play a crucial role in designing, developing, and maintaining scalable data pipelines and infrastructure to support our banking operations. You will...


  • Fort Lauderdale, United States Wärtsilä Full time

    Senior Service Engineer, Instrumentation and Controls Wärtsilä Energy leads the transition towards a 100% renewable energy future. We help our partners to accelerate their decarbonisation journeys through our market-leading technologies and power system modelling expertise. These cover decarbonisation services, future-fuel enabled balancing power...

  • Senior Technician

    7 days ago


    Fort Lauderdale, United States Stryker Corporation Full time

    As a member of the Engineering Services Team in our Digital, Robotics and Enabling Technology (DRE) division, you will be responsible for technical functions in support of engineering activities such as design, test, documentation, electro-mechanical Technician, Healthcare, Mechanical, Technology, Senior, Insurance, Manufacturing


  • Fort Collins, United States CPS Full time

    Water Treatment Engineer/Senior Water Treatment Engineer/Chemistry/Power Engineering/Senior Process Engineer/Senior Engineer/Chemical Engineer/Engineer/Engineering/Chemicals/Chemical Manufacturing/Agricultural Manufacturing/PSM/HAZOPs/MOCs/Continuous Process/Process Engineer/Wastewater/Water Treatment/Steam System/Hydrogen/ Our client is a producer of...


  • Fort Lauderdale, United States Georgia IT Inc Full time

    Senior Azure Cloud DevOps Engineer Location: Ft. Lauderdale, FL (relocation within 90 days) Duration: Contract to hire Rate: DOE Skills and Experience Needed: Minimum 10 years of automation and IT experience. Including 3+ years of experience developing platform orchestration code in Azure Python SDK, Terraform and GitHub Runners Previous public cloud...


  • Fort Lauderdale, United States Georgia IT Inc Full time

    Senior Azure Cloud DevOps Engineer Location: Ft. Lauderdale, FL (relocation within 90 days) Duration: Contract to hire Rate: DOE Skills and Experience Needed: Minimum 10 years of automation and IT experience. Including 3+ years of experience developing platform orchestration code in Azure Python SDK, Terraform and GitHub Runners Previous public cloud...

  • Data Engineer

    3 weeks ago


    Fort Worth, United States Motion Recruitment Full time

    Fort Worth, TX company is seeking a Data Engineer to join their team for a contract opportunity. Leverage the latest technology to solve business problems in a collaborative environment at this Fortune 500 transportation giant. Top technical resources are retained on long-term contract engagements. Responsible for leveraging cutting edge technology to...


  • Fort Lauderdale, Florida, United States H&H Full time

    H&H is offering and exciting opportunity for a Senior Project Engineer/Leader in Fort Lauderdale, FL. H&H is a full-service infrastructure engineering firm with more than 130 years of experience steeped in solving complex engineering challenges. Consulting firms, contractors and infrastructure owners count on us when innovative design and intricate...

  • Data Engineer

    3 weeks ago


    Fort Worth, Texas, United States Motion Recruitment Full time

    Fort Worth, TX company is seeking a Data Engineer to join their team for a contract opportunity.Leverage the latest technology to solve business problems in a collaborative environment at this Fortune 500 transportation giant. Top technical resources are retained on long-term contract engagements. Responsible for leveraging cutting edge technology to solve...