Senior Data Engineer
2 weeks ago
Job Description
We are seeking a highly skilled Senior Data Engineer with expertise in SQL, Python and PySpark, with extensive knowledge and practical experience in utilizing AWS services. The ideal candidate will have a strong background in data engineering, with a focus on building scalable and efficient data pipelines. The person in this role will work with a wide array of healthcare data for ingestion, processing and consumption including but not limited to eligibility, claims, payments and risk adjustment.
KEY DUTIES AND RESPONSIBILITIES:
Design, develop, and maintain robust data pipelines using Python and PySpark to process large volumes of healthcare data efficiently in a multitenant analytics platform.
Collaborate with cross-functional teams to understand data requirements, implement data models, and ensure data integrity throughout the pipeline.
Optimize data workflows for performance and scalability, considering factors such as data volume, velocity, and variety.
Implement best practices for data ingestion, transformation, and storage in AWS services such as S3, Glue, EMR, Athena, and Redshift.
Model data in relational databases (e.g., PostgreSQL, MySQL) and file-based databases to support data processing requirements.
Design and implement ETL processes using Python and PySpark to extract, transform, and load data from various sources into target databases.
Troubleshoot and enhance existing ETLs and processing scripts to improve efficiency and reliability of data pipelines.
Develop monitoring and alerting mechanisms to proactively identify and address data quality issues and performance bottlenecks.
EDUCATION AND EXPERIENCE:
Minimum of 5 years of experience in data engineering, with a focus on building and optimizing data pipelines.
Expertise in Python programming and hands-on experience with SQL and PySpark for data processing and analysis.
Proficiency in Python frameworks and libraries for scientific computing (e.g. Numpy, Pandas, SciPy, Pytorch, Pyarrow).
Strong understanding of AWS services and experience in deploying data solutions on cloud platforms.
Experience working with healthcare data, including but not limited to eligibility, claims, payments, and risk adjustment datasets.
Expertise in modeling data in relational databases (e.g., PostgreSQL, MySQL) and file-based databases, ETL processes and data warehousing concepts.
Proven track record of designing, implementing, and troubleshooting ETL processes and processing scripts using Python and PySpark.
Excellent problem-solving skills and the ability to work independently as well as part of a team.
Bachelor's or Master's degree in Computer Science, Data Engineering, or a related field.
Relevant certifications in AWS or data engineering would be a plus.
About Us
Convey is an analytics solution company focused on helping providers and health plans deliver improved financial and medical cost outcomes. Convey's Pareto IntelligenceTM was designed to help our health plan clients solve critical financial and business challenges in a post PPACA (Patient Protection and Affordable Care Act) world.
#J-18808-Ljbffr
-
Senior Data Engineer
4 weeks ago
Fort Worth, United States Robert Half Full timeSenior Data Engineer If you’re looking for the DNA of a start-up with the financial stability of a larger corporation, then you’ll love this! Why Join us?Our success is driven by the collective talent, expertise and enthusiasm of each unique employee working toward a common goal of delivering a superior customer experience. Yet, in spite of having one...
-
Senior Data Engineer
4 weeks ago
Fort Worth, United States Robert Half Full timeSenior Data Engineer If you’re looking for the DNA of a start-up with the financial stability of a larger corporation, then you’ll love this! Why Join us?Our success is driven by the collective talent, expertise and enthusiasm of each unique employee working toward a common goal of delivering a superior customer experience. Yet, in spite of having one...
-
Senior Data Engineer
4 weeks ago
Fort Worth, United States Robert Half Full timeSenior Data Engineer If you’re looking for the DNA of a start-up with the financial stability of a larger corporation, then you’ll love this! Why Join us?Our success is driven by the collective talent, expertise and enthusiasm of each unique employee working toward a common goal of delivering a superior customer experience. Yet, in spite of having one...
-
Senior Data Engineer
2 weeks ago
Fort Lauderdale, United States Quess Full time5 years experience Top skills needed Python, PySpark , frameworks and libraries (e.g. Numpy, Pandas, SciPy, Pytorch, Pyarrow) Modeling data in relational databases (e.g., PostgreSQL, MySQL) and file-based databases, ETL processes and data warehousing concept AWS services such as S3, Glue, EMR, and Redshift, deploying data solutions on cloud platforms...
-
Senior Cloud Security Architect/Engineer
2 weeks ago
Fort Lauderdale, United States Optimize Search Group Full timeTitle: Senior Cloud Security Architect/Engineer Location: Fort Lauderdale, FL (Hybrid- 3 days onsite, 2 days remote) Duration: Full Time Overview: We are seeking a skilled and experienced Cloud Security Cloud Architect/Engineer to join our team. This role involves overseeing our zero-trust network implementation, primarily utilizing Palo Alto's Prisma Cloud...
-
Senior Structural Engineer
3 weeks ago
Fort Lauderdale, United States Advanced Structural Solutions Inc Full timeJob Description Job Description Senior Structural Designer - Join Our Growing Team at Advanced Structural Solutions! About Us: Advanced Structural Solutions is at the forefront of the engineering consulting world, rapidly growing thanks to our innovative solutions and structural design expertise. Specializing in the restoration of high-rise buildings and a...
-
Senior Structural Engineer
3 weeks ago
Fort Lauderdale, United States Advanced Structural Solutions LLC Full timeJob DescriptionJob DescriptionSenior Structural Designer - Join Our Growing Team at Advanced Structural Solutions!About Us:Advanced Structural Solutions is at the forefront of the engineering consulting world, rapidly growing thanks to our innovative solutions and structural design expertise. Specializing in the restoration of high-rise buildings and a broad...
-
Fort Lauderdale, United States Georgia IT Inc Full timeSenior Quality Automation Engineer Location: Ft. Lauderdale, FL Duration: Contract to hire Rate: DOE NO third-party Corp to Corp accepted for this job Required Skills: Bachelor's degree in Computer Science, Software Engineering, or a related field At least 5 -7 years of experience in automation development and testing Strong experience in test automation...
-
Senior Software Engineer
2 days ago
Fort Mill, United States Lorven technologies Full timeJob DescriptionJob DescriptionRole: Senior Software Engineer - Snowflake Data Engineer Location: Fort Mill , SC We are seeking a highly skilled and experienced Data Engineer to join our team. The ideal candidate will have expertise in the following areas: 1. Snowflake, Snowpark: The candidate should have a deep understanding of Snowflake data warehousing...
-
Senior Project Engineer/Leader
3 weeks ago
Fort Lauderdale, United States H&H Full timeJob DescriptionJob DescriptionH&H is offering and exciting opportunity for a Senior Project Engineer/Leader in Fort Lauderdale, FL.H&H is a full-service infrastructure engineering firm with more than 130 years of experience steeped in solving complex engineering challenges. Consulting firms, contractors and infrastructure owners count on us when innovative...
-
Senior Desktop Engineer
3 days ago
Fort Lauderdale, United States Seacoast Bank Full timeDescription Hybrid work arrangement (3 days in the office/2 days remote). Location is flexible within the Seacoast footprint in Florida. JOB SUMMARY: The Senior End User Computing Engineer plays a critical role in ensuring the stability, security, and optimal performance of Seacoast's end user computing environment. This position requires advanced expertise...
-
Data Engineer
2 weeks ago
Fort Worth, United States Vantage Bank Full timeJOB CLASSIFICATION Full / Part-time: Full-time Hours Per Week: 40 Location: 3131 West 7th Street Suite 200, Fort Worth TX 76107 The Data Engineer is part of a high-performing Data Engineering team that will play a crucial role in designing, developing, and maintaining scalable data pipelines and infrastructure to support our banking operations. You will...
-
Fort Lauderdale, United States Wärtsilä Full timeSenior Service Engineer, Instrumentation and Controls Wärtsilä Energy leads the transition towards a 100% renewable energy future. We help our partners to accelerate their decarbonisation journeys through our market-leading technologies and power system modelling expertise. These cover decarbonisation services, future-fuel enabled balancing power...
-
Senior Technician
7 days ago
Fort Lauderdale, United States Stryker Corporation Full timeAs a member of the Engineering Services Team in our Digital, Robotics and Enabling Technology (DRE) division, you will be responsible for technical functions in support of engineering activities such as design, test, documentation, electro-mechanical Technician, Healthcare, Mechanical, Technology, Senior, Insurance, Manufacturing
-
Senior Water Treatment Engineer
1 week ago
Fort Collins, United States CPS Full timeWater Treatment Engineer/Senior Water Treatment Engineer/Chemistry/Power Engineering/Senior Process Engineer/Senior Engineer/Chemical Engineer/Engineer/Engineering/Chemicals/Chemical Manufacturing/Agricultural Manufacturing/PSM/HAZOPs/MOCs/Continuous Process/Process Engineer/Wastewater/Water Treatment/Steam System/Hydrogen/ Our client is a producer of...
-
Fort Lauderdale, United States Georgia IT Inc Full timeSenior Azure Cloud DevOps Engineer Location: Ft. Lauderdale, FL (relocation within 90 days) Duration: Contract to hire Rate: DOE Skills and Experience Needed: Minimum 10 years of automation and IT experience. Including 3+ years of experience developing platform orchestration code in Azure Python SDK, Terraform and GitHub Runners Previous public cloud...
-
Fort Lauderdale, United States Georgia IT Inc Full timeSenior Azure Cloud DevOps Engineer Location: Ft. Lauderdale, FL (relocation within 90 days) Duration: Contract to hire Rate: DOE Skills and Experience Needed: Minimum 10 years of automation and IT experience. Including 3+ years of experience developing platform orchestration code in Azure Python SDK, Terraform and GitHub Runners Previous public cloud...
-
Data Engineer
3 weeks ago
Fort Worth, United States Motion Recruitment Full timeFort Worth, TX company is seeking a Data Engineer to join their team for a contract opportunity. Leverage the latest technology to solve business problems in a collaborative environment at this Fortune 500 transportation giant. Top technical resources are retained on long-term contract engagements. Responsible for leveraging cutting edge technology to...
-
Senior Project Engineer/Leader
3 weeks ago
Fort Lauderdale, Florida, United States H&H Full timeH&H is offering and exciting opportunity for a Senior Project Engineer/Leader in Fort Lauderdale, FL. H&H is a full-service infrastructure engineering firm with more than 130 years of experience steeped in solving complex engineering challenges. Consulting firms, contractors and infrastructure owners count on us when innovative design and intricate...
-
Data Engineer
3 weeks ago
Fort Worth, Texas, United States Motion Recruitment Full timeFort Worth, TX company is seeking a Data Engineer to join their team for a contract opportunity.Leverage the latest technology to solve business problems in a collaborative environment at this Fortune 500 transportation giant. Top technical resources are retained on long-term contract engagements. Responsible for leveraging cutting edge technology to solve...