Sr. Data Engineer

2 weeks ago

New York, New York, United States HealthFirst Full time
Hello Thank you for considering Healthfirst for your next career opportunity.

Who we are:

Healthfirst was founded by a collection of major healthcare systems in the New York area to emphasize high quality of care, and better patient outcomes. We have grown into New York's largest not-for-profit health insurer, and cover over 1.7 million members in New York City and on Long Island, as well as in Westchester, Sullivan, Orange, and Rockland counties. Healthfirst accomplishes this all while following our value-based model and collaborating with our hospital sponsors and provider partners through our provider delivery system.
More about the team, and the role:

The Sr Data Engineer is responsible for leading and implementing best-in-class data management strategies and practices through various forms of integration; data acquisition/ingestion, data cleansing/refinements, data transformations/conversions, data migrations, data purging, and back-ups. The role will work with a variety of users and stakeholders to understand data requirements and support the data architecture to translate into the data management practice at Healthfirst.

The Sr Data Engineer is to author artifacts defining standards and definitions for storing, processing and moving data, including associated processes and business rules. Additionally, the Data Engineer will map the details within these artifacts to business processes, non-functional characteristics, qualitative criteria, and technical enablement. The role is responsible to be constantly thinking through the needs of the business to support efficient and error-free processes.

The Sr Data Engineer is responsible for finding trends in datasets and developing workflows and algorithms to assist in highlighting strategic raw data as useful to the enterprise. The role is also responsible for creating data acquisition strategy and develop dataset processes in a robust manner according to best practices of standardization. The role will support the Data Science team through existing pipelines and processes to integrate towards best-in-class data management practices seamlessly.

Duties and Responsibilities:

  • Designs and implements standardized data management procedures around data staging, data ingestion, data preparation, data provisioning, and data destruction (e.g., scripts, programs, automation, etc.)
  • Ensures quality of technical solutions as data moves across multiple zones and environments
  • Provides insight into the changing data environment, data processing, data storage and utilization requirements for the company, and offer suggestions for solutions
  • Ensures managed analytic assets to support the company's strategic goals by creating and verifying data acquisition requirements and strategy
  • Develops, constructs, tests, and maintains architectures
  • Aligns architecture with business requirements and use programming language and tools
  • Identifies ways to improve data reliability, efficiency, and quality
  • Conducts research for industry and business questions
  • Deploys sophisticated analytics programs, machine learning, and statistical methods to efficiently implement solutions
  • Prepares data for predictive and prescriptive modeling and find hidden patterns using data; in support of the Data Science team
  • Uses data to discover tasks that can be automated
  • Creates data monitoring capabilities for each business process and works with data consumers on updates
  • Aligns data architecture to the solution architecture; contributes to overall solution architecture
  • Develops patterns for standardizing the environment technology stack
  • Helps maintain the integrity and security of company data

Minimum Qualifications:

  • Bachelor's Degree in Computer Engineering or related field
  • 8+ years of experience in data engineering
  • 5+ years of experience in data programming languages, such as java, python or pyspark
  • 5+ years of experience working in a 'Big Data' ecosystem process data; includes file systems, data structures/data bases, , automation, security, messaging, movement, etc.
  • 5+ years of experience working in a production cloud infrastructure

Preferred Qualifications:

  • Proven track record of success directing the efforts of data engineers and data analysts with a deadline-driven and fast-paced environment
  • Hands-on experience in leading healthcare data transformation initiatives from on-premises to cloud deployment
  • Demonstrated experience working in an Agile environment as a Data Engineer
  • Hands-on work with AWS, including creating Redshift data structures, accessing them with Spectrum, and storing data in S3
  • Knowledge of SQL and multiple programming languages to optimize data processes and retrieval
  • Proven results using an analytical perspective to identify engineering patterns within complex strategies and ideas, and break them down into engineered code components
  • Experience developing, prototyping, and testing engineered processes, products, or services
  • Proven ability to work in distributed systems
  • Proficiency with relational, graph and NoSQL databases
  • Must be able to develop creative solutions to problems
  • Demonstrates critical thinking skills with ability to communicate across functional departments to achieve desired outcomes
  • Excellent interpersonal skills with proven ability to influence with impact across functions and disciplines
  • Ability to work independently and as part of a team
  • Ability to manage multiple projects/deadlines, identifying the necessary steps, and moving forward through completion
  • Skilled in Microsoft Office; including PowerPoint, Word, Excel and Visio

Please note: Since we care so greatly about our employees' and members' wellbeing, Healthfirst is moving to a fully vaccinated in-office environment. You must be vaccinated to work in our offices, even if you are partially remote. If you are selected to interview for this role, we will explain our vaccination policy and ensure you are comfortable moving forward with further interviews based on your work location.

WE ARE AN EQUAL OPPORTUNITY EMPLOYER. Applicants and employees are considered for positions and are evaluated without regard to race, color, religion, gender, gender identity, sexual orientation, national origin, age, genetic information, military or veteran status, marital status, mental or physical disability or any other protected Federal, State/Province or Local status unrelated to the performance of the work involved.

If you have a disability under the Americans with Disability Act or a similar law and want a reasonable accommodation to assist with your job search or application for employment, please contact us by sending an email to or calling In your email please include a description of the accommodation you are requesting and a description of the position for which you are applying. Only reasonable accommodation requests related to applying for a position within Healthfirst Management Services will be reviewed at the e-mail address and phone number supplied. Thank you for considering a career with Healthfirst Management Services.

EEO Law Poster and Supplement

All hiring and recruitment at Healthfirst is transacted with a valid "" email address only or from a recruitment firm representing our Company. Any recruitment firm representing Healthfirst will readily provide you with the name and contact information of the recruiting professional representing the opportunity you are inquiring about. If you receive a communication from a sender whose domain is not , or not one of our recruitment partners, please be aware that those communications are not coming from or authorized by Healthfirst. Healthfirst will never ask you for money during the recruitment or onboarding process.

  • Sr. Storage Engineer

    3 weeks ago

    New York, New York, United States TEKsystems Full time

    Job TitleSr. Storage/Network AnalystTop Required Skills1) 7+ yrs experience in Storage Engineering in an enterprise level environment2) Experience helping to lead and drive project activities in the storage area3) Experience with NetApp and Pure Storage**Experience with storage in Azure would be a major plus**One of our principal healthcare clients is...

  • Sr. Storage Engineer

    2 weeks ago

    New York, New York, United States TEKsystems Full time

    Job TitleSr. Storage/Network AnalystTop Required Skills1) 7+ yrs experience in Storage Engineering in an enterprise level environment2) Experience helping to lead and drive project activities in the storage area3) Experience with NetApp and Pure Storage**Experience with storage in Azure would be a major plus**One of our principal healthcare clients is...

  • Sr. Front-End Software Engineer

    2 weeks ago

    New York, New York, United States WireWheel Full time

    WireWheel is seeking a SR. FRONT-END SOFTWARE ENGINEER to join our team. WireWheel is revolutionizing the area of privacy and data protection by helping companies to build and manage cutting-edge and scalable privacy programs. Recognized by IDC Marketplace, Forrester and Gartner as a leader in worldwide data privacy management software, our cloud-based Data...

  • Sr. Front-End Software Engineer

    3 weeks ago

    New York, New York, United States WireWheel Full time

    WireWheel is seeking a SR. FRONT-END SOFTWARE ENGINEER to join our team. WireWheel is revolutionizing the area of privacy and data protection by helping companies to build and manage cutting-edge and scalable privacy programs. Recognized by IDC Marketplace, Forrester and Gartner as a leader in worldwide data privacy management software, our cloud-based Data...

  • Sr. Storage Engineer

    2 weeks ago

    New York, New York, United States TEKsystems Full time

    Our client is looking for a Sr. Storage Engineer on a 6 month+ contract. The position can sit remote, but the person will need to be able to commute into NYC if needed. The candidate will be responsible for managing petabytes of data across an enterprise infrastructure. The candidate will be responsible for design, build/test, migration, configurations,...

  • Sr Data Engineer

    2 months ago

    New York, New York, United States MSIT Full time

    Responsibilities Leverages existing data infrastructure to fulfill all data-related requests perform necessary data housekeeping data cleansing normalization hashing and implementation of required data model changes. Builds evolves and scales out infrastructure to ingest process and extract meaning out of data. Analyzes data to spot anomalies trends and...

  • Deployment Engineer

    2 weeks ago

    New York, New York, United States Heron Data Full time

    As a Deployment Engineer at Heron, you'll play a pivotal role in ensuring our highest-value customers have a seamless experience with our product. You'll guide prospects through their trial phase, ensuring smooth transitions as they become customers. Sitting at the nexus of customers, customer success, engineering, and product, your technical expertise will...

  • Deployment Engineer

    2 weeks ago

    New York, New York, United States Heron Data Full time

    As a Deployment Engineer at Heron, you'll play a pivotal role in ensuring our highest-value customers have a seamless experience with our product. You'll guide prospects through their trial phase, ensuring smooth transitions as they become customers. Sitting at the nexus of customers, customer success, engineering, and product, your technical expertise will...

  • Sr Data Analyst

    2 weeks ago

    New York, New York, United States Matal Full time

    Responsiblties Deliver data research results to technical and non-technical audiences. Document data product functional and technical requirements and collaborate with Engineering to build and implement them. Collaborate with architects and platform engineering teams to optimize queries for performance and efficiency. Mentor and help junior resources on best...

  • Sr Data Analyst

    2 months ago

    New York, New York, United States Matal Full time

    Responsiblties Deliver data research results to technical and non-technical audiences. Document data product functional and technical requirements and collaborate with Engineering to build and implement them. Collaborate with architects and platform engineering teams to optimize queries for performance and efficiency. Mentor and help junior resources on best...

  • Executive Director, Sr. Client Partner: HC

    3 weeks ago

    New York, New York, United States NTT DATA Services Full time

    Req ID: NTT DATA Services strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a Executive Director, Sr. Client Partner: HC - Life Sciences (remote) to join our team in Newark, New Jersey (US-NJ),...

  • Executive Director, Sr. Client Partner: HC

    2 weeks ago

    New York, New York, United States NTT DATA Services Full time

    Req ID: NTT DATA Services strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a Executive Director, Sr. Client Partner: HC - Life Sciences (remote) to join our team in Newark, New Jersey (US-NJ),...

  • Data Engineer

    3 weeks ago

    New York, New York, United States rag & bone Full time

    We are seeking a highly skilled and motivated Data Engineer to join our team. The ideal candidate will have strong proficiency in Python programming language, extensive experience with Oracle PL/SQL, and a solid understanding of Azure Serverless compute resources. As a Data Engineer, you will be responsible for designing, implementing, and maintaining...

  • Data Engineer

    2 weeks ago

    New York, New York, United States Masterworks Full time

    Masterworks Overview:Masterworks is the only platform for investing in blue-chip, multi-million dollar artworks. Prior to Masterworks, the only way to allocate to art was to purchase a multi-million dollar painting, making the asset class inaccessible for most investors. The company has over 900,000 users signed-up purchasing shares in primary offerings...

  • Data Engineer

    2 months ago

    New York, New York, United States Masterworks Full time

    Masterworks Overview:Masterworks is the only platform for investing in blue-chip, multi-million dollar artworks. Prior to Masterworks, the only way to allocate to art was to purchase a multi-million dollar painting, making the asset class inaccessible for most investors. The company has over 900,000 users signed-up purchasing shares in primary offerings...

  • Data Engineer

    2 months ago

    New York, New York, United States TopEdge Technology Full time

    Job DescriptionPosition Data Engineer Duration 12 months Location New Jersey Remote Work Permitted Due to COVID-19 the client has agreed to allow the selected candidate to work remotely for the time being. However the selected candidate must be available to report onsite as directed by the client.Position Data EngineerJob DescriptionThe Senior Data Engineer...

  • Data Engineer

    2 weeks ago

    New York, New York, United States TopEdge Technology Full time

    Job DescriptionPosition Data Engineer Duration 12 months Location New Jersey Remote Work Permitted Due to COVID-19 the client has agreed to allow the selected candidate to work remotely for the time being. However the selected candidate must be available to report onsite as directed by the client.Position Data EngineerJob DescriptionThe Senior Data Engineer...

  • Sr UI Software Engineer

    1 week ago

    New York, New York, United States FIA Tech Full time

    Position: UI Sr Software Engineer – Remote/Hybrid (report to an office once a month in tandem with your team)Locations: Tampa, Washington D.C., or Tri-state AreaAbout Us: FIA Tech is a dynamic and growing Software-as-a-Service technology company which supports over 8,000 global finance and trading firms. Our systems solve the most pressing operational and...

  • Data Engineer

    3 weeks ago

    New York, New York, United States Kustomer Full time

    About KustomerKustomer is the industry leading conversational CRM platform perfecting every customer experience. Built with intelligent tools such as AI and Automation, no code-configuration and a connected data platform that unifies data from multiple sources through a single timeline, Kustomer empowers businesses to operate with greater efficiency and...

  • Data Engineer

    2 weeks ago

    New York, New York, United States Kustomer Full time

    About KustomerKustomer is the industry leading conversational CRM platform perfecting every customer experience. Built with intelligent tools such as AI and Automation, no code-configuration and a connected data platform that unifies data from multiple sources through a single timeline, Kustomer empowers businesses to operate with greater efficiency and...