Data Engineer II

4 days ago

New York, United States Mount Sinai Health Systems Full-time $90,000 - $135,285 Contract
DescriptionWe are seeking a skilled Database Engineer to join our team within the Windreich Department of AI and Human Health and Institute for Critical Care Medicine (ICCM). In this role, you will be responsible for designing, implementing, and maintaining robust datamarts, data warehouses, databases and data visualization platforms for healthcare data. You will utilize your expertise in database management systems, to work with both current ETL/Data Warehousing and future Big Data/Streaming/Pipeline architectures. The focus will be on choosing optimal solutions to use for these purposes, then implementing, maintaining, and monitoring them, always being mindful of the overarching goal of accelerating translational research and improving clinical care. Responsibilities
• Facilitate data collection from a variety of different sources, getting it in the right formats, assuring that it adheres to data quality standards, and assuring that downstream users can get that data quickly and with a common standard interface.
• Ensure that data streams/pipelines are scalable, repeatable, and secure, and can serve multiple users.
• Design and develop a comprehensive datamart framework and data visualization platforms for healthcare data, ensuring scalability, efficiency, and data integrity.
• Manage and administer databases on relational database management systems such as Postgres or Microsoft SQL Server, optimizing performance and ensuring high availability.
• Develop and implement Extract, Transform, Load (ETL) processes to seamlessly integrate healthcare data from sources including Epic Inc's Caboodle and Clarity databases into the data mart.
• Apply AI agents to data engineering work, including pipeline development, SQL generation, data quality checks, documentation, and natural language access to databases.
• Responsible for creating the infrastructure that provides insight from raw data and handles diverse sources of data seamlessly.
• Additional responsibilities include developing prototypes and proof of concepts for the selected solutions, and implementing complex big data projects with a focus on collecting, parsing, and managing large sets of data using multiple platforms to allow for Operational, Research and Data Science initiatives.
• Translate business requirements into modern data pipeline solutions. Create centralized documents and diagrams of all solutions.
• Design and implement monitoring, backup, and disaster recovery of data systems.
• Create a data catalog store of all metadata.
• Responsible for the integrity and security of data in all forms of storage throughout the Data Architecture. Ensure compliance with the Institutional Review Board and HIPAA to follow all applicable policies and procedures.
• Assist in the development of standards and procedures affecting data management, design and maintenance. Documents all standards and procedures.
• Possess an extremely flexible attitude. Willing to work with multiple types of technologies and languages with an open mind and without technology bias. Continuous interest in updating skill sets and knowledge of trends in the Big Data Technology space. Work closely with cross-functional teams including data scientists, healthcare providers, and IT professionals to understand data requirements, develop solutions, and support data-driven decision-making. And other duties as assigned.
• Qualifications
• Bachelors degree in Computer Science or a related discipline; Advanced degree preferred.
• 4+ years relevant professional development experience, preferably in a LINUX environment.
• Strong SQL and NoSQL Database Knowledge: Oracle, PostgreSQL/MYSQL, and Mongo DB (or similar).
• Proficiency with at least 2 programming languages among Scala/Python/ Java. Must be flexible and fast to pick up new languages.
• Proficiency in Restful service development, preferably with Node JS, Django and PHP.
• Experience with micro-services and SOA.
• Strong SQL and NoSQL Database Knowledge: Oracle, PostgreSQL/MYSQL, and Mongo DB (or similar).
• Proficiency on installation and configuration of big data software and technology
• Knowledge of Hadoop, Spark, Kafka and other big data technology stacks and streaming tools.
• Familiarity with and the ability to leverage a wide variety of open source technologies and tools.
• Working knowledge of cloud architecture and implementation onAzure or AWS, is a big plus. Experience with serverless computing, creating VMs, cloud security, and other cloud services is also a big plus.
• Experience working in an Agile methodology. Experience working with JIRA is a plus. Preferred:
• Bachelor's degree in Computer Science, Information Technology, or a related field. Master's degree preferred.
• Strong proficiency in ETL processes, data warehousing, and data integration techniques with proven experience in database development and management
• Strong SQL skills and experience with relational databases such as Microsoft SQL Server, Oracle, or PostgreSQL.
• At least 2 years of hands-on experience building and maintaining ETL/ELT pipelines from Epic Clarity and Caboodle, with working knowledge of their data models. Epic Clarity or Caboodle Data Model certification preferred.
• Proficiency in Python and experience with modern data engineering tools, including cloud lakehouse platforms (Databricks, Snowflake, or Microsoft Fabric), orchestration and transformation tools (Airflow, dbt), and Git-based CI/CD.
• Experience using AI agents or LLM-based tools for database and data engineering tasks is strongly preferred.
• Working knowledge of cloud architecture and implementation on Azure or AWS, is a big plus. Experience with serverless computing, creating VMs, cloud security, and other cloud services is also a big plus.
• Excellent analytical and problem-solving skills with a keen attention to detail.
• Effective communication skills and ability to collaborate in a team environment. Employer Description Strength through Unity and Inclusion The Mount Sinai Health System is committed to fostering an environment where everyone can contribute to excellence. We share a common dedication to delivering outstanding patient care. When you join us, you become part of Mount Sinai’s unparalleled legacy of achievement, education, and innovation as we work together to transform healthcare. We encourage all team members to actively participate in creating a culture that ensures fair access to opportunities, promotes inclusive practices, and supports the success of every individual. At Mount Sinai, our leaders are committed to fostering a workplace where all employees feel valued, respected, and empowered to grow. We strive to create an environment where collaboration, fairness, and continuous learning drive positive change, improving the well-being of our staff, patients, and organization. Our leaders are expected to challenge outdated practices, promote a culture of respect, and work toward meaningful improvements that enhance patient care and workplace experiences. We are dedicated to building a supportive and welcoming environment where everyone has the opportunity to thrive and advance professionally. Explore this opportunity and be part of the next chapter in our history. About the Mount Sinai Health System Mount Sinai Health System is one of the nation’s leading integrated academic health systems and one of the largest in the New York metropolitan area. Its comprehensive system includes seven hospitals, more than 400 outpatient practices, over 600 research and clinical laboratories, the Icahn School of Medicine at Mount Sinai, the Graduate School of Biomedical Sciences, and the Mount Sinai Phillips School of Nursing. Together, the Health System comprises approximately 48,000 employees, more than 9,000 physicians, and 8,600 nurses. As a leading learning health system, Mount Sinai combines clinical expertise with scientific discovery to improve patient care while training the next generation of health care and biomedical leaders. The Health System provides care across every stage of life, from prenatal care through geriatrics, while advancing personalized medicine through artificial intelligence, data science, and biomedical research. Mount Sinai is consistently recognized among the nation’s leading academic health systems for patient care, research, and education. The Mount Sinai Hospital is ranked No. 1 in New York by Newsweek® and No. 7 in the U.
S. on the magazine’s 2026 World’s Best Hospitals list and No. 3 in the world in its World’s Best Smart Hospitals list. The Icahn School of Medicine at Mount Sinai ranks No. 9 among U.
S. medical schools and No. 1 among freestanding medical schools for National Institutes of Health grant funding, reflecting the strength of its scientific enterprise and leadership in biomedical research. Equal Opportunity Employer The Mount Sinai Health System is an equal opportunity employer, complying with all applicable federal civil rights laws. We do not discriminate, exclude, or treat individuals differently based on race, color, national origin, age, religion, disability, sex, sexual orientation, gender, veteran status, or any other characteristic protected by law. We are deeply committed to fostering an environment where all faculty, staff, students, trainees, patients, visitors, and the communities we serve feel respected and supported. Our goal is to create a healthcare and learning institution that actively works to remove barriers, address challenges, and promote fairness in all aspects of our organization. Compensation The Mount Sinai Health System (MSHS) provides salary ranges that comply with the New York City Law on Salary Transparency in Job Advertisements. The salary range for the role is $90000
- $135285 Annually. Actual salaries depend on a variety of factors, including experience, education, and operational need. The salary range or contractual rate listed does not include bonuses/incentive, differential pay or other forms of compensation or benefits.