Data Infrastructure Specialist

2 days ago


New York, New York, United States Memorial Sloan Full time
Data Infrastructure Specialist Job Description:

Memorial Sloan Kettering Cancer Center is looking for a skilled Data Infrastructure Specialist to help drive our data modernization journey. As a key member of our team, you will design, implement, and maintain data infrastructure solutions for a new hybrid and multi-cloud data ecosystem.

Your Key Responsibilities:
- Develop ELT data pipelines using PySpark coding best practices and collaborate with stakeholders to understand data requirements.
- Use CI/CD and other dataops best practices to ensure efficient data processing and minimal processing time.
- Transform data into conformed models and data products, ensuring data integrity throughout the processing lifecycle.
- Monitor and optimize data processing jobs for performance, utilizing resources efficiently and optimizing data storage structures.
- Implement data validation and quality checks to ensure reliable data.

Requirements and Qualifications:
- Bachelor's degree in Computer Science or related field.
- 4+ years of experience as a Cloud Data Engineer or related field.
- Strong analytical, problem-solving, and organizational skills, excellent communication and collaboration skills.
- Experience with AWS technologies, including S3, EC2, Glue, and MWAA.

Salary and Benefits:
- Estimated salary: $145,000 based on experience and location.
- Hybrid schedule with 4 days onsite per month.
- Opportunities for professional growth and development.

  • New York, New York, United States BlackHawk Data Full time

    Job Title: Network Infrastructure SpecialistAbout the Role:We are seeking a highly skilled and experienced Network Engineer to join our team at BlackHawk Data. This is an exceptional opportunity for a motivated professional to design, deploy, and maintain cutting-edge network solutions.Key Responsibilities:


  • New York, New York, United States Oxford Knight Full time

    At Oxford Knight, we're at the forefront of algorithmic trading, seeking a skilled Data Infrastructure Specialist to join our team. This pioneering role offers the opportunity to design and implement a cutting-edge system for data management, storage, and exploration.About the Role:We're looking for someone with 2-6 years of experience in data...


  • New York, New York, United States Middesk Full time

    Data Infrastructure RoleWe're looking for a seasoned Business Data Infrastructure Specialist to join our Foundation team at Middesk. As a critical member of this team, you'll be responsible for designing and implementing scalable data pipelines, building reliable systems, and extending our web scraping capabilities. Your focus on data quality and scalability...


  • New York, New York, United States Resource Informatics Group Full time

    Job SummaryWe are seeking a highly skilled Data Storage Infrastructure Specialist to join our team at Resource Informatics Group. The successful candidate will design, implement, and maintain our storage infrastructure, working with Dell/EMC Isilon, ECS, PowerVault, and Pure Storage Flash Array or FlashBlade technologies.About the RoleThe Data Storage...


  • New York, New York, United States Prescient Full time

    Job OverviewAt Prescient, we are seeking a highly skilled Data Infrastructure Specialist to join our team. As a key member of our engineering group, you will play a critical role in designing, building, and maintaining our dark web and open-source data repositories, search applications, and APIs.ResponsibilitiesThe successful candidate will be responsible...


  • New York, New York, United States Selby Jennings Full time

    **Job Overview**Selby Jennings is seeking an experienced Data Center Infrastructure Specialist to join our team. In this role, you will be responsible for managing and maintaining the data center infrastructure to ensure maximum availability of services.Key Responsibilities:Manage data center infrastructure components, including power, cooling, hardware,...


  • New York, New York, United States Fathom Full time

    About FathomFathom is a pioneering company in the field of medical data understanding and structuring using AI. Our mission begins by making sense of vast clinician notes contained within electronic health records. We aim to automate the translation of patient records into billing codes, reducing healthcare provider reimbursement costs and errors.Our deep...


  • New York, New York, United States Wynd Labs Full time

    We are at the forefront of developing a web-scale crawler and knowledge graph that allows ordinary people to participate in the process, and share in the benefits of AI development.As a High-Performance Data Infrastructure Specialist, you will play a crucial role in designing, implementing, and maintaining scalable, high-performance distributed systems to...


  • New York, New York, United States Alethea LLC Full time

    About AletheaAlethea LLC is a tech company founded in 2019, dedicated to detecting and mitigating disinformation and social media manipulation. Our mission is to provide clients with the tools they need to navigate the new digital reality.">Job DescriptionLeadership and Mentorship: Provide technical and career guidance to the data engineering team. Conduct...


  • New York, New York, United States Amazon Full time

    Why This Role MattersAs a Sr. Business Intelligence Engineer, SMB Marketing Analytics, you will play a critical role in supporting the growth and success of Amazon's SMB Marketing Analytics team. By designing, building and maintaining enterprise-level analytics and data infrastructure, you will enable business leaders to make informed decisions and drive...


  • New York, New York, United States Fathom Full time

    Company OverviewFathom is a cutting-edge technology company that utilizes artificial intelligence to decipher and structure the world's vast medical data. Our mission begins by interpreting the terabytes of clinician notes within electronic health records of the world's largest healthcare systems. Our deep learning engine automates the translation of patient...


  • New York, New York, United States Inizio Partners Full time

    Job OverviewInizio Partners is seeking a talented Data Engineer to join our team. As a Data Engineer, you will be responsible for designing and building scalable data infrastructure using Python. This is a great opportunity to work with a dynamic team and contribute to the growth of our company.Key Responsibilities Design and build scalable data...


  • New York, New York, United States Bloomberg Full time

    Scaling Financial Data Infrastructure with BloombergWe're looking for a talented software engineer to join our MSG Alerts team, where you'll play a key role in building a new, distributed, and scalable system for delivering real-time alerts to financial professionals. With millions of user-created rules and millions of emails per minute, this system must...


  • New York, New York, United States VTS Full time

    Unlock Your Potential as an IT Infrastructure SpecialistVTS is a trailblazer in the commercial and residential real estate industry, revolutionizing leasing operations with its cutting-edge technology platform. As an IT Infrastructure Specialist, you will be part of a high-performing team that values innovation, growth, and customer satisfaction.About VTSWe...


  • New York, New York, United States BlackHawk Data Full time

    Job Description: We are seeking a motivated Network Engineer with a passion for designing, deploying, and maintaining cutting-edge network solutions. The ideal candidate will have strong expertise in Cisco and Fortinet technologies, with a deep understanding of routing protocols including BGP, OSPF, and EIGRP.Responsibilities:Design and implement network...


  • New York, New York, United States Shaped Full time

    We are looking for a data engineer to design, build and optimize Shaped's real-time and batch streaming infrastructure. As one of Shaped's early employees, you will help shape the company's product, culture and vision.The ideal candidate should have skills in Python, Data Warehouses (such as Clickhouse, Snowflake, or BigQuery) and experience with batch and...


  • New York, New York, United States Columbia University Full time

    **Job Summary:**Columbia University is seeking a skilled IT Infrastructure Specialist to provide technical support for its computing resources in a hybrid infrastructure.The successful candidate will have a strong background in systems administration, with experience in virtualization technologies, cloud computing, and networking.**Key...

  • Data Engineer

    9 hours ago


    New York, New York, United States Aircall Full time

    Aircall is a pioneering communication technology company that empowers businesses to make authentic, human connections. As a Senior Data Engineer, you will play a crucial role in designing, developing, and maintaining our data infrastructure.About the RoleThis is an exceptional opportunity to be at the forefront of our engineering efforts, developing and...


  • New York, New York, United States Vimeo Full time

    Job SummaryVimeo seeks an experienced Data Infrastructure Architect to lead the management and optimization of our vector databases and data stores, including Elastic Search and AWS OpenSearch. This role is critical in maintaining our data systems' reliability, performance, and scalability.About UsVimeo (NASDAQ: VMEO) is a world-leading video experience...


  • New York, New York, United States United Software Group Full time

    United Software Group is seeking a highly skilled Cloud Infrastructure Specialist to join our team. As a key member of our infrastructure team, you will be responsible for designing and implementing robust monitoring solutions to track batch job performance and system health. Your expertise in AWS & On Prem mix for hosting, Oracle databases, Cron, Ansible,...