Lead Data Engineer

18 hours ago

Boston, Massachusetts, United States Ness USA, Inc. Full time $120,000 - $250,000 per year
Job Title: Lead Data Engineer / Data Architect Location: New York City, NY; Secondary location - Boston, MA (Onsite – 5 days/week) About the Role:
We are seeking an experienced Lead Data Engineer / Data Architect to spearhead the design, development, and implementation of our enterprise data platform. This role will be instrumental in shaping and driving our data engineering roadmap, ensuring scalability, performance, and innovation. The ideal candidate combines deep technical expertise with strong leadership skills and a solid understanding of financial services data domains. Key Responsibilities:
  • Lead the data architecture and engineering strategy, ensuring alignment with business and technology roadmaps.
  • Design and implement data models, pipelines, and data integration frameworks across multiple platforms.
  • Partner with stakeholders to translate business requirements into scalable data solutions.
  • Performance Optimization: Optimize data pipelines for performance, scalability, and reliability, including query tuning and resource management within Snowflake.
  • Drive adoption of best practices in data engineering design patterns and modern cloud architectures.
  • Data Quality Assurance: Implement and monitor data validation procedures to ensure data accuracy and consistency across systems.
  • Collaboration and Communication: Work closely with project managers, data architects, and business analysts to align project milestones and deliverables with business goals.
  • Mentor and guide data engineering teams (onsite & offshore) to deliver high-quality outcomes.
  • Ensure compliance with data governance, security, and privacy standards.
  • Documentation: Create and maintain detailed documentation of data pipelines, data flow diagrams, and transformation logic.
  • Issue Resolution: Troubleshoot and resolve issues related to data pipelines, including job failures and performance bottlenecks.
Required Qualifications:
  • Bachelor's degree in Computer Science, Information Technology, or a related field.
  • 8+ years of experience in data engineering with a strong focus on Data Architecture, Data Modelling (Conceptual, Logical, Physical), ELT processes and data pipeline development.
  • Hands-on experience with Snowflake cloud data platform, including data sharing, secure views, and performance optimization.
  • Proficiency in SQL and familiarity with data integration and ETL/ELT tools.
  • AWS Technologies (Glue, EMR)
  • Python for data engineering workflows
  • Strong understanding of data engineering design patterns
  • Strong problem-solving skills and the ability to work independently to meet deadlines.
  • Excellent communication skills for effectively interacting with technical and non-technical stakeholders.
Preferred Qualifications:
  • Certifications in Snowflake or relevant data technologies.
  • Experience in the financial services sector, especially asset management / alternative investments, with an understanding of data security and compliance requirements.
  • Familiarity with cloud platforms (e.g., AWS, Azure) and data orchestration tools (e.g., Apache Airflow).
  • Knowledge of data visualization tools (e.g., Tableau, Power BI).
Why Join Us: 
At Ness, you will work with diverse, talented professionals who are dedicated to making an impact through technology. We encourage applicants of all backgrounds to apply—even if you don't meet every requirement, we'd love to connect with you if this role excites you. We're committed to creating an inclusive workplace that celebrates each team member's unique talents.   With flexible remote options, diverse projects, and access to development resources, joining Ness means building a career that's meaningful and impactful.  Ready to Start Your Journey?

  • Data Studio Lead

    4 days ago

    Boston, Massachusetts, United States Foundation EGI Full time $120,000 - $200,000 per year

    We're an MIT-born, venture-backed Silicon Valley startup building Engineering General Intelligence (EGI), an AI copilot for design and manufacturing. Our mission is to reinvent how physical products are designed and built, dramatically accelerating product development.The Data Studio Lead owns the end-to-end process of transforming raw customer data into...

  • Data Science Lead

    3 days ago

    Boston, Massachusetts, United States Enumerate Full time $130,000 - $170,000 per year

    Department:EngineeringLocation:BostonCompensation:$130,000 - $170,000 / yearDescriptiontbdKey ResponsibilitiesLeadership & Strategy Lead the overall data strategy for the company, aligning data initiatives with business goals and product priorities. Manage a small team of data engineers, analysts, and data scientists, fostering collaboration and continuous...

  • Data Integration Developer

    3 days ago

    Boston, Massachusetts, United States NTT DATA Full time $120,000 - $180,000 per year

    NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Data Integration Developer to join our team in Boston, Massachusetts (US-MA), United States (US). Job Duties: The Data Integration...

  • Data Analyst – Corporate Technology Data Engineering

    5 days ago

    Boston, Massachusetts, United States MassMutual Full time $120,000 - $180,000 per year

    The OpportunityJoin our dynamic team as a Data Analyst – Corporate Technology Data Engineering & Analytics, where you'll play a pivotal role in driving the execution of our Data strategy. This role is crucial in driving digital transformation and operational efficiency across Investment Management. As part of this role, you will lead to extracting value...

  • Data Engineer

    5 days ago

    Boston, Massachusetts, United States Nasuni Full time $120,000 - $150,000 per year

    Data Engineer - Nasuni - Boston Seaport - Onsite-HybridPosition OverviewNasuni is seeking a motivated Data Engineer to join our Data & Analytics (DNA) team. As part of a small and collaborative group supporting a global SaaS business, you'll help build the infrastructure that powers reporting, analysis, and machine learning across the company. We are seeking...

  • Data Engineer II

    4 days ago

    Boston, Massachusetts, United States Chewy Full time $113,000 - $180,500 per year

    Our OpportunityWe are looking for a highly experienced and forward-thinking Data Engineer to join our Enterprise Data Systems team, which drives reporting, analytics, and data science capabilities for numerous teams across the organization. In this key role, you will be responsible for designing and building a state-of-the-art data platform that will serve...

  • GCP Data Engineer

    3 days ago

    Boston, Massachusetts, United States E-Solutions IT Service PVT LTD Full time $75,000 - $1,560,000 per year

    Job Role: Lead Data EngineerLocation: Boston, MA (Onsite)Contract job on W2 onlyRequired Skills & Experience:10+ years in Data Engineering with experience in client-facing leadership roles.Strong expertise in PySpark, SQL, and Google BigQuery.Hands-on with GCP services: IAM, Dataflow, BigQuery, Cloud Storage.Solid understanding of data privacy, encryption,...

  • Sr Data Engineer

    5 days ago

    Boston, Massachusetts, United States Quantiphi Full time $150,000 - $250,000 per year

    While technology is the heart of our business, a global and diverse culture is the heart of our success. We love our people and we take pride in catering them to a culture built on transparency, diversity, integrity, learning and growth. If working in an environment that encourages you to innovate and excel, not just in professional but personal life,...

  • Staff Data Engineer

    5 days ago

    Boston, Massachusetts, United States Velir Full time $150,000 per year

    Velir is an established mid-sized agency with a top-tier portfolio of clients, ranging from the world's largest non-profits to Fortune 500 brands. As of 2023, Velir acquired Brooklyn Data Company, a premier data and analytics consultancy focused on leadership, process improvement, implementation, and advanced analytics.At Velir, we believe people are our...

  • Senior Data Engineer

    17 hours ago

    Boston, Massachusetts, United States Careforth Full time $96,935 - $160,000

    About UsA pioneer in the caregiving space, Careforth supports family caregivers across the United States to confidently care for their loved ones at home. Through a combination of in-person home visits, remote coaching and our proprietary digital collaboration app, we provide caregivers with support, guidance, confidence, and connection to resources they...