Senior Data Architect

12 hours ago


New York, New York, United States The Custom Group of Companies Full time
About The Position:

We are looking for a highly experienced Senior Data Architect to lead our data engineering team. As a key member of our organization, you will be responsible for designing, developing, and maintaining data pipelines in Databricks on an AWS 6 ecosystem with Delta Lake, Python, SQL, and Starburst as the technology stack.

In this role, you will work closely with cross-functional teams to understand data needs and translate them into effective data pipeline solutions. You will also establish data quality checks, ensure data integrity and accuracy throughout the data lifecycle, automate testing of the data pipelines, optimize data processing and query performance for large-scale datasets within AWS and Databricks environments, document data engineering processes, architecture, and configurations, troubleshoot and debug data-related issues on the AWS Databricks platform, and integrate Databricks with other AWS products such as SNS, SQS, and MSK.

Key Responsibilities:
  • Lead the design, development, and maintenance of data pipelines in Databricks on an AWS 6 ecosystem.
  • Work closely with cross-functional teams to understand data needs and translate them into effective data pipeline solutions.
  • Establish data quality checks and ensure data integrity and accuracy throughout the data lifecycle.
  • Automate testing of the data pipelines and configure as part of CICD.
  • Optimize data processing and query performance for large-scale datasets within AWS and Databricks environments.
  • Document data engineering processes, architecture, and configurations.
  • Troubleshoot and debug data-related issues on the AWS Databricks platform.
  • Integrate Databricks with other AWS products such as SNS, SQS, and MSK.


  • New York, New York, United States Stratford Solutions Inc. Full time

    Job Title: Senior Enterprise Data ArchitectAt Stratford Solutions Inc., we're looking for a talented Senior Enterprise Data Architect to join our team of professionals. As a key member of our data analytics team, you'll be responsible for designing and developing data warehouse systems at enterprise scale.Key Responsibilities:Design and develop data...


  • New York, New York, United States Capital One Full time

    Capital One is seeking a Senior Data Architect and Engineer to drive the design and implementation of high-performance data ecosystems that support real-time, intelligent experiences for its Risk Management functions.This role involves shaping the Risk Management Data domains that will drive standardized data assets and products. The ideal candidate will...

  • Senior Data Architect

    2 weeks ago


    New York, New York, United States 3Cloud Full time

    Role SummaryWe are seeking a highly skilled Senior Data Architect to join our Data and Analytics Practice. The ideal candidate will have a strong background in data architecture, engineering, and cloud computing. As a Senior Consultant, you will work closely with our team to design, implement, and optimize data solutions using Microsoft's Azure suite of...


  • New York, New York, United States VS Tech Solutions Full time

    **Job Description**We are Vs Tech Solutions, a global leader in human resources consulting. We are seeking an experienced Senior Data Platform Architect to join our team.About the JobThis position requires a strong technical background in data architecture, as well as leadership qualities to lead cross-functional teams.The ideal candidate will have 10+ years...


  • New York, New York, United States New York Life Insurance Company Full time

    Transforming Enterprise Data ArchitectureIn the heart of New York Life Insurance Company, we're seeking an exceptionally skilled Senior Cloud Data Architect to spearhead our company's modern data management strategy. This pivotal role will require you to collaborate with cross-functional teams, including Data Product Owners, Data Scientists, and end-users,...

  • Senior Data Architect

    9 hours ago


    New York, New York, United States Angi Full time

    About the PositionWe're seeking an experienced Senior Data Architect to join our team at Angi. This role will be responsible for designing and implementing database solutions that support our 24/7 operations.You will work closely with our development teams to ensure database infrastructure standards are followed and architecture patterns are aligned with...


  • New York, New York, United States Capital One Full time

    Capital One is committed to changing banking for good. As a Senior Software Architect, Data Systems, you will be part of a community of technical experts working to define the future of banking in the cloud.You will work alongside our talented team of developers, machine learning experts, product managers, and people leaders. Our Senior Architects are...

  • Data Architect Lead

    2 weeks ago


    New York, New York, United States Photon Full time

    Job Title:Senior Data ArchitectAbout the Role:We are seeking a highly skilled Senior Data Architect to join our team at Photon. As a key member of our data architecture team, you will be responsible for designing and implementing data architectures that support data integration, transformation, and storage within the Informatica ecosystem.Key...


  • New York, New York, United States SysMind Tech Full time

    Job Title: Senior Azure Data Engineer and ArchitectSysMind Tech is seeking a highly skilled Senior Azure Data Engineer to join our team. The ideal candidate will have at least 5+ years of experience in designing and implementing scalable data architectures on Azure cloud platform.About the Role:The Senior Azure Data Engineer will be responsible for designing...


  • New York, New York, United States Saxon Global Full time

    Senior Database ArchitectSaxon Global is seeking an experienced Senior Database Architect to join our team in New York City. As a Senior Database Architect, you will be responsible for designing, implementing, and maintaining high-quality database systems to support our business applications.Minimum 4 Years hands-on coding skills in writing packages,...

  • Senior Data Architect

    2 weeks ago


    New York, New York, United States META Full time

    About the RoleWe are seeking a highly skilled Data Engineer, Analytics to join our team at Meta. In this role, you will have the opportunity to work with massive amounts of data to drive business insights and optimize user experience.Key ResponsibilitiesArchitect, implement and deploy new data models and data processes in production.Perform data analysis to...

  • Senior AI Architect

    2 weeks ago


    New York, New York, United States Oracle Full time

    **Job Title:** Senior AI Architect**Overview:At Oracle, we're seeking a highly skilled Senior Data Scientist/AI Engineer to contribute to the development of innovative CV & speech models. As a Senior Machine Learning Engineer specializing in Conversational AI, you will play a pivotal role in architecting, developing, and deploying models to power our...


  • New York, New York, United States Data Intellect Full time

    About This RoleWe are seeking a highly skilled Senior Financial Data Developer to join our team. In this role, you will be responsible for developing and maintaining complex financial data systems using kdb+.This is an exciting opportunity for someone who is passionate about working with data and wants to make a real impact in the financial industry.

  • Data Architect

    12 hours ago


    New York, New York, United States Paul Hastings Full time

    Unlock Your Potential as a Data Architect at Paul HastingsWe are seeking an experienced Data Architect to join our team. As a key member of our data management team, you will be responsible for designing and implementing data architectures that meet the needs of our business.The ideal candidate will have a strong background in data architecture and...


  • New York, New York, United States Inizio Partners Full time

    **Job Overview**About Inizio Partners: We are a global consulting firm providing data-driven solutions to businesses.Our team is seeking an experienced SQL/SSIS Senior Developer to join our agile team.**Key Responsibilities**Design, develop, and maintain data architecture and database systems for reporting environments.Participate in brainstorming sessions...

  • Data Architect

    14 hours ago


    New York, New York, United States Capital One Services, LLC Full time

    About This RoleJob SummaryWe are seeking a highly skilled Data Architect to join our team at Capital One Services, LLC. As a Data Architect, you will be responsible for designing and implementing data solutions that meet the needs of our business stakeholders.Key Responsibilities Design and implement data solutions using cloud-based technologies such as AWS,...


  • New York, New York, United States Data Intellect Full time

    About Data IntellectWe're dedicated to harnessing the power of human intellect and collaboration to drive innovative solutions for complex challenges.Our approach is guided by the principles of Humility, Can-do Attitude, and Togetherness, which form the foundation of our [DI] code.Compensation Package: $150,000 - $200,000 per annum, commensurate with...


  • New York, New York, United States Diverse Lynx Full time

    **Job Title:** Senior Salesforce Architect**Location:** Milwaukee, WI, USAWe are seeking an experienced Senior Salesforce Architect to join our team at Diverse Lynx LLC. The successful candidate will have a strong background in Salesforce development, technical design, and implementation.**About the Role:**This is a full-time, permanent position that offers...

  • Senior Data Architect

    4 weeks ago


    New York, New York, United States Vimeo Full time

    We are seeking a highly skilled Senior Data Engineer - Analytics to join our Data Architecture and Analytics Engineering team at Vimeo. This role involves working closely with Data Analysts and Data Scientists to design, build, and maintain robust, scalable, and sustainable data models that provide valuable insights for senior leadership.The ideal candidate...


  • New York, New York, United States Avant Tech Full time

    About the Role:We're seeking a seasoned Senior IT Architect to spearhead the design, development, and deployment of cutting-edge IT solutions at Avant Tech. As a key player, you'll drive innovation and ensure the seamless integration of technology into our business operations.Key Responsibilities:Architect and design robust, scalable, and secure IT solutions...