Data Architect

7 days ago


New York, New York, United States DRUM UPSKILL Full time
About the Role

DRUM UPSKILL is seeking a highly skilled Data Engineer to join our dynamic team and contribute to our mission of sustainability and innovation. As a Data Engineer, you will play a critical role in designing, architecting, and implementing a comprehensive data lake solution that integrates various data sources.

Key Responsibilities
  • Data Lake Design and Implementation: Design and implement a scalable and secure data lake solution that integrates multiple data sources, including REST APIs, AWS S3 buckets, GCP BigQuery, and other on-prem/cloud databases.
  • Directed Acyclic Graphs (DAGs) Development: Develop and maintain DAGs using Apache Airflow for efficient data workflows, ensuring data quality, integrity, and security.
  • Data Extraction, Transformation, and Loading (ETL): Extract, transform, and load data from various sources, including structured and unstructured datasets, and manage data streams for both clinical measurements and instrument data.
  • Database Management: Manage and optimize Snowflake databases to ensure high performance and reliability, and collaborate with cross-functional teams to understand data requirements and deliver solutions that meet business needs.
  • Containerization and CI/CD: Implement containerization and use container tools for efficient deployment and scaling of data solutions, and utilize GitHub and GitHub Actions for version control and CI/CD pipelines.
Requirements
  • Proven Experience: Proven experience in designing and implementing data lake solutions in cloud environments (GCP/AWS).
  • Strong Proficiency: Strong proficiency in Snowflake database management, Apache Airflow, and DAG development.
  • ETL Experience: Ability to extract, transform, and load data from diverse sources, including REST APIs, AWS S3, GCP BigQuery, and other databases.
  • Database Management: Experience working with both structured and unstructured datasets, and expertise in database management, ETL processes, and data architecture.
  • Containerization: Proficiency with GitHub and GitHub Actions for version control and CI/CD, and experience with containerization and container tools (e.g., Docker, Kubernetes).
Preferred Skills
  • Clinical Data Background: Clinical data background with experience in managing and analyzing clinical datasets.
  • Veeva Vault Integration: Experience with Veeva Vault integration for managing clinical data and documents.
  • Machine Learning: Experience with implementing or enhancing data sets for machine learning applications.
  • Professional Certification: Professional Data Engineer certification or equivalent experience.


  • New York, New York, United States Silver Search, Inc Full time

    Job Title: Senior Data ArchitectCompany: Silver Search, IncJob Type: Full-timeLocation: RemoteAbout Us:Silver Search, Inc is a cutting-edge technology company that specializes in providing innovative solutions for data-driven businesses. We are seeking a highly skilled Senior Data Architect to join our team and lead the development of our data engineering...

  • Data Architect

    4 days ago


    New York, New York, United States Koncept Engineers Full time

    Job OverviewKoncept Engineers is seeking a seasoned Data Architect to spearhead the development of our data architecture strategy. As a key member of our engineering team, you will be responsible for designing, implementing, and maintaining data architecture models that support business objectives.Key ResponsibilitiesData Architecture Design: Develop and...


  • New York, New York, United States Oakridge Staffing Full time

    Job Summary: Oakridge Staffing is seeking a highly skilled Senior Data Architect/Engineer to join our team and lead the development of a cloud-based data function and team. The ideal candidate will have experience in designing and implementing data pipelines, data warehousing, and data governance.About the Role: As a Senior Data Architect/Engineer, you will...

  • BI Data Architect

    3 months ago


    New York, New York, United States Simplebet Full time

    Our mission is to power the future of fan engagement. Simplebet is a B2B sports technology company that uses machine learning and real-time solutions to make every moment of every sporting event a betting opportunity. We're reimagining how people enjoy sports with products that are simple, intuitive, and entertaining. Our technology powers micro-betting...

  • aws data architect

    3 months ago


    New York, New York, United States Atechstar Full time

    Job DescriptionRoles and ResponsibilitiesProfessional with 12+ years overall DWH development experience 1-4+ years of relevant AWS development AWS Developer or Solution Architect associate certification Design Develop Deploy manage and operate scalable systems on AWS Select the appropriate AWS service based on compute data and security requirements Must be...


  • New York, New York, United States Corgan Full time

    About CorganCorgan is a leading architecture firm that is passionate about delivering exceptional design solutions. Our team of experts is dedicated to creating innovative and sustainable buildings that meet the needs of our clients.Job SummaryWe are seeking a highly skilled Architect to join our Data Centers team. As a key member of our team, you will be...

  • Data Engineer

    4 weeks ago


    New York, New York, United States NTT DATA Services Full time

    Req ID: NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a Data Engineer to join our team in New York, New York (US-NY), United States (US). Responsibilities:- Expand and optimize the...


  • New York, New York, United States VedaInfo Full time

    About the Role:We are seeking a highly skilled Data Warehouse Architect with expertise in Greenplum and other Data Warehouse Appliances to join our team at VedaInfo. As a key member of our team, you will be responsible for architecting complex Data Warehouse implementations that meet the evolving needs of our clients.Key Responsibilities:Design and implement...


  • New York, New York, United States Novisync Inc Full time

    Job Description**About the Role**We are seeking an experienced Data Warehouse Architect to join our team at Novisync Inc. As a key member of our data team, you will be responsible for designing and developing scalable data warehouse solutions that meet the needs of our business.Key Responsibilities:Design and implement data warehouse architectures for...


  • New York, New York, United States VedaInfo Full time

    About the Role:We are seeking a highly skilled Data Warehouse Architect with expertise in Greenplum and other Data Warehouse Appliances to join our team at VedaInfo. As a key member of our team, you will be responsible for architecting complex Data Warehouse implementations that meet the evolving needs of our clients.Key Responsibilities:Design and implement...

  • Solutions Architect

    2 days ago


    New York, New York, United States Ampcus Full time

    About the RoleThis is a key position at Ampcus where the Solutions Architect will serve as the bridge between technical design and business needs of the project. The role requires strong technical skills, knowledge of HR processes, technology projects, system implementation, solution design, team management, requirements gathering, data proficiency, and...


  • New York, New York, United States Creative Data Resources Full time

    Position Overview:Join Creative Data Resources as a Lead Salesforce Solutions Architect in a hybrid work environment. This role focuses on the development and maintenance of a tailored implementation of Sales Cloud, including seamless integrations with both internal and external systems.Key Responsibilities:- Develop and support a highly customized...


  • New York, New York, United States New York State Civil Service Full time

    Job SummaryWe are seeking a highly skilled Data Warehouse Architect to join our team at New York State Civil Service. As a key member of our IT department, you will be responsible for designing and building data warehouse structures to support our reporting and analytic needs.Key ResponsibilitiesDesign and develop data warehouse structures to meet business...

  • Fabric Engineer

    4 days ago


    New York, New York, United States MDMS Recruiting LLC Full time

    Job DescriptionMicrosoft Fabric Engineer / Data EngineerWe are seeking a highly skilled Microsoft Fabric Engineer / Data Engineer to join our team at MDMS Recruiting LLC. As a key member of our data engineering team, you will be responsible for designing, building, and maintaining large-scale data systems using Microsoft Fabric and Azure.Key...

  • Power BI Architect

    4 days ago


    New York, New York, United States Virtusa Full time

    Job DescriptionJob Title: Power BI ArchitectJob Summary:Virtusa is seeking an experienced Power BI Architect to join our team. As a Power BI Architect, you will be responsible for designing and implementing data visualization solutions using Power BI. You will work closely with business stakeholders to understand their requirements and design optimal...


  • New York, New York, United States Oakridge Staffing Full time

    About Oakridge StaffingWe are a leading staffing firm that specializes in connecting top talent with innovative companies. Our team is dedicated to providing exceptional service and support to our clients and candidates.Job SummaryWe are seeking a highly skilled Senior Data Architect/Engineer to join our client's team. As a key member of the data function,...


  • New York, New York, United States Hexaware Technologies Full time

    Job Title: Data and AI Architect cum Delivery Manager**About the Role**We are seeking a seasoned professional to lead our data architecture and AI initiatives as a Data and AI Architect cum Delivery Manager. As a key member of our team, you will play a crucial role in shaping our company's data strategy and architecture.**Key Responsibilities:**Develop and...


  • New York, New York, United States Dexian - Signature Consultants Full time

    About the RoleDexian - Signature Consultants is seeking a highly skilled Senior Data Architect to join our team. As a key member of our organization, you will be responsible for designing and implementing data architectures that support business growth and drive innovation.Key ResponsibilitiesData Quality and Governance: Develop and maintain data quality...


  • New York, New York, United States FTI Consulting Full time

    About the RoleOur Digital Transformation Practice helps large corporations, private equity firms, and other organizations build long-term competitive advantages, accelerate revenue growth, and drive investment valuations while optimizing costs. We bring together lean, fast-moving teams of expert technologists, digital specialists, and data scientists to...


  • New York, New York, United States Hexaware Technologies Full time

    Job Title: Data and AI Architect cum Delivery Manager**About the Role**We are seeking a seasoned professional to join our team as a Data and AI Architect cum Delivery Manager at Hexaware Technologies. As a key member of our organization, you will play a pivotal role in shaping our company's data strategy and architecture.**Key Responsibilities:**Develop and...