Bigdata Databricks Architect

4 weeks ago


Boston, United States Xoriant Corporation Full time

Job Title : Bigdata Databricks Architect

Client Location: Boston, MA (Hybrid 2-3 days a week onsite)

Duration : Long term contract

Education and experience Qualification

  • Bachelor s degree in Computer Science, Information Systems, or equivalent education or work experience
  • 8+ years of IT experience in big data space like Hadoop, data lake, data engineering using Python & Spark programming languages
  • Any AWS and/or Databricks certification will be a plus

Roles & Responsibilities

  • Recognize the current application infrastructure and suggest new concepts to improve performance
  • Document the best practices and strategies associated with application deployment and infrastructure support
  • Produce reusable, efficient, and scalable programs, and also cost-effective migration strategies
  • Develop Data Engineering and ML pipelines in Databricks and different AWS services, including S3, EC2, API, RDS, Kinesis/Kafka and Lambda to build serverless applications
  • Work jointly with the IT team and other departments to migrate data engineering and ML applications to Databricks/AWS
  • Comfortable to work on tight timelines, when required.

Skill Sets Required

  • Good decision-making and problem solving skills
  • Solid understanding of Databricks fundamentals/architecture and have hands on experience in setting up Databricks cluster, working in Databricks modules (Data Engineering, ML and SQL warehouse).
  • Knowledge on medallion architecture, DLT and unity catalog within Databricks.
  • Experience in migrating data from on-prem Hadoop to Databricks/AWS
  • Understanding of core AWS services, uses, and AWS architecture best practices
  • Hands-on experience in different domains, like database architecture, business intelligence, machine learning, advanced analytics, big data, etc.
  • Solid knowledge on Airflow
  • Solid knowledge on CI/CD pipeline in AWS technologies
  • Application migration of RDBMS, java/python applications, model code, elastic etc.
  • Solid programming background on scala, python
  • Experience with Docker and Kubernetes is a plus


  • Boston, United States Diverse Lynx Full time

    Title: AWS Databricks Data Architect Location: Boston, MA & Princeton, NJ (Onsite) Type: Full TimeJob Description: We are seeking a skilled and experienced Databricks Architect with expertise in working with Databricks on the AWS cloud platform. Comprehensive knowledge and hands on experience with Databricks pipelines, Unity Catalog and Medallion...


  • Boston, United States Diverse Lynx Full time

    Title: AWS Databricks Data Architect Location: Boston, MA & Princeton, NJ (Onsite) Type: Full TimeJob Description: We are seeking a skilled and experienced Databricks Architect with expertise in working with Databricks on the AWS cloud platform. Comprehensive knowledge and hands on experience with Databricks pipelines, Unity Catalog and Medallion...


  • Boston, United States Diverse Lynx Full time

    Title: AWS Databricks Data ArchitectLocation: Boston, MA & Princeton, NJ (Onsite)Type: Full Time Job Description:We are seeking a skilled and experienced Databricks Architect with expertise in working with Databricks on the AWS cloud platform.Comprehensive knowledge and hands on experience with Databricks pipelines, Unity Catalog and Medallion...


  • Boston, United States Xoriant Corporation Full time

    Job Title : AWS Databricks ArchitectClient Location: Boston, MA (Hybrid 2-3 days a week onsite)Duration : Long term contractEducation and experience QualificationBachelor s degree in Computer Science, Information Systems, or equivalent education or work experience8+ years of IT experience in big data space like Hadoop, data lake, data engineering using...


  • Boston, MA, United States Diverse Lynx Full time

    Title: AWS Databricks Data ArchitectLocation: Boston, MA & Princeton, NJ (Onsite)Type: Full Time Job Description:We are seeking a skilled and experienced Databricks Architect with expertise in working with Databricks on the AWS cloud platform.Comprehensive knowledge and hands on experience with Databricks pipelines, Unity Catalog and Medallion...


  • Boston, MA, United States Databricks Full time

    At Databricks we are on a mission to empower our customers to solve the world's toughest data problems by utilizing the Lakehouse platform. As a Delivery Solutions Architect (DSA), you will play an important role during this journey. You will collaborate with our sales and field engineering teams to accelerate the adoption and growth of the Databricks...


  • Boston, United States IMCS Group Full time

    Title: Databricks/AWS architectLocation: Boston, MA (day 1 Onsite)Duration: Long Term Contract Job Description:Ability to design/develop based on business requirements by effectively coordinating activities between business analysts, developers, and testing team.Uses advanced technical expertise in analyzing, designing, estimating, and developing software...


  • Boston, United States IMCS Group Full time

    Title: Databricks/AWS architectLocation: Boston, MA (day 1 Onsite)Duration: Long Term Contract Job Description:Ability to design/develop based on business requirements by effectively coordinating activities between business analysts, developers, and testing team.Uses advanced technical expertise in analyzing, designing, estimating, and developing software...

  • Databricks

    3 weeks ago


    Boston, United States APEX Full time

    Job Details : Must Have Skills Databricks, Big data, Data Architecture Detailed Job Description 12 years of IT industry experience including cloud technologies Very strong handson experience in data on Cloud services with Data engineering concepts.6 years of experience in architecting Cloud data solutions using AWS, Databricks, Python, PySpark,...


  • Boston, United States Infosys Technologies Ltd Full time

    Job Description :Infosys is seeking a AWS and Databricks Cloud Data Architect. Job type: Full timeJob location: Boston,MARequired Qualifications:Bachelor s degree or foreign equivalent required from an accredited institution. Will also consider three years of progressive experience in the specialty in lieu of every year of education.At least 7 years of...

  • Azure Architect

    3 weeks ago


    Boston, United States Vaco Full time

    Job Title: Azure Architect Contract Remote (EST) Job Overview: We are seeking a senior Azure Architect and Developer to support a data consolidation project. Role Details:Duration: 6-12 weeks, depending on availability (with potential for extension up to 4 months)Responsibilities:Take over and continue the implementation plan developed by the current...

  • BI Engineer

    2 weeks ago


    Boston, United States Zeektek Full time

    6-month contract with potential for conversion to permanent hireAdditional Requirements:Must reside in or be willing to relocate to the greater Sacramento area.Availability to work on-site two days per week as part of a hybrid working arrangement.Required Solution Architecture, Healthcare, Power BI, Tableau, Databricks, Overview:We are seeking a seasoned...

  • Data Architect

    3 weeks ago


    Boston, United States Trident Consulting Full time

    Trident Consulting is seeking a " Data Architect " for one of our clients in " Jersey City, NJ & Boston, MA ". Role: Data Architect Location: Jersey City / Boston Hybrid (onsite) Type: Contract/FTE Job Description We are seeking a Data Architect to help drive our data strategy for Private Banking and Investment Management business lines. This individual must...

  • Big Data Modeler

    4 weeks ago


    Boston, United States Sysmind, LLC Full time

    Role: Big Data Modeler / Architect (FX Domain) Location: Boston, MA Role Description: The team is involved in the build-out of a Data Lakehouse using Databricks for the FX business line. They are setting up the Databricks infrastructure and soon will start building ingestion pipelines into the Bronze Zone. Additionally, they will design the data model...

  • Data Architect

    2 weeks ago


    Boston, United States Codebase Full time

    Data Architect 3 days onsite at their Boston, MA or Jersey City, NJ office 3 days onsite at their Boston, MA or Jersey City, NJ office - Locals to MA or NJ or NY only** Looking for: -must be able to architect but also code, want someone who is open to being hands-on to code and develop when needed -8+ years of experience in an IT, preliminary on hands on...

  • Data Architect

    1 week ago


    Boston, United States Codebase Inc Full time

    Data Architect3 days onsite at their Boston, MA or Jersey City, NJ office3 days onsite at their Boston, MA or Jersey City, NJ office - Locals to MA or NJ or NY only** Looking for:-must be able to architect but also code, want someone who is open to being hands-on to code and develop when needed-8+ years of experience in an IT, preliminary on hands on...

  • Data Architect

    4 days ago


    Boston, United States Codebase Full time

    Data Architect 3 days onsite at their Boston, MA or Jersey City, NJ office 3 days onsite at their Boston, MA or Jersey City, NJ office - Locals to MA or NJ or NY only** Looking for: -must be able to architect but also code, want someone who is open to being hands-on to code and develop when needed -8+ years of experience in an IT, preliminary on hands on...

  • Data Architect

    2 weeks ago


    Boston, United States Codebase Inc Full time

    Data Architect3 days onsite at their Boston, MA or Jersey City, NJ office3 days onsite at their Boston, MA or Jersey City, NJ office - Locals to MA or NJ or NY only** Looking for:-must be able to architect but also code, want someone who is open to being hands-on to code and develop when needed-8+ years of experience in an IT, preliminary on hands on...

  • Security Architect

    2 months ago


    Boston, United States MassMutual Full time

    The MassMutual Enterprise Architecture team in the Enterprise Technology and Experience organization is seeking an outstanding Enterprise Architect-security to join our team. The enterprise architect for security will be responsible for evaluating and benchmarking new critical risk-based security capabilities for data protection, authentication, and software...

  • Security Architect

    1 week ago


    Boston, United States MassMutual Full time

    The MassMutual Enterprise Architecture team in the Enterprise Technology and Experience organization is seeking an outstanding Enterprise Architect-security to join our team. The enterprise architect for security will be responsible for evaluating and benchmarking new critical risk-based security capabilities for data protection, authentication, and software...