Azure Databricks Architect

1 week ago


Boston, Massachusetts, United States Cognizant North America Full time
About the Role

Cognizant North America is seeking a highly skilled Senior Architect to join our dynamic team. As a key member of our Artificial Intelligence and Analytics practice, you will be responsible for designing and implementing scalable data architectures using Databricks and Azure technologies.

Key Responsibilities
  • Lead the design and implementation of data architectures using Databricks and Azure technologies.
  • Oversee the administration of Databricks Workspace and ensure optimal performance.
  • Provide expertise in Databricks CLI and Unity Catalog for efficient data management.
  • Implement and manage Kafka for real-time data streaming solutions.
  • Utilize Azure Monitor to track and optimize system performance.
  • Manage data storage solutions using Azure Data Lake Store.
  • Ensure data security and compliance with Azure Key Vault.
  • Coordinate with development teams using Azure DevOps for seamless CI/CD pipelines.
  • Integrate and manage event-driven architectures using Azure Event Hub.
  • Develop and maintain data processing workflows using Python and PySpark.
  • Create and optimize SQL queries within Databricks SQL for data analysis.
  • Automate data workflows and pipelines using Databricks Workflows.
Requirements
  • Minimum 10 years of experience in data architecture and related technologies.
  • Expertise in Databricks Workspace Admin, Databricks CLI, and Databricks Unity Catalog.
  • Hands-on experience with Kafka for real-time data streaming.
  • Proficiency in using Azure Monitor, Azure Data Lake Store, and Azure Key Vault.
  • Strong skills in Azure DevOps for CI/CD pipeline management.
  • Experience in Azure Event Hub for event-driven architectures.
  • Advanced knowledge of Python and PySpark for data processing.
  • Skilled in writing and optimizing SQL queries within Databricks SQL.
  • Ability to automate workflows using Databricks Workflows.
What We Offer

Cognizant North America offers a competitive salary range of $160,000 - $170,000 per year, depending on experience and qualifications. Additionally, we offer a discretionary annual incentive program, medical/dental/vision/life insurance, paid holidays and time off, 401(k) plan, and other benefits.

Cognizant is an equal opportunity employer and values diversity. We are committed to ensuring that all current and prospective associates are afforded equal opportunities and treatment, and a work environment free of harassment. We are recognized as a Military Friendly Employer and are a coalition member of the Veteran Jobs Mission.



  • Boston, Massachusetts, United States BigRio Full time

    Job Title: DataBricks Subject Matter ExpertLocation: RemoteDuration: Contract- 3-12 monthsJob Summary:BigRio LLC is seeking a highly skilled and business-savvy DataBricks Subject Matter Expert to join our team as a Business Solutions Architect. In this role, you will leverage your deep technical expertise in DataBricks and your understanding of business...


  • Boston, Massachusetts, United States Digital Prospectors Full time

    Job DescriptionJob Title: Cloud Infrastructure ArchitectJob Summary:Digital Prospectors is seeking a highly skilled Cloud Infrastructure Architect to lead and drive cloud infrastructure projects across AWS and Azure environments. As a key member of our team, you will be responsible for architecting, deploying, and managing scalable and highly available cloud...


  • Boston, Massachusetts, United States Mindlance Full time

    Job Title: Senior BI ArchitectAt Mindlance, we are seeking a highly skilled Senior BI Architect to lead the design and implementation of our organization's BI strategy for a health data warehouse project.Job Summary:The Senior BI Architect will work closely with Senior Management and Data Analysts to identify business goals and objectives, and then design...


  • Boston, Massachusetts, United States Mindlance Full time

    Senior BI Architect Job DescriptionPosition Summary:Mindlance is seeking a contract Senior BI Architect to design, develop, and implement our organization's BI strategy for a health data warehouse project. The project team will rebuild an existing data warehouse using new ETL, BI, and database platforms with an eye towards cost containment and improved...


  • Boston, Massachusetts, United States Motion Recruitment Full time

    Salesforce Solutions Architect Opportunity **About the Role** We are seeking a highly skilled Salesforce Solutions Architect to join our team at a global PaaS company based in Boston. As a key member of our cross-functional team, you will be responsible for designing scalable solutions within Salesforce and contributing to the deployment into a multi-cloud...


  • Boston, Massachusetts, United States Berkshire Hathaway Specialty Insurance Full time

    Berkshire Hathaway Specialty Insurance - Software Architect PositionCompany Overview:Berkshire Hathaway Specialty Insurance (BHSI) stands as a premier insurance provider, delivering a comprehensive array of commercial property, casualty, and specialized insurance products on a global scale. As an integral part of Berkshire Hathaway's insurance framework, we...


  • Boston, Massachusetts, United States Motion Recruitment Full time

    About the RoleWe are seeking a highly skilled Salesforce Solutions Architect to join our team at Motion Recruitment. As a key member of our team, you will be responsible for designing and implementing scalable solutions within Salesforce, with a focus on CPQ (Configure, Price, Quote) and marketing-based lead generation.Key ResponsibilitiesWork closely with...


  • Boston, Massachusetts, United States Pyramid Consulting, Inc Full time

    Job Title: Senior End User Computing ArchitectWe are seeking a highly skilled and experienced Senior End User Computing Architect to join our dynamic team at Pyramid Consulting, Inc. As a key member of our team, you will play a pivotal role in designing, implementing, and maintaining end-user computing solutions that ensure seamless and efficient experiences...


  • Boston, Massachusetts, United States Berkshire Hathaway Specialty Insurance Full time

    Berkshire Hathaway Specialty Insurance - Software Architect PositionCompany Overview:Berkshire Hathaway Specialty Insurance (BHSI) stands as a premier insurance provider, delivering a comprehensive array of commercial property, casualty, and specialized insurance products on a global scale. As a key player within Berkshire Hathaway's insurance division, we...


  • Boston, Massachusetts, United States Motion Recruitment Full time

    Cloud Solutions Architect - Salesforce CPQBoston-based PaaS company seeks a skilled Salesforce Solutions Architect to drive marketing-based lead generation and Salesforce CPQ implementation.This full-time, remote position requires 7+ years of experience in Salesforce Marketing / Experience Cloud, Salesforce CPQ implementation, and deployment to multi-cloud...


  • Boston, Massachusetts, United States Russell Tobin Full time

    Job DescriptionWe are seeking a highly skilled and experienced Senior Modern Workplace Solutions Architect to join our dynamic team at Russell Tobin. The ideal candidate will possess a deep understanding of Windows Autopilot, Azure services, and End User Computing.Key Responsibilities:Lead the design, development, deployment, and maintenance of Windows...


  • Boston, Massachusetts, United States Cedent Consulting Full time

    Job Title: Principal Solutions ArchitectJob Summary:The Principal Solutions Architect will provide strategic leadership in architectural planning and driving solutions across multiple domains/solution areas, contributing to the future success of the business through innovations in technology.Key Responsibilities:Lead opportunity identification and analysis,...

  • Technical Architect

    2 weeks ago


    Boston, Massachusetts, United States Experis Full time

    Job Title: Technical ArchitectJob Summary:We are seeking a highly skilled Technical Architect to join our team at Experis. As a Technical Architect, you will be responsible for providing technical leadership and direction to our team, ensuring the successful implementation of our technology solutions.Key Responsibilities:Define the technical architecture and...


  • Boston, Massachusetts, United States Digital Prospectors Full time

    Senior Cloud EngineerAt Digital Prospectors, we're seeking a highly skilled Senior Cloud Engineer to lead and drive cloud infrastructure projects across AWS and Azure environments. As a key member of our team, you'll be responsible for architecting, deploying, and managing scalable and highly available cloud infrastructure.Key Responsibilities:Design and...


  • Boston, Massachusetts, United States Confluent Full time

    About the RoleWe're seeking a seasoned technologist to join our Advanced Technology Team, a specialist group within Confluent that focuses on the deep technical aspects of Kafka and distributed systems.Key ResponsibilitiesEngage with customers to understand their challenges and help them design distributed data architectures using Kafka, Kafka Connect, and...


  • Boston, Massachusetts, United States Fidelity Investments Full time

    {"Job Title: Platform Domain Solution ArchitectJob Summary: We are seeking a skilled Platform Domain Solution Architect to join our team at Fidelity Investments. As a key member of our Workplace Investing Technology Group, you will drive technology strategy and architecture aligned with business outcomes.The Role: In this architect role, you will provide...


  • Boston, Massachusetts, United States Berkshire Hathaway Specialty Insurance Full time

    Job OverviewPosition: Technical Architect at Berkshire Hathaway Specialty Insurance (BHSI)About Us: Berkshire Hathaway Specialty Insurance (BHSI) stands as a trusted insurance provider, delivering a comprehensive array of insurance solutions and exceptional service to clients globally. As part of the esteemed Berkshire Hathaway insurance group, we offer our...


  • Boston, Massachusetts, United States Palo Alto Networks Full time

    Job Title: Prisma Cloud Solutions ArchitectAt Palo Alto Networks, we're seeking a highly skilled Prisma Cloud Solutions Architect to join our team. As a key member of our sales team, you will be responsible for building influential relationships with key technical decision makers at customers, uncovering new opportunities, and fueling business drivers.Key...


  • Boston, Massachusetts, United States Brown Brothers Harriman Full time

    About the RoleBrown Brothers Harriman is seeking a highly skilled Senior Architect to join our Enterprise Architecture team. As a key member of our team, you will be responsible for designing and implementing Artificial Intelligence and Machine Learning capabilities across our Application Development efforts.Key ResponsibilitiesCreate and manage an...


  • Boston, Massachusetts, United States Cedent Consulting Full time

    About the RoleCedent Consulting is seeking a highly skilled AI/ML Solutions Principal to join our team. As a key member of our Enterprise Architecture organization, you will play a critical role in driving innovation and leading solutions across multiple domains.Key ResponsibilitiesLead opportunity identification and analysis, problem definition, and oversee...