Databricks Architect @ Boston, MA

3 days ago


Boston, MA, United States Diverse Lynx Full time

Databricks Architect
Boston, M
Hybrid - Boston. Client wants the associate to be in Boston.

1.Job title : ARCHITECT 2.Job summary : Join our dynamic team as an Architect, where youll leverage your 10 years of experience to design and implement cutting-edge data solutions. Youll work with technologies like Azure Synapse, AWS, and Databricks to drive innovation and efficiency. This hybrid role offers the opportunity to make a significant impact on our data strategy and contribute to our companys success. 3.Experience : 10to10Yrs 4.Required Skills : ,Python,Grafana,Datadog,Snowflake,Azure Databricks,PySpark,Apache Airflow,AWS,Apache Hudi,Data Build Tool,DataLake,Airflow,Databricks CLI,Azure Synapse DataWarehouse,Snowflake SQL,Snowflake Tasks,Databricks Unity Catalog Admin,Databricks Delta Lake,Apache Iceberg,Fivetran,AWS / GCP / Azure Cloud,Databricks Assistant 5.Nice to have skills : 6.Technology : -Not Applicable 7.Shift : Day 8.

Responsibilities : - Design and implement scalable data architectures using Azure Synapse and DataLake to optimize data processing and storage solutions. - Collaborate with cross-functional teams to integrate AWS, GCP, and Azure Cloud services, ensuring seamless data flow and accessibility. - Develop and maintain data pipelines using PySpark and Python, enhancing data processing efficiency and reliability. - Utilize Grafana and Datadog for monitoring and performance tuning, ensuring optimal system performance and availability. - Implement and manage Apache Airflow for orchestrating complex data workflows, improving automation and process efficiency. - Leverage Apache Hudi and Apache Iceberg for data versioning and time travel capabilities, enhancing data management practices. - Utilize Data Build Tool and Fivetran for data transformation and integration, streamlining data workflows. - Optimize Snowflake Tasks and Snowflake SQL for efficient data querying and analysis, driving data-driven decision-making. - Administer Databricks Unity Catalog and CLI for data governance and management, ensuring data security and compliance. - Implement Databricks Delta Lake for reliable data lakes, improving data consistency and reliability. - Utilize Databricks Assistant and Azure Databricks for collaborative data engineering, enhancing team productivity. - Ensure data solutions align with business objectives, contributing to the companys strategic goals and societal impact. - Stay updated with industry trends and emerging technologies, driving continuous improvement and innovation. -Qualifications - Possess extensive experience with Azure Synapse and DataLake, demonstrating expertise in data architecture design. - Have a strong background in AWS, GCP, and Azure Cloud services, showcasing proficiency in cloud integration. - Demonstrate proficiency in PySpark and Python, highlighting skills in data processing and automation. - Experience with Grafana and Datadog, emphasizing capabilities in system monitoring and performance tuning. - Proficient in Apache Airflow, showcasing skills in workflow orchestration and process automation. - Familiarity with Apache Hudi and Apache Iceberg, demonstrating knowledge in data versioning and management. - Experience with Data Build Tool and Fivetran, highlighting skills in data transformation and integration. - Proficient in Snowflake SQL and Snowflake Tasks, showcasing expertise in data querying and analysis. - Experience with Databricks Unity Catalog and CLI, emphasizing skills in data governance and management. - Familiarity with Databricks Delta Lake, demonstrating knowledge in data lake optimization. - Experience with Azure Databricks, showcasing skills in collaborative data engineering. 9.Job Location : Primary :USMABOSA02 Boston,MA-745 Atlantic Ave-COG Alternate : , 10.Job Type : 45CW01 Business Associate -BC 11.Demand Requires Travel? : N 12.Certifications Required : Azure Solutions Architect Expert, AWS Certified Solutions Architect, Databricks Certified Data Engineer Associate 13.Work Model : Hybrid 14.Sub Contractor allowed : Y 10.00 Years of Experience

Diverse Lynx LLC is an Equal Employment Opportunity employer. All qualified applicants will receive due consideration for employment without any discrimination. All applicants will be evaluated solely on the basis of their ability, competence and their proven capability to perform the functions outlined in the corresponding role. We promote and support a diverse workforce across all levels in the company.



  • Boston, MA, United States Kaav Inc. Full time

    Work Location: ONSITE - Boston, MA Required: Minimum of 15 years IT experience in Data BIA solution architecting of which at least 3 years in Azure Snowflake Databricks Good experience in Data architecture data warehousing architecture ETLELT parallel and multiprocessing APIs Streaming and real time data integration Must have good work experienceknowledge...


  • Boston, MA, United States Kaav Inc. Full time

    Work Location: ONSITE - Boston, MA Required: Minimum of 15 years IT experience in Data BIA solution architecting of which at least 3 years in Azure Snowflake Databricks Good experience in Data architecture data warehousing architecture ETLELT parallel and multiprocessing APIs Streaming and real time data integration Must have good work experienceknowledge...


  • Boston, MA, United States Kaav Inc. Full time

    Work Location: ONSITE - Boston, MA Required: Minimum of 15 years IT experience in Data BIA solution architecting of which at least 3 years in Azure Snowflake Databricks Good experience in Data architecture data warehousing architecture ETLELT parallel and multiprocessing APIs Streaming and real time data integration Must have good work experienceknowledge...


  • Boston, MA, United States Kaav Inc. Full time

    Work Location: ONSITE - Boston, MA Required: Minimum of 15 years IT experience in Data BIA solution architecting of which at least 3 years in Azure Snowflake Databricks Good experience in Data architecture data warehousing architecture ETLELT parallel and multiprocessing APIs Streaming and real time data integration Must have good work experienceknowledge...

  • DevOps Architect

    5 days ago


    Boston, MA, United States Motion Recruitment Full time

    We're looking for an experienced DevOps Architect to lead the strategy, architecture, and growth of a global DevOps function for an enterprise-scale multi-tenant SaaS platform. This full-time, hybrid position is based in Boston, MA, offering flexibility, collaboration, and the opportunity to shape the next generation of secure, cloud-native infrastructure....


  • Boston, MA, United States CData Software Full time

    Hi, Pls share profile for below JD. Job ID Account Name Skill Location Max Salary Range 285996 Santander Payments Solutions Architect Boston, MA or Remote 170k Job Title Solution Architect Skill General Banking Minimum Experience 8 - 10 Years • Previous background in Solutions Architecture in banking is prefered • Previous experience in creating...


  • Boston, MA, United States Berkshire Hathaway Specialty Insurance Full time

    Who are we? A strategic and trusted insurance partner, Berkshire Hathaway Specialty Insurance (BHSI), provides a broad range of commercial property, casualty and specialty insurance coverages and outstanding service to customers and brokers around the world. Part of Berkshire Hathaway's insurance operations, we bring our solutions to market with our stellar...


  • Boston, MA, United States Berkshire Hathaway Specialty Insurance Full time

    Who are we? A strategic and trusted insurance partner, Berkshire Hathaway Specialty Insurance (BHSI), provides a broad range of commercial property, casualty and specialty insurance coverages and outstanding service to customers and brokers around the world. Part of Berkshire Hathaway's insurance operations, we bring our solutions to market with our stellar...


  • Boston, MA, United States Berkshire Hathaway Specialty Insurance Full time

    Who are we? A strategic and trusted insurance partner, Berkshire Hathaway Specialty Insurance (BHSI), provides a broad range of commercial property, casualty and specialty insurance coverages and outstanding service to customers and brokers around the world. Part of Berkshire Hathaway's insurance operations, we bring our solutions to market with our stellar...


  • Boston, MA, United States Berkshire Hathaway Specialty Insurance Full time

    Who are we? A strategic and trusted insurance partner, Berkshire Hathaway Specialty Insurance (BHSI), provides a broad range of commercial property, casualty and specialty insurance coverages and outstanding service to customers and brokers around the world. Part of Berkshire Hathaway's insurance operations, we bring our solutions to market with our stellar...