Current jobs related to Azure Data Lake Principal Architect - Boston - Motion Recruitment

  • Azure Databricks Architect

    10 hours ago

    Boston, United States Cognizant Full time

    Title: Azure Databricks Architect (Onsite) Cognizant (NASDAQ: CTSH) is a leading provider of information technology, consulting, and business process outsourcing services, dedicated to helping the world's leading companies build stronger businesses. Headquartered in Teaneck, New Jersey (U.S.). Cognizant is a member of the NASDAQ-100, the S&P 500, the...

  • Data Architect

    2 days ago

    boston, United States Connect Group Full time

    Data ArchitectLocation: Boston / Norwood (MA) / HybridSalary: Up to $180,000 USD + 10% Performance BonusWe are looking for a highly skilled Data Architect to join our dynamic team. As a Data Architect, you will be responsible for designing and implementing scalable data solutions across the enterprise, ensuring data quality, security, and alignment with...

  • Principal Data Architect

    2 weeks ago

    Boston, Massachusetts, United States Motion Recruitment Full time

    Job Title: Principal Data ArchitectWe're seeking a highly skilled Principal Data Architect to join our team at Motion Recruitment. As a key member of our Data Team, you will play a critical role in providing technical leadership, expertise, and guiding other highly skilled Data Engineers.About the Role:5+ years of experience in Software and/or Data...

  • Principal Solutions Architect

    5 days ago

    Boston, Massachusetts, United States Cedent Consulting Full time

    Job Title: Principal Solutions ArchitectJob Summary:The Principal Solutions Architect will provide strategic leadership in architectural planning and driving solutions across multiple domains/solution areas, contributing to the future success of the business through innovations in technology.Key Responsibilities:Lead opportunity identification and analysis,...

  • Data Architect

    3 weeks ago

    Boston, United States Compunnel Inc. Full time

    Job Role: Data Solution ArchitectLocation: Boston, MA (Onsite)Type: ContractJob DescriptionMinimum of 15 years IT experience in Data BIA solution architecting of which at least 3 years in Azure Snowflake DatabricksGood experience in Data architecture data warehousing architecture ETL/ELT parallel and multiprocessing APIs Streaming and real time data...

  • Data Architect

    3 weeks ago

    Boston, United States Compunnel Inc. Full time

    Position - Data Solution Architect Location - Boston MA Type – Contract Work Mode – Onsite-HybridJob descriptionMinimum of 15 years IT experience in Data BIA solution architecting of which at least 3 years in Azure Snowflake DatabricksGood experience in Data architecture data warehousing architecture ETLELT parallel and multiprocessing APIs Streaming...

  • Data Architect

    2 days ago

    boston, United States Compunnel Inc. Full time

    Position - Data Solution Architect Location - Boston MA Type – Contract Work Mode – Onsite-HybridJob descriptionMinimum of 15 years IT experience in Data BIA solution architecting of which at least 3 years in Azure Snowflake DatabricksGood experience in Data architecture data warehousing architecture ETLELT parallel and multiprocessing APIs Streaming...

  • Principal Data Architect

    2 weeks ago

    Boston, Massachusetts, United States Motion Recruitment Full time

    About the Role:Motion Recruitment is seeking a highly skilled Principal Data Engineer to join our client's Data Team in Boston, Massachusetts. This is a hybrid full-time position that offers a competitive salary and benefits package, as well as opportunities for career growth and learning.Key Responsibilities:Provide technical leadership and expertise to the...

  • Principal Solutions Architect

    1 month ago

    Boston, United States Cedent Consulting Full time

    Title: Principal Solutions Architect - Analytics@ Portland, OR Atlanta, GA OR San Francisco, CA or Boston, MA) Terms of Hire: Full Time.Job descriptionThe Principal Analytics Architect will provide leadership in architectural planning and in driving solutions across multiple domains/ solution areas, contributing to the future success of?the business through...

  • .Net Azure Architect

    4 weeks ago

    Boston, United States S3b Global Inc Full time

    Job DescriptionJob DescriptionHi ,I hope you are doing great.Please Share your Updated resume if you want to apply for the position below.Job Title Azure ArchitectLocation Newton MA Hybrid OnsiteInterview Mode- Video Duration: Full Time/C2HClient: MResultVisa: GC,USC What you will be doing: The Azure Architect will lead designing and implementing solutions...

  • Data Solution Architect

    3 weeks ago

    Boston, United States Cloudious LLC Full time

    Job DescriptionJob DescriptionJob description Minimum of 15 years IT experience in Data BIA solution architecting of which at least 3 years in Azure Snowflake Databricks Good experience in Data architecture data warehousing architecture ETLELT parallel and multiprocessing APIs Streaming and real time data integration Must have good work experienceknowledge...

  • Principal Solutions Architect

    2 weeks ago

    Boston, Massachusetts, United States Cedent Consulting Full time

    Job DescriptionJob Title: Principal Solutions Architect - Analytics LeaderJob Summary:Cedent Consulting is seeking a highly skilled Principal Solutions Architect - Analytics Leader to join our team. As a key member of our analytics organization, you will be responsible for leading the development and implementation of advanced analytics solutions that drive...

  • Principal Azure Database Administrator

    1 week ago

    Boston, United States The Panther Group Full time

    We are a growing Software Company, looking to bring on an experienced Principal Azure Database Administrator. This role is full-time remote. Specifically, we need someone with 5+ years of Azure experience, in addition to extensive DBA experience.Responsibilities:Managing cloud-based database servicesEnsure high availability, performance tuning, disaster...

  • Enterprise Data Architect with Data Integration

    2 months ago

    Boston, United States Saviance Full time

    Job Title: Enterprise Data Architect Location: Remote- East Coast Hours Duration: 6+ Months bout BigRio: BigRio is a remote technology consulting firm headquartered in Boston. We deliver a range of solutions including custom machine learning/AI integrations and data warehousing and processing solutions. Our comprehensive approach serves clients from a...

  • Principal Data Architect

    5 days ago

    Boston, Massachusetts, United States Motion Recruitment Full time

    Job Title: Principal Data EngineerWe are seeking a highly skilled Principal Data Engineer to join our team at Motion Recruitment. As a key member of our Data Team, you will play a critical role in providing technical leadership, expertise, and best practices to guide other highly skilled Data Engineers.About the Role:5+ years of experience in Software and/or...

  • Lead Azure Engineer

    3 months ago

    Boston, United States Resource Informatics Group Full time

    The team is looking for two Azure Cloud engineers to drive their cloud migration initiative. They will be the first two engineers on the team, joining two existing Cloud architects. Therefore, they need to have past experience working/ leading a cloud migration project with the ability to also support some of their existing/legacy on premise infra. This...

  • Principal Architect

    5 days ago

    Boston, Massachusetts, United States The Ceres Group Full time

    Job Title: Principal ArchitectJob Summary:The Principal Architect will lead technology improvements and evaluations within our environment, serving as a technical mentor for the development staff. This role will guide and lead the design and technical oversight of various project deliveries, contributing to our technology advancement by evaluating new...

  • Principal Architect for AI/ML Solutions

    4 weeks ago

    Boston, Massachusetts, United States Cedent Consulting Full time

    Title:AI/ML Principal Solution ArchitectAbout Cedent Consulting:This role is with a prominent firm in the technology sector committed to transforming its platforms to streamline, modernize, and facilitate advancements beyond current standards.Salary:$ Open K/ YR + Benefits.Job Overview:Lead and strategize architectural solutions across diverse...

  • Enterprise Data Architect with Databricks and Epic Clarity

    2 months ago

    Boston, United States Saviance Full time

    Job Title: Enterprise Data Architect with Databricks and Epic Clarity Location: Remote About the Company: BigRio is a leading IT Services company focused on Data and Analytics in the Healthcare Industry segment. We are committed to being the client's strategic partner in accelerating digital transformation and fostering innovation. With a relentless focus on...

  • Principal C++ Software Architect

    1 week ago

    Boston, Massachusetts, United States Motion Recruitment Full time

    Principal C++ EngineerBoston, MassachusettsFull Time$150k - $250kWe are seeking a highly skilled Principal C++ Engineer to join our talented team. As a Principal C++ Engineer specializing in data plane development, you will play a crucial role in architecting and implementing performant and efficient data planes for our service mesh platforms.Key...

Azure Data Lake Principal Architect

3 months ago

Boston, United States Motion Recruitment Full time

Azure Data Lake Principal Architect

Location: Somerville, MA


Position Overview

We are seeking a highly skilled and experienced Principal Data Engineer to join our dynamic team. As a key member of our data engineering team, you will play a crucial role in designing, developing, and maintaining our data infrastructure and platform integration solutions. The Principal Data Engineer will be responsible for advancing our data engineering capabilities, ensuring data quality, and contributing to the success of data-driven initiatives.

Principal Duties and Responsibilities:

Infrastructure, Architecture and Design:

Design end-to-end data solutions on the Azure data platform, considering Scalability, Security, Compliance and Performance.

Contribute to technical foundation of the Data Lake platform, expanding and optimizing the data ecosystem and pipeline architecture.

Provide expertise in selecting and implementing appropriate data platform services (e.g. Azure, Databricks, Snowflake) for various data processing and storage needs.

Collaborate with cross-functional teams to integrate data solutions with existing MGB data platform systems and applications, integrate new data management technologies aligned with the latest vendor products & capabilities (Microsoft Azure and Fabric, Databricks, Snowflake, Collibra, etc.) and software engineering tools into existing structures.

Design, develop, construct, test, and maintain Data Lake architectures and large-scale data processing systems.

Support big data, data lake, lakehouse ecosystem related tool selection and POC analysis.

Data Pipeline Development:

Gather and process raw data at scale including large complex data sets, meeting functional/non-functional business requirements (using ADF, Databricks, Python, Pyspark, scripts, REST API calls, SQL Queries, etc.).

Develop data set processes for data modeling, mining, and production.

Create and maintain optimal data pipeline architecture on cloud-based platforms (e.g., Azure) and relational data systems (SQL Server, SSIS, Snowflakes).



Data Optimization and Automation:


Identify, design, and implement internal process improvements, automation of manual processes, optimization of data delivery, etc.

Build the data infrastructure required for optimal extraction, transformation, and loading of data from traditional/legacy sources.

Qualifications:

Bachelor's or Master's degree in Computer Science, Information Technology, or related fields; or comparable work experience

8+ years of related professional experience including 5+ years in data lake development in large reporting environment(s)

Expert in Azure cloud computing, specializing in Azure data engineering stacks like ADF (Azure Data Factory), ADLS, Event Hubs, Snowflake, Databricks, streaming, Azure PowerShell, and Log Analytics.

Hands-on development experience with Design and Architecture of big data frameworks/tools: Azure Data Lake, Snowflake, Azure Data Bricks.

Expert experience with Hadoop based technology (e.g. Spark) and programming (Python, SQL, PySpark)

Knowledgeable about cloud computing costs and performance and capable of providing ongoing suggestions for cost & performance optimization.

Solid understanding of Snowflake computing, including its integration with Azure Data Lake, utilizing ADLS as a source for data processing.

Experience with Design and Architecture of relational SQL and NoSQL databases, including MS SQL Server, Snowflake.

Experience with Azure DevOps, familiar with CI/CD (Continuous Integration/Continuous Deployment) processes and capable of scaling them across engineering teams, leveraging Azure native resources for data ingestion.