Bigdata Databricks Architect
4 weeks ago
Job Title : Bigdata Databricks Architect
Client Location: Boston, MA (Hybrid 2-3 days a week onsite)
Duration : Long term contract
Education and experience Qualification
- Bachelor s degree in Computer Science, Information Systems, or equivalent education or work experience
- 8+ years of IT experience in big data space like Hadoop, data lake, data engineering using Python & Spark programming languages
- Any AWS and/or Databricks certification will be a plus
Roles & Responsibilities
- Recognize the current application infrastructure and suggest new concepts to improve performance
- Document the best practices and strategies associated with application deployment and infrastructure support
- Produce reusable, efficient, and scalable programs, and also cost-effective migration strategies
- Develop Data Engineering and ML pipelines in Databricks and different AWS services, including S3, EC2, API, RDS, Kinesis/Kafka and Lambda to build serverless applications
- Work jointly with the IT team and other departments to migrate data engineering and ML applications to Databricks/AWS
- Comfortable to work on tight timelines, when required.
Skill Sets Required
- Good decision-making and problem solving skills
- Solid understanding of Databricks fundamentals/architecture and have hands on experience in setting up Databricks cluster, working in Databricks modules (Data Engineering, ML and SQL warehouse).
- Knowledge on medallion architecture, DLT and unity catalog within Databricks.
- Experience in migrating data from on-prem Hadoop to Databricks/AWS
- Understanding of core AWS services, uses, and AWS architecture best practices
- Hands-on experience in different domains, like database architecture, business intelligence, machine learning, advanced analytics, big data, etc.
- Solid knowledge on Airflow
- Solid knowledge on CI/CD pipeline in AWS technologies
- Application migration of RDBMS, java/python applications, model code, elastic etc.
- Solid programming background on scala, python
- Experience with Docker and Kubernetes is a plus
-
AWS Databricks Architect
2 months ago
Boston, United States Diverse Lynx Full timeTitle: AWS Databricks Data Architect Location: Boston, MA & Princeton, NJ (Onsite) Type: Full TimeJob Description: We are seeking a skilled and experienced Databricks Architect with expertise in working with Databricks on the AWS cloud platform. Comprehensive knowledge and hands on experience with Databricks pipelines, Unity Catalog and Medallion...
-
AWS Databricks Architect
1 month ago
Boston, United States Diverse Lynx Full timeTitle: AWS Databricks Data Architect Location: Boston, MA & Princeton, NJ (Onsite) Type: Full TimeJob Description: We are seeking a skilled and experienced Databricks Architect with expertise in working with Databricks on the AWS cloud platform. Comprehensive knowledge and hands on experience with Databricks pipelines, Unity Catalog and Medallion...
-
AWS Databricks Architect
3 weeks ago
Boston, United States Diverse Lynx Full timeTitle: AWS Databricks Data ArchitectLocation: Boston, MA & Princeton, NJ (Onsite)Type: Full Time Job Description:We are seeking a skilled and experienced Databricks Architect with expertise in working with Databricks on the AWS cloud platform.Comprehensive knowledge and hands on experience with Databricks pipelines, Unity Catalog and Medallion...
-
AWS Databricks Architect
4 weeks ago
Boston, United States Xoriant Corporation Full timeJob Title : AWS Databricks ArchitectClient Location: Boston, MA (Hybrid 2-3 days a week onsite)Duration : Long term contractEducation and experience QualificationBachelor s degree in Computer Science, Information Systems, or equivalent education or work experience8+ years of IT experience in big data space like Hadoop, data lake, data engineering using...
-
AWS Databricks Architect
2 months ago
Boston, MA, United States Diverse Lynx Full timeTitle: AWS Databricks Data ArchitectLocation: Boston, MA & Princeton, NJ (Onsite)Type: Full Time Job Description:We are seeking a skilled and experienced Databricks Architect with expertise in working with Databricks on the AWS cloud platform.Comprehensive knowledge and hands on experience with Databricks pipelines, Unity Catalog and Medallion...
-
Senior Solution Architect, Data
2 weeks ago
Boston, MA, United States Databricks Full timeAt Databricks we are on a mission to empower our customers to solve the world's toughest data problems by utilizing the Lakehouse platform. As a Delivery Solutions Architect (DSA), you will play an important role during this journey. You will collaborate with our sales and field engineering teams to accelerate the adoption and growth of the Databricks...
-
AWS Data Engineer/ Architect
4 weeks ago
Boston, United States IMCS Group Full timeTitle: Databricks/AWS architectLocation: Boston, MA (day 1 Onsite)Duration: Long Term Contract Job Description:Ability to design/develop based on business requirements by effectively coordinating activities between business analysts, developers, and testing team.Uses advanced technical expertise in analyzing, designing, estimating, and developing software...
-
AWS Data Engineer/ Architect
1 month ago
Boston, United States IMCS Group Full timeTitle: Databricks/AWS architectLocation: Boston, MA (day 1 Onsite)Duration: Long Term Contract Job Description:Ability to design/develop based on business requirements by effectively coordinating activities between business analysts, developers, and testing team.Uses advanced technical expertise in analyzing, designing, estimating, and developing software...
-
Databricks
3 weeks ago
Boston, United States APEX Full timeJob Details : Must Have Skills Databricks, Big data, Data Architecture Detailed Job Description 12 years of IT industry experience including cloud technologies Very strong handson experience in data on Cloud services with Data engineering concepts.6 years of experience in architecting Cloud data solutions using AWS, Databricks, Python, PySpark,...
-
AWS and Databricks Cloud Data Architect
4 weeks ago
Boston, United States Infosys Technologies Ltd Full timeJob Description :Infosys is seeking a AWS and Databricks Cloud Data Architect. Job type: Full timeJob location: Boston,MARequired Qualifications:Bachelor s degree or foreign equivalent required from an accredited institution. Will also consider three years of progressive experience in the specialty in lieu of every year of education.At least 7 years of...
-
Azure Architect
3 weeks ago
Boston, United States Vaco Full timeJob Title: Azure Architect Contract Remote (EST) Job Overview: We are seeking a senior Azure Architect and Developer to support a data consolidation project. Role Details:Duration: 6-12 weeks, depending on availability (with potential for extension up to 4 months)Responsibilities:Take over and continue the implementation plan developed by the current...
-
BI Engineer
2 weeks ago
Boston, United States Zeektek Full time6-month contract with potential for conversion to permanent hireAdditional Requirements:Must reside in or be willing to relocate to the greater Sacramento area.Availability to work on-site two days per week as part of a hybrid working arrangement.Required Solution Architecture, Healthcare, Power BI, Tableau, Databricks, Overview:We are seeking a seasoned...
-
Data Architect
3 weeks ago
Boston, United States Trident Consulting Full timeTrident Consulting is seeking a " Data Architect " for one of our clients in " Jersey City, NJ & Boston, MA ". Role: Data Architect Location: Jersey City / Boston Hybrid (onsite) Type: Contract/FTE Job Description We are seeking a Data Architect to help drive our data strategy for Private Banking and Investment Management business lines. This individual must...
-
Big Data Modeler
4 weeks ago
Boston, United States Sysmind, LLC Full timeRole: Big Data Modeler / Architect (FX Domain) Location: Boston, MA Role Description: The team is involved in the build-out of a Data Lakehouse using Databricks for the FX business line. They are setting up the Databricks infrastructure and soon will start building ingestion pipelines into the Bronze Zone. Additionally, they will design the data model...
-
Data Architect
2 weeks ago
Boston, United States Codebase Full timeData Architect 3 days onsite at their Boston, MA or Jersey City, NJ office 3 days onsite at their Boston, MA or Jersey City, NJ office - Locals to MA or NJ or NY only** Looking for: -must be able to architect but also code, want someone who is open to being hands-on to code and develop when needed -8+ years of experience in an IT, preliminary on hands on...
-
Data Architect
1 week ago
Boston, United States Codebase Inc Full timeData Architect3 days onsite at their Boston, MA or Jersey City, NJ office3 days onsite at their Boston, MA or Jersey City, NJ office - Locals to MA or NJ or NY only** Looking for:-must be able to architect but also code, want someone who is open to being hands-on to code and develop when needed-8+ years of experience in an IT, preliminary on hands on...
-
Data Architect
4 days ago
Boston, United States Codebase Full timeData Architect 3 days onsite at their Boston, MA or Jersey City, NJ office 3 days onsite at their Boston, MA or Jersey City, NJ office - Locals to MA or NJ or NY only** Looking for: -must be able to architect but also code, want someone who is open to being hands-on to code and develop when needed -8+ years of experience in an IT, preliminary on hands on...
-
Data Architect
2 weeks ago
Boston, United States Codebase Inc Full timeData Architect3 days onsite at their Boston, MA or Jersey City, NJ office3 days onsite at their Boston, MA or Jersey City, NJ office - Locals to MA or NJ or NY only** Looking for:-must be able to architect but also code, want someone who is open to being hands-on to code and develop when needed-8+ years of experience in an IT, preliminary on hands on...
-
Security Architect
2 months ago
Boston, United States MassMutual Full timeThe MassMutual Enterprise Architecture team in the Enterprise Technology and Experience organization is seeking an outstanding Enterprise Architect-security to join our team. The enterprise architect for security will be responsible for evaluating and benchmarking new critical risk-based security capabilities for data protection, authentication, and software...
-
Security Architect
1 week ago
Boston, United States MassMutual Full timeThe MassMutual Enterprise Architecture team in the Enterprise Technology and Experience organization is seeking an outstanding Enterprise Architect-security to join our team. The enterprise architect for security will be responsible for evaluating and benchmarking new critical risk-based security capabilities for data protection, authentication, and software...