Databricks Architect

3 weeks ago

Atlanta, United States Genpact Full time

Inviting applications for the role of Senior Principal Consultant-Databricks Senior Developer/Architect

In this role, the Sr. Databricks developer is responsible for solving real-world cutting-edge problem and mentor a team of one or more junior developer to address the goal.

Responsibilities

  • Closely work with Architect and lead to design solutions to meet functional and non-functional requirements.
  • Participate to understand architecture and solution design artifacts.
  • Evangelize re-use through the implementation of shared assets.
  • Proactively implement engineering methodologies, standards, and leading practices.
  • Provide insight and direction on roles and responsibilities required for solution operations.
  • Identify, communicate, and mitigate Risks, Assumptions, Issues, and Decisions throughout the full lifecycle.
  • Considers the art of the possible, compares various solution options based on feasibility and impact, and proposes actionable plans.
  • Demonstrate strong analytical and technical problem-solving skills.
  • Ability to analyse and operate at various levels of abstraction.
  • Ability to balance what is strategically right with what is practically realistic.


Qualifications we seek in you

Minimum Qualifications

  • Excellent technical skills to enabling the creation of future-proof, complex global solutions
  • Bachelor’s Degree or equivalency (CS, CE, CIS, IS, MIS, or engineering discipline) or equivalent work experience.
  • Maintains close awareness of new and emerging technologies and their potential application for service offerings and products.
  • Work with architect and leads for solutioning to meet functional and non-functional requirements.
  • Demonstrated knowledge of relevant industry trends and standards.
  • Demonstrate strong analytical and technical problem-solving skills.
  • Must have excellent coding skills either Python or Scala, preferably Python.
  • Must have experience in Data Engineering domain.
  • Must have implemented at least 2 project end-to-end in Databricks.
  • Must have experience on data bricks which consists of various components as below.
  • Delta lake
  • dB Connect
  • dB API 2.0
  • Databricks workflows orchestration
  • Must be well versed with Databricks Lakehouse concept and its implementation in enterprise environments.
  • Must have strong understanding of Data warehousing and various governance and security standards around Databricks.
  • Must have knowledge of cluster optimization and its integration with various cloud services.
  • Must have good understanding to create complex data pipeline.
  • Must have good knowledge of Data structure & algorithms.
  • Must be strong in SQL and sprak-sql.
  • Must have strong performance optimization skills to improve efficiency and reduce cost.
  • Must have worked on both Batch and streaming data pipeline.
  • Must have extensive knowledge of Spark and Hive data processing framework.
  • Must have worked on any cloud (Azure, AWS, GCP) and most common services like ADLS/S3, ADF/Lambda, Cosmos DB/DynamoDB, ASB/SQS, Cloud databases.
  • Must be strong in writing unit test case and integration test.
  • Must have strong communication skills and have worked on the team of size 5 plus.
  • Must have great attitude towards learning new skills and upskilling the existing skills.
  • Good to have Rest API knowledge.
  • Good to have understanding around cost distribution.
  • Good to have knowledge of Databricks platform design.
  • Good to have Unity catalog and basic governance knowledge.
  • Good to have Databricks SQL Endpoint understanding.
  • Good To have CI/CD experience to build the pipeline for Databricks jobs.
  • Good to have if worked on migration project to build Unified data platform.
  • Good to have knowledge of DBT.
  • Good to have knowledge of docker and Kubernetes.

Skillset:

  • Azure databricks
  • Must have excellent coding skills either Python or Scala, preferably Python.
  • Must have implemented at least 2 project end-to-end in Databricks.
  • Must have experience on databricks which consists of various components as below.
  • Delta lake
  • dbConnect
  • db API 2.0
  • Databricks workflows orchestration
  • cloud (Azure, AWS, GCP)

  • Databricks Architect

    Found in: Appcast Linkedin GBL C2 - 3 weeks ago

    Atlanta, United States Genpact Full time

    Inviting applications for the role of Senior Principal Consultant-Databricks Senior Developer/Architect!In this role, the Sr. Databricks developer is responsible for solving real-world cutting-edge problem and mentor a team of one or more junior developer to address the goal. ResponsibilitiesClosely work with Architect and lead to design solutions to meet...

  • Databricks Architect

    Found in: Appcast US C2 - 2 weeks ago

    Atlanta, United States Genpact Full time

    Inviting applications for the role of Senior Principal Consultant-Databricks Senior Developer/Architect!In this role, the Sr. Databricks developer is responsible for solving real-world cutting-edge problem and mentor a team of one or more junior developer to address the goal. ResponsibilitiesClosely work with Architect and lead to design solutions to meet...

  • Databricks Architect

    1 week ago

    Atlanta, United States Genpact Full time

    Inviting applications for the role of Senior Principal Consultant-Databricks Senior Developer/Architect! A variety of soft skills and experience may be required for the following role Please ensure you check the overview below carefully. In this role, the Sr. Databricks developer is responsible for solving real-world cutting-edge problem and mentor a team of...

  • Sr. Principal Consultant

    Found in: beBee S US - 2 weeks ago

    Atlanta, United States Genpact Full time

    Senior Principal Consultant- Databricks Hybrid Architect PlatformWe are seeking a highly skilled and experienced Databricks Platform Architect to lead the design, implementation, and optimization of our Databricks platform.They will work closely with our data engineering team to ensure that our Databricks platform is optimized for performance, scalability,...

  • Azure Databrick Lead

    7 days ago

    Atlanta, United States Syntricate Technologies Full time

    Job Title: Azure Databrick Lead Location: Atlanta, GA (Onsite) Job type: Fulltime only no C2CRoles and Responsibility: We are seeking a skilled Azure Databricks Tech Lead to join our dynamic team. As the Azure Databricks Tech Lead, you will play a pivotal role in architecting, implementing, and optimizing Azure Databricks solutions to support our data...

  • Azure Databrick Lead

    2 weeks ago

    Atlanta, United States Tata Consultancy Services Full time

    We are seeking a skilled Azure Databricks Tech Lead to join our dynamic team. As the Azure Databricks Tech Lead, you will play a pivotal role in architecting, implementing, and optimizing Azure Databricks solutions to support our data engineering and analytics initiatives. You will collaborate closely with cross-functional teams to understand business...

  • Azure Databrick Lead

    2 days ago

    Atlanta, United States Diverse Lynx Full time

    Job Title: Azure Databrick Lead Location: Atlanta, GA Job Type: Fulltime Skill : Azure Job Description: We are seeking a skilled Azure Databricks Tech Lead to join our dynamic team. As the Azure Databricks Tech Lead, you will play a pivotal role in architecting, implementing, and optimizing Azure Databricks solutions to support our data engineering...

  • Consulting & SI Partner Sales Manager - East Boston, MA; Atlanta, GA

    1 week ago

    Atlanta, United States Databricks Full time

    ** Consulting & SI Partner Sales Manager - East** ** Boston, MA; Atlanta, GA** **Mission** The Consulting & Systems Integrator (C&SI) partner team accelerates Databricks growth by building and managing relationships with the leading professional services companies who help customers successfully adopt and gain value with our platform. The role of C&SI...

  • Partner Sales Director, Emerging Business

    Found in: Talent US C2 - 6 days ago

    Atlanta, United States Databricks Full time

    DiscoverCustomersPartners Databricks PlatformIntegrations and DataPricingOpen Source Databricks for IndustriesCross Industry SolutionsMigration & DeploymentSolution Accelerators Training and CertificationEventsBlog and PodcastsGet HelpDive Deep CompanyCareersPressSecurity and Trust Partner Sales Director, Emerging Business Atlanta, Georgia...

  • Azure Databrick Lead

    2 weeks ago

    Atlanta, United States smart techlink Full time

    Job DescriptionJob DescriptionHi,Hope you are doing well.Please review the job description and if you are interested. Please do share your updated resume.Job Title : Azure Databrick LeadLocation : Atlanta, GA(Onsite)Role - LeadDesired Skills - AzureJob DescriptionWe are seeking a skilled Azure Databricks Tech Lead to join our dynamic team. As the Azure...

  • Cloud Architect

    Found in: Appcast Linkedin GBL C2 - 6 days ago

    Atlanta, United States Centraprise Full time

    Role: Azure Databricks LeadLocation: Atlanta, GAMode: FulltimeJD:We are seeking a skilled Azure Databricks Tech Lead to join our dynamic team. As the Azure Databricks Tech Lead, you will play a pivotal role in architecting, implementing, and optimizing Azure Databricks solutions to support our data engineering and analytics initiatives. You will collaborate...

  • Databricks Platform Administrator

    Found in: Resume Library US A2 - 2 weeks ago

    Atlanta, Georgia, United States iSoftTek Solutions Inc Full time

    Databricks Platform Administrator Primary Skill: Data Analysis Location: Atlanta, GA Job Type: W2 Duration: 12 Months Job Description: ·       Responsibilities will include designing, implementing, and maintaining the Databricks platform, and providing operational support. Operational support responsibilities include platform set-up and...

  • Sr. Principal Consultant

    Found in: beBee jobs US - 2 weeks ago

    Atlanta, Georgia, United States Genpact Full time

    Senior Principal Consultant- Databricks Hybrid Architect PlatformWe are seeking a highly skilled and experienced Databricks Platform Architect to lead the design, implementation, and optimization of our Databricks platform.They will work closely with our data engineering team to ensure that our Databricks platform is optimized for performance, scalability,...

  • Architect (Data)

    2 weeks ago

    Atlanta, United States DCM INFOTECH LIMITED Full time

    Title : Architect (Data) Location : Atlanta, GA (Initially Remote - preferred who is willing to relocate) JD : Total 10 + yrs. of IT experience in ETL /Big Data Technologies Proven track record in establishing Global Data / Information Architecture (traditional and modernized) Application integration experience, including data integration design, and...

  • Financial Reporting Solution Architect

    Found in: Appcast US C2 - 3 weeks ago

    Atlanta, United States DKMRBH Inc. Full time

    Financial Reporting Solution Architect (Anaplan Financial Planning experience preferred) Seattle based client Location Remote ok must be willing to work PST. Job Summary and Mission -As a reporting solution architect for you will build and enhance financial reporting solutions that transform Financial Planning and Analysis (FPandA) reporting with a...

  • Azure Data Architect

    Found in: Appcast Linkedin GBL C2 - 2 weeks ago

    Atlanta, United States Fortune 500 Full time

    Azure Data ArchitectLocation: Atlanta, GAType: Long-Term-ContractAdditional Info: Client is looking for candidate having some experience in reporting side and especially in Power BI.Role & Responsibility:Designing, developing, implementing, and translating business requirements and the overall organizational data strategy, including standards, principles,...

  • Azure Data Architect

    2 weeks ago

    Atlanta, United States Fortune 500 Full time

    Azure Data ArchitectLocation: Atlanta, GAType: Long-Term-ContractAdditional Info: Client is looking for candidate having some experience in reporting side and especially in Power BI.Role & Responsibility:Designing, developing, implementing, and translating business requirements and the overall organizational data strategy, including standards, principles,...

  • Azure Data Architect

    Found in: Appcast US C2 - 2 weeks ago

    Atlanta, United States Fortune 500 Full time

    Azure Data ArchitectLocation: Atlanta, GAType: Long-Term-ContractAdditional Info: Client is looking for candidate having some experience in reporting side and especially in Power BI.Role & Responsibility:Designing, developing, implementing, and translating business requirements and the overall organizational data strategy, including standards, principles,...

  • Consulting & SI Partner Sales Manager - East Boston, MA; Atlanta, GA

    1 week ago

    Atlanta, United States CareerBuilder Full time

    ** Consulting & SI Partner Sales Manager - East** ** Boston, MA; Atlanta, GA** **Mission** The Consulting & Systems Integrator (C&SI) partner team accelerates Databricks growth by building and managing relationships with the leading professional services companies who help customers successfully adopt and gain value with our platform. The role of C&SI...

  • Sr. Lead Software Engineer, Analytics Engineering

    2 weeks ago

    Atlanta, United States Chick-fil-A Corporate Support Center Full time

    Sr. Lead Software Engineer, Analytics Engineering Experience designing complex software solutions Experience mentoring and leading a team, including good interpersonal and team collaboration skills Broad and deep programming experience in Python, or other comparable languages Experience with SQL and data modeling Experience with source control systems like...