Databricks Architect

4 weeks ago

Atlanta, United States Genpact Full time

Inviting applications for the role of Senior Principal Consultant-Databricks Senior Developer/Architect

In this role, the Sr. Databricks developer is responsible for solving real-world cutting-edge problem and mentor a team of one or more junior developer to address the goal.

Responsibilities

  • Closely work with Architect and lead to design solutions to meet functional and non-functional requirements.
  • Participate to understand architecture and solution design artifacts.
  • Evangelize re-use through the implementation of shared assets.
  • Proactively implement engineering methodologies, standards, and leading practices.
  • Provide insight and direction on roles and responsibilities required for solution operations.
  • Identify, communicate, and mitigate Risks, Assumptions, Issues, and Decisions throughout the full lifecycle.
  • Considers the art of the possible, compares various solution options based on feasibility and impact, and proposes actionable plans.
  • Demonstrate strong analytical and technical problem-solving skills.
  • Ability to analyse and operate at various levels of abstraction.
  • Ability to balance what is strategically right with what is practically realistic.


Qualifications we seek in you

Minimum Qualifications

  • Excellent technical skills to enabling the creation of future-proof, complex global solutions
  • Bachelor’s Degree or equivalency (CS, CE, CIS, IS, MIS, or engineering discipline) or equivalent work experience.
  • Maintains close awareness of new and emerging technologies and their potential application for service offerings and products.
  • Work with architect and leads for solutioning to meet functional and non-functional requirements.
  • Demonstrated knowledge of relevant industry trends and standards.
  • Demonstrate strong analytical and technical problem-solving skills.
  • Must have excellent coding skills either Python or Scala, preferably Python.
  • Must have experience in Data Engineering domain.
  • Must have implemented at least 2 project end-to-end in Databricks.
  • Must have experience on data bricks which consists of various components as below.
  • Delta lake
  • dB Connect
  • dB API 2.0
  • Databricks workflows orchestration
  • Must be well versed with Databricks Lakehouse concept and its implementation in enterprise environments.
  • Must have strong understanding of Data warehousing and various governance and security standards around Databricks.
  • Must have knowledge of cluster optimization and its integration with various cloud services.
  • Must have good understanding to create complex data pipeline.
  • Must have good knowledge of Data structure & algorithms.
  • Must be strong in SQL and sprak-sql.
  • Must have strong performance optimization skills to improve efficiency and reduce cost.
  • Must have worked on both Batch and streaming data pipeline.
  • Must have extensive knowledge of Spark and Hive data processing framework.
  • Must have worked on any cloud (Azure, AWS, GCP) and most common services like ADLS/S3, ADF/Lambda, Cosmos DB/DynamoDB, ASB/SQS, Cloud databases.
  • Must be strong in writing unit test case and integration test.
  • Must have strong communication skills and have worked on the team of size 5 plus.
  • Must have great attitude towards learning new skills and upskilling the existing skills.
  • Good to have Rest API knowledge.
  • Good to have understanding around cost distribution.
  • Good to have knowledge of Databricks platform design.
  • Good to have Unity catalog and basic governance knowledge.
  • Good to have Databricks SQL Endpoint understanding.
  • Good To have CI/CD experience to build the pipeline for Databricks jobs.
  • Good to have if worked on migration project to build Unified data platform.
  • Good to have knowledge of DBT.
  • Good to have knowledge of docker and Kubernetes.

Skillset:

  • Azure databricks
  • Must have excellent coding skills either Python or Scala, preferably Python.
  • Must have implemented at least 2 project end-to-end in Databricks.
  • Must have experience on databricks which consists of various components as below.
  • Delta lake
  • dbConnect
  • db API 2.0
  • Databricks workflows orchestration
  • cloud (Azure, AWS, GCP)

  • Databricks Architect

    4 weeks ago

    Atlanta, United States Genpact Full time

    Inviting applications for the role of Senior Principal Consultant-Databricks Senior Developer/Architect!In this role, the Sr. Databricks developer is responsible for solving real-world cutting-edge problem and mentor a team of one or more junior developer to address the goal. ResponsibilitiesClosely work with Architect and lead to design solutions to meet...

  • DataBricks Architect

    1 week ago

    Atlanta, United States Diverse Lynx Full time

    DataBricks Architect Atlanta, GA Fulltime 15+ years of experience in architecture, design, implementation and analytics solutions. In-depth knowledge Data processing techniques and handling large data sets. • Hands on development Design and Develop applications using Databricks and Experience with Azure cloud technologies. • In-depth knowledge Data...

  • Databricks Solutions Architect 2024

    1 week ago

    Atlanta, United States Aimpoint Digital Full time

    Are you an accomplished Data Engineer who wants to further grow their Databricks expertise, develop technical content and presentations, and help build a best-in-class Databricks community of practice? Aimpoint Digital is a fast-growing and fully remote data and analytics consultancy. We partner with the most innovative software providers in the data...

  • AWS Cloud Architect for Databricks Migration

    1 week ago

    Atlanta, United States High 5 Full time

    Job Title : AWS ArchitectLocation : Remote Pay Rate : $40/hr - $46/hrDuration: 19 W 2 DNOTE: AWS Solution Architect Associate Certification ( Must) AWS Solution Architect - Professional - prefer. Experts across several areas of AWS Cloud for Databricks Migration.Responsibilities. • Provide AWS Solutions for Databricks Implementation • Build CFT...

  • Azure Databrick Lead

    1 week ago

    Atlanta, United States Syntricate Technologies Full time

    Job Title: Azure Databrick Lead Location: Atlanta, GA (Onsite) Job type: Fulltime only no C2CRoles and Responsibility: We are seeking a skilled Azure Databricks Tech Lead to join our dynamic team. As the Azure Databricks Tech Lead, you will play a pivotal role in architecting, implementing, and optimizing Azure Databricks solutions to support our data...

  • Azure Databrick Lead

    3 weeks ago

    Atlanta, United States Tata Consultancy Services Full time

    We are seeking a skilled Azure Databricks Tech Lead to join our dynamic team. As the Azure Databricks Tech Lead, you will play a pivotal role in architecting, implementing, and optimizing Azure Databricks solutions to support our data engineering and analytics initiatives. You will collaborate closely with cross-functional teams to understand business...

  • Consulting & SI Partner Sales Manager - East Boston, MA; Atlanta, GA

    3 weeks ago

    Atlanta, United States Databricks Full time

    ** Consulting & SI Partner Sales Manager - East** ** Boston, MA; Atlanta, GA** **Mission** The Consulting & Systems Integrator (C&SI) partner team accelerates Databricks growth by building and managing relationships with the leading professional services companies who help customers successfully adopt and gain value with our platform. The role of C&SI...

  • Databricks Platform Administrator

    3 weeks ago

    Atlanta, Georgia, United States iSoftTek Solutions Inc Full time

    Databricks Platform Administrator Primary Skill: Data Analysis Location: Atlanta, GA Job Type: W2 Duration: 12 Months Job Description: ·       Responsibilities will include designing, implementing, and maintaining the Databricks platform, and providing operational support. Operational support responsibilities include platform set-up and...

  • Cloud Architect

    3 weeks ago

    Atlanta, United States Centraprise Full time

    Role: Azure Databricks LeadLocation: Atlanta, GAMode: FulltimeJD:We are seeking a skilled Azure Databricks Tech Lead to join our dynamic team. As the Azure Databricks Tech Lead, you will play a pivotal role in architecting, implementing, and optimizing Azure Databricks solutions to support our data engineering and analytics initiatives. You will collaborate...

  • Data Architect

    3 days ago

    Atlanta, United States Insight Global Full time

    Overview Are you passionate about designing, prototyping and implementing data solutions that can help our customers achieve anything imaginable? Do you have experience with cloud technologies, data platforms, and AI/ML tools preferably in the telecom industry space? If so, you might be the perfect fit for our Technical Architect Data (Telecom Emphasis)...

  • Sr. Principal Consultant

    4 weeks ago

    Atlanta, Georgia, United States Genpact Full time

    Senior Principal Consultant- Databricks Hybrid Architect PlatformWe are seeking a highly skilled and experienced Databricks Platform Architect to lead the design, implementation, and optimization of our Databricks platform.They will work closely with our data engineering team to ensure that our Databricks platform is optimized for performance, scalability,...

  • Financial Reporting Solution Architect

    4 weeks ago

    Atlanta, United States DKMRBH Inc. Full time

    Financial Reporting Solution Architect (Anaplan Financial Planning experience preferred) Seattle based client Location Remote ok must be willing to work PST. Job Summary and Mission -As a reporting solution architect for you will build and enhance financial reporting solutions that transform Financial Planning and Analysis (FPandA) reporting with a...

  • Associate Director- Data Architecture

    2 weeks ago

    Atlanta, United States Prudential plc Full time

    Job Summary: Join our global team as a Data Architecture and play a pivotal role in architecting and implementing cutting-edge data solutions across our diverse organisational landscape. We're seeking an experienced professional proficient in cloud technologies, particularly Azure and GCP, with a passion for continuous learning, meticulous attention to...

  • Technical Product Owner

    2 days ago

    Atlanta, United States Edjuster Full time

    The Technical Product Owner will be responsible for owning vision and prioritization of new technical features and/or enhancements to compelling, customer-oriented products across brands for Inspire, and will be responsible for translating technical features into prioritized user stories and acceptance criteria; accountable for value delivery and value...