Databricks Architect

2 months ago

Atlanta, United States Genpact Full time

Inviting applications for the role of Senior Principal Consultant- Databricks Hybrid Architect Platform

We are seeking a highly skilled and experienced Databricks Platform Architect to lead the design, implementation, and optimization of our Databricks platform. The ideal candidate will have a strong background in cloud-based data processing systems, data warehousing, and big data technologies. They will work closely with our data engineering team to ensure that our Databricks platform is optimized for performance, scalability, and reliability.


Responsibilities

  • Architect and design solutions to meet functional and non-functional requirements.
  • Lead the design, implementation, and optimization of our Databricks platform.
  • Work closely with our data engineering team to ensure that our Databricks platform is optimized for performance, scalability, and reliability.
  • Develop and maintain a comprehensive understanding of our data pipeline and data architecture.
  • Collaborate with other teams to ensure that our Databricks platform is integrated with our other systems and technologies.
  • Develop and maintain documentation for our Databricks platform, including architecture diagrams, deployment guides, and operational procedures.
  • Provide guidance and support to our data engineering team on Databricks-related issues.
  • Create and review architecture and solution design artifacts.
  • Evangelize re-use through the implementation of shared assets.
  • Enforce adherence to architectural standards/principles, global product-specific guidelines, usability design standards, etc.
  • Proactively guide engineering methodologies, standards, and leading practices.
  • Guidance of engineering staff and reviews of as-built configurations during the construction phase.
  • Provide insight and direction on roles and responsibilities required for solution operations.
  • Identify, communicate, and mitigate Risks, Assumptions, Issues, and Decisions throughout the full lifecycle.
  • Considers the art of the possible, compares various architectural options based on feasibility and impact, and proposes actionable plans.
  • Demonstrate strong analytical and technical problem-solving skills.
  • Ability to analyze and operate at various levels of abstraction.
  • Ability to balance what is strategically right with what is practically realistic.
  • Growing the Data Engineering business by helping customers identify opportunities to deliver improved business outcomes, designing and driving the implementation of those solutions.
  • Supporting and developing our people, including learning & development, certification & career development plans
  • Providing technical governance and oversight for platform design and implementation
  • Should have technical foresight to understand new technology and advancement.
  • Leading team in the definition of best practices & repeatable methodologies in Cloud Data Engineering, including Data Storage, ETL, Data Integration & Migration, Data Warehousing and Data Governance
  • Should have Technical Experience in AWS Cloud Data Engineering services and solutions.
  • Contributing to Sales & Pre-sales activities including proposals, pursuits, demonstrations, and proof of concept initiatives
  • Evangelizing the Data Engineering service offerings to both internal and external stakeholders
  • Development of Whitepapers, blogs, webinars and other though leadership material
  • Development of Go-to-Market and Service Offering definitions for Data Engineering
  • Working with Learning & Development teams to establish appropriate learning & certification paths for their domain.
  • Expand the business within existing accounts and help clients, by building and sustaining strategic executive relationships, doubling up as their trusted business technology advisor.
  • Position differentiated and custom solutions to clients, based on the market trends, specific needs of the clients and the supporting business cases.
  • Build new Data capabilities, solutions, assets, accelerators, and team competencies.
  • Manage multiple opportunities through the entire business cycle simultaneously, working with cross-functional teams as necessary.


Qualifications we seek in you

Minimum qualifications

  • Excellent technical architecture skills, enabling the creation of future-proof, complex global Platform solutions on Databricks.
  • Excellent interpersonal communication and organizational skills are required to operate as a leading member of global, distributed teams that deliver quality services and solutions.
  • Ability to rapidly gain knowledge of the organizational structure of the firm to facilitate work with groups outside of the immediate technical team.
  • Knowledge and experience in IT methodologies and life cycles that will be used.
  • Familiar with solution implementation/management, service/operations management, etc.
  • Leadership skills can inspire others and persuade.
  • Maintains close awareness of new and emerging technologies and their potential application for service offerings and products.
  • Bachelor’s Degree or equivalency (CS, CE, CIS, IS, MIS, or engineering discipline) or equivalent work experience.
  • Experience in a Platform architecture role using service and hosting solutions such as private/public cloud IaaS, PaaS, and SaaS platforms.
  • Experience in architecting and designing technical solutions for cloud-centric solutions based on industry standards using IaaS, PaaS, and SaaS capabilities.
  • Must have strong hands-on experience on various cloud services like Lambda, S3, Security, Monitoring, Governance & Compliance.
  • Hands-on Experience to design and build Databricks based solution on AWS.
  • Hands-on experience to design and build solution powered by DBT models and integrate with Databricks.
  • Must have good knowledge of Data Engineering concept and related services of cloud.
  • Must have good experience in Python and Spark.
  • Must have good experience in setting up development best practices.
  • Strong knowledge of docker and Kubernetes.
  • Experience with claims-based authentication (SAML/OAuth/OIDC), MFA, RBAC, SSO etc.
  • Knowledge of cloud security controls including tenant isolation, encryption at rest, encryption in transit, key management, vulnerability assessments, application firewalls, SIEM, etc.
  • Experience building and supporting mission-critical technology components with DR capabilities.
  • Experience with multi-tier system and service design and development for large enterprises
  • Extensive, real-world experience designing technology components for enterprise solutions and defining solution architectures and reference architectures with a focus on cloud technologies.
  • Exposure to infrastructure and application security technologies and approaches
  • Familiarity with requirements gathering techniques.

  • Databricks Architect

    2 months ago

    Atlanta, United States Genpact Full time

    Inviting applications for the role of Senior Principal Consultant- Databricks Hybrid Architect Platform!We are seeking a highly skilled and experienced Databricks Platform Architect to lead the design, implementation, and optimization of our Databricks platform. The ideal candidate will have a strong background in cloud-based data processing systems, data...

  • Azure Databricks Architect

    4 weeks ago

    Atlanta, United States Tata Consultancy Services Full time

    Technical/Functional SkillsMUST HAVE SKILLS Experience: Proven experience as a Data Architect or similar role with extensive experience in designing and implementing solutions on Azure Data bricks.Technical Skills: Proficiency with Azure Data bricks, Apache Spark, and data processing frameworks.Strong experience with Azure services (e.g., Azure Data Lake,...

  • Senior Azure Databricks Developer

    3 weeks ago

    Atlanta, United States Artmac Soft LLC Full time

    Job DescriptionJob DescriptionWho We Are: Artmac Soft is a technology consulting and service-oriented IT company dedicated to providing innovative technology solutions and services to customers.Job Description Job Title : Senior Azure Databricks DeveloperJob Type : C2C Experience : 8 - 10 years Location : Atlanta, Georgia (Onsite)Responsibilities :The effort...

  • Data Engineer Databricks

    4 weeks ago

    Atlanta, United States Capgemini Full time

    Job Title: Data Engineer DatabricksJob Location: Atlanta, GA/ Tampa, FL/ NJKey Responsibilities: Work closely with analytics architects and AI engineers to support exploratory and production application data preparation needs. Data customers will include human analysts, analytics engineers, AI and analytical models, dashboarding applications, and data...

  • Data Architect

    3 months ago

    Atlanta, United States Furniture.com America LLC Full time

    Job DescriptionJob DescriptionData ArchitectFurniture.comAbout Us Furniture.com is a high growth consumer tech start up that is addressing fundamental challenges in the $200B US furniture space. The company is a B2B and B2C digital aggregator with a simple mission: To make finding furniture easy. For consumers, we make it easy to find the right furniture by...

  • Security Analytics Architect

    2 weeks ago

    Atlanta, United States Capgemini Full time

    Job Title: Sr. Security Analytics Architect (Azure Databricks)Job Location: Atlanta, GA/ Chicago IL/ NJJob ResponsibilitiesWork directly with the business to co-create a detailed vision of the tools they need to effectively monitor the dark-web and other data sources to help their company and their clients from threats.Define a set of metrics reports and...

  • Senior Software Solutions Architect

    1 week ago

    Atlanta, Georgia, United States Saxon Global Full time

    Senior Software Solutions Architect The Senior Software Solutions Architect role at Saxon Global necessitates a robust background in Java, comprehensive web application development, and system integration via APIs. The ideal candidate will possess outstanding problem-solving abilities and excellent communication skills, with a preference for familiarity with...

  • Solution Architect, Data

    1 month ago

    Atlanta, United States Insight Global Full time

    This is a permanent role working directly for Insight Global, within our Professional Services division (Evergreen). This is a hybrid role (Tues-Thurs on-site). Evergreen is bringing a dynamic approach to professional services/consulting, and this role will be key in driving our continued growth and success. Our team is less than 250 people today, but poised...

  • Solution Architect, Data

    1 month ago

    Atlanta, United States Insight Global Full time

    This is a permanent role working directly for Insight Global, within our Professional Services division (Evergreen). This is a hybrid role (Tues-Thurs on-site). Evergreen is bringing a dynamic approach to professional services/consulting, and this role will be key in driving our continued growth and success. Our team is less than 250 people today, but poised...

  • Data Platform Architect 2024

    3 weeks ago

    Atlanta, Georgia, United States Aimpoint Digital Full time

    Are you an experienced data architect looking to apply your strategic mindset to help customers transform their analytics using the best modern tools and lead the technical delivery of large-scale infrastructure build projects? Aimpoint Digital is a fast-growing and fully remote data and analytics consultancy. We partner with the most innovative software...

  • Data Platform Architect 2024

    3 weeks ago

    Atlanta, United States Aimpoint Digital Full time

    Are you an experienced data architect looking to apply your strategic mindset to help customers transform their analytics using the best modern tools and lead the technical delivery of large-scale infrastructure build projects?  Aimpoint Digital is a fast-growing and fully remote data and analytics consultancy. We partner with the most innovative software...

  • Integration Lead/Architect

    2 months ago

    Atlanta, United States Amtex Systems Inc. Full time

    Integration Lead/ArchitectCandidate should have done heavy CRM Integration (Any CRM- Ideally Dynamics 365 but they will take SAP or any other CRM also).Most important skill will be API's Integration and SQL with any type of CRM. Azure Cloud/Azure Cloud API is a must. Look for heavy CRM Integration, API's, SQL and Azure CloudRoles and responsibilities for...

  • Integration Lead/Architect

    4 weeks ago

    Atlanta, United States Amtex Systems Inc. Full time

    Integration Lead/ArchitectCandidate should have done heavy CRM Integration (Any CRM- Ideally Dynamics 365 but they will take SAP or any other CRM also).Most important skill will be API's Integration and SQL with any type of CRM. Azure Cloud/Azure Cloud API is a must. Look for heavy CRM Integration, API's, SQL and Azure CloudRoles and responsibilities for...

  • Lead Cloud Solutions Architect

    1 week ago

    Atlanta, Georgia, United States Nasdaq Full time

    Role OverviewThe Lead Cloud Solutions Architect will be instrumental in shaping the architecture of the Nasdaq Index Platform, ensuring that development platform engineering needs are met with precision. This role requires a blend of technical acumen and leadership skills, focusing on platform engineering and DevSecOps methodologies.Key...

  • Azure Data Bricks Developer

    2 days ago

    Atlanta, United States Avance Consulting Full time

    The effort would involve managing the databricks platform, provide, develop architectural solutions and implement new cutting databricks features(e.g. AI/ML), suggest new capabilities, monitor the platform for efficiencies, continue to progress the platform by applying incremental capabilities – Premium storage etc. and be overall owner of the environment....

  • Lead Software Architect

    3 days ago

    Atlanta, Georgia, United States OneTrust Full time

    Job OverviewStrength in TrustOneTrust empowers organizations to harness the full potential of data and artificial intelligence in a secure and responsible manner. Our platform ensures the safe management of corporate data, enabling businesses to foster innovation while effectively mitigating risks. With a comprehensive suite of solutions that cover data and...

  • Sr. Software Engineer

    3 weeks ago

    Atlanta, United States PROCYON TECHNOSTRUCTURE Full time

    Job DescriptionJob DescriptionPosition Azure data bricks developerLocation :- Atlanta GA The effort would involve managing the databricks platform, provide, develop architectural solutions and implement new cutting databricks features(e.g. AI/ML), suggest new capabilities, monitor the platform for efficiencies, continue to progress the platform by applying ...

  • Cloud Infrastructure Engineer

    1 week ago

    Atlanta, Georgia, United States Collabera Full time

    Home Search Jobs Job Description Cloud Infrastructure Engineer Contract Type: Contractual Engagement Location: Remote Compensation: $73.00 Per Hour Key Responsibilities:Develop infrastructure as code utilizing Terraform with over 7 years of practical experience. Possess Terraform and Azure certifications. Architect and implement cloud landing zones....

  • Lead Data Architect

    2 months ago

    Atlanta, United States CapTech Consulting Full time

    Job DescriptionJob DescriptionCompany DescriptionCapTech is an award-winning consulting firm that collaborates with clients to achieve what’s possible through the power of technology. At CapTech, we’re passionate about the work we do and the results we achieve for our clients. From the outset, our founders shared a collective passion to create a...

  • Senior Azure Data Engineer

    1 month ago

    Atlanta, United States 3i People Full time

    At 3i People, we’re more than a staffing agency, we are career accelerators! Partnered with cutting-edge tech firms and innovative companies, we connect top-tier talent with their dream jobs. Our mission is to open doors for professionals like you to thriving workplaces where you can leave your mark. Here is one such opportunity for a Senior Azure Data...