Principle Architect Databricks Platform

2 weeks ago

Atlanta, United States Valtofs Technologies Full time

Position: Databricks Architect

Location: Atlanta, GA (Hybrid)

Duration: Fulltime - Permanent


Job Description:

Responsibilities

  • Architect and design solutions to meet functional and non-functional requirements.
  • Lead the design, implementation, and optimization of our Databricks platform.
  • Work closely with our data engineering team to ensure that our Databricks platform is optimized for performance, scalability, and reliability.
  • Develop and maintain a comprehensive understanding of our data pipeline and data architecture.
  • Collaborate with other teams to ensure that our Databricks platform is integrated with our other systems and technologies.
  • Develop and maintain documentation for our Databricks platform, including architecture diagrams, deployment guides, and operational procedures.
  • Provide guidance and support to our data engineering team on Databricks-related issues.
  • Create and review architecture and solution design artifacts.
  • Evangelize re-use through the implementation of shared assets.
  • Enforce adherence to architectural standards/principles, global product-specific guidelines, usability design standards, etc.
  • Proactively guide engineering methodologies, standards, and leading practices.
  • Guidance of engineering staff and reviews of as-built configurations during the construction phase.
  • Provide insight and direction on roles and responsibilities required for solution operations.
  • Identify, communicate, and mitigate Risks, Assumptions, Issues, and Decisions throughout the full lifecycle.
  • Considers the art of the possible, compares various architectural options based on feasibility and impact, and proposes actionable plans.
  • Demonstrate strong analytical and technical problem-solving skills.
  • Ability to analyze and operate at various levels of abstraction.
  • Ability to balance what is strategically right with what is practically realistic.
  • Growing the Data Engineering business by helping customers identify opportunities to deliver improved business outcomes, designing and driving the implementation of those solutions.
  • Supporting and developing our people, including learning & development, certification & career development plans
  • Providing technical governance and oversight for platform design and implementation
  • Should have technical foresight to understand new technology and advancement.
  • Leading team in the definition of best practices & repeatable methodologies in Cloud Data Engineering, including Data Storage, ETL, Data Integration & Migration, Data Warehousing and Data Governance
  • Should have Technical Experience in AWS Cloud Data Engineering services and solutions.
  • Contributing to Sales & Pre-sales activities including proposals, pursuits, demonstrations, and proof of concept initiatives
  • Evangelizing the Data Engineering service offerings to both internal and external stakeholders
  • Development of Whitepapers, blogs, webinars and other though leadership material
  • Development of Go-to-Market and Service Offering definitions for Data Engineering
  • Working with Learning & Development teams to establish appropriate learning & certification paths for their domain.
  • Expand the business within existing accounts and help clients, by building and sustaining strategic executive relationships, doubling up as their trusted business technology advisor.
  • Position differentiated and custom solutions to clients, based on the market trends, specific needs of the clients and the supporting business cases.
  • Build new Data capabilities, solutions, assets, accelerators, and team competencies.
  • Manage multiple opportunities through the entire business cycle simultaneously, working with cross-functional teams as necessary.


Minimum Qualifications

  • Excellent technical architecture skills, enabling the creation of future-proof, complex global Platform solutions on Databricks.
  • Excellent interpersonal communication and organizational skills are required to operate as a leading member of global, distributed teams that deliver quality services and solutions.
  • Ability to rapidly gain knowledge of the organizational structure of the firm to facilitate work with groups outside of the immediate technical team.
  • Knowledge and experience in IT methodologies and life cycles that will be used.
  • Familiar with solution implementation/management, service/operations management, etc.
  • Leadership skills can inspire others and persuade.
  • Maintains close awareness of new and emerging technologies and their potential application for service offerings and products.
  • Bachelor’s Degree or equivalency (CS, CE, CIS, IS, MIS, or engineering discipline) or equivalent work experience.
  • Experience in a Platform architecture role using service and hosting solutions such as private/public cloud IaaS, PaaS, and SaaS platforms.
  • Experience in architecting and designing technical solutions for cloud-centric solutions based on industry standards using IaaS, PaaS, and SaaS capabilities.
  • Must have strong hands-on experience on various cloud services like Lambda, S3, Security, Monitoring, Governance & Compliance.
  • Hands-on Experience to design and build Databricks based solution on AWS.
  • Hands-on experience to design and build solution powered by DBT models and integrate with Databricks.
  • Must have good knowledge of Data Engineering concept and related services of cloud.
  • Must have good experience in Python and Spark.
  • Must have good experience in setting up development best practices.
  • Strong knowledge of docker and Kubernetes.
  • Experience with claims-based authentication (SAML/OAuth/OIDC), MFA, RBAC, SSO etc.
  • Knowledge of cloud security controls including tenant isolation, encryption at rest, encryption in transit, key management, vulnerability assessments, application firewalls, SIEM, etc.
  • Experience building and supporting mission-critical technology components with DR capabilities.
  • Experience with multi-tier system and service design and development for large enterprises
  • Extensive, real-world experience designing technology components for enterprise solutions and defining solution architectures and reference architectures with a focus on cloud technologies.
  • Exposure to infrastructure and application security technologies and approaches
  • Familiarity with requirements gathering techniques.

  • Databricks Architect

    5 days ago

    Atlanta, United States Genpact Full time

    Genpact (NYSE: G) is a global professional services and solutions firm delivering outcomes that shape the future. Our 125,000+ people across 30+ countries are driven by our innate curiosity, entrepreneurial agility, and desire to create lasting value for clients. Powered by our purpose the relentless pursuit of a world that works better for people we serve...

  • Databricks Architect

    6 days ago

    Atlanta, United States Genpact Full time

    Genpact (NYSE: G) is a global professional services and solutions firm delivering outcomes that shape the future. Our 125,000+ people across 30+ countries are driven by our innate curiosity, entrepreneurial agility, and desire to create lasting value for clients. Powered by our purpose the relentless pursuit of a world that works better for people we serve...

  • Databricks Architect

    7 days ago

    Atlanta, United States Genpact Full time

    Genpact (NYSE: G) is a global professional services and solutions firm delivering outcomes that shape the future. Our 125,000+ people across 30+ countries are driven by our innate curiosity, entrepreneurial agility, and desire to create lasting value for clients. Powered by our purpose the relentless pursuit of a world that works better for people we serve...

  • DataBricks Architect

    5 days ago

    Atlanta, United States Diverse Lynx Full time

    DataBricks Architect Atlanta, GA Fulltime 15+ years of experience in architecture, design, implementation and analytics solutions. In-depth knowledge Data processing techniques and handling large data sets. Hands on development Design and Develop applications using Databricks and Experience with Azure cloud technologies. In-depth knowledge Data processing...

  • Principal Databricks Architect

    6 days ago

    Atlanta, United States Tiger Analytics Full time

    Tiger Analytics is an advanced analytics consulting firm. We are the trusted analytics partner for several Fortune 100 companies, enabling them to generate business value from data. Our consultants bring deep expertise in Data Science, Machine Learning, and AI. Our business value and leadership have been recognized by various market research firms, including...

  • Principal Databricks Architect

    7 days ago

    Atlanta, United States Tiger Analytics Full time

    Tiger Analytics is an advanced analytics consulting firm. We are the trusted analytics partner for several Fortune 100 companies, enabling them to generate business value from data. Our consultants bring deep expertise in Data Science, Machine Learning, and AI. Our business value and leadership have been recognized by various market research firms, including...

  • Databricks Solutions Architect 2024

    6 days ago

    Atlanta, United States Aimpoint Digital Full time

    Are you an accomplished Data Engineer who wants to further grow their Databricks expertise, develop technical content and presentations, and help build a best-in-class Databricks community of practice? Aimpoint Digital is a fast-growing and fully remote data and analytics consultancy. We partner with the most innovative software providers in the data...

  • Databricks Solutions Architect 2024

    4 days ago

    Atlanta, United States Aimpoint Digital Full time

    Are you an accomplished Data Engineer who wants to further grow their Databricks expertise, develop technical content and presentations, and help build a best-in-class Databricks community of practice? Aimpoint Digital is a fast-growing and fully remote data and analytics consultancy. We partner with the most innovative software providers in the data...

  • Consulting & SI Partner Sales Manager - East Boston, MA; Atlanta, GA

    1 month ago

    Atlanta, United States Databricks Full time

    ** Consulting & SI Partner Sales Manager - East** ** Boston, MA; Atlanta, GA** **Mission** The Consulting & Systems Integrator (C&SI) partner team accelerates Databricks growth by building and managing relationships with the leading professional services companies who help customers successfully adopt and gain value with our platform. The role of C&SI...

  • Data Architect

    2 weeks ago

    Atlanta, United States Furniture.com America LLC Full time

    Job DescriptionJob DescriptionData ArchitectFurniture.comAbout Us Furniture.com is a high growth consumer tech start up that is addressing fundamental challenges in the $200B US furniture space. The company is a B2B and B2C digital aggregator with a simple mission: To make finding furniture easy. For consumers, we make it easy to find the right furniture by...

  • Data Architect

    7 days ago

    Atlanta, United States Furniture.com America LLC Full time

    Job DescriptionJob DescriptionData ArchitectFurniture.comAbout Us Furniture.com is a high growth consumer tech start up that is addressing fundamental challenges in the $200B US furniture space. The company is a B2B and B2C digital aggregator with a simple mission: To make finding furniture easy. For consumers, we make it easy to find the right furniture by...

  • Azure Databrick Lead

    6 days ago

    Atlanta, United States Syntricate Technologies Full time

    Job Title: Azure Databrick Lead Location: Atlanta, GA (Onsite) Job type: Fulltime only no C2CRoles and Responsibility: We are seeking a skilled Azure Databricks Tech Lead to join our dynamic team. As the Azure Databricks Tech Lead, you will play a pivotal role in architecting, implementing, and optimizing Azure Databricks solutions to support our data...

  • Azure Databricks, Python, SSIS, SQL

    1 week ago

    Atlanta, United States Diverse Lynx Full time

    MUST HAVE Skill Set: Azure data bricks (Core), Azure Admin and platform services, Python, SQL, SSIS, ETL Roles and responsibilities: Propose good and optimized solutions and architecture for new/existing projects Solutions should primarily focus on saving latency and costs in batch and streaming environment. Create cost reports for existing sources in...

  • Solutions Architect

    2 weeks ago

    Atlanta, United States Applied Resource Group Full time

    Job Title: Sr. Solutions ArchitectJob Description: My client is seeking a Sr. Solutions Architect to join our Technology team. This role will focus on developing and implementing advanced capabilities. The successful candidate will work on various technologies, including a Loyalty Management SaaS Platforms, Marketing Activation Platforms, Customer Data...

  • Solutions Architect

    2 weeks ago

    Atlanta, United States Applied Resource Group Full time

    Job Title: Sr. Solutions ArchitectJob Description: My client is seeking a Sr. Solutions Architect to join our Technology team. This role will focus on developing and implementing advanced capabilities. The successful candidate will work on various technologies, including a Loyalty Management SaaS Platforms, Marketing Activation Platforms, Customer Data...

  • Solutions Architect

    2 weeks ago

    Atlanta, United States Applied Resource Group Full time

    Job Title: Sr. Solutions ArchitectJob Description: My client is seeking a Sr. Solutions Architect to join our Technology team. This role will focus on developing and implementing advanced capabilities. The successful candidate will work on various technologies, including a Loyalty Management SaaS Platforms, Marketing Activation Platforms, Customer Data...

  • Solutions Architect

    6 days ago

    Atlanta, United States Applied Resource Group Full time

    Job Title: Sr. Solutions ArchitectJob Description: My client is seeking a Sr. Solutions Architect to join our Technology team. This role will focus on developing and implementing advanced capabilities. The successful candidate will work on various technologies, including a Loyalty Management SaaS Platforms, Marketing Activation Platforms, Customer Data...

  • Architect (Data)

    6 days ago

    Atlanta, United States DCM INFOTECH LIMITED Full time

    Title : Architect (Data) Location : Atlanta, GA (Initially Remote - preferred who is willing to relocate) JD : Total 10 + yrs. of IT experience in ETL /Big Data Technologies Proven track record in establishing Global Data / Information Architecture (traditional and modernized) Application integration experience, including data integration design, and...

  • Software Architect

    5 days ago

    Atlanta, United States Saxon Global Full time

    Software Architect The Software Architect position requires experience with Java, web application full stack, system integration using API, exceptional troubleshooting skill and strong communication and would ideally have some familiarity with the healthcare industry and health IT. The role is responsible for working with a diverse set of stakeholders to...

  • Delivery Lead Senior Manager, Analytics

    2 days ago

    Atlanta, United States Mindlance Full time

    Job Title: Delivery Lead Senior Manager, Analytics (Databricks) Location: 100% Remote is OK but need someone who can work EST time zone Job Summary: We are seeking a highly motivated and experienced Delivery Lead to join our analytics team. As the Delivery Lead, you will be responsible for leading a team that utilizes Databricks to deliver...