DataBricks Architect Lead

2 weeks ago


Jacksonville, United States Editech Staffing Full time
Job DescriptionJob Description

DataBricks Architect Lead


Jacksonville, FL / Onsite / Contract to hire


Job Summary


  • Conceptualize and communicate Data architecture strategy, technical design and technology roadmap for data platform solutions and services.
  • Lead design and development of data architecture to support implementation of large-scale data solutions in Databricks to support multiple use cases (delta lake, cloud Datawarehouse migrations, reporting and analytics).
  • Guiding the organization and development teams on the overall data processes, architectural approaches for data strategy design and implementation.
  • Providing data solutions that enable business intelligence data integrations, data services, self-service analytics, and data-driven digital products and services.
  • Articulating the value proposition of cloud modernization/transformation to stakeholders; creating detailed documentation that empowers other engineers and customers.
  • Architecting the solutions for Databricks-specific use cases (streaming and batch) as well as integrating it into other solution components in the customer architecture landscape.
  • Translating the advanced business data, integration and analytics problems into technical approaches that yield actionable recommendations, across multiple, diverse domains.
  • Implement architectural improvements for existing solutions using legacy modernization and cloud adoptions strategies.
  • Creating Azure Data Factory processes for SQL and NoSQL data pipelines, and work in Azure SQL, to create tables, views, stored procedures, and other database objects.
  • Creating applications through Scala, Python, and Java.
  • Developing Spark tasks for data aggregation and transformation
  • Writing Scala style documents with each code.
  • Identifying technical issues (performance bottlenecks, data discrepancies, system defects) in data and software, perform root cause analysis, and communicate results effectively to the development team and other stakeholders
  • Providing recommendations on opportunities and improvements and participating in technology and analytics proof-of-concepts


Required Qualifications


  • Bachelors Degree in Computer Science, Data, Information Systems, or related field
  • 8+ years of experience with Azure Databricks, Azure Data Factory, and Pyspark
  • 5+ years experience working in Microsoft Azure
  • 3+ years experience with Python to extract data from unstructured files, such as XML, PDF, HTML
  • Highly proficient in use of Spark and Azure Databricks
  • Experience with deployment and builds using Azure DevOps
  • Experience in an agile development environment, or an understanding of the concepts of Agile software development
  • Excellent communication, organization, technical, and project management skills
  • Experience in leading projects relating to cloud modernization, data migration, data warehousing experience with cloud-based data platforms (Databricks/Apache Spark); preferably Databricks certified; experience driving technical workshops with technical and business clients to derive value added services and implementation.
  • Hands-on working knowledge of topics such as data security, messaging patterns, ELT, Data wrangling and cloud computing and proficiency in data integration/EAI and DB technologies, sophisticated analytics tools, programming languages or visualization platforms
  • Knowledge of the Databricks ecosystem



#LI-PS1



  • Jacksonville, United States Editech Staffing Full time

    DataBricks Architect LeadJacksonville, FL / Onsite / Contract to hireJob SummaryConceptualize and communicate Data architecture strategy, technical design and technology roadmap for data platform solutions and services. Lead design and development of data architecture to support implementation of large-scale data solutions in Databricks to support multiple...


  • Jacksonville, United States Fanatics Full time

    Company Overview Fanatics isbuilding a leadingglobal digital sports platform. The company ignites the passions of global sports fans and maximizes the presence and reach for hundreds of sports partners globally by offering innovative products and services across Fanatics Commerce, FanaticsCollectibles, and Fanatics Betting & Gaming, allowing sports fans to...

  • Project Architect

    4 weeks ago


    Jacksonville, United States BDG Architects Full time

    BDG Architects has an immediate need for a talented and motivated Project Architect or Sr. Project Architect. This is a full-time position that will be based out of our growing Jacksonville, FL office that launched in 2021. A minimum of 7 years of experience and license to practice architecture within an NCARB jurisdiction of the United States is required....

  • Solutions Architect

    4 weeks ago


    Jacksonville, United States The Stellar Group Full time

    Job Description Job Description We are seeking a visionary and strategic Solutions Architect to lead the design and implementation of our AI and machine learning initiatives. The Solutions Architect will serve as the technical expert and thought leader, guiding our organization in leveraging AI to drive business value and innovation. The ideal candidate will...

  • Big Data Architect

    4 weeks ago


    Jacksonville, United States RAMPS International Inc. Full time

    Job DescriptionJob DescriptionRole: Big Data ArchitectLocation: Jacksonville, FLLong term Contract  Apache NIFI and Horotonworks are the key skills for this role. Job description:  We are leading the first phase of a SOW for our client in Jacksonville, FL.  We need a Big Data Architect with Hadoop experience to help build a new large data solution....

  • Big Data Architect

    2 weeks ago


    Jacksonville, United States RAMPS International Inc. Full time

    Job DescriptionJob DescriptionRole: Big Data ArchitectLocation: Jacksonville, FLLong term Contract  Apache NIFI and Horotonworks are the key skills for this role. Job description:  We are leading the first phase of a SOW for our client in Jacksonville, FL.  We need a Big Data Architect with Hadoop experience to help build a new large data solution....


  • Jacksonville, Florida, United States Spectraforce Technologies Full time

    Job Title: Sr Cybersecurity Architect Duration: 6 months Location: Remote Job Summary:The Senior Cybersecurity Architect serves the company as an advisor on best practices and is responsible for designing and effectively implementing enterprise security strategies, architectures and solutions that guide IT security direction. They are accountable for the...


  • Jacksonville, United States CareerBuilder Full time

    Job Title: Sr Cybersecurity Architect Duration: 6 months Location: Remote Job Summary: The Senior Cybersecurity Architect serves the company as an advisor on best practices and is responsible for designing and effectively implementing enterprise security strategies, architectures and solutions that guide IT security direction. They are accountable for the...

  • Solutions Architect

    4 weeks ago


    Jacksonville, United States The Stellar Group Inc Full time

    Job DescriptionJob DescriptionWe are seeking a visionary and strategic Solutions Architect to lead the design and implementation of our AI and machine learning initiatives. The Solutions Architect will serve as the technical expert and thought leader, guiding our organization in leveraging AI to drive business value and innovation. The ideal candidate will...

  • Solutions Architect

    5 days ago


    Jacksonville, United States The Stellar Group Inc Full time

    Job DescriptionJob DescriptionWe are seeking a visionary and strategic Solutions Architect to lead the design and implementation of our AI and machine learning initiatives. The Solutions Architect will serve as the technical expert and thought leader, guiding our organization in leveraging AI to drive business value and innovation. The ideal candidate will...

  • Solutions Architect

    2 weeks ago


    Jacksonville, Florida, United States Stellar Full time

    We are seeking a visionary and strategic Solutions Architect to lead the design and implementation of our AI and machine learning initiatives. The Solutions Architect will serve as the technical expert and thought leader, guiding our organization in leveraging AI to drive business value and innovation. The ideal candidate will possess a deep understanding of...

  • Solutions Architect

    3 weeks ago


    Jacksonville, United States Stellar Full time

    We are seeking a visionary and strategic Solutions Architect to lead the design and implementation of our AI and machine learning initiatives. The Solutions Architect will serve as the technical expert and thought leader, guiding our organization in leveraging AI to drive business value and innovation. The ideal candidate will possess a deep understanding of...

  • Solutions Architect

    3 weeks ago


    Jacksonville, United States VyStar Credit Union Full time

    At VyStar, we offer competitive pay, an excellent benefit package that includes a 401(k) Plan, an extensive paid technical and on-the-job training program, and tuition reimbursement-available to all full and part time employees. Part time positions start at a minimum of 30 hours per week. We encourage you to become a part of VyStar Credit Union's family of...


  • Jacksonville, United States Soft source inc Full time

    Job DescriptionJob DescriptionMust be willing to go on-site 3x a week in Jacksonville, FL! -Must have LEAD experience -Must have 5+ years of Azure, to include Cosmos -Must have 7+ years of .Net Development The Lead Software Developer will: Oversee and direct technical staff to develop code and unit tests for the development, enhancement, or maintenance of...


  • Jacksonville, United States Hummingbirds Innovations Full time

    Job DescriptionJob DescriptionJob Description:The Lead Software Developer will:Oversee and direct technical staff to develop code and unit tests for the development, enhancement, or maintenance of software / systems. Lead meetings to gather and interpret user technical requirements/user stories to design software components and solutions based on guiding...

  • Licensed Architect

    4 weeks ago


    Jacksonville, United States Fortress Engineering Group LLC Full time

    Job DescriptionJob DescriptionFortress Engineering Group LLC is a vibrant, energetic, and driven design-build firm that thrives on team collaboration and innovation, with a commitment to putting our best foot forward in every project and client interaction. We are seeking a Florida Licensed Architect to become part of our team as we experience consistent...


  • Jacksonville, United States ARC Group Full time

    Job DescriptionJob DescriptionCLOUD CYBERSECURITY ARCHITECT – REMOTE ARC Group has an immediate opportunity for a Cloud Cybersecurity Architect! This position is 100% remote! This is starting out as a contract position running through November 2024 with strong potential to extend or possibly convert to FTE. This is a fantastic opportunity to join an...


  • Jacksonville, United States American Recruiting & Consulting Group Full time

    CLOUD CYBERSECURITY ARCHITECT - REMOTE ARC Group has an immediate opportunity for a Cloud Cybersecurity Architect! This position is 100% remote! This is starting out as a contract position running through November 2024 with strong potential to extend or possibly convert to FTE. This is a fantastic opportunity to join an established and well-respected...

  • Senior Architect

    2 weeks ago


    Jacksonville, Florida, United States Bank of America Full time

    Job Description: At Bank of America, we are guided by a common purpose to help make financial lives better through the power of every connection. Responsible Growth is how we run our company and how we deliver for our clients, teammates, communities and shareholders every day. One of the keys to driving Responsible Growth is being a great place to work for...


  • Jacksonville, United States Hornet Staffing, Inc. Full time

    Job Description: The Senior Cybersecurity Architect serves the company as an advisor on best practices and is responsible for designing and effectively implementing enterprise security strategies, architectures and solutions that guide IT security direction. They are accountable for the security architecture across a variety of applications or domains and...