Databricks Solutions Architect

1 week ago

Lake Forest, California, United States Net2source Full time
Job Title: Databricks Architect

Duration: Contract/Contract To Hire/FTE/Direct hire

Location: Chicago IL/Hybrid

Job Description:

As a Data Architect, you will be part of an Agile team to build healthcare applications and implement new features while adhering to best coding development standards.

Mandatory skills: AZURE, Medallion Architecture, SQL, Databricks and Data Lake

Responsibilities:
  1. Design and architect scalable, high-performance, and cost-effective cloud-based solutions using Azure services and Databricks.
  2. Develop comprehensive architecture blueprints that include data pipelines, data warehousing, and advanced analytics solutions.
  3. Architect and implement big data processing solutions using Databricks, leveraging Apache Spark for data transformation, ETL processes, and machine learning workflows.
  4. Design data pipelines that handle large-scale data ingestion, processing, and storage.
  5. Implement data security, data governance, and compliance measures within the Databricks environment using Unity Catalog.
  6. Work closely with Data engineers, DevOps teams, and other stakeholders to ensure seamless integration of solutions.
  7. Collaborate with project managers and business analysts to gather and interpret requirements, ensuring technical feasibility and alignment with business objectives.
  8. Analyze and optimize system performance, identifying bottlenecks and implementing solutions to enhance processing speed and efficiency.
  9. Implement monitoring tools and strategies to proactively manage the health and performance of the Azure and Databricks environments.
  10. Ensure that all solutions adhere to security best practices and compliance requirements, including data encryption, access control, and logging.
  11. Implement strategies to protect sensitive data and ensure compliance with relevant regulations, such as GDPR, HIPAA, etc.

Deep understanding of Azure services, including but not limited to Azure Data Factory, Azure Storage, Azure SQL, Azure Functions, etc.

Proficiency in Databricks, Apache Spark, and related big data technologies.

Strong scripting skills in Python, SQL, and experience with Terraform or CloudFormation.

Excellent problem-solving skills and the ability to work in a fast-paced environment.

Experience with Kubernetes, Docker, and containerized applications. Familiarity with data lake architectures, Delta Lake, and advanced analytics solutions.

Strong understanding of CI/CD pipelines, DevOps practices, and Infrastructure as Code (IaC).

Experience: 15+ Years

Educational Qualifications: -

Engineering Degree BE/ME/BTech/MTech/BSc/MSc.

Technical certification in multiple technologies is desirable.

  • Digital Solutions Architect

    4 days ago

    Lake Forest, California, United States Insight Global Full time

    Job DescriptionAs a key member of our team, you will play a strategic leadership role in driving business growth and protecting our market-leading position in the Digital/HPC market segment.We are seeking an experienced Semiconductor industry leader or Senior digital application engineer with strong marketing skills to join our team.Key responsibilities will...

  • Product Security Solutions Architect

    4 weeks ago

    Lake Forest, California, United States Resolution Technologies, Inc. Full time

    Job DescriptionProduct Security Solutions ArchitectAt Resolution Technologies, Inc., we are seeking a highly skilled Product Security Solutions Architect to join our team. As a key member of our organization, you will play a critical role in ensuring the security of our medical device products, including software, hardware, and digital solutions.Key...

  • Interoperability Architect

    2 weeks ago

    Lake Forest, California, United States Futran Tech Solutions Pvt. Ltd. Full time

    Job Title: Interoperability ArchitectFutran Tech Solutions Pvt. Ltd. is seeking a highly skilled Interoperability Architect to join our team. As an Interoperability Architect, you will be responsible for developing frameworks for integrating various medical devices, ensuring seamless connectivity and interoperability of medical technologies, mobile apps, and...

  • Product Security Solutions Architect

    3 weeks ago

    Lake Forest, California, United States Resolution Technologies, Inc. Full time

    Product Security Solutions Engineering Job DescriptionA Product Security Solutions Engineering Architect for medical devices plays a critical role in ensuring the security of customer products, including medical software, hardware, and digital products. This position involves a mix of technical expertise, understanding of healthcare/medical devices...

  • Solution Engineer

    1 week ago

    Lake Forest, California, United States Pfizer Full time

    About the RolePfizer is seeking a highly motivated Solution Engineer to join our Digital Commercial and Customer Creation Center (C4) Digital Technology team. As a key member of our team, you will be responsible for designing, developing, and maintaining curated data sources in Tableau to support self-service reporting and analytics for business users.Key...

  • Network Architect

    2 weeks ago

    Lake Forest, California, United States Motion Recruitment Full time

    Network Engineer/ContractAbout the Role:We are seeking a highly skilled Network Engineer to join our team in Lake Forest, IL. As a key member of our enterprise engineering team, you will be responsible for designing and implementing cutting-edge network technologies to meet business objectives.Key Responsibilities:Design and implement network infrastructure...

  • MuleSoft Integration Specialist

    7 days ago

    Lake Forest, California, United States TechnoGen Full time

    MuleSoft Architect Job DescriptionWe are seeking a highly skilled MuleSoft Architect to join our team at TechnoGen. As a key member of our integration team, you will be responsible for designing and implementing MuleSoft solutions that meet the needs of our clients.Key Responsibilities:Design and implement MuleSoft integration infrastructureDevelop and...

  • Business Systems Architect

    3 weeks ago

    Lake Forest, California, United States W.W. Grainger Full time

    About W.W. GraingerGrainger is a leading distributor of products and services that enable businesses to operate efficiently and effectively. With operations in North America, Japan, and the United Kingdom, we serve a diverse range of customers across various industries.Our PurposeWe Keep the World Working by providing our customers with the products and...

  • Civil Engineer Designer

    4 weeks ago

    Lake Forest, California, United States Proactive Engineering Consultants Inc Full time

    Job Title: Civil Engineer DesignerWe are seeking a highly motivated and experienced Civil Engineer Designer to join our team at Proactive Engineering Consultants Inc.Job SummaryThe ideal candidate will have a deep understanding of design and engineering principles required for successful residential development in Southern California, including knowledge of...

  • Civil Engineer Designer

    3 weeks ago

    Lake Forest, California, United States Proactive Engineering Consultants Inc Full time

    Job Title: Civil Engineer DesignerWe are seeking a highly motivated and experienced Civil Engineer Designer to join our team at Proactive Engineering Consultants Inc.The ideal candidate will have a deep understanding of the design and engineering principles required for successful residential land development projects in Southern California, including...

  • Senior Software Development Engineer

    4 weeks ago

    Lake Forest, California, United States Ampcus Incorporated Full time

    Job Description:Ampcus Incorporated is seeking a highly skilled .NET Architect to join our team.Key Responsibilities:Design and develop scalable Windows Desktop Applications using C++, C#, and.NET.Collaborate with distributed development resources to ensure timely and high-quality software releases.Develop and maintain APIs with strong exposure to API...

  • Business Systems Engineer Lead

    3 weeks ago

    Lake Forest, California, United States Grainger Businesses Full time

    About GraingerGrainger is a leading broad line distributor with operations primarily in North America, Japan, and the United Kingdom. Our purpose is to keep the world working by serving more than 4.5 million customers with a wide range of products that keep their operations running and their people safe.We deliver services and solutions, such as technical...

  • Business Systems Engineer Lead

    2 weeks ago

    Lake Forest, California, United States Grainger Businesses Full time

    About GraingerGrainger is a leading distributor with operations in North America, Japan, and the United Kingdom. Our purpose is to keep the world working by serving customers with a wide range of products that keep their operations running and their people safe.We deliver services and solutions, such as technical support and inventory management, to save...

  • Digital Marketing Agency Leader

    3 weeks ago

    Lake Forest, California, United States Solomon Page Full time

    {"title": "Director of Client Services", "description": "Lead a Talented Team and Drive Client SuccessSolomon Page is seeking a visionary Director of Client Services to lead our talented team and become a trusted advisor to our C-suite clientele across various brands.In this role, you will be the architect of exceptional client experiences, ensuring...

  • Senior Front-End Developer

    1 week ago

    Lake Forest, California, United States PropStream Full time

    About This RoleWe are seeking an experienced and passionate Senior Front-End Developer to join our team at PropStream. As a key member of our delivery team, you will be responsible for designing and implementing high-quality user interfaces for our web applications and websites.As a Senior Front-End Developer, you will work closely with our Product Owners,...

  • Senior Front-End Developer

    3 weeks ago

    Lake Forest, California, United States PropStream Full time

    About This RoleWe are seeking an experienced and passionate Senior Front-End Developer to join our team at PropStream. As a key member of our delivery team, you will be responsible for designing and implementing high-quality user interfaces for our web applications and websites.As a Senior Front-End Developer, you will work closely with our Product Owners,...

  • Senior Front-End Developer

    2 weeks ago

    Lake Forest, California, United States PropStream Full time

    About This RoleWe are seeking a highly skilled and experienced Senior Front-End Developer to join our team at PropStream. As a key member of our delivery team, you will be responsible for designing and implementing high-quality user interfaces for our web applications and websites.As a Senior Front-End Developer, you will work closely with our Product...

  • Business Systems Engineering Manager

    4 weeks ago

    Lake Forest, California, United States Grainger Businesses Full time

    About Grainger BusinessesGrainger Businesses is a leading broad line distributor with operations primarily in North America, Japan, and the United Kingdom. We achieve our purpose, We Keep the World Working, by serving more than 4.5 million customers with a wide range of products that keep their operations running and their people safe. Grainger Businesses...

  • Data Engineer III-V

    4 weeks ago

    South Lake Tahoe, California, United States Murphy Oil Full time

    Job Posting**Job Summary**The Data Engineer III-V is a critical role at Murphy Oil, responsible for designing and implementing data-driven systems solutions that drive business growth and innovation. As a key member of our data engineering team, you will work closely with cross-functional teams to architect, implement, and maintain scalable and reliable data...

  • Data Engineer III-V

    3 weeks ago

    South Lake Tahoe, California, United States Murphy Oil Full time

    Job Posting**Job Summary**The Data Engineer III-V is a critical role at Murphy Oil, responsible for designing and implementing data-driven systems solutions that drive business growth and innovation. As a key member of our data engineering team, you will work closely with cross-functional teams to architect, implement, and maintain scalable and reliable data...