Databricks Architect

1 day ago

Lake Forest, United States Net2Source Inc. Full time

Job Title: Databricks Architect

Duration: Contract/Contract To Hire/FTE/Direct hire

Location: Chicago IL/Hybrid


Job Description:

As a Data Architect you will be a part of an Agile team to build healthcare applications and implement new features while adhering to the best coding development standards.


Mandatory skills: AZURE, Medallion Architecture, SQL, Databricks and Data Lake


Responsibilities: -

Design and architect scalable, high-performance, and cost-effective cloud-based solutions using Azure services and Databricks.

Develop comprehensive architecture blueprints that include data pipelines, data warehousing, and advanced analytics solutions.

Architect and implement big data processing solutions using Databricks, leveraging Apache Spark for data transformation, ETL processes, and machine learning workflows.

Design data pipelines that handle large-scale data ingestion, processing, and storage.

Implement data security, data governance, and compliance measures within the Databricks environment using Unity Catalog.

Work closely with Data engineers, DevOps teams, and other stakeholders to ensure seamless integration of solutions.

Collaborate with project managers and business analysts to gather and interpret requirements, ensuring technical feasibility and alignment with business objectives.

Analyze and optimize system performance, identifying bottlenecks and implementing solutions to enhance processing speed and efficiency.

Implement monitoring tools and strategies to proactively manage the health and performance of the Azure and Databricks environments.

Ensure that all solutions adhere to security best practices and compliance requirements, including data encryption, access control, and logging.

Implement strategies to protect sensitive data and ensure compliance with relevant regulations, such as GDPR, HIPAA, etc.

Deep understanding of Azure services, including but not limited to Azure Data Factory, Azure Storage, Azure SQL, Azure Functions, etc.

Proficiency in Databricks, Apache Spark, and related big data technologies.

Strong scripting skills in Python, SQL, and experience with Terraform or CloudFormation.

Excellent problem-solving skills and the ability to work in a fast-paced environment.

Experience with Kubernetes, Docker, and containerized applications. Familiarity with data lake architectures, Delta Lake, and advanced analytics solutions.

Strong understanding of CI/CD pipelines, DevOps practices, and Infrastructure as Code (IaC).


Experience: 15+ Years


Educational Qualifications: -

  • Engineering Degree – BE/ME/BTech/MTech/BSc/MSc.
  • Technical certification in multiple technologies is desirable.




If you are interested, please forward your resume to vijay.singh@net2source.com.

  • Databricks Architect

    7 hours ago

    Lake Forest, Illinois, United States Net2Source Inc. Full time

    Job Title: Databricks ArchitectDuration: Contract/Contract To Hire/FTE/Direct hireLocation: Chicago IL/HybridJob Description:As a Data Architect, you will be part of an Agile team to build healthcare applications and implement new features while adhering to best coding development standards.Mandatory Skills:AzureMedallion ArchitectureSQLDatabricksData...

  • Data Architect

    2 days ago

    Lake Forest, United States CitiusTech Full time

    Sr Solutions Architect - Databricks & AWSWho we are: -At CitiusTech, we constantly strive to solve the industry's greatest challenges with technology, creativity, and agility. With over 8,500 healthcare technology professionals worldwide, CitiusTech powers healthcare digital innovation, business transformation, and industry-wide convergence for over 140...

  • Data Architect

    1 day ago

    Lake Forest, Illinois, United States CitiusTech Full time

    About the RoleCitiusTech is seeking a highly skilled Data Architect to join our team. As a Data Architect, you will be responsible for designing and implementing scalable, high-performance, and cost-effective cloud-based solutions using AWS services and Databricks.Key ResponsibilitiesDesign and architect data pipelines, data warehousing, and advanced...

  • Data Engineer

    2 weeks ago

    Lake Saint Louis, United States NISC Full time

    We are seeking an experienced Data Engineer to join our growing team of data analytics experts. The hire will be responsible for curating and optimizing our data and data pipeline architecture, as well as optimizing data flow and collection for various application teams. The Data Engineer will support our application experts, software developers, database...

  • Data Architect

    4 weeks ago

    Salt Lake City, United States Credit.com Full time

    Are you a Data Architect passionate about creating scalable, secure, and efficient data architectures? We’re seeking a talented professional to shape our data strategy and infrastructure.Location: Hybrid position - 3 days onsite per week in Salt Lake City, Utah About the Role:As a Data Architect, you’ll:Design and implement cutting-edge data...

  • Cloud Adoption Principal Architect

    2 weeks ago

    Lake Oswego, United States Presidio Full time

    About the RoleWe are seeking a highly skilled Principal Solutions Architect to join our team at Presidio. As a key member of our sales team, you will be responsible for formulating and executing a sales strategy to exceed revenue objectives through the adoption of Cloud and Cloud Native Strategies.Key ResponsibilitiesPartner with the sales team to develop...

  • Data Architect

    4 weeks ago

    Salt Lake, Utah, United States Credit Full time

    About the RoleWe are seeking a highly skilled Data Architect to join our team at Credit. As a Data Architect, you will play a critical role in shaping our data strategy and infrastructure, ensuring that our data is secure, efficient, and scalable.Key ResponsibilitiesDesign and Implement Data Architectures: Develop and implement cutting-edge data...

  • Staff Engineer

    4 months ago

    Lake Forest, United States Grainger Full time

    About Grainger: Grainger is a leading broad line distributor with operations primarily in North America, Japan and the United Kingdom. We achieve our purpose, We Keep the World Working, by serving more than 4.5 million customers with a wide range of products that keep their operations running and their people safe. Grainger also delivers services and...

  • Business Intelligence and Data Solutions Architect

    4 weeks ago

    Salt Lake, Utah, United States Credit Full time

    About the RoleWe are seeking a highly skilled Data Architect to join our team at Credit. As a Data Architect, you will play a critical role in shaping our data strategy and infrastructure to drive business growth and innovation.Key ResponsibilitiesDesign and Implement Data Architectures: Develop and implement cutting-edge data architectures to enhance data...

  • Data Strategy and Infrastructure Specialist

    4 weeks ago

    Salt Lake, Utah, United States Credit Full time

    About the RoleWe are seeking a highly skilled Data Architect to join our team at Credit. As a Data Architect, you will play a critical role in shaping our data strategy and infrastructure to drive business growth and innovation.Key ResponsibilitiesDesign and Implement Data Architectures: Develop and implement cutting-edge data architectures to enhance data...

  • Sr Lead Data Engineer

    2 months ago

    Salt Lake City, United States bioMerieux SA Full time

    Sr Lead Data Engineer - Solution DesignbioMerieux SA - Salt Lake City, UTDescription “Integrated Solution” is the bioMerieux suite of products & components that are flexible & scalable for the customer inside or outside the lab bringing synergies to create a common solution with added value. The current scope of Integrated Solutions includes FlexPrep,...

  • Aumni - Site Reliability Engineer III - MLOPS

    4 months ago

    Salt Lake City, United States JPMorgan Chase & Co. Full time

    There’s nothing more exciting than being at the center of a rapidly growing field in technology and applying your skillsets to drive innovation and modernize the world's most complex and mission-critical systems. As a Site Reliability Engineer III at JPMorgan Chase within the Digital Private Markets /Aumni (A JP Morgan Chase Company), you will solve...