Azure Databricks Engineer

4 days ago


Raleigh, North Carolina, United States Software Technology Inc Full time
Job Description

NCDIT-Transportation Web Systems Team seeks an experienced Azure Databricks Engineer to join their team. The ideal candidate will have a strong background in data engineering, with expertise in designing and implementing ETL pipelines using Azure Databricks.

Key Responsibilities:

  • Design and implement resilient ETL workflows using Databricks notebooks and Delta Live Tables for batch and stream processing.
  • Collaborate with business users to develop data products that meet business domain expectations.
  • Work with DBAs to ingest data from cloud and on-prem transactional databases.
  • Contribute to the development of the Data Architecture for NC DIT - Transportation, ensuring data security, streamlining data product development, and maintaining documentation.
  • Ensure data quality through testing and validation, and share insights with stakeholders and engineers.

Requirements:

  • Excellent interpersonal and written communication skills.
  • 5+ years of experience in data engineering, with a strong focus on Azure Databricks.
  • Deep knowledge of data engineering best practices, data warehouses, data lakes, and the Delta Lake architecture.
  • Good knowledge of Spark and Databricks SQL/PySpark.
  • Technical experience with Azure Databricks and cloud providers like AWS, Google Cloud, or Azure.
  • In-depth knowledge of OLTP and OLAP systems, Apache Spark, and streaming products like Azure Service Bus.
  • Good practical experience with Databricks Delta Live Tables.
  • Knowledge of object-oriented languages like C#, Java, or Python.


  • Raleigh, North Carolina, United States USM Full time

    Job SummaryThe USM company is seeking a skilled Azure Databricks Engineer to join their team. As a key member of the data engineering team, you will be responsible for designing and implementing ETL pipelines and data products using Azure Databricks. Your expertise in data engineering best practices, data warehouses, and data lakes will be essential in...


  • Raleigh, North Carolina, United States Software Technology Inc Full time

    Job DescriptionWe are seeking an experienced Azure Databricks Engineer to join our Transportation Web Systems Team. The successful candidate will work closely with our existing staff to plan and design ETL pipelines and product solutions using Azure Databricks.The ideal candidate will have a strong background in data engineering, with experience in designing...


  • Raleigh, North Carolina, United States Astyra Full time

    Job Description:Azure Databricks Data EngineerAbout the Role:Astyra Corporation is seeking an experienced Azure Databricks Data Engineer to join our team. As a key member of our Transportation Web Systems Team, you will work closely with existing staff to plan and design ETL pipelines and product solutions using Azure Databricks.Responsibilities:Research and...


  • Raleigh, North Carolina, United States Crescens Full time

    Job Title: Azure Databricks EngineerJob Summary:Crescens is seeking an experienced Azure Databricks Engineer to join our team. As a key member of our data engineering team, you will be responsible for designing and implementing ETL pipelines and data products using Azure Databricks.Key Responsibilities: Research and engineer repeatable and resilient ETL...


  • Raleigh, North Carolina, United States Connvertex Technologies Inc. Full time

    Job DescriptionThe NCDIT-Transportation Web Systems Team is seeking an experienced Azure Databricks Engineer to join their team. The ideal candidate will have a strong background in designing and implementing ETL pipelines and data products using Azure Databricks.Responsibilities will include:Researching and engineering repeatable and resilient ETL workflows...

  • Data Engineer

    1 week ago


    Raleigh, North Carolina, United States Cyborgwave Full time

    Job SummaryCyborgwave is seeking a highly skilled Data Engineer to join our team as an Azure Databricks Specialist. In this role, you will be responsible for designing and implementing ETL pipelines using Azure Databricks, ensuring data quality and security.Key ResponsibilitiesDesign and develop repeatable and resilient ETL workflows using Databricks...

  • Cloud Data Engineer

    3 days ago


    Raleigh, North Carolina, United States Infosys Limited Digital Full time

    Job Title: Azure and Databricks Cloud Data EngineerJob Summary:We are seeking an experienced Azure and Databricks Cloud Data Engineer to join our team at Infosys Limited Digital. As a key member of our digital transformation team, you will play a crucial role in enabling our clients to navigate their digital journey.Key Responsibilities:Design and implement...

  • Azure Data Engineer

    2 weeks ago


    Raleigh, North Carolina, United States Infosys Limited Digital Full time

    Job Title: Azure Data EngineerWe are seeking an experienced Azure Data Engineer to join our team at Infosys Limited Digital. As a key member of our data engineering team, you will be responsible for designing, implementing, and managing large-scale data processing systems on Azure.Key Responsibilities:Design and implement data pipelines using Azure Data...

  • Azure Data Engineer

    5 days ago


    Raleigh, North Carolina, United States Infosys Limited Digital Full time

    Job Title: Azure Data EngineerAbout the Role:We are seeking an experienced Azure Data Engineer to join our team at Infosys Limited Digital. As a key member of our data engineering team, you will be responsible for designing, building, and maintaining large-scale data processing systems on Azure. You will work closely with our data scientists and engineers to...


  • Raleigh, North Carolina, United States Infosys Limited Digital Full time

    Job DetailsInfosys Limited Digital is seeking a highly skilled Azure and Databricks Cloud Data Engineer to join our team.Job SummaryWe are looking for a talented individual to enable digital transformation for our clients in a global delivery model. The successful candidate will research on technologies independently, recommend appropriate solutions, and...


  • Raleigh, North Carolina, United States Focused HR Solutions Full time

    Job DescriptionWe are seeking an experienced Data Engineer to join our team at Focused HR Solutions. As a Data Engineer, you will play a key role in modernizing our technology stack and driving our organization's digital transformation journey.ResponsibilitiesCollaborate with cross-functional business teams to understand requirements, analyze, and organize...


  • Raleigh, North Carolina, United States Focused HR Solutions Full time

    Azure Data Engineer Job DescriptionWe are seeking an experienced Data Engineer to join our team at Focused HR Solutions. As a Data Engineer, you will play a key role in modernizing our technology stack and driving our organization's digital transformation journey.Responsibilities:Collaborate with cross-functional business teams to understand requirements,...


  • Raleigh, North Carolina, United States Focused HR Solutions Full time

    Job DescriptionWe are seeking an experienced Data Engineer to join our team. The ideal candidate will have a strong background in data engineering, along with expertise in cloud computing. This role offers an exciting opportunity to play a key role in modernizing our technology stack and driving our organization's digital transformation...


  • Raleigh, North Carolina, United States Infosys Full time

    About the Role:We are seeking an experienced Azure Data Engineer to join our team at Infosys. As a key member of our data engineering program, you will lead critical modules and work directly with clients to deliver high-quality data solutions.Key Responsibilities:Design, implement, and maintain robust and scalable data pipelines on Azure using services such...

  • Data Engineer

    7 days ago


    Raleigh, North Carolina, United States Rose International Full time

    Job SummaryWe are seeking a highly skilled Data Engineer - Junior to join our team at Rose International. As a Data Engineer - Junior, you will be responsible for designing, developing, and maintaining large-scale data systems and architectures.Key Responsibilities:Research and engineer repeatable and resilient ETL workflows using Databricks notebooks and...

  • Data Engineer

    1 week ago


    Raleigh, North Carolina, United States Rose International Full time

    Job Title: Data Engineer - JuniorRose International is seeking a highly skilled Data Engineer - Junior to join our team. As a Data Engineer - Junior, you will be responsible for designing, developing, and maintaining large-scale data systems.Key Responsibilities:Design and develop data pipelines using Databricks notebooks and Delta Live TablesCollaborate...


  • Raleigh, North Carolina, United States Infosys Full time

    Job Title: Azure Data EngineerInfosys is seeking a highly skilled Azure Data Engineer to join our team. As a key member of our cloud engineering team, you will be responsible for designing, implementing, and maintaining large-scale cloud-based data systems.Key Responsibilities:Design and implement cloud-based data architectures using Azure services such as...

  • Data Engineer

    1 week ago


    Raleigh, North Carolina, United States Tricon Solutions Full time

    Job Title: Data Engineer - Cloud ArchitectLocation: RemoteJob Summary:We are seeking a highly skilled Data Engineer - Cloud Architect to join our team at Tricon Solutions. As a Data Engineer - Cloud Architect, you will be responsible for designing and implementing scalable and secure data architectures on cloud platforms.Key Responsibilities:Design and...


  • Raleigh, North Carolina, United States Phaxis - Technology Full time

    Job OpportunityWe are seeking a highly skilled Azure DevOps Engineer to join our team at Phaxis - Technology. As a key member of our engineering team, you will be responsible for automating and streamlining operations and development processes.Key Responsibilities:Design and implement automated deployment and monitoring tools using Azure Cloud Services and...


  • Raleigh, North Carolina, United States Magicforce Full time

    Job Title: Logic Apps EngineerAt Magicforce, we're seeking a highly skilled Logic Apps Engineer to join our team. As a key member of our cloud infrastructure team, you will be responsible for designing, implementing, and maintaining CI/CD pipelines for Azure Logic Apps using Azure DevOps.Key Responsibilities:Design and implement CI/CD pipelines for Azure...