Azure Databricks Engineer
2 weeks ago
Position: Azure Databricks Engineer
Location: Raleigh, NC 27610 - Hybrid
Duration: 12+ Months
Important notes
- Client: State of NC
- NCDOT - Technical Specialist- Junior (749799)
- Deadline: 10/28/2024
- Rate: $65-80 Per HR on C2C
- 12+ years of experience needed
- The candidate will need to come onsite on the first day to collect equipment.**
- All candidates must be local to the Triangle region of North Carolina, and posting may require up to 1-2 days per month in a Triangle area office for meetings.**
NCDIT-Transportation Web Systems Team seeks an Azure Databricks Engineer who will work with existing staff to plan and design ETL pipelines and product solutions using Azure Databricks. The person filling this role will create resilient processes to ingest data from a variety of on-prem and cloud transactional databases and APIs. Responsibilities will also include developing business requirements, facilitating change management documentation, and actively collaborating with stakeholders. This individual will work closely with a development technical lead and discuss all aspects of the design and planning with the development team.
Roles and Responsibilities
- Research and engineer repeatable and resilient ETL workflows using Databricks notebooks and Delta Live Tables for both batch and stream processing
- Collaborate with business users to develop data products that align with business domain expectations
- Work with DBAs to ingest data from cloud and on-prem transactional databases
- Contribute to the development of the Data Architecture for NC DIT - Transportation:
- By following practices for keeping sensitive data secure
- By streamlining the development of data products for use by data analysts and data scientists
- By developing and maintaining documentation for data engineering processes
- By ensuring data quality through testing and validation
- By sharing insights and experiences with stakeholders and engineers throughout DIT - Transportation
Specific RTR
By signing below, I [ ] acknowledge and agree that [USM Business Systems INC] has the sole right to represent me in matters of work assignment relating the NC IT Managed Services Contract by submitting my professional resume to the Contract's Managed Service Provider, Computer Aid, Inc. for the requirement identified below. I also acknowledge and verify that all the information contained in my resume related to my technical credentials is accurate and is based on educational training and professional experience obtained throughout my career. VectorVMS Requirement Number and Title (including Name of Agency): USM SYSTEMS INC/ NCDOT - Technical Specialist- Junior (749799)
Skill
Required / Desired
years Needed Amount
Possessed years of exp
Excellent interpersonal skills as well as written and communication skills.
Required
5
Able to write clean, easy-to-follow Databricks notebook code
Required
2
Deep knowledge of data engineering best practices, data warehouses, data lakes, and the Delta Lake architecture
Required
2
Good knowledge of Spark and Databricks SQL/PySpark
Required
2
Technical experience with Azure Databricks and cloud providers like AWS, Google Cloud, or Azure
Required
2
In-depth knowledge of OLTP and OLAP systems, Apache Spark, and streaming products like Azure Service Bus
Required
2
Good practical experience with Databricks Delta Live Tables
Required
2
Knowledge of object-oriented languages like C#, Java, or Python
Desired
7
-
Databricks Lakehouse Engineer
1 month ago
Raleigh, North Carolina, United States Cyborgwave Full timeJob Title: Databricks Lakehouse EngineerWe are seeking a highly skilled Databricks Architect to join our team at Cyborgwave. This is an excellent opportunity for you to utilize your expertise in designing and implementing data platforms.
-
Azure Data Engineer
7 months ago
Raleigh, United States Focused HR Solutions Full timeThis position is 100% on-site in Raleigh, NC. In-Person Interview REQUIRED on 1st round. Our direct client has an opening for a Azure Data Engineer position # 730992. This position is for 4+ months, with option of extension, and will be worked 100% on-site in Raleigh, NC. If you are interested, please submit the following:YOUR CURRENT RESUMEYOUR HOURLY...
-
Data Engineer
6 days ago
Raleigh, North Carolina, United States Cyborgwave Full timeCyborgwave is seeking a highly skilled Data Engineer - Cloud Services to join our team. As an Azure Databricks Solutions Developer, you will work closely with our development technical lead to plan and design ETL pipelines and product solutions using Azure Databricks.Job Responsibilities:Create repeatable and resilient ETL workflows using Databricks...
-
Azure Cloud Engineer
2 weeks ago
Raleigh, North Carolina, United States TechnoGen Full timeJob Title: Azure Cloud EngineerAbout the Role:We are seeking a highly skilled Azure Cloud Engineer to join our team at TechnoGen. The ideal candidate will have extensive experience designing and implementing cloud solutions on the Microsoft Azure platform.Key Responsibilities:Design and implement cloud solutions on the Microsoft Azure platform.Develop and...
-
Scala, Spark and Azure Technology Architect
4 days ago
Raleigh, United States Infosys Full timeInfosys is seeking a Scala, Spark and Azure Technology Architect. In the role of Technology Architect, you will interface with key stakeholders and apply your technical proficiency across different stages of Data Solutions Life Cycle including strategy & roadmap, architecture definition, design, implementation, and operations. You will play an important role...
-
Scala, Spark and Azure Technology Architect
5 days ago
Raleigh, United States Infosys Full timeInfosys is seeking a Scala, Spark and Azure Technology Architect. In the role of Technology Architect, you will interface with key stakeholders and apply your technical proficiency across different stages of Data Solutions Life Cycle including strategy & roadmap, architecture definition, design, implementation, and operations. You will play an important role...
-
Azure Cloud Engineer
6 months ago
Raleigh, United States Surya Technologies Full timeJob Description Job Description Surya is looking for an Azure Cloud Engineer to join our rapidly evolving Global Infrastructure team. This is a key role in cloud operations to support day to day activities of azure cloud. You will be primarily focusing on daily administration tasks, application migration activities and responding to any failures /...
-
Azure Cloud Engineer
1 month ago
Raleigh, United States Surya Technologies, Inc. Full timeJob DescriptionJob DescriptionSurya is looking for an Azure Cloud Engineer to join our rapidly evolving Global Infrastructure team. This is a key role in cloud operations to support day to day activities of azure cloud. You will be primarily focusing on daily administration tasks, application migration activities and responding to any failures / alerts.This...
-
Data Engineering Specialist with Azure Expertise
4 weeks ago
Raleigh, North Carolina, United States Focused HR Solutions Full timeJob DescriptionWe are seeking a highly skilled Data Engineering Specialist to join our team at Focused HR Solutions in Raleigh, NC. This full-time position offers an exciting opportunity to work on modernizing our technology stack and driving digital transformation.About the RoleThis Data Engineer will be responsible for designing and implementing data...
-
Cloud Database Engineer
1 week ago
Raleigh, North Carolina, United States Pierce Technology Corp Full timeAbout the RolePierce Technology Corp is a leading technology company that specializes in cloud-based database solutions. We are seeking a Cloud Database Engineer to join our team and help us design and implement highly available and scalable Azure-based database solutions.The ideal candidate will have strong experience with Azure SQL Database, Azure SQL...
-
Azure Data Engineer
4 weeks ago
Raleigh, United States Crescens Full timeJob Title: Azure Data Engineer Location: Raleigh, NC (Remote) Duration: 12 Months Type: Contract Notes: ***Equipment can be shipped to the candidate. Job Description: The client is seeking a highly motivated Senior Business / Data Analyst to join the Permit Transformation Program team. Currently, the Department enterprise is a complex, multi-platform data...
-
raleigh, United States Infosys Full timeInfosys is seeking a Scala, Spark and Azure Technology Architect. In the role of Technology Architect, you will interface with key stakeholders and apply your technical proficiency across different stages of Data Solutions Life Cycle including strategy & roadmap, architecture definition, design, implementation, and operations. You will play an important role...
-
Enterprise Data Systems Engineer
2 weeks ago
Raleigh, North Carolina, United States Golden Technology Full timeJob TitleWe are seeking an experienced Enterprise Data Systems Engineer to join our team. This role will involve designing, implementing, and migrating large-scale enterprise data systems to the cloud using Snowflake and Azure.Key ResponsibilitiesMigrate on-premises data systems to cloud-based platformsDevelop APIs to support the new cloud environmentDesign...
-
Data Engineer
1 month ago
Raleigh, United States Golden Technology Full timeOur client is looking for a Data Engineer to join their team! In this role, you will help the client move their data systems from on-premises to the cloud, specifically using Snowflake and Azure. You will work closely with the client to plan and carry out a smooth transition, making sure their data is securely and efficiently moved to the cloud. Your skills...
-
Azure Snowflake Data Engineer
2 months ago
Raleigh, United States Infosys Full timeInfosys is seeking an Azure and Snowflake Data Engineer. In this role, you will enable digital transformation for our clients in a global delivery model, research on technologies independently, recommend appropriate solutions and contribute to technology-specific best practices and standards. You will be responsible to interface with key stakeholders and...
-
Azure Snowflake Data Engineer
2 months ago
raleigh, United States Infosys Full timeInfosys is seeking an Azure and Snowflake Data Engineer. In this role, you will enable digital transformation for our clients in a global delivery model, research on technologies independently, recommend appropriate solutions and contribute to technology-specific best practices and standards. You will be responsible to interface with key stakeholders and...
-
Azure DevOps Engineering Lead
2 weeks ago
Raleigh, North Carolina, United States Phaxis - Technology Full timeJob OverviewPhaxis - Technology seeks an experienced Azure DevOps Engineer to lead our team in streamlining and automating operations and development processes.
-
Azure Devops Engineer
2 weeks ago
Raleigh, United States Diverse Lynx Full timeRole Description: Azure DevopsWorking experience of 5 years in Azure infrastructureCreating VM, VNs, subnets, working with Azure firewalls and other infrastructure activitiesWork location is Raleigh, NC? Experience with Azure Entra ID Administration? Experience with Azure vNet/subnet/NSG creation, deployment and maintenance? Experience with Azure PowerShell...
-
Cloud DevOps Engineer
1 week ago
Raleigh, North Carolina, United States KYYBA, Inc Full timeKYYBA, Inc is seeking a skilled Cloud DevOps Engineer - Azure Specialist to join their team. This 12-month engagement will focus on supporting several Department of Highways cloud initiatives. As a key member of the Transportation Web Systems group, you will be responsible for designing and developing new and existing PaaS applications and their involved...
-
Azure Cloud Engineer
2 weeks ago
Raleigh, North Carolina, United States Diverse Lynx Full time**Job Summary:**We are seeking an experienced Azure DevOps professional to join our team at Diverse Lynx LLC. The successful candidate will have a strong background in designing, deploying, and managing cloud infrastructure on Microsoft Azure.**Key Responsibilities:**Designing and implementing secure and scalable Azure infrastructure solutionsMaintaining and...
