Azure Data Engineer

4 months ago

Raleigh, United States Focused HR Solutions Full time
This position is 100% on-site in Raleigh, NC.  In-Person Interview REQUIRED on 1st round. Our direct client has an opening for a Azure Data Engineer position # 730992. This position is for 4+ months, with option of extension, and will be worked 100% on-site in Raleigh, NC. If you are interested, please submit the following:
  • YOUR CURRENT RESUME
  • YOUR HOURLY RATE 
 Below is the job description – Resumes due ASAP. Description:We are looking for an experienced Data Engineer to join our team. You will use various methods to import raw data into Azure Cloud. You will analyze data and create rules for the ETL process. The import process will also include identifying the business rules and apply them to the files stored in staging area before moving the files to processed area. The ideal candidate will have a strong background in data engineering, along with expertise in cloud computing. This role offers an exciting opportunity to play a key role in modernizing our technology stack and driving our organization's digital transformation journey. Responsibilities:
  • Collaborate with cross-functional business teams to understand requirements, analyze, and organize raw data import by identifying the ETL rules. 
  • Identify and apply transformation rules for legacy data migration from mainframe systems to the Azure cloud platform.
  • Develop and implement data pipelines, ETL processes, and data integration solutions to facilitate the conversion of data.
  • Develop and maintain documentation, best practices, and standards for data engineering processes and procedures.
  • Provide technical leadership and mentorship to team members, guiding them in best practices for data engineering and cloud migration projects.
  • Explore ways to enhance data quality and reliability.
 Requirements and Skills:Data Modeling and Database Design:
  • Proficiency in designing and implementing relational and non-relational databases.
  • Knowledge of data modeling techniques and tools.
Azure Data Services:
  •  Deep understanding and hands-on experience with Azure data services such as Azure SQL Database, Azure Cosmos DB, Azure Data Lake Storage, Azure Blob Storage, etc.
ETL (Extract, Transform, Load) Processes:
  • Expertise in designing and implementing ETL processes using tools like Azure Data Factory or Azure Databricks.
  • Knowledge of data integration and transformation techniques.
SQL and T-SQL:
  • Proficient in writing complex SQL queries and stored procedures.
  • Familiarity with Transact-SQL (T-SQL) for managing and querying SQL Server databases.
Data Security and Compliance:
  • Knowledge of data security best practices and experience implementing security measures for data storage and processing on Azure.
  • Awareness of compliance requirements and ability to implement solutions that adhere to NC DPI and DIT regulations.
Data Monitoring and Optimization:
  • Ability to set up monitoring and logging for data pipelines and databases.
  • Skills in optimizing data storage and processing for performance and cost-effectiveness.
Scripting and Automation:
  • Proficiency in scripting languages like Python or PowerShell for automating data engineering tasks.
  • Knowledge of Azure Resource Manager (ARM) templates for infrastructure as code.
  • Additionally, obtaining relevant certifications, such as the Microsoft Certified: Azure Data Engineer Associate, can further validate and enhance these skills.
 Qualifications:
  • Bachelor’s degree in computer science, Engineering, or a related field
  • Proven experience as a data engineer, with a strong focus on data migration, ETL, and data integration.
  • Hands-on experience with data warehousing concepts, database technologies (SQL on Azure)
  • Strong problem-solving skills, attention to detail, and the ability to work effectively in a fast-paced environment.
  • Excellent communication and interpersonal skills, with the ability to collaborate effectively with cross-functional teams and stakeholders.
 Required/Desired Skills:
  • Proficiency in designing and implementing relational and non-relational databases. - Required - 5 Years
  • Knowledge of data modeling techniques and tools. - Required - 5 Years
  • Hands-on experience with Azure data services such as Azure SQL Database, Azure Cosmos DB, Azure Data Lake Storage, Azure Blob Storage, etc. - Required - 5 Years
  • Expertise in designing and implementing ETL processes using tools like Azure Data Factory or Azure Databricks. - Required - 5 Years
  • Knowledge of data integration and transformation techniques. - Required - 5 Years
  • Proficient in writing complex SQL queries and stored procedures - Required - 5 Years
  • Knowledge of data security best practices and experience implementing security measures for data storage and processing on Azure. - Required - 5 Years
  • Ability to set up monitoring and logging for data pipelines and databases. - Required - 5 Years
  • Skills in optimizing data storage and processing for performance and cost-effectiveness - Required - 5 Years
  • Proficiency in scripting languages like Python or PowerShell for automating data engineering tasks - Required - 5 Years
  • Knowledge of Azure Resource Manager (ARM) templates for infrastructure as code - Required - 5 Years
FHR

  • Azure Data Engineer

    4 days ago

    Raleigh, North Carolina, United States Crescens Full time

    Job Title: Azure Data EngineerCrescens is seeking a highly motivated Senior Business / Data Analyst to join the Permit Transformation Program team.About the RoleThe client is seeking a Senior Business / Data Analyst to provide analysis and leadership on data analysis projects across the DEQ enterprise. You will provide insight to other data analysts, data...

  • Azure Data Engineer

    1 week ago

    Raleigh, North Carolina, United States Focused HR Solutions Full time

    About the RoleWe are seeking a highly skilled Data Engineer to join our team at Focused HR Solutions. As a Data Engineer, you will play a key role in modernizing our technology stack and driving our organization's digital transformation journey.Key ResponsibilitiesData Engineering: Collaborate with cross-functional business teams to understand requirements,...

  • Azure Data Engineer with Medallion Exp

    2 weeks ago

    Raleigh, United States Magicforce Full time

    Job Title: Azure Data Engineer with Medallion Architecture Location: Remote Duration: Long Term Must have 13 years of experience Job Description: Sr. Azure Data Engineer Data Bricks ADF Medallion Architecture 15 years of experience in implementing large data and analytics platforms. Deep experience architecting and building data platforms on...

  • Azure Data Engineer

    2 hours ago

    Raleigh, United States Infosys Full time

    Required Qualifications:Candidate must be located within commuting distance of Indianapolis, IN/Raliegh, NC/Hartford, CT or be willing to relocate to the area, This position may require travel within the US.Bachelor's degree or foreign equivalent required from an accredited institution. Will also consider three years of progressive experience in a specialty...

  • Azure Data Engineer

    14 minutes ago

    raleigh, United States Infosys Full time

    Required Qualifications:Candidate must be located within commuting distance of Indianapolis, IN/Raliegh, NC/Hartford, CT or be willing to relocate to the area, This position may require travel within the US.Bachelor's degree or foreign equivalent required from an accredited institution. Will also consider three years of progressive experience in a specialty...

  • Azure Data Engineer

    3 weeks ago

    Raleigh, North Carolina, United States Focused HR Solutions Full time

    About Focused HR Solutions Focused HR Solutions is a leading provider of talent acquisition and workforce solutions, connecting top-tier professionals with exciting opportunities across diverse industries. Azure Data Engineer - Cloud Migration Specialist We are currently seeking a highly skilled Azure Data Engineer to join our client's team. This role...

  • Azure Data Architect with Medallion Expertise

    2 weeks ago

    Raleigh, North Carolina, United States Magicforce Full time

    Job Title: Azure Data Engineer with Medallion ArchitectureLocation: RemoteDuration: Long TermRequirements:We are seeking a highly experienced Azure Data Engineer with expertise in Medallion Architecture to join our team at Magicforce. The ideal candidate will have a strong background in designing and implementing large-scale data platforms on Azure.Key...

  • Senior Data Engineer in Azure using Databricks for Scala/Python

    3 weeks ago

    Raleigh, United States UBS Full time

    Your role Do you like building complex, secure platforms with a touch of a button? Are passionate about developing automated infrastructure as code that is successfully rolled out across a global implementation? Do you have what it takes to build robust solution that aide data engineers in delivering their data pipelines? UBS , the Group Compliance &...

  • Senior Data Engineer

    3 weeks ago

    Raleigh, United States Targan, Inc. Full time

    As a Data Engineer, you will be responsible for designing, developing, and maintaining our data infrastructure. You will work closely with a diverse range of users, including business users, leadership, mechanical engineers, controls programmers, biologists, and data scientists. Your expertise in Azure, Fabric, Data Factory, IoT, and common data formats such...

  • Senior Data Engineer

    3 months ago

    Raleigh, United States TARGAN Inc. Full time

    Job DescriptionJob DescriptionDescription:As a Data Engineer, you will be responsible for designing, developing, and maintaining our data infrastructure. You will work closely with a diverse range of users, including business users, leadership, mechanical engineers, controls programmers, biologists, and data scientists. Your expertise in Azure, Fabric, Data...

  • Database Engineer

    4 months ago

    Raleigh, United States Pierce Technology Corp Full time

    Job DescriptionJob DescriptionWork closely with development teams to design and implement highly available and scalable Azure-based database solutionsOptimize database performance and troubleshoot any performance issuesDesign and implement database backup and recovery strategiesCollaborate with cross-functional teams to ensure data governance and...

  • Senior Data Migration Engineer

    2 weeks ago

    Raleigh, North Carolina, United States Golden Technology Full time

    About the RoleWe are seeking a highly skilled Senior Data Migration Engineer to join our team at Golden Technology. As a key member of our data engineering team, you will be responsible for designing, implementing, and migrating data systems from on-premises to the cloud, specifically using Snowflake and Azure.Key ResponsibilitiesPlan and execute a smooth...

  • Azure Security Engineer Sr.

    2 months ago

    Raleigh, United States Southern Talent Specialists Full time

    Job DescriptionJob DescriptionAzure Security Engineer Sr.SummaryOur client’s,  CISO group, seeks a qualified Active Directory/Azure Administrator to manage the administration, implementation, and maintenance of Active Directory and Azure infrastructures. This position provides 24x7x365 operational support for 7,000+ banking and non-banking branch users...

  • Senior Data Engineer

    3 weeks ago

    Raleigh, United States Golden Technology Full time

    In this role, you will help the client move their data systems from on-premises to the cloud, specifically using Snowflake and Azure. You will work closely with the client to plan and carry out a smooth transition, making sure their data is securely and efficiently moved to the cloud. Your skills in data modeling, advanced SQL, and cloud tools like...

  • Senior Data Engineer

    1 month ago

    Raleigh, United States Golden Technology Full time

    In this role, you will help the client move their data systems from on-premises to the cloud, specifically using Snowflake and Azure. You will work closely with the client to plan and carry out a smooth transition, making sure their data is securely and efficiently moved to the cloud. Your skills in data modeling, advanced SQL, and cloud tools like...

  • Senior Data Engineer

    4 weeks ago

    Raleigh, United States Golden Technology Full time

    In this role, you will help the client move their data systems from on-premises to the cloud, specifically using Snowflake and Azure. You will work closely with the client to plan and carry out a smooth transition, making sure their data is securely and efficiently moved to the cloud. Your skills in data modeling, advanced SQL, and cloud tools like...

  • Azure Cyber Security Engineer

    4 months ago

    Raleigh, United States Southern Talent Specialists Full time

    Job DescriptionJob DescriptionAzure Cyber Security EngineerSummaryThe Cyber Security Engineer – Threat Management is responsible for second level security event/incident response along with the collection, analysis, and dissemination of cyber threat intelligence. These capabilities will include timely collection of advanced warning of impeding IT...

  • Data Engineer Position

    3 days ago

    Raleigh, North Carolina, United States VirtualVocations Full time

    VirtualVocations is seeking a skilled Data Engineer to design and implement scalable data pipelines within AWS cloud environments. The ideal candidate will have a strong background in managing and optimizing Snowflake, SQL Server, and Oracle databases, as well as experience with ETL tools such as Airflow, PySpark, Kafka, and Python. Additionally, the...

  • Python Data Engineer

    4 months ago

    Raleigh, United States Saxon Global Full time

    Client: Optum Job Title: Python Data Engineer Duration: 6+ month contract Location: Raleigh, NC is the preferred location, open to Remote PROJECT: This team supports data analytics for HEDIS. They have a Python engine which reports HEDIS standards for each year. Code runs on big data and cloud DAY TO DAY: Supporting data analytics for HEDIS Python...

  • Azure Cloud Engineer

    4 months ago

    Raleigh, United States Surya Technologies, Inc. Full time

    Job DescriptionJob DescriptionSurya is looking for an Azure Cloud Engineer to join our rapidly evolving Global Infrastructure team. This is a key role in cloud operations to support day to day activities of azure cloud. You will be primarily focusing on daily administration tasks, application migration activities and responding to any failures / alerts.This...