Cloud Data Engineer

4 weeks ago

Atlanta, United States Abbtech Professional Resources Full time

This program requires US Citizenship

Our client is seeking a seeking a customer experience focused Microsoft Azure Cloud Data Engineer to work with a team of subject matter experts and developers to design and implement full lifecycle data pipeline services for Azure cloud based data lake, SQL, and NoSQL data stores. As a data engineer, you will translate business requirements to data engineering solutions to support an enterprise scale Microsoft Azure based data analytics and reporting platform. Our ideal candidate is mission focused and delivery oriented, and applies critical thinking to create innovative functions and solve technical issues.
In this role, you will :

  • Support the development, lifecycle management, and deployment of data pipeline services and solutions.
  • Work with client personnel and team members to understand data requirements and implement appropriate data solutions.
  • Design and implement data models and data pipelines for relational, dimensional, data lakehouse (medallion architecture), data warehouse, data mart, NoSQL data stores.
  • Manage and optimize data storage using Azure ADLS Gen2, Azure Synapse SQL Pools, Azure Cosmos DB.
  • Develop batch/incremental/streaming data pipelines using Python, SQL, Spark, Scala and Microsoft Azure services including ADLS Gen2/Blob Storage, Data Factory, Synapse Pipelines, Azure Analysis Services, Logic Apps, Azure Functions, Azure Files, Visual Studio, SQL Server Change Data Capture, SQL Server stored procedures.
  • Redevelop or migrate existing SSIS extract, transform, load scripts to Azure Data Factory.
  • Identify, create, prepare data required for advanced analytics, visualization, reporting, and AI/ML.
  • Implement data migration, data integrity, data quality, metadata management, and data security functions, and apply advanced techniques such as machine learning to optimize data pipelines.
  • Monitor and troubleshoot data related issues to maintain high availability and performance.
  • Implement governance, build, deployment and monitoring standards to automate platform administration.
  • Apply DevOps and CI/CD principles to development, test, deployment, and release of code.


For this position, you must possess:

  • BS degree in Computer Science or related field and 8+ years or Masters with 6+ years of experience
  • 4+ years of professional experience implementing Azure cloud based data engineering solutions
  • 4+ years of experience designing and building solutions utilizing various cloud services such as Azure Blob, Azure Data Lake Services, Azure Synapse Analytics, Azure Data Factory, Integration Runtime, Azure EventHubs, Azure Functions, Azure Logic Apps, Azure Analysis Services
  • 4+ years of experience in the design and build of ETL/ELT processes by writing custom data pipelines, initial, incremental and change data capture experiences
  • 4+ years of experience with more than one of the follow scripting languages: SQL, T-SQL, Python, Scala, PySpark
  • Experience working with Microsoft database and business intelligence tools, including SQL Server, including stored procedures, SSIS, SSRS, SSAS (cubes)
  • Knowledge and experience with shell scripting, MDX, DAX queries
  • Admin, system level experiences with data management, DB creation, user management/access control, ETL package deployment, data modeling, scheduling, debug, monitor, security controls, and O&M aspect for both on-premise and cloud based data assets.
  • Experience with data engineering solutions for data warehouse, data mart, multi-dimensional models, semantic data models (e.g. Azure Analysis Services)
  • Knowledge and understanding of AWS cloud services including data management and data movement services.
  • Demonstrated experience in supporting a production, testing, integration, and development environments
  • Open mindset, ability to quickly adapt new technologies to solve customer problems
  • Experience with Agile process methodology, and CI/CD automation, and cloud based development (Azure, AWS).
  • Ability to successfully obtain a government-issued Public Trust clearance.


Not required, but additional education, certifications, and/or experience are a plus:

  • Experience with ETL/ELT processes for Master Data Management.
  • Working within Scaled Agile Framework (SAFe) process.
  • Experience working with Azure DevOps.
  • Knowledge and understanding in data governance, data discovery tools such as Alation, MS Purview
  • Knowledge and experience of configuring ETL pipelines in cloud, VPC/VNet config, Integration Runtime, Gateway, EC2/Bastion access settings
  • Microsoft certified in Azure fundamentals, data engineer, AI or AWS certified data engineer.
  1.  

ABBTECH is an EOE/Minorities/Women/Disabled Individuals/Veterans

  • Cloud Data Engineer

    3 weeks ago

    Atlanta, United States Bank of America Full time

    Job Description:About UsAt Bank of America, we are guided by a common purpose to help make financial lives better through the power of every connection. Responsible Growth is how we run our company and how we deliver for our clients, teammates, communities, and shareholders every day.One of the keys to driving Responsible Growth is being a great place to...

  • Cloud Data Engineer

    4 weeks ago

    Atlanta, United States VML South Africa Full time

    At VML, we are a beacon of innovation and growth in an ever-evolving world. Our heritage is built upon a century of combined expertise, where creativity meets technology, and diverse perspectives ignite inspiration. With the merger of VMLY&R and Wunderman Thompson, we have forged a new path as a growth partner that is part creative agency, part consultancy,...

  • Cloud Data Engineer

    1 week ago

    Atlanta, United States VML South Africa Full time

    At VML, we are a beacon of innovation and growth in an ever-evolving world. Our heritage is built upon a century of combined expertise, where creativity meets technology, and diverse perspectives ignite inspiration. With the merger of VMLY&R and Wunderman Thompson, we have forged a new path as a growth partner that is part creative agency, part consultancy,...

  • Cloud Data Engineer

    3 weeks ago

    Atlanta, United States VML Full time

    Who We Are: At VML, we are a beacon of innovation and growth in an ever-evolving world. Our heritage is built upon a century of combined expertise, where creativity meets technology, and diverse perspectives ignite inspiration. With the merger of VMLY&R and Wunderman Thompson, we have forged a new path as a growth partner that is part creative agency, part...

  • Cloud Data Engineer

    4 days ago

    Atlanta, United States VML Full time

    Who We Are: At VML, we are a beacon of innovation and growth in an ever-evolving world. Our heritage is built upon a century of combined expertise, where creativity meets technology, and diverse perspectives ignite inspiration. With the merger of VMLY&R and Wunderman Thompson, we have forged a new path as a growth partner that is part creative agency, part...

  • Azure Cloud SRE Engineer

    5 days ago

    Atlanta, Georgia, United States NTT DATA Services Full time

    Req ID:#NTT DATA Services strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a Azure Cloud SRE Engineer - HYBRID or REMOTE to join our team in Atlanta, Georgia (US-GA), United States...

  • Data Engineer

    2 months ago

    Atlanta, Georgia, United States Boston Data Pro, LLC Full time

    We are looking for a Data Engineer to join our engineering team and help us develop and maintain various software products.The main responsibilities include writing and testing code debugging programs and integrating applications and transmission of the data from on-prem to AWS cloud.OPT CPT OK but must not be fresher.Key Skills Python Snowflake...

  • Azure Cloud SRE Engineer

    5 days ago

    Atlanta, United States NTT DATA Services Full time

    Req ID: #NTT DATA Services strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a Azure Cloud SRE Engineer - HYBRID or REMOTE to join our team in Atlanta, Georgia (US-GA), United States...

  • Data Engineering Lead

    3 weeks ago

    Atlanta, United States Further Full time

    Job DescriptionJob DescriptionWE'RE HIRING! If you love data and are looking for unlimited growth opportunities, we want to talk with you about joining Further. Further is a data, cloud, and AI company whose focus is helping companies turn raw data into the right decisions. We have an award winning culture of extraordinary people. Our purpose is to...

  • Data Engineering Lead

    1 week ago

    Atlanta, United States Further Full time

    Job DescriptionJob DescriptionWE'RE HIRING! If you love data and are looking for unlimited growth opportunities, we want to talk with you about joining Further. Further is a data, cloud, and AI company whose focus is helping companies turn raw data into the right decisions. We have an award winning culture of extraordinary people. Our purpose is to...

  • Cloud Data Engineer III

    25 seconds ago

    Atlanta, United States Elevance Health Full time

    Anticipated End Date: 2024-05-27 Position Title: Cloud Data Engineer III Job Description: Cloud Data Engineer III Location : This position will work a hybrid model (remote and office). The ideal candidate will live within 50 miles of our Richmond, VA Elevance Health PulsePoint location. The Cloud Data Engineer III is responsible for the design and...

  • Cloud Data Engineer

    1 week ago

    Atlanta, United States Deloitte Full time

    Position Summary Are you an experienced, passionate pioneer in technology – a solutions builder, a roll-up-your-sleeves technologist who wants a daily collaborative environment, think-tank feel and share new ideas with your colleagues - without the extensive demands of travel? If so, consider an opportunity with our US Delivery Center – we are...

  • Cloud Data Engineer

    3 weeks ago

    Atlanta, United States Deloitte Full time

    Position Summary Are you an experienced, passionate pioneer in technology – a solutions builder, a roll-up-your-sleeves technologist who wants a daily collaborative environment, think-tank feel and share new ideas with your colleagues - without the extensive demands of travel? If so, consider an opportunity with our US Delivery Center – we are...

  • Cloud Data Engineer III

    4 days ago

    Atlanta, United States Elevance Health Full time

    Anticipated End Date: 2024-05-27 Position Title: Cloud Data Engineer III Job Description: Cloud Data Engineer III Location: This position will work a hybrid model (remote and office). The ideal candidate will live within 50 miles of our Richmond, VA Elevance Health PulsePoint location. TheCloud Data Engineer III is responsible for the design and development...

  • Cloud Data Engineer III

    4 days ago

    Atlanta, United States Elevance Health Full time

    Anticipated End Date: 2024-05-27 Position Title: Cloud Data Engineer III Job Description: Cloud Data Engineer III Location: This position will work a hybrid model (remote and office). The ideal candidate will live within 50 miles of our Richmond, VA Elevance Health PulsePoint location. TheCloud Data Engineer III is responsible for the design and development...

  • Cloud Data Warehouse Analyst

    3 weeks ago

    Atlanta, United States Healthcare InfoTech Full time

    Role: Cloud Data Warehouse Analyst Location: Remote Duration: Long Term Rate: $60/hr on w2 Job Description Requirements and design analyst for an enterprise Cloud Data Warehouse. Functional & Technical Data Engineering Requirements: • Engage business stakeholders to gather, analyze and document functional data requirements for cloud data engineering...

  • Security Cloud Engineer

    3 weeks ago

    Atlanta, United States ENVISN INCORPORATED Full time

    Job Title: Security Cloud Engineer Location: Atlanta, GA Duration: 12+ months contract Our client is looking for a Security Cloud Engineer for a 12+ months contract role in Atlanta, GA who will assist the Cybersecurity Team by supporting Security staff in their efforts to protect systems. This position will be responsible for developing and maturing...

  • Security Cloud Engineer

    1 month ago

    Atlanta, United States ENVISN INCORPORATED Full time

    Job DescriptionJob DescriptionJob Title: Security Cloud EngineerLocation: Atlanta, GADuration: 12+ months contractOur client is looking for a Security Cloud Engineer for a 12+ months contract role in Atlanta, GA who will assist the Cybersecurity Team by supporting Security staff in their efforts to protect systems. This position will be responsible for...

  • Security Cloud Engineer

    1 week ago

    Atlanta, United States ENVISN INCORPORATED Full time

    Job DescriptionJob DescriptionJob Title: Security Cloud EngineerLocation: Atlanta, GADuration: 12+ months contractOur client is looking for a Security Cloud Engineer for a 12+ months contract role in Atlanta, GA who will assist the Cybersecurity Team by supporting Security staff in their efforts to protect systems. This position will be responsible for...

  • AWS Cloud Engineer

    4 weeks ago

    Atlanta, United States ASCENDING Full time

    Job DescriptionJob DescriptionFully remote however must reside within 50 miles of Birmingham AL, Charlotte NC, Nashville TN, Atlanta GA. Job DescriptionOur Client is looking for a Cloud Engineer who focuses on the evaluation, design, and execution of processes, and logic to deliver business value through operational and analytical data assets. They will be...