Data Engineer

4 weeks ago


Atlanta, United States Scalene Works People Solution LLP Full time

Requisition/Position Title

Senior Azure Data Engineer

Employment (Regular/Consultant)

Regular

Position Type (New/Replacement)

New

Experience Level (Min-Max)

>6 Years

Mandatory Skillset (Maximum 5)

Azure Data Factory, Spark, SQL, Python, Databricks, Snowflake

Detailed Job Description

Job Responsibilities:

· Design, develop, and implement robust and scalable data solutions using Azure technologies, including Azure Data Factory, Azure SQL Data Warehouse, Azure Databricks, and/or Azure Synapse Analytics.

  • Proficient in programming languages like Spark (with either Python or Scala), SQL
  • Experience with Databases like Sql Server, Teradata, Snowflake, Synapse.

· Good understanding of data engineering principles, data modelling, data warehousing, and ETL/ELT processes which includes data testing, validation and reconciliation processes.

· Hands-on experience with data integration and data transformation frameworks, tools, and methodologies.

· Experience with version control systems like Git, GitHub etc

· Collaborate with cross-functional teams and business teams to understand business requirements and translate them into technical designs and solutions.

· Build and maintain data pipelines, data integrations, and data transformations to enable efficient data processing, storage, and retrieval.

· Optimize data infrastructure and solutions for performance, scalability, and cost-efficiency, ensuring high availability and reliability.

· Conduct data profiling, data validation, and data cleansing activities to ensure data integrity and accuracy.

  • Mentor and provide technical guidance to junior data engineers, freshers/interns, fostering knowledge sharing and skills development within the team.

Good to have:

· Experience with version control systems, CI/CD pipelines, and automated testing frameworks.

· Knowledge in streaming technologies, pipelines and frameworks like Kafka, EventHub, Azure Stream Analytics.


  • Data Engineer

    1 month ago


    Atlanta, United States Boston Data Pro, LLC Full time

    We are looking for a Data Engineer to join our engineering team and help us develop and maintain various software products.The main responsibilities include writing and testing code debugging programs and integrating applications and transmission of the data from on-prem to AWS cloud.OPT CPT OK but must not be fresher.Key Skills Python Snowflake...

  • Data Engineer

    4 weeks ago


    Atlanta, Georgia, United States Boston Data Pro, LLC Full time

    We are looking for a Data Engineer to join our engineering team and help us develop and maintain various software products.The main responsibilities include writing and testing code debugging programs and integrating applications and transmission of the data from on-prem to AWS cloud.OPT CPT OK but must not be fresher.Key Skills Python Snowflake...


  • Atlanta, United States T5 Data Centers Full time

    Job Description The Assistant Project Engineer is responsible for performing support tasks to assist Project Engineers and Project Managers in overseeing and managing T5CS projects. This includes processing documents and certifications, managing schedules, liaising with internal and external parties, and providing technical support to staff as...

  • Lead Data Engineer

    5 days ago


    Atlanta, United States Motion Recruitment Full time

    The Lead Data Engineer position is part of the Marketing Technology team focused on enabling the development and roll-out of world-class modern Marketing Data Engineering capabilities at the Customer. This role partners with teams responsible for Marketing and Digital Guest Engagement platforms that leverage world-class technology to create personalized,...

  • Azure Data Engineer

    7 days ago


    Atlanta, United States InterEx Group Full time

    Microsoft Azure Data Engineer - Atlanta, GAKey Responsibilities:Design and implement highly scalable, high-volume data pipelines and warehouses using Azure Data Factory, Azure Databricks, and other Azure services.Develop and maintain data models, structures, and procedures to ensure data accuracy and accessibility.Work closely with stakeholders to understand...

  • Azure Data Engineer

    1 week ago


    Atlanta, United States InterEx Group Full time

    Microsoft Azure Data Engineer - Atlanta, GAKey Responsibilities:Design and implement highly scalable, high-volume data pipelines and warehouses using Azure Data Factory, Azure Databricks, and other Azure services.Develop and maintain data models, structures, and procedures to ensure data accuracy and accessibility.Work closely with stakeholders to understand...

  • Azure Data Engineer

    1 week ago


    Atlanta, United States InterEx Group Full time

    Microsoft Azure Data Engineer - Atlanta, GAKey Responsibilities:Design and implement highly scalable, high-volume data pipelines and warehouses using Azure Data Factory, Azure Databricks, and other Azure services.Develop and maintain data models, structures, and procedures to ensure data accuracy and accessibility.Work closely with stakeholders to understand...

  • Data Engineer

    2 days ago


    Atlanta, United States Visionaire Partners Full time

    Sr. Data Analytics Engineer (Microsoft stack / Power BI)Exciting opportunity to join 1st class organization that offers a great work-life balance, outstanding company culture, and amazing benefits! Most of our client's employees retire from here, which is the reason for this opening! As a part of the Analytics Engineering team, you will provide advanced...

  • Data Engineer

    3 days ago


    Atlanta, United States Visionaire Partners Full time

    Sr. Data Analytics Engineer (Microsoft stack / Power BI)Exciting opportunity to join 1st class organization that offers a great work-life balance, outstanding company culture, and amazing benefits! Most of our client's employees retire from here, which is the reason for this opening! As a part of the Analytics Engineering team, you will provide advanced...

  • Data Engineer

    3 days ago


    Atlanta, United States Visionaire Partners Full time

    Sr. Data Analytics Engineer (Microsoft stack / Power BI)Exciting opportunity to join 1st class organization that offers a great work-life balance, outstanding company culture, and amazing benefits! Most of our client's employees retire from here, which is the reason for this opening! As a part of the Analytics Engineering team, you will provide advanced...

  • MDM Data Engineer

    6 days ago


    Atlanta, United States Apptad Inc Full time

    Job DescriptionJob DescriptionJob Title: MDM Data EngineerJob Location: RemoteJob Duration: Long-TermJob description:Bachelors or Master's degree in computer science or related discipline.7 + years of relevant experience in software development, preferably in Data Engineering, Master Data Management (MDM), Information Management platformsPreferred...


  • Atlanta, United States GAP Solutions, Inc. Full time

    Position Objective: The Data Modernization Accelerator at CDC (DMAC) Team is seeking a Cloudera Data Engineer. The role involves designing, building, and maintaining data pipelines. The Engineer will integrate data from various sources and deploy solutions on cloud services. Additionally, they be responsible for optimizing data infrastructure for...


  • Atlanta, United States GAP Solutions, Inc. Full time

    Position Objective: The Data Modernization Accelerator at CDC (DMAC) Team is seeking a Cloudera Data Engineer. The role involves designing, building, and maintaining data pipelines. The Engineer will integrate data from various sources and deploy solutions on cloud services. Additionally, they be responsible for optimizing data infrastructure for...

  • Big Data Engineer

    7 days ago


    Atlanta, United States Equifax Inc. Full time

    Equifax is where you can power your possible. If you want to achieve your true potential, chart new paths, develop new skills, collaborate with bright minds, and make a meaningful impact, we want to hear from you. Equifax is seeking creative, high-energy and driven Big Data Engineer in Test with hands-on development skills to work on a variety of meaningful...


  • Atlanta, United States Compunnel Inc. Full time

    Minimum of 5 years of experience in data engineering, with a focus on AWS technologies.Proven expertise in creating datasets from scratch and developing Tableau dashboards.Must have experience in Data VisualizationExtensive experience in building data integrationsStrong understanding of data models, data warehousing, data ingestion concepts, and relational...


  • Atlanta, United States Compunnel Inc. Full time

    Minimum of 5 years of experience in data engineering, with a focus on AWS technologies.Proven expertise in creating datasets from scratch and developing Tableau dashboards.Must have experience in Data VisualizationExtensive experience in building data integrationsStrong understanding of data models, data warehousing, data ingestion concepts, and relational...

  • Data Engineer Lead

    2 weeks ago


    Atlanta, United States Spartan Technologies Full time

    Job Description:We are seeking a Technical Lead Data Engineer Contract to hire (located in Atlanta, GA) that has the skills to bring substantial experience in Data Solutions in order to help unlock the power of our data for the Company's Stakeholders. In this role, you will handle the increasing complexity and demand for data from various sources, enabling...

  • Data Engineer Lead

    2 weeks ago


    Atlanta, United States Spartan Technologies Full time

    Job Description:We are seeking a Technical Lead Data Engineer Contract to hire (located in Atlanta, GA) that has the skills to bring substantial experience in Data Solutions in order to help unlock the power of our data for the Company's Stakeholders. In this role, you will handle the increasing complexity and demand for data from various sources, enabling...


  • Atlanta, United States RiseIT Solutions Full time

    Position: Lead/Senior Data Engineer Location: Princeton, NJ Part Time @ 20 hours per week 7 + months with possible extensions Remote w/ occasional travel to the site. Data Engineering Job Responsibilities: Develop and maintain data pipelines to ingest, process, and Analyze large volumes of data efficiently. Design and implement...

  • Data Engineer

    1 month ago


    Atlanta, Georgia, United States Control Risks Full time

    Control Risks is hiring for a Data Engineer to support a Fortune 50 technology client of ours. This role will including data processing, data analytics, and creation of data visualizations; to develop the data pipeline and data lake needed to develop dashboards; building out data analytics capabilities and developing dashboards to the needs and requirement...