Data Engineer

3 months ago


Atlanta, United States Scalene Works People Solution LLP Full time

Requisition/Position Title

Senior Azure Data Engineer

Employment (Regular/Consultant)

Regular

Position Type (New/Replacement)

New

Experience Level (Min-Max)

>6 Years

Mandatory Skillset (Maximum 5)

Azure Data Factory, Spark, SQL, Python, Databricks, Snowflake

Detailed Job Description

Job Responsibilities:

· Design, develop, and implement robust and scalable data solutions using Azure technologies, including Azure Data Factory, Azure SQL Data Warehouse, Azure Databricks, and/or Azure Synapse Analytics.

  • Proficient in programming languages like Spark (with either Python or Scala), SQL
  • Experience with Databases like Sql Server, Teradata, Snowflake, Synapse.

· Good understanding of data engineering principles, data modelling, data warehousing, and ETL/ELT processes which includes data testing, validation and reconciliation processes.

· Hands-on experience with data integration and data transformation frameworks, tools, and methodologies.

· Experience with version control systems like Git, GitHub etc

· Collaborate with cross-functional teams and business teams to understand business requirements and translate them into technical designs and solutions.

· Build and maintain data pipelines, data integrations, and data transformations to enable efficient data processing, storage, and retrieval.

· Optimize data infrastructure and solutions for performance, scalability, and cost-efficiency, ensuring high availability and reliability.

· Conduct data profiling, data validation, and data cleansing activities to ensure data integrity and accuracy.

  • Mentor and provide technical guidance to junior data engineers, freshers/interns, fostering knowledge sharing and skills development within the team.

Good to have:

· Experience with version control systems, CI/CD pipelines, and automated testing frameworks.

· Knowledge in streaming technologies, pipelines and frameworks like Kafka, EventHub, Azure Stream Analytics.


  • Data Engineer

    5 months ago


    Atlanta, United States Boston Data Pro, LLC Full time

    We are looking for a Data Engineer to join our engineering team and help us develop and maintain various software products.The main responsibilities include writing and testing code debugging programs and integrating applications and transmission of the data from on-prem to AWS cloud.OPT CPT OK but must not be fresher.Key Skills Python Snowflake...

  • Data Engineer

    5 months ago


    Atlanta, Georgia, United States Boston Data Pro, LLC Full time

    We are looking for a Data Engineer to join our engineering team and help us develop and maintain various software products.The main responsibilities include writing and testing code debugging programs and integrating applications and transmission of the data from on-prem to AWS cloud.OPT CPT OK but must not be fresher.Key Skills Python Snowflake...


  • Atlanta, United States Amazon Data Services, Inc. Full time

    At Amazon, we're working to be Earth's most Customer-centric Company and Earth's Best Employer. To get there, we need exceptionally talented, bright, and driven people. If you'd like to help us build and expand The Cloud, this is your chance to make history.Amazon Data Services Inc. is currently hiring for a Engineering Operations Tech (EOT) to support our...

  • Systems Engineer

    3 days ago


    Atlanta, United States NTT DATA Full time

    Company Overview: Req ID: 24-02313 NTT DATA Services strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Systems Engineer to join our team in Atlanta, Georgia (US-GA), United States (US). Job...

  • Data Engineer

    4 weeks ago


    Atlanta, Georgia, United States iVoyant Full time

    About the job Data Engineer iVoyant is looking for multiple Data Engineers to join our client Digital Team.The Data Engineers will work with the client functional SMEs within the Digital and the Business team to understand the requirements and prepare technical design.They will ensure the availability and validity of the data to ensure that it fits with the...

  • Data Engineer

    1 day ago


    Atlanta, United States Brooksource Full time

    Data Engineer Location: Atlanta, GA (Hybrid)Position Type: Contract, W2 (September 2024 - April 2025)$55-$62/hourAbout Us:Our Energy and Utilities client is a leading provider of reliable and sustainable energy solutions. We are committed to innovation and efficiency in every aspect of our operations. As part of our continued growth and digital...

  • Data Engineer

    3 days ago


    Atlanta, United States Brooksource Full time

    Data Engineer Location: Atlanta, GA (Hybrid)Position Type: Contract, W2 (September 2024 - April 2025)$55-$62/hourAbout Us:Our Energy and Utilities client is a leading provider of reliable and sustainable energy solutions. We are committed to innovation and efficiency in every aspect of our operations. As part of our continued growth and digital...

  • Data Engineer

    3 months ago


    Atlanta, United States GSquared Group Full time

    Title: Data Engineer / GCP Terms: Contract to hire Location: Atlanta area HYBRID ROLEMUST LIVE IN ATLANTA, GEORGIANo 3rd party agencies at this timeAre you looking for a career opportunity that allows you to grow your career? If so, this opportunity will genuinely excite you! Our client is transforming how their organization services their customers while...

  • Data Engineer

    2 weeks ago


    Atlanta, United States Motion Recruitment Full time

    Every year, nearly 200 million travelers trust our client to get them where they're going. Take your career to new heights by working for this longstanding leader in air travel that services more worldwide destinations than any other airline. We are looking for a Data Engineer to join our team for a 12 month contract in Atlanta, GA (hybrid). Contract...

  • Data Engineer

    3 weeks ago


    Atlanta, United States Wise Skulls llc Full time

    Job DescriptionJob DescriptionJob Title: Data Engineer Location: Atlanta, GA; Dallas, TX (On-site) Duration: 6+ Months Implementation Partner: Infosys End Client: To be disclosedJD:4 to 5 years of experience in Snowflake with DatabricksExperience working with large, heterogeneous data sets in building and optimizing data pipelines and solutions on the...

  • Data Engineer

    2 months ago


    Atlanta, United States Agile Full time

    Data Engineer Our client is a thriving company fostering a collaborative and engaging work environmentThey empower individuals to make a real difference through their contributions. The Data Engineer plays a pivotal role in driving data-centric decision makingYou'll collaborate with various business units to translate needs into actionable data...

  • Data Engineer

    3 months ago


    Atlanta, United States Marathon TS Full time

    Job DescriptionJob DescriptionData Engineer is responsible for supporting our enterprise data warehouse for our Supply Chain Operations. As a Data Engineer, you will be part of a dynamic team with engineers of all experience levels who help each other build and grow technical and leadership skills while creating, deploying, and supporting production...

  • Data Engineer

    1 month ago


    Atlanta, United States VetsEZ Full time

    VetsEZ is seeking a highly skilled Data Engineer to join our team. The successful candidate will work remotely and will be responsible for managing and optimizing large-scale data systems, supporting data integration and transformation, and ensuring data quality and accessibility. This role requires strong technical expertise in database management, data...


  • Atlanta, United States Optomi Full time

    Senior Data EngineerOptomi, in partnership with a leading distributor of wine and spirits, is seeking a Senior Data Engineer for their Atlanta, GA location. Candidates must be able to combine raw information from different sources to create consistent and machine-readable datasets that are easy to analyze and support company initiatives. They will support...


  • Atlanta, United States Optomi Full time

    Senior Data EngineerOptomi, in partnership with a leading distributor of wine and spirits, is seeking a Senior Data Engineer for their Atlanta, GA location. Candidates must be able to combine raw information from different sources to create consistent and machine-readable datasets that are easy to analyze and support company initiatives. They will support...

  • Data Engineer

    7 days ago


    Atlanta, United States Hirewell Full time

    Your RoleAs a Technology Data Engineer, you'll be instrumental in managing the flow, ingestion, and accessibility of data to support the growth of our brand. We are looking for a proactive team player who takes ownership of their work and responsibilities. You’ll ensure the seamless integration and security of data within our data warehouse, focusing on...

  • Data Engineer

    6 days ago


    Atlanta, United States Hirewell Full time

    Your RoleAs a Technology Data Engineer, you'll be instrumental in managing the flow, ingestion, and accessibility of data to support the growth of our brand. We are looking for a proactive team player who takes ownership of their work and responsibilities. You’ll ensure the seamless integration and security of data within our data warehouse, focusing on...

  • Data Engineer

    1 week ago


    Atlanta, United States Stellar Consulting Solutions, LLC Full time

    Job Description:The Data Engineer will analyze, design, develop, performance tuning, test their code as well as others code and support initiatives to build an enterprise integration framework while providing inputs for improving standards for data mapping, integration, and data traceability across the NAPA business functions. Qualifications:Five or more...

  • Data Engineer

    1 week ago


    Atlanta, United States Stellar Consulting Solutions, LLC Full time

    Job Description:The Data Engineer will analyze, design, develop, performance tuning, test their code as well as others code and support initiatives to build an enterprise integration framework while providing inputs for improving standards for data mapping, integration, and data traceability across the NAPA business functions. Qualifications:Five or more...

  • Data Engineer

    2 days ago


    atlanta, United States Northern Rock Full time

    Data Engineer at Northern RockOverview: Northern Rock is seeking a skilled Data Engineer to play a pivotal role in evolving and enhancing our data infrastructure. We are looking for a candidate who is not only experienced in building and optimizing data pipelines but is also passionate about creating data systems from the ground up.Key Responsibilities:Data...