See more Collapse

Data Engineer-PySpark, SQL

1 month ago

Minneapolis, United States Zortech Solutions Full time
Job DescriptionJob Description

Role: Data Engineer-PySpark, SQL

Location: Minneapolis, MN (Onsite)

Duration: Fulltime

Primary Skills: PySpark, Azure DataFactory, Databricks, SQL

Secondary Skills: DBT, Snowflake

Role Responsibility:

  • Data Engineer with 8 years of experience

  • Must have good experience in pyspark programming and SQL scripting

  • Translate business requirement document, functional specification, and technical specification to related coding

  • Must have data migration experience using tools like Azure Datafactory and Databricks

  • Must have data pipeline creation on Azure Databricks data processing engine

  • Must have good experience in complex sql scripts and stored procedures

  • Develop efficient code with unit testing and code documentation

  • Ensuring accuracy and integrity of data and applications through analysis, coding, documenting, testing, and problem solving

  • Setting up the development environment and configuration of the development tools

  • Manage, monitor, and ensure the security and privacy of data to satisfy business needs

  • Contribute to the automation of modules, wherever required

  • To be proficient in written, verbal and presentation communication (English)

  • Co-ordinating with the UAT team

We have other current jobs related to this field that you can find below

  • Data Engineer

    6 days ago

    Minneapolis, United States E-Solutions Full time

    Role: Data EngineerLocation: Minneapolis, MN (Onsite)Full time onlyPrimary Skills: PySpark, Azure DataFactory, Databricks, SQLSecondary Skills: DBT, SnowflakeRole Responsibility:Data Engineer with 5-8 years of experienceMust have good experience in pyspark programming and SQL scriptingTranslate business requirement document, functional specification, and...

  • Data Engineer

    1 week ago

    Minneapolis, United States E-Solutions Full time

    Role: Data EngineerLocation: Minneapolis, MN (Onsite)Full time onlyPrimary Skills: PySpark, Azure DataFactory, Databricks, SQLSecondary Skills: DBT, SnowflakeRole Responsibility:Data Engineer with 5-8 years of experienceMust have good experience in pyspark programming and SQL scriptingTranslate business requirement document, functional specification, and...

  • Data Engineer

    1 week ago

    Minneapolis, United States E-Solutions Full time

    Role: Data EngineerLocation: Minneapolis, MN (Onsite)Full time onlyPrimary Skills: PySpark, Azure DataFactory, Databricks, SQLSecondary Skills: DBT, SnowflakeRole Responsibility:Data Engineer with 5-8 years of experienceMust have good experience in pyspark programming and SQL scriptingTranslate business requirement document, functional specification, and...

  • Data Engineer

    4 weeks ago

    Minneapolis, United States VySystems Full time

    Primary Skills: PySpark, Azure DataFactory, Databricks, SQLSecondary Skills: DBT, SnowflakeRole Responsibility:Data Engineer with 5-8 years of experienceMust have good experience in pyspark programming and SQL scriptingTranslate business requirement document, functional specification, and technical specification to related codingMust have data migration...

  • Data Engineer

    4 weeks ago

    Minneapolis, United States VySystems Full time

    Primary Skills: PySpark, Azure DataFactory, Databricks, SQLSecondary Skills: DBT, SnowflakeRole Responsibility:Data Engineer with 5-8 years of experienceMust have good experience in pyspark programming and SQL scriptingTranslate business requirement document, functional specification, and technical specification to related codingMust have data migration...

  • Data Engineer-Azure DataFactory/ Fulltime

    2 weeks ago

    Minneapolis, United States Zortech Solutions Full time

    Job DescriptionJob DescriptionRole: Data Engineer-Azure DataFactory Location: Minneapolis, MN (Onsite) Primary Skills: PySpark, Azure DataFactory, Databricks, SQL Secondary Skills: DBT, Snowflake Role Responsibility: Data Engineer with 5-8 years of experience Must have good experience in pyspark programming and SQL scripting Translate business requirement...

  • Data Engineer

    3 days ago

    Minneapolis, United States Zortech Solutions Full time

    Job DescriptionJob DescriptionNote: we need immediate joiner need local profiles. Role: Data Engineer-Azure DataFactory Location: Minneapolis, MN (Onsite) Primary Skills: PySpark, Azure DataFactory, Databricks, SQL Secondary Skills: DBT, Snowflake Role Responsibility: Data Engineer with 5-8 years of experience Must have good experience in pyspark programming...

  • Data Engineer

    2 weeks ago

    Minneapolis, Minnesota, United States Diverse Lynx Full time

    Title: Data Engineer Location- Minneapolis, MN(Onsite) Type: c Minimum 7+ Yrs of experience required Experience in structured databases( Oracle, MSSQL) and unstructured databases (Hadoop) Experience in spark / python (PySpark) / Azure products like Synapse, ADF, Databricks / Autosys Strong experience on Data warehousing projects Proficiency in writing and...

  • Azure Data Engineer

    6 days ago

    Minneapolis, United States Motion Recruitment Full time

    Outstanding long-term contract opportunity! A well-known Financial Services Company is looking for a Azure Data Engineer in Minneapolis, MN (Hybrid). Work with the brightest minds at one of the largest financial institutions in the world. This is long-term contract opportunity that includes a competitive benefit package! Our client has been around for...

  • Azure Data Engineer

    7 days ago

    Minneapolis, Minnesota, United States Motion Recruitment Full time

    Outstanding long-term contract opportunity A well-known Financial Services Company is looking for a Azure Data Engineer in Minneapolis, MN (Hybrid). Work with the brightest minds at one of the largest financial institutions in the world. This is long-term contract opportunity that includes a competitive benefit package Our client has been around for over 150...

  • Data Science

    2 days ago

    Minneapolis, United States Diverse Lynx Full time

    Job Description: Experience in Python, Pyspark and SQL - Overall 8 + years of experience in Python with 2+ in Pyspark Data Science and AI/Client - 5+ years Experience in Data Science/Ai-Client NLP, LLM/GenAI and Deep Learning (Preferred) - Working experience Good understanding/co-ordination with ETL team- Has hands on experience on building ETL pipeline in...

  • Azure Data Engineer

    3 days ago

    Minneapolis, United States Motion Recruitment Partners LLC Full time

    Azure Data Engineer Minneapolis, MN Hybrid Contract $69.5/hr - $78.31/hr Outstanding long-term contract opportunity! A well-known Financial Services Company is looking for a Azure Data Engineer in Minneapolis, MN (Hybrid). Work with the brightest minds at one of the largest financial institutions in the world. This is long-term contract opportunity...

  • Sr Data Engineer

    2 weeks ago

    Minneapolis, Minnesota, United States Sierra Nevada Corporation Full time

    Are you ready to showcase your advanced technical abilities? Dream, Innovate, Inspire and Empower the next generation to transform humanity through technology and imagination As a Sr Data Engineer, you'll design, develop, document, test, and debug new and existing cloud-based data pipelines and transformations. You will participate and lead design meetings...

  • SQL Server Engineer

    4 weeks ago

    Minneapolis, United States Strategic Staffing Solutions Full time

    SQL Server Engineer in Minneapolis at Strategic Staffing Solutions **Location:** **Experience:** Not Specified **Job Description** **SQL Server Developer 12 months** **How to Apply:** Send resume in MS word format to **Reginald Dykes** rdykes@strategicstaff.com **Reference JOB# 191449** ***Locations: onsite Raleigh, NC, Dallas, TX' Minneapolis, MN;...

  • Quality Engineer

    2 weeks ago

    Minneapolis, United States Saxon Global Full time

    Surest | RemoteETL QE6 Month Contract to Hire Project: The Senior Software Engineer in Quality Engineering will work within Bind's Data Engineering Platform to write automated tests (functional, integration, unit, data quality) in Python to ensure our ETL and data pipeline jobs deliver the expected output.Responsibilities: Work within a delivery team to...

  • Technical Lead

    4 weeks ago

    Minneapolis, United States eTeam Full time

    Mandatory - SSIS, SQL / SSIS /SSRS, airflow, Control M, Autosys, Qlik view, Data stage, Informatic Python/Scala/PySpark Reverse engineering of Legacy platforms Mapping of Legacy models to Cloud Cloud migration experience from Legacy Skills Required: 10+ years of experience required Strong experience in SQL / SSIS /SSRS Orchestration experience...

  • Principal Data Engineer, Azure Data Lake and Synapse Contract Strategic Staffing SolutionsMINNEAPOLIS MN 554152 days ago

    1 week ago

    Minneapolis, United States Strategic Staffing Solutions Full time

    Principal Data Engineer, Azure Data Lake and Synapse ******W2 ONLY- NO C2C******** Hybrid Remote – 3 days per week onsite Location: Minneapolis, MN 55415 Contract:  12 Months + W2 pay rate:   $75/hr LAST 2 WEEKS OF THE YEAR ARE OFF – NOT WORKING  AZURE Data Lake Storage, AZURE Synapse Analytics The Lead Engineer will...

  • Big data consultant

    2 weeks ago

    Minneapolis, Minnesota, United States Diverse Lynx Full time

    Big data consultant Minneapolis, Minnesota (day 1 onsite) Job Description : Good Knowledge on Spark -Scala or PySpark; Should be Hands-on Good Knowledge on Basic Big Data - Hive, Sql etc Good Unix knowledge - Should be able to work with Shell scripts with ease Basic Cloud skills in at least one environment - AWS or GCP or Azure ( Azure preferable) Diverse...

  • Quality Engineer

    2 weeks ago

    Minneapolis, United States Saxon Global Full time

    Surest | RemoteETL QE6 Month Contract to Hire Project: The Senior Software Engineer in Quality Engineering will work within Bind's Data Engineering Platform to write automated tests (functional, integration, unit, data quality) in Python to ensure our ETL and data pipeline jobs deliver the expected output. Responsibilities: Work within a delivery team to...

  • Operations Analyst I

    2 weeks ago

    Minneapolis, Minnesota, United States Diverse Lynx Full time

    Sr.No Skill Technical Area Must Have/Good to have Proficiency Rating (1 to 5) 1 Data Bricks Strong hands on in Pyspark and Apache SparkStrong hands on in Medallion architectureExperience in Native Spark Migration to Databricks.Experience in Building Data Governance Solutions like Unity Catalog, Azure Purview etc.Highly experienced in Usability Optimization...