Senior Data Integration Specialist with PySpark

3 weeks ago


Minneapolis, Minnesota, United States Diverse Lynx Full time
Job Description:

Diverse Lynx LLC is seeking a highly skilled Senior Data Integration Specialist to lead our data pipelining efforts using PySpark. As a key member of our team, you will design, develop, and maintain efficient ETL processes to support data integration and business intelligence initiatives.

Responsibilities:
  • Work closely with stakeholders to understand data requirements and ensure efficient data flow and transformation using ETL tools and PySpark.
  • Develop and implement ETL processes using AWS Glue and PySpark to extract, transform, and load data.
  • Collaborate with a scrum team(s) to deliver product stories according to priorities set by the business and the Product Owners.

Requirements:
  • 4+ years of experience in ETL development with knowledge on PySpark.
  • 5+ years as an ETL Developer SQL expert AWS Glue WITH Python (PySpark) PySpark Data frame API Spark SQL.
  • Knowledge in AWS services (e.g., DMS, S3, RDS, Redshift, Step Function).

Estimated Salary: $120,000 - $150,000 per year

  • Minneapolis, Minnesota, United States Diverse Lynx Full time

    Job Description:Data Integration SpecialistThe Role: As a Data Integration Specialist at Diverse Lynx, you will be responsible for designing, developing, and maintaining ETL processes to support data integration and business intelligence initiatives. You will work closely with stakeholders to understand data requirements and ensure efficient data flow and...


  • Minneapolis, Minnesota, United States K&K Global Talent Solutions Inc. Full time

    Job OverviewWe are seeking a highly skilled Lead Data Integration Engineer to join our team at K&K Global Talent Solutions Inc. in this key role, you will be responsible for designing, developing, and maintaining ETL processes to support data integration and business intelligence initiatives.About the RoleThis is a full-time position with an estimated salary...


  • Minneapolis, Minnesota, United States Accuro Group Full time

    We are seeking a highly skilled Data Integration Lead to join our team at Accuro Group in Minneapolis, MN. The ideal candidate will have 10+ years of experience in ETL development and a strong background in PySpark.Job DescriptionRole: Data Integration Lead with SparkLocation: Minneapolis, MN (Onsite)Experience: 10+ YearsDuration: Long-term contractJob...


  • Minneapolis, Minnesota, United States Diverse Lynx Full time

    Job Overview:We are looking for a highly experienced PySpark ETL Developer Lead to join our team at Diverse Lynx LLC. As a key member of our data pipelining team, you will be responsible for designing, developing, and maintaining efficient ETL processes using AWS Glue and PySpark.Key Responsibilities:Design and develop ETL processes using AWS Glue and...


  • Minneapolis, Minnesota, United States Futran Tech Solutions Pvt. Ltd. Full time

    Job Description: We are looking for a skilled Azure Tech Lead with expertise in Pyspark to join our team at Futran Tech Solutions Pvt. Ltd. The ideal candidate will have hands-on experience in designing, implementing, and managing big data integration solutions using Azure and Apache Spark.The estimated salary for this role is $130-135K, which includes a...

  • Senior Consultant

    3 weeks ago


    Minneapolis, Minnesota, United States Futran Tech Solutions Pvt. Ltd. Full time

    About the CompanyFutran Tech Solutions Pvt. Ltd. is a leading provider of big data solutions for clients across various industries. We are seeking a highly skilled Senior Consultant - Big Data Solutions to join our team. As a Senior Consultant, you will work with our team to deliver cutting-edge big data solutions for clients. You should have good knowledge...

  • Senior Data Engineer

    3 weeks ago


    Minneapolis, Minnesota, United States Futran Tech Solutions Pvt. Ltd. Full time

    Futran Tech Solutions Pvt. Ltd. is seeking a highly skilled Senior Data Engineer - Cloud Computing to lead our team in designing, implementing, and maintaining large-scale cloud-based data engineering solutions.The ideal candidate will have extensive experience with Pyspark, Spark SQL programming, and expertise in Azure services such as ADLS Gen2, AZ copy,...


  • Minneapolis, Minnesota, United States Futran Tech Solutions Pvt. Ltd. Full time

    Job Title: Cloud Engineering Lead for Big Data IntegrationWe are seeking an experienced Cloud Engineering Lead to join our team at Futran Tech Solutions Pvt. Ltd. The ideal candidate will have hands-on experience in designing, implementing, and managing big data integration solutions using Azure and Apache Spark.The estimated salary for this role is...


  • Minneapolis, Minnesota, United States Associated Bank National Full time

    Job Overview: Associated Bank National seeks a highly skilled Senior Data Scientist to drive business growth through data-driven decision making. As a Senior Data Scientist, you will lead the development of advanced predictive models to drive personalized banking experiences and possess expert proficiency in contemporary visualization platforms such as...


  • Minneapolis, Minnesota, United States Diverse Lynx Full time

    Job DescriptionWe are looking for a skilled Data Scientist to join our team at Diverse Lynx LLC. The successful candidate will have a strong background in data science and AI, with experience in Python, PySpark, and SQL.About the RoleThis is an excellent opportunity for a talented Data Scientist to work on challenging projects and contribute to the growth of...


  • Minneapolis, Minnesota, United States Diverse Lynx Full time

    Job Title: Senior MuleSoft Integration SpecialistThe ideal candidate will have a strong understanding of the MuleSoft AnyPoint Platform and experience with designing, implementing, and integrating APIs using this platform. Responsibilities include: Developing and maintaining API integrations using MuleSoft's Anypoint Platform Migrating existing APIs to...


  • Minneapolis, Minnesota, United States Saxon Global Full time

    Job Summary:Saxon Global seeks a highly skilled Senior System Integration Specialist to lead the development of our Customer Onboarding capabilities. This individual will work closely with cross-functional teams to design, implement, and maintain robust integration architecture.Key Responsibilities:Maintain and communicate application architecture for...


  • Minneapolis, Minnesota, United States IPG Photonics Full time

    Job OverviewIPG Photonics is revolutionizing the laser industry with innovative solutions and a pioneering spirit. As a Senior Laser Systems Integration Specialist, you will play a crucial role in developing cutting-edge laser systems that transform industries.The IPG team is committed to attracting and retaining top talent, fostering a diverse and inclusive...


  • Minneapolis, Minnesota, United States Zoll Data Systems Full time

    Job DescriptionWe are seeking a highly motivated and experienced Implementation Specialist to join our team at ZOLL Data Systems. As a key member of our Customer Success Organization, you will be responsible for developing and executing effective training plans, collaborating with clients, and ensuring a successful implementation...

  • Data Scientist

    3 weeks ago


    Minneapolis, Minnesota, United States Diverse Lynx Full time

    Job Title: Data ScientistWe are seeking a highly skilled Data Scientist to join our team at Diverse Lynx LLC. The ideal candidate will have 8+ years of experience in Python, with 2+ years of experience in Pyspark and SQL.Key Responsibilities:Develop and implement data science solutions using Python, Pyspark, and SQL.Collaborate with the ETL team to build...


  • Minneapolis, Minnesota, United States Diverse Lynx Full time

    About the RoleWe are seeking an exceptional Azure Data Brick engineer to spearhead our data transformation journey. As a key member of our team, you will be responsible for crafting data ingestion pipelines and orchestrating processes within our organization. Your expertise in Azure Databricks, ADF, and Unity catalog will enable us to effectively manage data...


  • Minneapolis, Minnesota, United States Cynet Systems Full time

    Job DescriptionAs an experienced Azure Data Engineer, you will play a key role in designing, implementing, and managing data pipelines using Databricks (PySpark) for data ingestion, processing, and analysis. Your expertise in Azure Data Factory (ADF) will enable you to orchestrate data workflows and ETL processes efficiently. Additionally, you will be...


  • Minneapolis, Minnesota, United States Futran Tech Solutions Pvt. Ltd. Full time

    About the RoleAs a Senior Consultant - Big Data Solutions at Futran Tech Solutions Pvt. Ltd., you will work with our team to deliver cutting-edge big data solutions for clients across various industries. The ideal candidate should have good knowledge of basic big data concepts, including Hive and SQL, as well as hands-on experience with Spark, Scala, or...


  • Minneapolis, Minnesota, United States KPMG Full time

    About the RoleWe are looking for a highly experienced Senior Data Architecture Specialist to oversee and support projects across multiple applications and technologies. As a key member of our team, you will be responsible for designing and implementing data pipelines with scalable transformations that ingest data to the Azure Data Lake.


  • Minneapolis, Minnesota, United States Associated Bank National Full time

    About This Opportunity:We are seeking a highly skilled Senior Data Scientist to join our team at Associated Bank National. As a Senior Data Scientist, you will be responsible for leading the development of advanced predictive models to drive personalized banking experiences, developing and implementing strategic quantitative analytic methods that obtain...