Senior Data Engineer with PySpark

5 days ago


Charlotte, North Carolina, United States Diverse Lynx Full time
Job Title: Senior Data Engineer with PySpark

Job Description:

We are seeking a highly experienced Senior Data Engineer with expertise in PySpark to lead our data engineering team. The ideal candidate will have a strong background in designing and implementing large-scale data architectures, including data lakes, data warehouses, and data marts.

Responsibilities:

* Design and implement end-to-end data architectures for data lakes, data warehouses, and data marts
* Develop and maintain large-scale data processing pipelines using PySpark
* Collaborate with cross-functional teams to integrate data engineering solutions with business applications
* Ensure data quality, security, and compliance with regulatory requirements

Requirements:

* 10+ years of experience in data engineering with a focus on PySpark
* Strong background in data architecture design and implementation
* Experience with cloud-based data platforms, including Azure
* Excellent communication and leadership skills

About Us:

Diverse Lynx LLC is an Equal Employment Opportunity employer. We promote and support a diverse workforce across all levels in the company.

  • Charlotte, North Carolina, United States Syntricate Technologies Full time

    Job SummaryWe are seeking a highly skilled Pyspark Data Engineer to join our team at Syntricate Technologies. The ideal candidate will have extensive experience in designing, implementing, and maintaining large-scale data processing systems using Pyspark and Hadoop. Key responsibilities include working on Pyspark frameworks to ingest data from various...


  • Charlotte, North Carolina, United States Randstad Digital Full time

    We're looking for an experienced Data Transformation Specialist to join our team at Randstad Digital. If you have a strong background in Python, PySpark, and object-oriented programming, we'd love to hear from you.In this role, you'll design, develop, and implement new features to our existing framework using PySpark and Python. You'll work collaboratively...


  • Charlotte, North Carolina, United States ApTask Full time

    About This Role:Candidates for the Senior Data Engineer - Big Data Hadoop position at ApTask will be responsible for designing, developing, and implementing large-scale data processing systems using Big Data Hadoop. The ideal candidate will have experience working with big data technologies, including Hadoop, PySpark, and Teradata, and will be able to...


  • Charlotte, North Carolina, United States Randstad Digital Full time

    We are Randstad Digital, a leading provider of digital solutions. We are seeking a highly skilled Senior Data Engineer to join our team.Estimated Salary: $140,000 - $180,000 per yearJob Description:As a Senior Data Engineer at Randstad Digital, you will play a critical role in designing, developing, and implementing new features to our existing framework...


  • Charlotte, North Carolina, United States Aloden, Inc. Full time

    Job Title: Lead Data EngineerJob Summary:We are seeking a highly skilled Lead Data Engineer to join our team at Aloden, Inc. This is an exciting opportunity to work with cutting-edge technologies and contribute to the development of our data infrastructure. As a Lead Data Engineer, you will be responsible for designing, developing, and maintaining data...


  • Charlotte, North Carolina, United States Diverse Lynx Full time

    Job DescriptionWe are seeking an experienced Data Engineer to join our team at Diverse Lynx LLC. As a key member of our data engineering group, you will design, build, and maintain large-scale data processing systems using big data technologies such as Spark, Scala, and PySpark.The ideal candidate will have a strong background in big data, including...


  • Charlotte, North Carolina, United States Randstad Digital Full time

    At Randstad Digital, we're currently seeking a highly skilled Senior PySpark Engineer to join our team. With a strong background in Python and object-oriented programming, you'll be responsible for designing and developing new features to our existing framework using PySpark and Python.The ideal candidate will have hands-on coding experience with PySpark,...


  • Charlotte, North Carolina, United States Matlen Silver Full time

    Job Summary:We are seeking a highly skilled Senior Data Engineer to lead the design and development of warehousing domain data interfaces at Matlen Silver. This is a hands-on role that involves collaborating with cross-functional teams, defining canonical data models, and driving innovative solutions.About the Role:As a Senior Data Engineer, you will play a...


  • Charlotte, North Carolina, United States Aloden, Inc. Full time

    Job Title: Senior Technology and Data EngineerJob Summary:We are seeking a highly skilled Senior Technology and Data Engineer to join our team at Aloden, Inc. As a key member of our engineering team, you will be responsible for developing and implementing innovative technology solutions to drive business growth and improve operational efficiency.Key...

  • Big Data Engineer

    1 day ago


    Charlotte, North Carolina, United States Atlantis IT group Full time

    About the RoleAt Atlantis IT group, we are seeking an experienced Big Data Engineer to join our team in Charlottte. This is a full-time W2 position that requires US citizenship or a Green Card.We need someone with expertise in Hadoop, Python, and Spark, as well as Pyspark and custom-built Spark SQL. MapR experience is preferred, but Hortonworks and Cloudera...


  • Charlotte, North Carolina, United States Matlen Silver Full time

    About the Role:As a Senior Data Solutions Architect at Matlen Silver, you will play a key role in shaping our data architecture and delivering impactful data solutions. This is a hands-on role that involves collaborating with cross-functional teams, defining canonical data models, and driving innovative solutions.Key Responsibilities:Design and implement...


  • Charlotte, North Carolina, United States Genesis10 Full time

    Data Engineer Role We are seeking an experienced Data Engineer to join our team at a leading financial institution in Charlotte, NC. As a Data Engineer, you will be responsible for designing, developing, and maintaining large-scale data processing systems using Python and Big Data technologies. The ideal candidate will have 5+ years of experience with...


  • Charlotte, North Carolina, United States Genesis10 Full time

    Job OverviewGenesis10 is currently seeking a highly skilled Python/Big Data Engineer to join our client in the financial industry in Charlotte, NC. This 12+ month contract position offers an exciting opportunity to leverage your expertise in developing innovative data solutions.About the RoleAs a Data Engineering Specialist, you will be responsible for...


  • Charlotte, North Carolina, United States Pantheon Data Full time

    Job OverviewPantheon Data is a private, small business based in the Washington, DC area.We are seeking a skilled Data Engineer with expertise in designing data-centric technical solutions.The ideal candidate will have hands-on experience with data modeling, data warehousing, and ETL pipelines.Analyze customer technology landscapes, business processes, and...


  • Charlotte, North Carolina, United States Pantheon Data Full time

    Job OverviewPantheon Data, a private company based in the Washington, DC area, is seeking an experienced Chief Data Systems Engineer.We are looking for someone to design and develop software applications that drive our business forward. Our ideal candidate will have experience working with embedded systems, data warehouses, and ETL...


  • Charlotte, North Carolina, United States Pantheon Data Full time

    At Pantheon Data, we are seeking a seasoned Senior Deep Learning Engineer to join our team of innovators in the field of Intelligent Document Processing (IDP). As a key member of our engineering team, you will be responsible for developing and implementing cutting-edge solutions that leverage Optical Character Recognition (OCR), Natural Language Processing...


  • Charlotte, North Carolina, United States TechnoGen Full time

    Job Title: Senior Data Engineering ManagerJob Summary:We are seeking a Senior Data Engineering Manager to lead our data engineering team at TechnoGen. The ideal candidate will have 12+ years of experience in data engineering and a strong background in SQL, Python, and Spark programming languages.Key Responsibilities:Lead multiple teams and drive technical...


  • Charlotte, North Carolina, United States Aloden, Inc. Full time

    Software Engineer - .Net Full Stack with ETL and Data Modeling ExpertiseLocation: Charlotte, NC (Hybrid)Duration: 12+ Months ContractResponsibilities:Participate in and consult on moderately complex software engineering initiatives and deliverables.Contribute to large-scale planning efforts related to software engineering projects.Review and analyze...


  • Charlotte, North Carolina, United States Pantheon Data Full time

    Job Title: Cloud Data EngineerAbout Us:Pantheon Data is a private company based in the Washington, DC area. Founded in 2011, we have grown to offer various services including infrastructure resiliency, contact center operations, and software engineering. Our customer base includes commercial clients and federal agencies.Position Overview:We are seeking an...


  • Charlotte, North Carolina, United States Manpower Group Inc. Full time

    **Job Title:** Senior Data EngineerWe are seeking a highly skilled Senior Data Engineer to join our team at Manpower Group Inc. As a Senior Data Engineer, you will be responsible for designing, implementing, and maintaining large-scale data systems, including data pipelines, data warehouses, and data lakes.The ideal candidate will have a strong background in...