Senior Data Engineer with PySpark

7 months ago


Charlotte, United States Diverse Lynx Full time
Senior Data Engineer with PySpark- Day 1 onsite (3 days per week)
Locations - Mt Laurel, NJ / Charlotte, NC
Fulltime/Contract

Experience: 10-12+ Years

Primary Tech skills - Databricks, Pyspark, Azure SQL, ADF
Secondary Tech skills - Azure, SAS, Synapse,
• Experience in building end to end architecture for Data Lakes, Data Warehouses and Data Marts
• Experience of DWH, Data Integration, Cloud, Architecture, Design, Data Modelling
• Hands-on experience in Pyspark is a must.
• Experience working with structured and unstructured data.
• Extensive knowledge of ETL and Data Warehousing concepts, strategies, methodologies
• Experience in data ingestion, preparation, integration, and operationalization techniques in optimally addressing the data requirements.
• Experience in relational data processing technology like MS SQL, Delta Lake, Spark SQL, SQL Server
• Experience with Orchestration tools and GitHub
• Experience to own end-to-end development, including coding, testing, debugging and deployment.
• Must be team oriented with strong communication, collaboration, prioritization, and adaptability skill
• Need to be an individual performer as well as a Lead.

Diverse Lynx LLC is an Equal Employment Opportunity employer. All qualified applicants will receive due consideration for employment without any discrimination. All applicants will be evaluated solely on the basis of their ability, competence and their proven capability to perform the functions outlined in the corresponding role. We promote and support a diverse workforce across all levels in the company.

  • Charlotte, United States CV Library Full time

    Senior Data Engineer with PySpark Day 1 onsite (3 days per week)Locations Mt Laurel, NJ / Charlotte, NCFulltime/ContractExperience: 10-12+ YearsPrimary Tech skills Databricks, Pyspark, Azure SQL, ADFSecondary Tech skills Azure, SAS, Synapse," Experience in building end to end architecture for Data Lakes, Data Warehouses and Data Marts" Experience of DWH,...

  • Lead Data Engineer

    2 months ago


    Charlotte, United States Aloden, Inc. Full time

    Lead Data Engineer - Python/Pyspark Locations: Charlotte, NC Work Authorization: W2 only Must-Have Skills for Leads (2 positions): Python & PySpark: Strong proficiency in both Python and PySpark (70% PySpark, 30% Java focus). Java: Solid understanding and experience in Java development. Must-Have Skills for Other Engineers (3 positions): Python & PySpark:...

  • Pyspark Data Engineer

    2 months ago


    Charlotte, United States Syntricate Technologies Full time

    Required Skills: CICD, using GitHub, Jenkin, Python, Hadoop with PySpark, SQL. Work on Pyspark Framework to ingest data from different sources system to Hadoop and SQL Server regions. Sound knowledge in Python and Good to have enough knowledge in Scala. Strong experience in database migration to MS SQL Server/Hadoop Extensive experience in database...

  • Data Engineer

    1 day ago


    Charlotte, United States Compunnel Inc. Full time

    Detailed Job Description:We are currently seeking a Senior Data Engineer with hands-on coding experience and a strong background in Python, PySpark, and Object-oriented programming. The ideal candidate will be responsible for designing, developing, and implementing new features to our existing framework using PySpark and Python. This position requires a deep...

  • Data Engineer

    1 day ago


    Charlotte, United States Compunnel Inc. Full time

    Detailed Job Description:We are currently seeking a Senior Data Engineer with hands-on coding experience and a strong background in Python, PySpark, and Object-oriented programming. The ideal candidate will be responsible for designing, developing, and implementing new features to our existing framework using PySpark and Python. This position requires a deep...


  • Charlotte, North Carolina, United States Randstad Digital Full time

    Randstad Digital is a dynamic and innovative company that offers exciting opportunities for growth and development.We are offering a competitive salary range of $120,000 - $160,000 per year for this position.Job Overview:As a Senior Data Engineer at Randstad Digital, you will play a key role in shaping the future of our company by designing, developing, and...


  • Charlotte, North Carolina, United States CV Library Full time

    Company Overview">Diverse Lynx LLC is an equal opportunity employer committed to fostering a diverse workforce. We promote and support a diverse workforce across all levels in the company.Job Summary">We are looking for a seasoned Senior Data Engineer with PySpark expertise to lead our data engineering efforts. As a senior engineer, you will be responsible...

  • Data Engineer

    2 weeks ago


    Charlotte, United States Compunnel Inc. Full time

    Data EngineerCharlotte, NC- HybridMandatory: Python with Object oriented concepts, Spark, Problem-Solving ability, Effective communicationGood to have: AWS.Detailed Job Description:We are currently seeking a Senior Data Engineer with hands-on coding experience and a strong background in Python, PySpark, and Object-oriented programming. The ideal candidate...

  • Data Engineer

    2 weeks ago


    Charlotte, United States Compunnel Inc. Full time

    Data EngineerCharlotte, NC- HybridMandatory: Python with Object oriented concepts, Spark, Problem-Solving ability, Effective communicationGood to have: AWS.Detailed Job Description:We are currently seeking a Senior Data Engineer with hands-on coding experience and a strong background in Python, PySpark, and Object-oriented programming. The ideal candidate...

  • Data Engineer

    1 day ago


    Charlotte, United States Compunnel Inc. Full time

    Data EngineerCharlotte, NC- HybridMandatory: Python with Object oriented concepts, Spark, Problem-Solving ability, Effective communicationGood to have: AWS.Detailed Job Description:We are currently seeking a Senior Data Engineer with hands-on coding experience and a strong background in Python, PySpark, and Object-oriented programming. The ideal candidate...

  • Data Engineer Lead

    2 days ago


    Charlotte, North Carolina, United States Compunnel Inc. Full time

    About UsAt Compunnel Inc., we are currently seeking a Senior Data Engineer to join our team in Charlotte, NC. The ideal candidate will be responsible for designing, developing, and implementing new features to our existing framework using PySpark and Python.Key Responsibilities:Design and develop new features to our existing framework using PySpark and...


  • Charlotte, North Carolina, United States Aloden, Inc. Full time

    Aloden, Inc. is looking for a seasoned Senior Data Engineering Manager to lead our big data solutions team in Charlotte, NC.The successful candidate will have expertise in designing, implementing, and maintaining large-scale data systems using PySpark and Java.The estimated salary for this position is $145,000 - $165,000 per year.Responsibilities include...


  • charlotte, United States Compunnel Inc. Full time

    Data EngineerCharlotte, NC- HybridMandatory: Python with Object oriented concepts, Spark, Problem-Solving ability, Effective communicationGood to have: AWS.Detailed Job Description:We are currently seeking a Senior Data Engineer with hands-on coding experience and a strong background in Python, PySpark, and Object-oriented programming. The ideal candidate...


  • Charlotte, North Carolina, United States Syntricate Technologies Full time

    Job Title: Big Data Developer with Pyspark Expertise\\ At Syntricate Technologies, we are seeking a highly skilled Big Data Developer with Pyspark Expertise to join our team. As a key member of our big data team, you will play a crucial role in designing, developing, and implementing large-scale data processing systems using Pyspark and Hadoop...


  • Charlotte, North Carolina, United States Randstad Full time

    Financial Data Development OpportunityAre you a highly skilled Financial Data Developer looking for a new challenge? Do you have experience with PySpark, Python, and Dremio? We are seeking a talented individual to join our team in Charlotte, North Carolina as a Senior Financial Data Developer.Job ResponsibilitiesAs a Senior Financial Data Developer, you will...

  • Senior Data Engineer

    4 weeks ago


    Charlotte, United States CV Library Full time

    Senior Data EngineerLocation: Charlotte, NC/HybridDuration: 1 year with Possible Contract to hireDescription:Key Responsibilities:Translates complex cross-functional business requirements and functional specifications into logical program designs, code modules, stable application systems, and data solutions; partners with Product Team to understand business...

  • Data Scientist

    3 weeks ago


    Charlotte, North Carolina, United States Randstad Digital Full time

    We are Randstad Digital, a leading digital transformation company.Our estimated salary for this position is $150,000 - $180,000 per year.Job Description:We are seeking an experienced Senior Data Engineer to join our team in designing, developing, and implementing new features to our existing framework using PySpark and Python.This role requires a strong...


  • Charlotte, North Carolina, United States Insight Global Full time

    Job Overview:We are seeking an experienced Data Engineer to join our team at Insight Global. As a key member of our data engineering team, you will be responsible for designing, developing, and maintaining large-scale data systems using Python and Pyspark.About the Role:This is a unique opportunity to work on complex data engineering projects and develop...

  • Lead Data Engineer

    2 days ago


    Charlotte, United States Irvine Technology Corporation Full time

    Position: Lead Data Engineer (Azure, Snowflake, ETL, PySpark)Location: Local Remote in Charlotte, NCWork Model: Remote on EST HoursDuration: Contract to Permanent Full Time Hire (6 month CTH)Hourly Rate: 62/hr to 68/hr (W2 or Corp to Corp)Must Haves: Azure, Snowflake, ETL, PySparkWhat You Will Do:Provide day-to-day technical leadership for key company...

  • Lead Data Engineer

    1 day ago


    Charlotte, United States Irvine Technology Corporation Full time

    Position: Lead Data Engineer (Azure, Snowflake, ETL, PySpark)Location: Local Remote in Charlotte, NCWork Model: Remote on EST HoursDuration: Contract to Permanent Full Time Hire (6 month CTH)Hourly Rate: 62/hr to 68/hr (W2 or Corp to Corp)Must Haves: Azure, Snowflake, ETL, PySparkWhat You Will Do:Provide day-to-day technical leadership for key company...