Pyspark Data Engineer

3 days ago


Charlotte, North Carolina, United States Syntricate Technologies Full time

Job Summary:

We are seeking a highly skilled Pyspark Data Engineer to join our team at Syntricate Technologies. The ideal candidate will have a strong background in Pyspark, Hadoop, and SQL, with experience in ingesting data from various sources and migrating databases to MS SQL Server/Hadoop.

Key Responsibilities:

  • Design and implement Pyspark data pipelines to ingest data from different sources into Hadoop and SQL Server regions.
  • Develop and maintain scalable and efficient Pyspark applications using Python and Scala.
  • Collaborate with cross-functional teams to ensure smooth database migrations and query tuning.
  • Provide technical guidance and support to team members on Pyspark and database-related issues.
  • Stay up-to-date with industry trends and best practices in Pyspark, Hadoop, and SQL.

Requirements:

  • Strong experience with Pyspark, Hadoop, and SQL.
  • Excellent Python and Scala programming skills.
  • Good understanding of database architecture and query optimization.
  • Ability to work in a team environment and provide technical guidance.
  • Strong communication and problem-solving skills.

Preferred Qualifications:

  • Experience with CICD pipelines using GitHub, Jenkins, and Liquibase.
  • Knowledge of RDBMS architecture and T-SQL query optimization.
  • Experience with data migration from Hadoop to CDP.


  • Charlotte, North Carolina, United States CV Library Full time

    Job Summary: We are seeking a highly skilled Senior Data Engineer with expertise in PySpark to join our team. The ideal candidate will have a strong background in data engineering, with experience in designing and implementing large-scale data pipelines using PySpark. Key Responsibilities: * Design and implement data pipelines using PySpark * Collaborate...


  • Charlotte, North Carolina, United States Aloden, Inc. Full time

    Job SummaryWe are seeking a skilled Python/Pyspark/Oracle Developer to join our team in Charlotte, NC. In this role, you will leverage your expertise in Python, Pyspark, and Oracle to develop and maintain critical data processing and analysis solutions. You will work closely with other developers, data engineers, and business stakeholders to design,...


  • Charlotte, North Carolina, United States Collabera Full time

    Job SummaryWe are seeking a highly skilled Python/PySpark Specialist to join our team at Collabera. The ideal candidate will have a strong background in software engineering and experience working with Python/PySpark development. Key Responsibilities* Develop and maintain large-scale data processing pipelines using Python/PySpark* Collaborate with...

  • PySpark Architect

    6 days ago


    Charlotte, North Carolina, United States Cynet Systems Full time

    Job Title: PySpark ArchitectWe are seeking a highly skilled PySpark Architect to join our team at Cynet Systems in Charlotte, NC.Job SummaryThe successful candidate will lead the architecture, design, and implementation of large-scale distributed data systems using PySpark. They will collaborate with business stakeholders, technology teams, and data...

  • PySpark Architect

    5 days ago


    Charlotte, North Carolina, United States Lorven technologies Full time

    Job Title: PySpark ArchitectLorven Technologies is seeking a highly skilled PySpark Architect to lead the design and implementation of large-scale distributed data systems.Key Responsibilities:Design and implement high-performance, distributed data processing systems using PySpark.Collaborate with cross-functional teams to gather requirements and build...

  • PySpark Architect

    6 days ago


    Charlotte, North Carolina, United States Lorven Technologies, Inc. Full time

    Job Title: Data Engineering LeaderLocation: Charlotte, NCDuration: ContractJob Description:The ideal candidate will have 10+ years of experience in software architecture, data engineering, and large-scale data processing systems, with a strong focus on PySpark. Experience in Finance Technology or Enterprise Function technology domains will be a significant...


  • Charlotte, North Carolina, United States JobRialto Full time

    Job SummaryThe Senior Data Engineer is responsible for designing, developing, and implementing new features using Python and PySpark within the company's data framework.This role involves solving complex data transformation problems, writing standalone scripts based on business logic, and collaborating with the team to ensure solutions align with the...

  • Big Data Engineer

    2 days ago


    Charlotte, North Carolina, United States Diverse Lynx Full time

    Job Title: Data EngineerJob Summary: We are seeking a highly skilled Data Engineer to join our team at Diverse Lynx LLC. The successful candidate will have expertise in Big Data technologies, including Hadoop, Spark, and Scala. They will be responsible for designing, developing, and maintaining large-scale data processing systems, as well as providing...


  • Charlotte, North Carolina, United States TechnoGen Full time

    Job Title: Data Engineer/Database DeveloperTechnoGen is seeking a highly skilled Data Engineer/Database Developer to join our team. The ideal candidate will have a strong background in designing and developing data integration solutions that deliver business value.Key Responsibilities:Design and develop data integration solutions using Python, Pyspark, and...


  • Charlotte, North Carolina, United States Saxon Global Full time

    Job Title: Senior Data Engineer - Cloud ETL SpecialistAt Saxon Global, we are seeking a highly skilled Senior Data Engineer to join our team. The ideal candidate will have hands-on experience in Python and SQL using AWS Cloud to build robust ETL pipelines. The successful candidate will participate in agile team meetings, analyze requirements, design, and...


  • Charlotte, North Carolina, United States Insight Global Full time

    Job Title: Lead Azure Data EngineerJob Summary:We are seeking an experienced Lead Azure Data Engineer to join our team at Insight Global. As a key member of our data engineering team, you will be responsible for designing, developing, and implementing data solutions within Azure to empower our organization to derive actionable insights from intricate...


  • Charlotte, North Carolina, United States Insight Global Full time

    Azure Data Engineering ManagerWe are seeking an experienced Azure Data Engineering Manager to lead our team in designing, developing, and implementing data solutions that empower our organization to make informed decisions.As a key member of our data engineering team, you will be responsible for guiding a team of data engineers, collaborating with...

  • Big Data Architect

    21 hours ago


    Charlotte, North Carolina, United States Collabera Full time

    Key Responsibilities:As a Big Data Engineer at Collabera, you will be responsible for designing, developing, and implementing big data architectures using Hadoop and related technologies. Your expertise in MapR, Scala, PySpark, and Java will be crucial in delivering ETL, data warehouse, and data analytics capabilities.Requirements:* 3+ years of experience in...


  • Charlotte, North Carolina, United States Insight Global Full time

    Job SummaryWe are seeking a highly skilled Senior Data Engineer to join our team at Insight Global. As a key member of our data engineering team, you will be responsible for designing, building, and maintaining large-scale data pipelines and architectures.Your primary focus will be on developing and implementing data solutions that empower our organization...


  • Charlotte, North Carolina, United States Aloden, Inc. Full time

    Software Engineer -.NET Full Stack with ETL and Data Modeling ExpertiseAloden, Inc. is seeking a skilled Software Engineer to join our team in Charlotte, NC. As a hybrid employee, you will work 3 days onsite and 2 days from home.Responsibilities:Participate in and consult on moderately complex software engineering initiatives and deliverables.Contribute to...


  • Charlotte, North Carolina, United States Aloden, Inc. Full time

    About the RoleWe are seeking a highly skilled Senior Software Engineer to join our team at Aloden, Inc. as a Data Modeling and ETL Expert. This is a 12+ month contract opportunity that will allow you to leverage your expertise in software engineering, data modeling, and ETL processes to drive business growth and innovation.Key ResponsibilitiesParticipate in...

  • AWS Data Engineer

    6 days ago


    Charlotte, North Carolina, United States Brooksource Full time

    Job Title: AWS Data EngineerWe are seeking an experienced AWS Data Engineer to join our team at Brooksource. As a key member of our data engineering team, you will be responsible for designing, building, and maintaining large-scale data processing systems on AWS.Responsibilities:Design and implement data pipelines using AWS services such as S3, EMR, Glue...

  • AWS Data Engineer

    2 days ago


    Charlotte, North Carolina, United States Eliassen Group Full time

    Job DescriptionOur client, a leader in their industry, has an excellent opportunity for an AWS Data Engineer to work on a 36-month contract position in Charlotte, NC.Due to client requirement, applicants must be willing and able to work on a w2 basis. For our w2 consultants, we offer a great benefits package that includes Medical, Dental, and Vision...


  • Charlotte, North Carolina, United States HexaQuEST Global, Inc. Full time

    Job Requirements:As a skilled Database Systems Engineer, you will be responsible for designing, implementing, and maintaining large-scale data warehouses and informatics systems. You will work closely with our team to develop and implement data integration and ETL processes using Python and Informatica tools. A strong background in SQL and data modeling is...

  • AWS Data Engineer

    5 days ago


    Charlotte, North Carolina, United States Brooksource Full time

    Job Title: AWS Data EngineerLocation: Charlotte, NC (Hybrid 2-3 days a week on site)Contract Details: 3-year contract with opportunity for extension or full-time hireEmployment Type: W-2 Only, No Corp-to-Corp or 1099Brooksource is seeking an experienced AWS Data Engineer to join our Fortune 500 Energy & Utilities client in Charlotte,...