Python/pyspark/aws data engineer

4 weeks ago

Charlotte, United States Randstad Full time

job summary:
***ONSITE ROLE: MUST BE LOCAL TO CHARLOTTE, NC***

Job Description:

We are currently seeking a Senior Data Engineer with hands-on coding experience and a strong background in Python, PySpark, and Object-oriented programming. The ideal candidate will be responsible for designing, developing, and implementing new features to our existing framework using PySpark and Python. This position requires a deep understanding of data transformation and the ability to create standalone scripts based on given business logic.

location: Charlotte, North Carolina
job type: Contract
salary: $55 - 63 per hour
work hours: 8am to 4pm
education: Bachelors

responsibilities:
Detailed Job Description:

We are currently seeking a Senior Data Engineer with hands-on coding experience and a strong background in Python, PySpark, and Object-oriented programming. The ideal candidate will be responsible for designing, developing, and implementing new features to our existing framework using PySpark and Python. This position requires a deep understanding of data transformation and the ability to create standalone scripts based on given business logic.

Responsibilities:

  • Design, develop and implement new features to our existing framework using PySpark and Python.

  • Write efficient and effective standalone scripts in PySpark with transformations as per the defined business logic.

  • Use your expertise in Python and Object-oriented concepts to solve complex problems and implement robust solutions.

  • Work closely with the team to understand the requirements and develop solutions that align with the company's objectives.

  • Test and debug code to ensure it produces the desired results.

  • Document all programming tasks and procedures for future reference and troubleshooting.
Qualifications:

  • Proficient in Python, PySpark, and Object-oriented programming concepts.

  • Proven experience as a Senior Data Engineer or similar role.

  • strong problem-solving techniques with an ability to troubleshoot complex software issues.

  • Experience with AWS is preferred, but not mandatory.

  • Excellent communication skills, both written and verbal.

  • Self-motivated and able to work independently with minimal supervision.
qualifications:
  • Experience level: Experienced
  • Minimum 5 years of experience
  • Education: Bachelors (required)

skills: Python (5 years of experience is required) PySpark (5 years of experience is required) Object Oriented Programming (5 years of experience is required) AWS Cloud Formation (3 years of experience is preferred) SQL (3 years of experience is required) Data Warehouse (6 years of experience is required) ETL (6 years of experience is required)

Equal Opportunity Employer: Race, Color, Religion, Sex, Sexual Orientation, Gender Identity, National Origin, Age, Genetic Information, Disability, Protected Veteran Status, or any other legally protected group status.

At Randstad Digital, we welcome people of all abilities and want to ensure that our hiring and interview process meets the needs of all applicants. If you require a reasonable accommodation to make your application or interview experience a great one, please contact HRsupport@randstadusa.com.

Pay offered to a successful candidate will be based on several factors including the candidate's education, work experience, work location, specific job duties, certifications, etc. In addition, Randstad Digital offers a comprehensive benefits package, including health, an incentive and recognition program, and 401K contribution (all benefits are based on eligibility).

This posting is open for thirty (30) days.

  • Lead Data Engineer

    4 weeks ago

    Charlotte, United States Aloden, Inc. Full time

    Lead Data Engineer - Python/Pyspark Locations: Charlotte, NC Work Authorization: W2 only Must-Have Skills for Leads (2 positions): Python & PySpark: Strong proficiency in both Python and PySpark (70% PySpark, 30% Java focus). Java: Solid understanding and experience in Java development. Must-Have Skills for Other Engineers (3 positions): Python & PySpark:...

  • Data Engineer

    12 hours ago

    Charlotte, United States Compunnel Inc. Full time

    Data EngineerCharlotte, NC- HybridMandatory: Python with Object oriented concepts, Spark, Problem-Solving ability, Effective communicationGood to have: AWS.Detailed Job Description:We are currently seeking a Senior Data Engineer with hands-on coding experience and a strong background in Python, PySpark, and Object-oriented programming. The ideal candidate...

  • Pyspark Data Engineer

    4 weeks ago

    Charlotte, United States Syntricate Technologies Full time

    Required Skills: CICD, using GitHub, Jenkin, Python, Hadoop with PySpark, SQL. Work on Pyspark Framework to ingest data from different sources system to Hadoop and SQL Server regions. Sound knowledge in Python and Good to have enough knowledge in Scala. Strong experience in database migration to MS SQL Server/Hadoop Extensive experience in database...

  • Senior Data Engineering Specialist

    4 weeks ago

    Charlotte, North Carolina, United States Randstad Digital Full time

    We are Randstad Digital, a leading provider of digital solutions. We are seeking a highly skilled Senior Data Engineer to join our team.Estimated Salary: $140,000 - $180,000 per yearJob Description:As a Senior Data Engineer at Randstad Digital, you will play a critical role in designing, developing, and implementing new features to our existing framework...

  • Chief Cloud Architect and Data Engineer

    6 days ago

    Charlotte, North Carolina, United States Lorven technologies Full time

    Job Title: Chief Cloud Architect and Data EngineerLorven Technologies is seeking a highly skilled Chief Cloud Architect and Data Engineer to join our team in Charlotte, NC. This is a long-term contract position with a competitive salary.About the Role:We are looking for an experienced solution architect with a strong background in cloud computing and data...

  • ETL lead with PySpark expertise

    12 hours ago

    Charlotte, United States Centraprise Full time

    ETL lead with PySpark expertiseMinneapolis, MN/Atlanta, GA/Dallas, TX/Charlotte, NCFull-Time/PermanentJob Description:ETL Developer to create data pipeline ETL Jobs using PySpark within the financial services industry.Responsibilities:Work with a scrum team(s) to deliver product stories according to priorities set by the business and the Product...

  • ETL lead with PySpark expertise

    12 hours ago

    Charlotte, United States Centraprise Full time

    Job Title: ETL lead with PySpark expertiseLocation: Minneapolis, MN//Atlanta, GA//Dallas, TX & Charlotte, NC (Onsite)Duration: Full Time OnlyJob Description:ETL Developer to create data pipeline ETL Jobs using PySpark within the financial services industry.Responsibilities:Work with a scrum team(s) to deliver product stories according to priorities set by...

  • Big Data Engineer

    3 weeks ago

    Charlotte, North Carolina, United States Atlantis IT group Full time

    About the RoleAt Atlantis IT group, we are seeking an experienced Big Data Engineer to join our team in Charlottte. This is a full-time W2 position that requires US citizenship or a Green Card.We need someone with expertise in Hadoop, Python, and Spark, as well as Pyspark and custom-built Spark SQL. MapR experience is preferred, but Hortonworks and Cloudera...

  • Senior Data Engineering Manager

    4 weeks ago

    Charlotte, North Carolina, United States Aloden, Inc. Full time

    Job Title: Lead Data EngineerJob Summary:We are seeking a highly skilled Lead Data Engineer to join our team at Aloden, Inc. This is an exciting opportunity to work with cutting-edge technologies and contribute to the development of our data infrastructure. As a Lead Data Engineer, you will be responsible for designing, developing, and maintaining data...

  • AWS Data Engineer

    12 hours ago

    Charlotte, United States Brooksource Full time

    Brooksource is searching for an AWS Data Engineer with expertise in data warehousing using AWS Redshift and Kafka to join our Fortune 500 client in Charlotte, NC. AWS Data Engineer IV Core Technical Skills 5+ years of AWS experience AWS services - S3, EMR, Glue Jobs, Lambda, Athena, CloudTrail, SNS, SQS, CloudWatch, Step Functions, QuickSight Experience with...

  • Senior Data Engineer with PySpark

    4 weeks ago

    Charlotte, North Carolina, United States Diverse Lynx Full time

    Job Title: Senior Data Engineer with PySparkJob Description:We are seeking a highly experienced Senior Data Engineer with expertise in PySpark to lead our data engineering team. The ideal candidate will have a strong background in designing and implementing large-scale data architectures, including data lakes, data warehouses, and data marts....

  • Senior PySpark Engineer

    4 weeks ago

    Charlotte, North Carolina, United States Randstad Digital Full time

    We're looking for an experienced Data Transformation Specialist to join our team at Randstad Digital. If you have a strong background in Python, PySpark, and object-oriented programming, we'd love to hear from you.In this role, you'll design, develop, and implement new features to our existing framework using PySpark and Python. You'll work collaboratively...

  • Brooksource | AWS Data Engineer

    21 hours ago

    charlotte, United States Brooksource Full time

    Brooksource is searching for an AWS Data Engineer with expertise in data warehousing using AWS Redshift and Kafka to join our Fortune 500 client in Charlotte, NC. AWS Data Engineer IV Core Technical Skills 5+ years of AWS experience AWS services - S3, EMR, Glue Jobs, Lambda, Athena, CloudTrail, SNS, SQS, CloudWatch, Step Functions, QuickSight Experience with...

  • Senior Data Engineering Manager

    1 week ago

    Charlotte, North Carolina, United States Aloden, Inc. Full time

    Aloden, Inc. is looking for a seasoned Senior Data Engineering Manager to lead our big data solutions team in Charlotte, NC.The successful candidate will have expertise in designing, implementing, and maintaining large-scale data systems using PySpark and Java.The estimated salary for this position is $145,000 - $165,000 per year.Responsibilities include...

  • Pyspark Data Engineer and DevOps Professional

    4 weeks ago

    Charlotte, North Carolina, United States Syntricate Technologies Full time

    Job SummaryWe are seeking a highly skilled Pyspark Data Engineer to join our team at Syntricate Technologies. The ideal candidate will have extensive experience in designing, implementing, and maintaining large-scale data processing systems using Pyspark and Hadoop. Key responsibilities include working on Pyspark frameworks to ingest data from various...

  • Senior Data Engineer with PySpark

    6 months ago

    Charlotte, United States Diverse Lynx Full time

    Senior Data Engineer with PySpark- Day 1 onsite (3 days per week) Locations - Mt Laurel, NJ / Charlotte, NC Fulltime/Contract Experience: 10-12+ Years Primary Tech skills - Databricks, Pyspark, Azure SQL, ADF Secondary Tech skills - Azure, SAS, Synapse, • Experience in building end to end architecture for Data Lakes, Data Warehouses and Data Marts...

  • Senior Data Engineer with PySpark

    4 weeks ago

    Charlotte, United States CV Library Full time

    Senior Data Engineer with PySpark Day 1 onsite (3 days per week)Locations Mt Laurel, NJ / Charlotte, NCFulltime/ContractExperience: 10-12+ YearsPrimary Tech skills Databricks, Pyspark, Azure SQL, ADFSecondary Tech skills Azure, SAS, Synapse," Experience in building end to end architecture for Data Lakes, Data Warehouses and Data Marts" Experience of DWH,...

  • Database/Data Engineer

    4 weeks ago

    Charlotte, United States Tech Tammina Full time

    Role: Database/Data Engineer Location: Charlotte, NC (Fully onsite) Rate: Market Duration: Long term The primary role of the Developer - Database/Data Engineer is to function as a critical member of a data team by designing data integration solutions that deliver business value in line with the company's objectives. They are responsible for the design and...

  • Big Data Engineer

    4 weeks ago

    Charlotte, United States Diverse Lynx Full time

    Big Data Engineer with mapreduce , spark , hive , sql skillset" Expert in SQL and Data warehousing concepts. Hands-on experience with public cloud data warehouse (GCP, Azure, AWS). GCP certification will be very good to have. MapR experience is must Strong Hands on experience with one or more programming languages ( Python or Java). Hands-on...

  • Python Data Architect

    4 weeks ago

    Charlotte, North Carolina, United States Randstad Digital Full time

    Randstad Digital is seeking a skilled Python Data Architect to lead the design and implementation of new features to our existing framework. As a seasoned expert in Python, PySpark, and object-oriented programming, you'll be responsible for creating efficient standalone scripts based on given business logic.With a strong focus on collaboration and teamwork,...