Data Engineer with Pyspark

4 weeks ago

Wilmington, United States Wise Skulls llc Full time
Job DescriptionJob DescriptionJob Title: Data Engineer with Pyspark
Location: Wilmington, DE Only Local
Duration: Long Term
Implementation Partner: Mphasis
End Client: TBDJob responsibilities
  • Executes creative software solutions, design, development, and technical troubleshooting with ability to think beyond routine or conventional approaches to build solutions or break down technical problems
  • Develops secure high-quality production code, and reviews and debugs code written by others
  • Identifies opportunities to eliminate or automate remediation of recurring issues to improve overall operational stability of software applications and systems
  • Produces architecture and design artifacts for complex applications while being accountable for ensuring design constraints are met by software code development
  • Gathers, analyzes, synthesizes, and develops visualizations and reporting from large, diverse data sets in service of continuous improvement of software applications and systems.
  • Design and develop data pipelines to ingest, store, and process data from multiple sources
  • Proactively identifies hidden problems and patterns in data and uses these insights to drive improvements to coding hygiene and system architecture.
  • Contributes to software engineering communities of practice and events that explore new and emerging technologies
  • Adds to team culture of diversity, equity, inclusion, and respect
Required qualifications, capabilities, and skills
  • Formal training or certification on data engineering concepts and 3+ years of applied experience
  • Practical Experience in one or more programming language(s), such as Python, Java
  • Experience with SQL-based technologies (e.g., MySQL/ Oracle DB)
  • Hands-on practical experience delivering data pipelines
  • Proficient in all aspects of the Software Development Life Cycle
  • Understanding of agile methodologies such as CI/CD, Applicant Resiliency, and Security
  • Demonstrated proficiency and experience with cloud-native distributed systems
  • Ability to develop reports, dashboards, and processes to continuously monitor data quality and integrity
  • Experience in developing, debugging, and maintaining code in a large corporate environment with one or more modern programming languages and database querying languages
  • Experience with statistical data analysis and ability to determine appropriate tools and data patterns to perform analysis
  • Demonstrated knowledge of software applications and technical processes within a technical discipline (e.g., cloud, artificial intelligence, machine learning, mobile, etc.)
  • Working knowledge of bitbucket and JIRA

  • Pyspark

    2 days ago

    Wilmington, United States K-Tek Resourcing LLC Full time

    Title: PySpark Location: Plano, TX Job Description Hands-on Pyspark SME with multiple project experience with Data planforms comprising of Hadoop, Teradata Data Warehouse, Ab Initio, Informatica, Java Spark (DPL), SSIS, AWS Lake Formation (S3), Snowflake Ability to design, build and unit test applications on Spark framework on Python. Build PySpark based...

  • Python Pyspark Developer

    5 days ago

    Wilmington, United States TalentOla Full time

    Job DescriptionJob DescriptionPlease find JD for Python Pyspark DeveloperPython Pyspark Developer Hands-on object-oriented programming experience using Python is required. Professional work experience building real-time data streams using Spark and Experience in Spark. Knowledge or experience in architectural best practices in building data lakes Experience...

  • Python Pyspark Developer

    2 days ago

    Wilmington, United States Enexus Global Full time

    Job Title: Python Pyspark Developer Location : Wilmington, DE Onsite W2 or Full Time Only Skills: Python, Pyspark Experience: 8+ Years Hands-on object-oriented programming experience using Python is required. Professional work experience building real-time data streams using Spark and Experience in Spark. Knowledge or experience in architectural best...

  • Python Pyspark Developer

    2 days ago

    Wilmington, United States ApTask Full time

    Hands-on object-oriented programming experience using Python is required.Professional work experience building real-time data streams using Spark and Experience in Spark.Knowledge or experience in architectural best practices in building data lakesExperience with 2 or more scripting languages such as Python, Bash Regards,Shelly AgarwalConnect: | Python...

  • Python Pyspark Developer

    1 week ago

    Wilmington, United States Tekgence Private Ltd Full time

    Job DescriptionJob DescriptionJob Title: Python Pyspark DeveloperLocation: Wilmington, DEJob Description: Hands-on object-oriented programming experience using Python is required. Professional work experience building real-time data streams using Spark and Experience in Spark. Knowledge or experience in architectural best practices in building data lakes...

  • Python Pyspark Developer

    7 days ago

    Wilmington, United States AIT Global inc. Full time

    Job DescriptionJob DescriptionJob Title: Python Pyspark Developer Location: Wilmington, DEJob Description:Hands-on object-oriented programming experience using Python is required.Professional work experience building real-time data streams using Spark and Experience in Spark.Knowledge or experience in architectural best practices in building data...

  • Big Data Developer

    1 month ago

    Wilmington, United States Laiba Technologies Full time

    **Role - Big data Pyspark Developer** **Location - Wilmington, DE (Hybrid)** - Develop and maintain data platforms using Python, Spark, PySpark - Handling migration to PySpark on AWS - Work with AWS and Big Data, design and implement data pipelines, and ensure data quality and integrity. - Collaborate with cross functional teams to understand data...

  • Data Engineer

    4 weeks ago

    Wilmington, United States The Judge Group Full time

    Title: Data EngineerLocation: Hybrid in Wilmington, DEW2 Only Contract to Hire (no sponsorship)NO C2C, MUST BE ON W2Conversion salary negotiableCompany Overview: We are a dynamic and innovative organization seeking a talented Data Engineer to join our team. As a Data Engineer, you will play a crucial role in designing, developing, and maintaining our data...

  • Data Engineer

    4 weeks ago

    Wilmington, United States The Judge Group Full time

    Title: Data EngineerLocation: Hybrid in Wilmington, DEW2 Only Contract to Hire (no sponsorship)NO C2C, MUST BE ON W2Conversion salary negotiableCompany Overview: We are a dynamic and innovative organization seeking a talented Data Engineer to join our team. As a Data Engineer, you will play a crucial role in designing, developing, and maintaining our data...

  • Data Engineer

    4 weeks ago

    Wilmington, United States The Judge Group Full time

    Title: Data EngineerLocation: Hybrid in Wilmington, DEW2 Only Contract to Hire (no sponsorship)NO C2C, MUST BE ON W2Conversion salary negotiableCompany Overview: We are a dynamic and innovative organization seeking a talented Data Engineer to join our team. As a Data Engineer, you will play a crucial role in designing, developing, and maintaining our data...

  • Data Engineer

    1 week ago

    Wilmington, United States PamTen Full time

    Role: Data Engineer with AEP Location: Hybrid DC Duration: 6+ Months Required Skills : • Configure AEP to get the data set needed and then use spark (AWS glue ) to load data in the data lake • should be strong in SQL • Need good communication skills. • Preferred to have knowledge in python and redshift

  • Lead Software Engineer

    16 hours ago

    Wilmington, United States JPMorgan Chase & Co. Full time

    We have an opportunity to impact your career and provide an adventure where you can push the limits of what's possible. As a Lead Software Engineer at JPMorgan Chase within the Global Data Aggregation and Control team, you are an integral part of an agile team that works to enhance, build, and deliver trusted market-leading technology products in a...

  • Data Engineer Hybrid

    1 week ago

    Wilmington, United States CyberTec Full time

    Job Title: Data Engineer - Hybrid Location: : Branchville, NJ or Charlotte, NC. Job Type : Hybrid Duration: 12 months Opening : 1 Opening ! Visa Acceptable : USC or GC This is a Data Engineer role and involves extraction and integration of data. It will be on a cloud-based platform. Background with analytical tools is a huge plus. The candidate will be...

  • Python PySpark Developer

    5 days ago

    Wilmington, United States Saransh Inc Full time

    Job DescriptionJob Description Hands-on object-oriented programming experience using Python is required. Professional work experience building real-time data streams using Spark and Experience in Spark. Knowledge or experience in architectural best practices in building data lakes Experience with 2 or more scripting languages such as Python, Bash

  • Python Pyspark Developer

    5 days ago

    Wilmington, United States Tekgence Full time

    • Hands-on object-oriented programming experience using Python is required. • Professional work experience building real-time data streams using Spark and Experience in Spark. • Knowledge or experience in architectural best practices in building data lakes • Experience with 2 or more scripting languages such as Python, Bash

  • Python Pyspark Developer

    7 days ago

    Wilmington, United States Tekgence Inc Full time

    • Hands-on object-oriented programming experience using Python is required.• Professional work experience building real-time data streams using Spark and Experience in Spark.• Knowledge or experience in architectural best practices in building data lakes• Experience with 2 or more scripting languages such as Python, Bash

  • Python Pyspark Developer

    6 days ago

    Wilmington, United States Tekgence Inc Full time

    • Hands-on object-oriented programming experience using Python is required.• Professional work experience building real-time data streams using Spark and Experience in Spark.• Knowledge or experience in architectural best practices in building data lakes• Experience with 2 or more scripting languages such as Python, Bash

  • Python Pyspark Developer

    6 days ago

    Wilmington, United States Tekgence Inc Full time

    • Hands-on object-oriented programming experience using Python is required.• Professional work experience building real-time data streams using Spark and Experience in Spark.• Knowledge or experience in architectural best practices in building data lakes• Experience with 2 or more scripting languages such as Python, Bash

  • Python Pyspark Developer

    3 days ago

    Wilmington, United States Tekgence Inc Full time

    Hands-on object-oriented programming experience using Python is required.Professional work experience building real-time data streams using Spark and Experience in Spark.Knowledge or experience in architectural best practices in building data lakesExperience with 2 or more scripting languages such as Python, Bash

  • Python Pyspark Developer

    5 hours ago

    Wilmington, United States Tekgence Full time

    Hands-on object-oriented programming experience using Python is required.Professional work experience building real-time data streams using Spark and Experience in Spark.Knowledge or experience in architectural best practices in building data lakesExperience with 2 or more scripting languages such as Python, Bash