Pyspark Developer

6 days ago


Pittsburgh, Pennsylvania, United States ERP Savvy, LLC. Full time

Job Description:

The candidate would write ETL jobs using pyspark and schedule them on airflow using various operators including bash , sparksubmit , k8s operator and snowflake operator .
Write code in python to read/write hive/snowflake using pyspark and snowpark .



  • Pittsburgh, Pennsylvania, United States The PNC Financial Services Group, Inc Full time

    Position Overview At PNC, our people are our greatest differentiator and competitive advantage in the markets we serve. We are all united in delivering the best experience for our customers. We work together each day to foster an inclusive workplace culture where all of our employees feel respected, valued and have an opportunity to contribute to the...


  • Pittsburgh, Pennsylvania, United States PNC Full time

    Position Overview At PNC, our people are our greatest differentiator and competitive advantage in the markets we serve. We are all united in delivering the best experience for our customers. We work together each day to foster an inclusive workplace culture where all of our employees feel respected, valued and have an opportunity to contribute to the...


  • Pittsburgh, Pennsylvania, United States PNC Full time

    Position OverviewAt PNC, our people are our greatest differentiator and competitive advantage in the markets we serve. We are all united in delivering the best experience for our customers. We work together each day to foster an inclusive workplace culture where all of our employees feel respected, valued and have an opportunity to contribute to the...

  • Pyspark Developer

    6 days ago


    Pittsburgh, United States ERP Savvy, LLC. Full time

    Job Description: The candidate would write ETL jobs using pyspark and schedule them on airflow using various operators including bash , sparksubmit , k8s operator and snowflake operator . Write code in python to read/write hive/snowflake using pyspark and snowpark .


  • Pittsburgh, United States Synechron Full time

    Title: Data Engineering Architect (Neo4j and PySpark)Location: Pittsburgh, PAJob Type: Full timeAbout the role: The Data Architect will specifically help to generate and assess the calculated data quality, Risk Tech Analyst also supports Quants and Risk models validation efforts.Job Responsibilities:Use GraphQL for querying Neo4j to develop front end...


  • Pittsburgh, United States Synechron Full time

    Title: Data Engineering Architect (Neo4j and PySpark)Location: Pittsburgh, PAJob Type: Full timeAbout the role: The Data Architect will specifically help to generate and assess the calculated data quality, Risk Tech Analyst also supports Quants and Risk models validation efforts.Job Responsibilities:Use GraphQL for querying Neo4j to develop front end...

  • Databricks Engineer

    4 weeks ago


    Pittsburgh, United States Syntricate Technologies Full time

    Required Skills: Strong Databricks development with GCP and python experience are the main skills. 5 years of experience as a developer with demonstrated skills in: Databricks Python/Pyspark GCP: Big Query and PostgreSQL 5 years of experience as a developer Experience with Project Management tools. Experience with databases. Experience...

  • Lead Data Scientist

    2 weeks ago


    Pittsburgh, United States Saxon Global Full time

    This is a full time role with pnc bank. Hybrid - 2 days office 3 days remote. Candidate must be close to Pittsburgh, Cleveland, New Jersey, DC, Atlanta, Raileigh NC, Columbus Dallas. Lead Data Scientist/ Engineer / Architect (8 + yrs) Must have technical skills/experience (ask for alternative/tool/version): Hadoop Pyspark/ Python Graph database...

  • Engineer

    3 weeks ago


    Pittsburgh, United States Tata Consultancy Services Full time

    Role: Senior Hadoop Data Engineer 1. Deep understanding of Hadoop ecosystem technologies. 2. Strong Proficient in PySpark for data processing and analytics. 3. In-depth knowledge of Hive for data warehousing and querying. 4. Experienced with Livy for interactive job submission. 5. Proficiency in shell scripting for automation and orchestration. 6. Hands-on...


  • Pittsburgh, United States Certu Systems Full time

    Work with the engineering team to test and develop critical solutions to our software system. Job duties include: Design and development of novel optimization algorithms; development of new products, solutions, and processes; Strive to improve efficiency and sustainability of processes and product designs; Communicate technical information to non-technical...


  • Pittsburgh, United States Certu Systems Full time

    Work with the engineering team to test and develop critical solutions to our software system. Job duties include: Design and development of novel optimization algorithms; development of new products, solutions, and processes; Strive to improve efficiency and sustainability of processes and product designs; Communicate technical information to non-technical...


  • Pittsburgh, United States EXL Full time

    EXL Analytics is looking for a Senior Model Developer to join the team. EXL (NASDAQ:EXLS) is a global analytics and digital solutions company that partners with clients to improve business outcomes and unlock growth. Bringing together deep domain expertise with robust data, powerful analytics, cloud, and AI, we create agile, scalable solutions and execute...


  • Pittsburgh, United States Certu Systems, Inc. Full time

    Join an exciting new start-up company focused on using the most reliable AI Engine to revolutionize logistics operations. Actionable insights and real-time predictions for reliability, efficiency, transparency, and cost savings. This is why a cool pack of innovators and problem-solvers got together to fix the ongoing supply chain challenges across the globe....

  • Test Lead and Tester

    4 weeks ago


    Pittsburgh, United States Softpath System Full time

    Test Lead/ Test Manager 10+ Years Sr Tester 6-9 YearsJob description - Test engineer (Data Engineering Scrum Team):Strong working experience with Oracle /AWS Redshift/ MS SQL Server Database and highly proficient with complexSQLscripting to validate source/target data load and transformationExperience in Bigdata data pipeline testing with Hadoop/Spark...


  • Pittsburgh, United States eNGINE Full time

    eNGINE builds Technical Teams. We are a Solutions and Placement firm shaped by decades of interaction with technical professionals. Our inspiration is continuous learning and engagement with the markets we serve, the talent we represent, and the teams we build. Our Consulting Workforce is encouraged to enjoy career fulfillment in the form of challenging...

  • Test Lead and Tester

    4 weeks ago


    Pittsburgh, United States Softpath System Full time

    Test Lead/ Test Manager 10+ Years Sr Tester 6-9 Years Job description - Test engineer (Data Engineering Scrum Team):Strong working experience with Oracle /AWS Redshift/ MS SQL Server Database and highly proficient with complex SQL scripting to validate source/target data load and transformationExperience in Bigdata data pipeline testing with Hadoop/Spark...


  • Pittsburgh, United States eNGINE Full time

    eNGINE builds Technical Teams. We are a Solutions and Placement firm shaped by decades of interaction with technical professionals. Our inspiration is continuous learning and engagement with the markets we serve, the talent we represent, and the teams we build. Our Consulting Workforce is encouraged to enjoy career fulfillment in the form of challenging...


  • Pittsburgh, United States eNGINE Full time

    eNGINE builds Technical Teams. We are a Solutions and Placement firm shaped by decades of interaction with technical professionals. Our inspiration is continuous learning and engagement with the markets we serve, the talent we represent, and the teams we build. Our Consulting Workforce is encouraged to enjoy career fulfillment in the form of challenging...

  • Test Lead and Tester

    4 weeks ago


    Pittsburgh, United States Softpath System Full time

    Test Lead/ Test Manager 10+ Years Sr Tester 6-9 Years Job description - Test engineer (Data Engineering Scrum Team): Strong working experience with Oracle /AWS Redshift/ MS SQL Server Database and highly proficient with complex SQL scripting to validate source/target data load and transformation Experience in Bigdata data pipeline testing with...


  • Pittsburgh, United States Georgia IT Inc Full time

    Position- ETL Bigdata Tester Location- Pittsburg, PA Duration- Contract Rate- DOE Job description - Test engineer (Data Engineering Scrum Team): Strong working experience with Oracle /AWS Redshift/ MS SQL Server Database and highly proficient with complex SQL scripting to validate source/target data load and transformation Experience in Bigdata...


  • Pittsburgh, United States Georgia IT Inc Full time

    Position- ETL Bigdata Tester Location- Pittsburg, PA Duration- Contract Rate- DOE Job description - Test engineer (Data Engineering Scrum Team): Strong working experience with Oracle /AWS Redshift/ MS SQL Server Database and highly proficient with complex SQL scripting to validate source/target data load and transformation Experience in Bigdata...


  • Pittsburgh, United States Pantherx Specialty Llc Full time

    7,000 Diseases - 500 Treatments - 1 Rare Pharmacy PANTHERx is the nation’s largest rare disease pharmacy, and we put the patient experience at the top of everything that we do. If you are looking for a career in the healthcare field that embraces authentic dedication to patient care, you don’t need to look beyond PANTHERx. In every line of service, in...


  • Pittsburgh, United States Pantherx Specialty LLC Full time

    Job DescriptionJob Description7,000 Diseases - 500 Treatments - 1 Rare PharmacyPANTHERx is the nation’s largest rare disease pharmacy, and we put the patient experience at the top of everything that we do. If you are looking for a career in the healthcare field that embraces authentic dedication to patient care, you don’t need to look beyond PANTHERx. In...