PySpark Data Engineer

3 months ago


New York, United States Oakridge Staffing Full time

Global hospitality company is looking for an experienced PySpark Data Engineer for their Midtown NYC headquarters.


Responsibilities:

  • Lead the in-house development of ETL/ELT data pipelines and data science projects.
  • Create and own data products, such as a recommendation engine or predictive model.
  • Provide key insights and analyses to senior stakeholders and executives.
  • Work with the Data Engineering team to design and develop data models.


Qualifications And Requirements

  • 5+ years of relevant professional experience in building AWS big data pipelines using Apache Spark.
  • Strong hands-on experience with programming in Python.
  • Expertise in SQL and analytical data modeling.
  • Hands-on experience in pipeline orchestration tools, like Apache Airflow.
  • Experience in PostgreSQL, Redshift, S3, AWS Lambda, Kinesis and Athena.
  • Previous work with cloud-based BI tools (such as Looker, and Quicksight) is a plus.
  • Strong organizational, problem-solving, and communications skills (must be able to do basic technical writing)


  • PySpark Data Engineer

    3 weeks ago


    New York, New York, United States Oakridge Staffing Full time

    Job Title: PySpark Data EngineerAbout Oakridge Staffing:Oakridge Staffing is a leading provider of top talent to the hospitality industry.Job Summary:We are seeking an experienced PySpark Data Engineer to join our team at Oakridge Staffing. As a key member of our data engineering team, you will be responsible for designing and developing data pipelines and...


  • New York, New York, United States The Data Sherpas Full time

    Job Title: Data Engineer for Cloud Data PlatformThe Data Sherpas are seeking a highly skilled Data Engineer to join our team and help our clients at every phase of their cloud journey. As a Data Engineer, you will be responsible for designing, building, and maintaining scalable data platforms on cloud-based infrastructure.Responsibilities:Design and...


  • New York, New York, United States The Data Sherpas Full time

    About The Data SherpasWe are a team of highly skilled and motivated engineers who help our clients at every phase of their cloud journey.Our expertise spans cloud infrastructure, data engineering, and analytics, with a focus on delivering scalable and intuitive solutions.Job DescriptionWe are seeking a self-motivated and data-driven engineer to join our team...


  • New York, New York, United States The Data Sherpas Full time

    About The Data SherpasWe are a team of highly skilled and motivated engineers who help our clients at every phase of their cloud journey. Our expertise spans cloud infrastructure, data engineering, and application development.Job DescriptionWe are seeking a self-motivated and data-driven engineer to join our team. The ideal candidate will have a solid...


  • New York, New York, United States The Data Sherpas Full time

    About The Data SherpasWe are a team of highly skilled and motivated engineers who help our clients at every phase of their cloud journey. Our expertise spans cloud infrastructure, data engineering, and application development.Job DescriptionWe are seeking a self-motivated and data-driven engineer to join our team. As a Data Engineer for Cloud Data Platforms,...


  • New York, New York, United States Tech Tammina Full time

    Job Title: Senior PySpark/Python EngineerAt Tech Tammina, we are seeking a highly skilled Senior PySpark/Python Engineer to join our team. The ideal candidate will have a strong background in PySpark, Python, and data engineering, with experience in improving performance and user experience of new applications.Key Responsibilities:Improve performance and...


  • New York, New York, United States Tech Tammina Full time

    Senior PySpark/Python EngineerWe are seeking a highly skilled Senior PySpark/Python Engineer to join our team at Tech Tammina. The ideal candidate will have a strong background in data engineering, with expertise in PySpark, Python, and related technologies.Key Responsibilities:Design and implement data pipelines using PySpark and PythonWork with data lakes,...


  • New York, New York, United States TENTH MOUNTAIN LLC Full time

    Job Title: Senior Data EngineerWe are seeking a highly skilled Senior Data Engineer to join our team at TENTH MOUNTAIN LLC. As a Senior Data Engineer, you will play a crucial role in migrating our existing data platform to an on-premises Hadoop environment.Key Responsibilities:Data Pipeline Development: Design and develop scalable, efficient ETL pipelines...

  • Senior Data Engineer

    4 weeks ago


    New York, United States TENTH MOUNTAIN LLC Full time

    Job DescriptionJob DescriptionJoin KGES as a Senior Data EngineerAt KGES, we're dedicated to empowering veterans by connecting them with top-tier employers who value their unique military background. As a Senior Data Engineer, you'll have the opportunity to leverage your skills in data engineering, machine learning, and cloud platforms while making a...

  • Fabric Engineer

    3 weeks ago


    New York, New York, United States MDMS Recruiting LLC Full time

    Job DescriptionMicrosoft Fabric Engineer / Data EngineerWe are seeking a highly skilled Microsoft Fabric Engineer / Data Engineer to join our team at MDMS Recruiting LLC. As a key member of our data engineering team, you will be responsible for designing, building, and maintaining large-scale data systems using Microsoft Fabric and Azure.Key...

  • Sr Data Engineer

    18 hours ago


    New York, United States Tek Leaders Inc Full time

    Hi Everyone I hope you are doing well This is Siddharth from Tekleaders we have a requirement below please share me the updated resume Role: Senior Healthcare Data Engineer Location :NYC NY (Remote) Type of Hire Contract/ C2H Visas: GC USC Only W2 No C2C Duration :6 Months Position requirements (Remote/ Hybrid/Fully onsite) :Remote Job...


  • New York, United States ASB Resources Full time

    We are seeking a skilled Databricks Consultant to join our team. The ideal candidate will possess extensive experience in creating, managing and optimizing data engineering pipelines using Databricks and associated technologies. Responsibilities: 1. Worked on Lakehouse ETL Projects: - Execute ETL projects within the Lakehouse architecture, ensuring seamless...


  • New York, New York, United States Guardian Life Full time

    About the RoleWe are seeking a highly motivated and detail-oriented Data Engineering Intern to join our team at Guardian Life. As a Data Engineering Intern, you will play a key role in designing, implementing, and validating data pipelines to support business intelligence and machine learning initiatives.Key ResponsibilitiesDesign and implement data...


  • New York, United States NTT DATA Services Full time

    Req ID: 292343  NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Machine Learning Engineer to join our team in New York, New York (US-NY), United States (US). Job...

  • Data Engineer

    1 week ago


    New York, New York, United States Publicis Media Full time

    Job Title: Data EngineerWe are seeking a highly skilled Data Engineer to join our team at Publicis Media. As a Data Engineer, you will be responsible for designing, developing, and maintaining large-scale data systems and architectures.Key Responsibilities:Analyze business requirements and partner with product owners to build scalable data...

  • Data Engineer

    7 days ago


    new york city (bloomfield), United States Tata Consultancy Services Full time

    Position: AWS Data EngineerLocation: Bloomfield, CT (Onsite)Duration: FTE/ Direct HireJob Description:Relevant Experience:7-10 years of hands on Pyspark/Databricks development experience.Knowledge in Terraform, S3, API Gateway, Lamba, SNS and SQS.Should have wide experience in AWS services such as Glue, EMR, Lambda, Step Functions, CloudTrail, CloudWatch,...


  • New York, New York, United States Memorial Sloan Kettering Cancer Center Full time

    Cloud Data Infrastructure EngineerJoin Memorial Sloan Kettering Cancer Center in driving its data modernization journey as a Cloud Data Infrastructure Engineer. This exciting opportunity involves designing, implementing, and maintaining data infrastructure solutions for a hybrid and multi-cloud data ecosystem.Key Responsibilities:Collaborate with technical...


  • New York, New York, United States Jobot Full time

    Remote Data Product Engineer OpportunityWe are a growing subsidiary of a large public company seeking a highly skilled Data Product Engineer to join our team. As a key member of our data engineering team, you will be responsible for designing, developing, and maintaining large-scale data systems.Key Responsibilities:Design and implement data pipelines using...


  • New York, New York, United States Algobrain Full time

    Job Title: Lead Data EngineerAt Algobrain, we are seeking a highly skilled Lead Data Engineer to lead the design and development of enhanced data services and cloud enablement for Data and Services. As a key member of our team, you will push the limits of the state of the art with best-in-class data product enablement in the cloud and design the roadmap to...

  • Data Engineer

    1 month ago


    New York, United States NTT DATA Full time

    Req ID: 270954 NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a Data Engineer to join our team in New York, New York (US-NY), United States (US).Responsibilities:- Expand and optimize...