PySpark Data Engineer

2 weeks ago


New York, New York, United States Oakridge Staffing Full time

Job Title: PySpark Data Engineer

About Oakridge Staffing:

Oakridge Staffing is a leading provider of top talent to the hospitality industry.

Job Summary:

We are seeking an experienced PySpark Data Engineer to join our team at Oakridge Staffing. As a key member of our data engineering team, you will be responsible for designing and developing data pipelines and data science projects that drive business insights and growth.

Responsibilities:

  • Lead Data Pipeline Development: Design, develop, and maintain large-scale data pipelines using Apache Spark and AWS big data technologies.
  • Data Product Development: Create and own data products, such as recommendation engines or predictive models, that drive business value and growth.
  • Business Insights and Analytics: Provide key insights and analyses to senior stakeholders and executives to inform business decisions.
  • Collaboration and Communication: Work closely with cross-functional teams, including data engineering, data science, and business stakeholders, to ensure seamless data pipeline development and deployment.

Requirements:

  • 5+ Years of Experience: Proven experience in building large-scale data pipelines using Apache Spark and AWS big data technologies.
  • Programming Skills: Strong hands-on experience with programming in Python and expertise in SQL and analytical data modeling.
  • Pipeline Orchestration: Hands-on experience with pipeline orchestration tools, such as Apache Airflow.
  • Cloud-Based Technologies: Experience with cloud-based BI tools, such as Looker and Quicksight, and AWS services, including PostgreSQL, Redshift, S3, AWS Lambda, Kinesis, and Athena.
  • Strong Organizational and Communication Skills: Strong organizational, problem-solving, and communications skills, with the ability to do basic technical writing.


  • New York, New York, United States The Data Sherpas Full time

    About The Data SherpasWe are a team of highly skilled and motivated engineers who help our clients at every phase of their cloud journey.Our expertise spans cloud infrastructure, data engineering, and analytics, with a focus on delivering scalable and intuitive solutions.Job DescriptionWe are seeking a self-motivated and data-driven engineer to join our team...


  • New York, New York, United States The Data Sherpas Full time

    About The Data SherpasWe are a team of highly skilled and motivated engineers who help our clients at every phase of their cloud journey. Our expertise spans cloud infrastructure, data engineering, and application development.Job DescriptionWe are seeking a self-motivated and data-driven engineer to join our team. The ideal candidate will have a solid...


  • New York, New York, United States The Data Sherpas Full time

    About The Data SherpasWe are a team of highly skilled and motivated engineers who help our clients at every phase of their cloud journey. Our expertise spans cloud infrastructure, data engineering, and application development.Job DescriptionWe are seeking a self-motivated and data-driven engineer to join our team. As a Data Engineer for Cloud Data Platforms,...


  • New York, New York, United States Tech Tammina Full time

    Job Title: Senior PySpark/Python EngineerAt Tech Tammina, we are seeking a highly skilled Senior PySpark/Python Engineer to join our team. The ideal candidate will have a strong background in PySpark, Python, and data engineering, with experience in improving performance and user experience of new applications.Key Responsibilities:Improve performance and...


  • New York, New York, United States TENTH MOUNTAIN LLC Full time

    Job Title: Senior Data EngineerWe are seeking a highly skilled Senior Data Engineer to join our team at TENTH MOUNTAIN LLC. As a Senior Data Engineer, you will play a crucial role in migrating our existing data platform to an on-premises Hadoop environment.Key Responsibilities:Data Pipeline Development: Design and develop scalable, efficient ETL pipelines...

  • Fabric Engineer

    3 weeks ago


    New York, New York, United States MDMS Recruiting LLC Full time

    Job DescriptionMicrosoft Fabric Engineer / Data EngineerWe are seeking a highly skilled Microsoft Fabric Engineer / Data Engineer to join our team at MDMS Recruiting LLC. As a key member of our data engineering team, you will be responsible for designing, building, and maintaining large-scale data systems using Microsoft Fabric and Azure.Key...


  • New York, New York, United States Guardian Life Full time

    About the RoleWe are seeking a highly motivated and detail-oriented Data Engineering Intern to join our team at Guardian Life. As a Data Engineering Intern, you will play a key role in designing, implementing, and validating data pipelines to support business intelligence and machine learning initiatives.Key ResponsibilitiesDesign and implement data...

  • Data Engineer

    5 days ago


    New York, New York, United States Publicis Media Full time

    Job Title: Data EngineerWe are seeking a highly skilled Data Engineer to join our team at Publicis Media. As a Data Engineer, you will be responsible for designing, developing, and maintaining large-scale data systems and architectures.Key Responsibilities:Analyze business requirements and partner with product owners to build scalable data...


  • New York, New York, United States Jobot Full time

    Remote Data Product Engineer OpportunityWe are a growing subsidiary of a large public company seeking a highly skilled Data Product Engineer to join our team. As a key member of our data engineering team, you will be responsible for designing, developing, and maintaining large-scale data systems.Key Responsibilities:Design and implement data pipelines using...

  • Data Engineering Lead

    22 hours ago


    New York, New York, United States Algobrain Full time

    Job Title: Lead Data EngineerAt Algobrain, we are seeking a highly skilled Lead Data Engineer to lead the design and development of enhanced data services and cloud enablement for Data and Services. As a key member of our team, you will push the limits of the state of the art with best-in-class data product enablement in the cloud and design the roadmap to...


  • New York, New York, United States Dennis Earl Hardy Inc Full time

    Job OverviewWe are seeking an experienced and proactive Data Engineer to join our team at Dennis Earl Hardy Inc, focusing on building scalable, efficient, and automated data solutions.You will work closely with analysts and data scientists to develop, validate, and implement data models, ensuring the integrity and performance of downstream data...


  • New York, New York, United States DTG Consulting Solutions, Inc. Full time

    Job Title: Reporting & Analytics LeadDTG Consulting Solutions, Inc. is seeking a highly skilled Reporting & Analytics Lead to join our team. As a key member of our organization, you will be responsible for overseeing the development and execution of data engineering and analytics strategies within our dynamic banking environment.Key Responsibilities:Lead and...


  • New York, New York, United States ASB Resources Full time

    We are seeking a skilled Databricks Consultant to join our team at ASB Resources. The ideal candidate will possess extensive experience in creating, managing and optimizing data engineering pipelines using Databricks and associated technologies.Key Responsibilities:1. Lakehouse ETL Projects:Execute ETL projects within the Lakehouse architecture, ensuring...

  • DevOps Engineer

    18 hours ago


    New York, New York, United States NTT DATA Full time

    Job Title: DevOps Engineer - Data Center OperationsWe are seeking a highly skilled DevOps Engineer to join our team in New York, NY. As a DevOps Engineer, you will be responsible for designing and implementing efficient batch workflows, configuring and scheduling batch processing systems, and troubleshooting issues to ensure business continuity.Key...


  • New York, New York, United States Della Infotech Full time

    Job Title: Data ManagementJob Summary:We are seeking a highly skilled Data Management professional to join our team at Della Infotech. The ideal candidate will have expertise in data warehousing, data modeling, and database management.Key Responsibilities:Analyze reporting requirements to determine summary table/view data model requirements.Extend data...


  • New York, New York, United States Della Infotech Full time

    Job DescriptionPosition: Data Management - Data Warehouse Architect IIILocation: New YorkDuration: 11 MonthsWe are seeking a highly skilled Data Management Specialist to join our team at Della Infotech. As a Data Warehouse Architect III, you will be responsible for designing and implementing data warehouses that meet the business needs of our...


  • New York, New York, United States Memorial Sloan Kettering Cancer Center Full time

    Job Description:**Bioinformatics Software Engineer I**We are seeking a highly skilled Bioinformatics Software Engineer I to join our team at Memorial Sloan Kettering Cancer Center. As a key member of our bioinformatics team, you will play a critical role in designing, developing, and implementing software tools and applications for processing and analyzing...

  • Data Engineer

    7 days ago


    New York, New York, United States Creative Data Resources Full time

    Job Title: ETL DeveloperAt Creative Data Resources, we are seeking an experienced ETL Developer to join our team. As an ETL Developer, you will be responsible for designing, implementing, and maintaining data pipelines that extract, transform, and load data from various sources into our data warehouse.Key Responsibilities:Migrate existing SSIS scripts to...

  • Data Analyst

    1 week ago


    New York, New York, United States Curate Partners Full time

    Key ResponsibilitiesWe are seeking a highly skilled professional to join our team at Curate Partners as a Data Scientist. The ideal candidate will have a strong background in data science, machine learning, and statistical modeling.Key Skills:Strong data science intuition and ability to build solutions through data for business use casesExperience with...


  • New York, New York, United States Guardian Life Insurance Company Full time

    Internship OverviewGuardian Life Insurance Company is seeking a highly motivated and talented Data Science Intern to join our team for a 10-week paid internship program. As a Data Science Intern, you will have the opportunity to work with our Enterprise Data & Analytics organization, whose mission is to be trusted partners who continuously enable valuable...