Senior Data Engineer

4 weeks ago


New York, New York, United States Motion Recruitment Full time
Job Description

We are seeking a Senior Data Engineer with expertise in Databricks to join our team at Motion Recruitment.

The ideal candidate will have extensive experience in data engineering, working with large-scale data infrastructures, and optimizing ETL processes.

Key Responsibilities:

  • Design, build, and maintain scalable data pipelines using Databricks and other cloud-based platforms.
  • Collaborate with cross-functional teams to develop and implement data-driven solutions.
  • Optimize ETL processes to improve data quality and reduce latency.

Requirements:

  • Bachelor's or Master's degree in Computer Science, Data Engineering, or related field.
  • At least 5 years of experience in data engineering, with a focus on building data pipelines.
  • Proven experience with Databricks and Apache Spark.
  • Strong proficiency in Python or Scala.
  • Experience with cloud platforms such as AWS or Azure.

Desired Skills:

  • Experience with real-time data processing.
  • Knowledge of ML model deployment within data pipelines.
  • Familiarity with Delta Lake and data lakes architecture.

What You Will Be Doing:

As a Senior Data Engineer, you will be instrumental in designing, building, and maintaining scalable data pipelines using Databricks and other cloud-based platforms.

You will collaborate with cross-functional teams to develop and implement data-driven solutions, and optimize ETL processes to improve data quality and reduce latency.

Tech Breakdown:

60% Databricks & Spark Development

40% ETL Optimization

Daily Responsibilities:

70% Hands-On Coding

20% Data Pipeline Design & Development

10% Documentation & Reporting



  • New York, New York, United States Hudson Data Full time

    Job Title: Senior Azure Data EngineerLocation: NYC, NYDuration: Long Term W2 RoleJob Description:The ideal candidate should have hands-on experience with various Azure services, including Azure Data Factory, Databricks, Data Lake, and Power BI. They should be able to design, build, and maintain ETL pipelines, manage data lakes, and create insightful reports...

  • Senior Data Engineer

    4 weeks ago


    New York, New York, United States The Data Sherpas Full time

    Job SummaryWe are seeking a highly skilled Senior Data Engineer to lead our team in designing, developing, and deploying high-performance data analytics solutions on Google Cloud Platform (GCP). As a key member of our team, you will be responsible for architecting transformation and modernization of enterprise data solutions on GCP, integrating native GCP...

  • Senior Data Engineer

    4 weeks ago


    New York, New York, United States Capital One Full time

    Job Title: Senior Data EngineerCapital One is seeking a Senior Data Engineer to join our team. As a Senior Data Engineer, you will be responsible for designing, developing, and implementing data engineering solutions that drive business value.Key Responsibilities:Collaborate with cross-functional teams to design and develop data engineering solutionsDevelop...

  • Senior Engineer

    4 weeks ago


    New York, New York, United States Acquired Data Solutions Full time

    Job SummaryWe are seeking a highly skilled Senior Level Engineer to join our Transportation Security Laboratory (TSL) Team in Egg Harbor, NJ as Key Personnel to support Development Test & Evaluation (DT&E) of existing and emerging technologies for airport security equipment.Key ResponsibilitiesPerform in-depth engineering analysis of security related systems...

  • Senior Data Engineer

    4 weeks ago


    New York, New York, United States A Place For Mom Full time

    Job Title: Senior Data EngineerA Place for Mom is seeking a highly skilled Senior Data Engineer to join our team. As a Senior Data Engineer, you will be responsible for designing, developing, and maintaining our data warehouse on Databricks within AWS, ensuring optimal performance and reliability.Key Responsibilities:Design and develop ETL processes to...

  • Senior Data Engineer

    3 weeks ago


    New York, New York, United States TechnoGen Full time

    Job Title: Senior Data EngineerJob Summary:We are seeking a Senior Data Engineer to join our Data Infrastructure team at TechnoGen. As a Senior Data Engineer, you will be responsible for building and maintaining tools and infrastructure to write, test, and schedule batch data pipelines. Your work will enable other developers, data scientists, and analysts to...

  • Senior Data Engineer

    4 weeks ago


    New York, New York, United States Capital One Full time

    Job Title: Senior Data EngineerCapital One is seeking a Senior Data Engineer to join our team. As a Senior Data Engineer, you will be responsible for designing, developing, and implementing technical solutions in full-stack development tools and technologies.You will work with a team of developers with deep experience in machine learning, distributed...

  • Senior Data Engineer

    4 weeks ago


    New York, New York, United States Capital One Full time

    Job Title: Senior Data EngineerCapital One is seeking a Senior Data Engineer to join our team. As a Senior Data Engineer, you will be responsible for designing, developing, and implementing technical solutions in full-stack development tools and technologies.You will work with a team of developers with deep experience in machine learning, distributed...

  • Senior Data Engineer

    3 weeks ago


    New York, New York, United States Diverse Lynx Full time

    Job Title: Senior Data EngineerLocation: RemoteDuration: Long Term contractJob Description:We are seeking a highly skilled Senior Data Engineer to join our team at Diverse Lynx LLC. The ideal candidate will have 8 to 10 years of experience in Data Engineering space with AWS as primary cloud experience. Key responsibilities include conducting design reviews...

  • Senior Data Engineer

    3 weeks ago


    New York, New York, United States A-Line Staffing Solutions Full time

    Job Title: Senior Data EngineerJob Summary:A-Line Staffing Solutions is seeking a highly skilled Senior Data Engineer to join our team. As a Senior Data Engineer, you will be responsible for designing, developing, and maintaining complex data pipelines in cloud environments. You will work closely with our technical teams to ensure the smooth operation of our...

  • Azure Data Engineer

    4 weeks ago


    New York, New York, United States Hudson Data Full time

    Job Title: Azure Data Engineer - Design and Implement Data SolutionsLocation: NYC, NYDuration: Long Term W2 RoleJob Description:The ideal candidate will have hands-on experience with various Azure services, including Azure Data Factory, Databricks, Data Lake, and Power BI. They should be able to design, build, and maintain ETL pipelines, manage data lakes,...


  • New York, New York, United States Acquired Data Solutions Full time

    Job Title: Senior Security Systems EngineerWe are seeking a highly skilled Senior Security Systems Engineer to join our team at Acquired Data Solutions, Inc. in Egg Harbor, NJ.Job Summary:The successful candidate will be responsible for performing in-depth engineering analysis of security-related systems to determine their potential for further development,...

  • Senior Data Engineer

    4 weeks ago


    New York, New York, United States Amazon Full time

    Job Title: Senior Data EngineerAbout the Role:We are seeking a highly skilled Senior Data Engineer to join our team at Amazon. As a Senior Data Engineer, you will be responsible for designing and implementing large-scale data systems, leading complex technical initiatives, and collaborating with cross-functional teams to drive business outcomes.Key...


  • New York, New York, United States The Data Sherpas Full time

    Job Description:The Data Sherpas are a team of skilled engineers who help clients with their cloud journey. We are looking for a self-motivated and data-driven engineer to join our team.Responsibilities:Leverage DBT on Snowflake to build scalable transformations for landed dataBuild business logic and transform raw data for analytic, ML, and reporting use...

  • Senior Data Engineer

    4 weeks ago


    New York, New York, United States Capital One Full time

    Job Title: Senior Data EngineerAbout the Role:We are seeking a highly skilled Senior Data Engineer to join our team at Capital One. As a Senior Data Engineer, you will be responsible for designing, developing, and implementing large-scale data systems and architectures. You will work closely with cross-functional teams to deliver high-quality solutions that...


  • New York, New York, United States The Data Sherpas Full time

    About The Data SherpasWe are a team of highly skilled and motivated engineers who help our clients at every phase of their cloud journey.Our team has extensive experience in data and analytics engineering, with a strong foundation in Snowflake, FiveTran, and DBT.We are looking for a self-motivated and data-driven engineer to join our team and collaborate...


  • New York, New York, United States Glow Networks Full time

    Job Title: Senior Cloud Data EngineerJob Summary: We are seeking a highly skilled Senior Cloud Data Engineer to join our team at Glow Networks. As a Senior Cloud Data Engineer, you will be responsible for designing, building, and maintaining large-scale data engineering systems in the cloud.Key Responsibilities:* Design and implement data engineering systems...


  • New York, New York, United States Tech Tammina Full time

    Job Description**Senior Cloud Data Engineer**We are seeking a highly skilled Senior Cloud Data Engineer to join our team at Tech Tammina. As a Senior Cloud Data Engineer, you will be responsible for designing, developing, and maintaining data pipelines on Google Cloud Platform (GCP).The ideal candidate should have extensive experience in IT and data...

  • Senior Data Engineer

    3 weeks ago


    New York, New York, United States Justworks Full time

    Job DescriptionWe are seeking a highly skilled Senior Data Engineer to join our Tax Technology team at Justworks. As a Senior Data Engineer, you will be responsible for designing, building, and maintaining data pipelines and models that power tax computation, withholding, and reporting for our customers.Key Responsibilities:Design and build data pipelines...

  • Senior Data Engineer

    4 weeks ago


    New York, New York, United States NYU Langone Full time

    Job Title: Senior Data EngineerNYU Langone Health is a world-class, patient-centered, integrated academic medical center, known for its excellence in clinical care, research, and education. We are seeking a Senior Data Engineer to join our team.The Enterprise Data and Analytics EDA department at NYU Langone Health plays a crucial role in modern healthcare...