Senior Data Engineer
4 weeks ago
We are seeking a Senior Data Engineer with expertise in Databricks to join our team at Motion Recruitment.
The ideal candidate will have extensive experience in data engineering, working with large-scale data infrastructures, and optimizing ETL processes.
Key Responsibilities:
- Design, build, and maintain scalable data pipelines using Databricks and other cloud-based platforms.
- Collaborate with cross-functional teams to develop and implement data-driven solutions.
- Optimize ETL processes to improve data quality and reduce latency.
Requirements:
- Bachelor's or Master's degree in Computer Science, Data Engineering, or related field.
- At least 5 years of experience in data engineering, with a focus on building data pipelines.
- Proven experience with Databricks and Apache Spark.
- Strong proficiency in Python or Scala.
- Experience with cloud platforms such as AWS or Azure.
Desired Skills:
- Experience with real-time data processing.
- Knowledge of ML model deployment within data pipelines.
- Familiarity with Delta Lake and data lakes architecture.
What You Will Be Doing:
As a Senior Data Engineer, you will be instrumental in designing, building, and maintaining scalable data pipelines using Databricks and other cloud-based platforms.
You will collaborate with cross-functional teams to develop and implement data-driven solutions, and optimize ETL processes to improve data quality and reduce latency.
Tech Breakdown:
60% Databricks & Spark Development
40% ETL Optimization
Daily Responsibilities:
70% Hands-On Coding
20% Data Pipeline Design & Development
10% Documentation & Reporting
-
Senior Azure Data Engineer
3 weeks ago
New York, New York, United States Hudson Data Full timeJob Title: Senior Azure Data EngineerLocation: NYC, NYDuration: Long Term W2 RoleJob Description:The ideal candidate should have hands-on experience with various Azure services, including Azure Data Factory, Databricks, Data Lake, and Power BI. They should be able to design, build, and maintain ETL pipelines, manage data lakes, and create insightful reports...
-
Senior Data Engineer
4 weeks ago
New York, New York, United States The Data Sherpas Full timeJob SummaryWe are seeking a highly skilled Senior Data Engineer to lead our team in designing, developing, and deploying high-performance data analytics solutions on Google Cloud Platform (GCP). As a key member of our team, you will be responsible for architecting transformation and modernization of enterprise data solutions on GCP, integrating native GCP...
-
Senior Data Engineer
4 weeks ago
New York, New York, United States Capital One Full timeJob Title: Senior Data EngineerCapital One is seeking a Senior Data Engineer to join our team. As a Senior Data Engineer, you will be responsible for designing, developing, and implementing data engineering solutions that drive business value.Key Responsibilities:Collaborate with cross-functional teams to design and develop data engineering solutionsDevelop...
-
Senior Engineer
4 weeks ago
New York, New York, United States Acquired Data Solutions Full timeJob SummaryWe are seeking a highly skilled Senior Level Engineer to join our Transportation Security Laboratory (TSL) Team in Egg Harbor, NJ as Key Personnel to support Development Test & Evaluation (DT&E) of existing and emerging technologies for airport security equipment.Key ResponsibilitiesPerform in-depth engineering analysis of security related systems...
-
Senior Data Engineer
4 weeks ago
New York, New York, United States A Place For Mom Full timeJob Title: Senior Data EngineerA Place for Mom is seeking a highly skilled Senior Data Engineer to join our team. As a Senior Data Engineer, you will be responsible for designing, developing, and maintaining our data warehouse on Databricks within AWS, ensuring optimal performance and reliability.Key Responsibilities:Design and develop ETL processes to...
-
Senior Data Engineer
3 weeks ago
New York, New York, United States TechnoGen Full timeJob Title: Senior Data EngineerJob Summary:We are seeking a Senior Data Engineer to join our Data Infrastructure team at TechnoGen. As a Senior Data Engineer, you will be responsible for building and maintaining tools and infrastructure to write, test, and schedule batch data pipelines. Your work will enable other developers, data scientists, and analysts to...
-
Senior Data Engineer
4 weeks ago
New York, New York, United States Capital One Full timeJob Title: Senior Data EngineerCapital One is seeking a Senior Data Engineer to join our team. As a Senior Data Engineer, you will be responsible for designing, developing, and implementing technical solutions in full-stack development tools and technologies.You will work with a team of developers with deep experience in machine learning, distributed...
-
Senior Data Engineer
4 weeks ago
New York, New York, United States Capital One Full timeJob Title: Senior Data EngineerCapital One is seeking a Senior Data Engineer to join our team. As a Senior Data Engineer, you will be responsible for designing, developing, and implementing technical solutions in full-stack development tools and technologies.You will work with a team of developers with deep experience in machine learning, distributed...
-
Senior Data Engineer
3 weeks ago
New York, New York, United States Diverse Lynx Full timeJob Title: Senior Data EngineerLocation: RemoteDuration: Long Term contractJob Description:We are seeking a highly skilled Senior Data Engineer to join our team at Diverse Lynx LLC. The ideal candidate will have 8 to 10 years of experience in Data Engineering space with AWS as primary cloud experience. Key responsibilities include conducting design reviews...
-
Senior Data Engineer
3 weeks ago
New York, New York, United States A-Line Staffing Solutions Full timeJob Title: Senior Data EngineerJob Summary:A-Line Staffing Solutions is seeking a highly skilled Senior Data Engineer to join our team. As a Senior Data Engineer, you will be responsible for designing, developing, and maintaining complex data pipelines in cloud environments. You will work closely with our technical teams to ensure the smooth operation of our...
-
Azure Data Engineer
4 weeks ago
New York, New York, United States Hudson Data Full timeJob Title: Azure Data Engineer - Design and Implement Data SolutionsLocation: NYC, NYDuration: Long Term W2 RoleJob Description:The ideal candidate will have hands-on experience with various Azure services, including Azure Data Factory, Databricks, Data Lake, and Power BI. They should be able to design, build, and maintain ETL pipelines, manage data lakes,...
-
Senior Security Systems Engineer
4 weeks ago
New York, New York, United States Acquired Data Solutions Full timeJob Title: Senior Security Systems EngineerWe are seeking a highly skilled Senior Security Systems Engineer to join our team at Acquired Data Solutions, Inc. in Egg Harbor, NJ.Job Summary:The successful candidate will be responsible for performing in-depth engineering analysis of security-related systems to determine their potential for further development,...
-
Senior Data Engineer
4 weeks ago
New York, New York, United States Amazon Full timeJob Title: Senior Data EngineerAbout the Role:We are seeking a highly skilled Senior Data Engineer to join our team at Amazon. As a Senior Data Engineer, you will be responsible for designing and implementing large-scale data systems, leading complex technical initiatives, and collaborating with cross-functional teams to drive business outcomes.Key...
-
Data Engineer for Cloud Data Platforms
4 weeks ago
New York, New York, United States The Data Sherpas Full timeJob Description:The Data Sherpas are a team of skilled engineers who help clients with their cloud journey. We are looking for a self-motivated and data-driven engineer to join our team.Responsibilities:Leverage DBT on Snowflake to build scalable transformations for landed dataBuild business logic and transform raw data for analytic, ML, and reporting use...
-
Senior Data Engineer
4 weeks ago
New York, New York, United States Capital One Full timeJob Title: Senior Data EngineerAbout the Role:We are seeking a highly skilled Senior Data Engineer to join our team at Capital One. As a Senior Data Engineer, you will be responsible for designing, developing, and implementing large-scale data systems and architectures. You will work closely with cross-functional teams to deliver high-quality solutions that...
-
Data Engineering Specialist
3 weeks ago
New York, New York, United States The Data Sherpas Full timeAbout The Data SherpasWe are a team of highly skilled and motivated engineers who help our clients at every phase of their cloud journey.Our team has extensive experience in data and analytics engineering, with a strong foundation in Snowflake, FiveTran, and DBT.We are looking for a self-motivated and data-driven engineer to join our team and collaborate...
-
Senior Cloud Data Engineer
3 weeks ago
New York, New York, United States Glow Networks Full timeJob Title: Senior Cloud Data EngineerJob Summary: We are seeking a highly skilled Senior Cloud Data Engineer to join our team at Glow Networks. As a Senior Cloud Data Engineer, you will be responsible for designing, building, and maintaining large-scale data engineering systems in the cloud.Key Responsibilities:* Design and implement data engineering systems...
-
Senior Cloud Data Engineer
4 weeks ago
New York, New York, United States Tech Tammina Full timeJob Description**Senior Cloud Data Engineer**We are seeking a highly skilled Senior Cloud Data Engineer to join our team at Tech Tammina. As a Senior Cloud Data Engineer, you will be responsible for designing, developing, and maintaining data pipelines on Google Cloud Platform (GCP).The ideal candidate should have extensive experience in IT and data...
-
Senior Data Engineer
3 weeks ago
New York, New York, United States Justworks Full timeJob DescriptionWe are seeking a highly skilled Senior Data Engineer to join our Tax Technology team at Justworks. As a Senior Data Engineer, you will be responsible for designing, building, and maintaining data pipelines and models that power tax computation, withholding, and reporting for our customers.Key Responsibilities:Design and build data pipelines...
-
Senior Data Engineer
4 weeks ago
New York, New York, United States NYU Langone Full timeJob Title: Senior Data EngineerNYU Langone Health is a world-class, patient-centered, integrated academic medical center, known for its excellence in clinical care, research, and education. We are seeking a Senior Data Engineer to join our team.The Enterprise Data and Analytics EDA department at NYU Langone Health plays a crucial role in modern healthcare...