Current jobs related to Senior Data Engineer - New York, New York - Professional Search Group (PSG)
-
Senior Azure Data Engineer
4 days ago
New York, New York, United States Hudson Data Full timeJob Title: Senior Azure Data EngineerLocation: NYC, NYDuration: Long Term W2 RoleJob Description:The ideal candidate should have hands-on experience with various Azure services, including Azure Data Factory, Databricks, Data Lake, and Power BI. They should be able to design, build, and maintain ETL pipelines, manage data lakes, and create insightful reports...
-
Senior Data Engineer
1 week ago
New York, New York, United States The Data Sherpas Full timeJob SummaryWe are seeking a highly skilled Senior Data Engineer to lead our team in designing, developing, and deploying high-performance data analytics solutions on Google Cloud Platform (GCP). As a key member of our team, you will be responsible for architecting transformation and modernization of enterprise data solutions on GCP, integrating native GCP...
-
Senior Data Engineer
4 weeks ago
New York, New York, United States Net2Source Inc. Full timeJob Title: Senior Data EngineerWe are seeking a highly skilled Senior Data Engineer to join our team at Net2Source Inc. As a Senior Data Engineer, you will be responsible for designing and managing data ecosystems, particularly within the finance sector.Key Responsibilities:Building and maintaining data pipelines to ensure data quality and integrityDriving...
-
Senior Data Engineer
2 weeks ago
New York, New York, United States Capital One Full timeJob Title: Senior Data EngineerCapital One is seeking a Senior Data Engineer to join our team. As a Senior Data Engineer, you will be responsible for designing, developing, and implementing data engineering solutions that drive business value.Key Responsibilities:Collaborate with cross-functional teams to design and develop data engineering solutionsDevelop...
-
Senior Data Engineer
1 month ago
New York, New York, United States Harnham Full timeSenior Data EngineerAbout the RoleWe are seeking a highly skilled Senior Data Engineer to join our team at Harnham. As a Senior Data Engineer, you will be responsible for designing and developing comprehensive technical designs for both streaming and batch processing systems.Key ResponsibilitiesDevelop technical designs for streaming and batch processing...
-
Senior Data Engineer
3 weeks ago
New York, New York, United States Capital One Full timeJob Title: Senior Data EngineerCapital One is seeking a Senior Data Engineer to join our team. As a Senior Data Engineer, you will be responsible for designing, developing, and implementing data engineering solutions that drive business value.Key Responsibilities:Collaborate with cross-functional teams to design and develop data engineering solutions that...
-
Senior Data Engineer
2 weeks ago
New York, New York, United States Capital One Full timeJob Title: Senior Data EngineerCapital One is seeking a Senior Data Engineer to join our team. As a Senior Data Engineer, you will be responsible for designing, developing, and implementing data engineering solutions that drive business value.Key Responsibilities:Collaborate with cross-functional teams to design and develop data engineering solutionsDevelop...
-
Senior Data Engineer
2 weeks ago
New York, New York, United States Capital One Full timeJob Title: Senior Data EngineerCapital One is seeking a Senior Data Engineer to join our team. As a Senior Data Engineer, you will be responsible for designing, developing, and implementing data pipelines and architectures to support our business needs.About the Role:Collaborate with cross-functional teams to design and develop data pipelines and...
-
Senior Data Engineer
4 weeks ago
New York, New York, United States A Place For Mom Full timeJob Title: Senior Data EngineerWe are seeking a highly skilled Senior Data Engineer to join our team at A Place for Mom. As a Senior Data Engineer, you will be responsible for designing, developing, and maintaining our data warehouse on Databricks within AWS, ensuring optimal performance and reliability.Key Responsibilities:Design and develop ETL processes...
-
Senior Data Engineer
2 weeks ago
New York, New York, United States Silver Search, Inc Full timeSenior Data EngineerSilver Search, Inc is seeking a highly skilled Senior Data Engineer to join our data and analytics team. As a key member of our team, you will be responsible for designing and building data processing frameworks, working closely with data science and visualization teams, and ensuring the integrity and scalability of our data...
-
Senior Engineer
2 weeks ago
New York, New York, United States Acquired Data Solutions Full timeJob SummaryWe are seeking a highly skilled Senior Level Engineer to join our Transportation Security Laboratory (TSL) Team in Egg Harbor, NJ as Key Personnel to support Development Test & Evaluation (DT&E) of existing and emerging technologies for airport security equipment.Key ResponsibilitiesPerform in-depth engineering analysis of security related systems...
-
Senior Data Engineer
3 weeks ago
New York, New York, United States Coinbase Full timeJob Title: Senior Data EngineerWe are seeking a highly skilled Senior Data Engineer to join our team at Coinbase. As a Senior Data Engineer, you will be responsible for designing, building, and maintaining robust data pipelines, trusted data sources, and analytics/data products that inject automation into data science processes.Key Responsibilities:Design...
-
Senior Data Engineer
4 weeks ago
New York, New York, United States Coinbase Full timeJob Title: Senior Data EngineerWe are seeking a highly skilled Senior Data Engineer to join our team at Coinbase. As a Senior Data Engineer, you will be responsible for designing, building, and maintaining robust data pipelines, trusted data sources, and analytics/data products that inject automation into data science processes.Key Responsibilities:Design...
-
Senior Data Engineer
4 weeks ago
New York, New York, United States Tech Tammina Full timeSenior PySpark/Python EngineerWe are seeking a highly skilled Senior PySpark/Python Engineer to join our team at Tech Tammina. The ideal candidate will have a strong background in data engineering, with expertise in PySpark, Python, and related technologies.Key Responsibilities:Design and implement data pipelines using PySpark and PythonWork with data lakes,...
-
Senior Data Engineer
2 weeks ago
New York, New York, United States MidStream PA Full timeJoin Our Team as a Senior Data EngineerWe are seeking a highly skilled Senior Data Engineer to lead the development of our core data processing platform. As a key member of our engineering team, you will be responsible for designing and implementing scalable, reliable, and high-performance data systems.Your expertise in data modeling, warehousing, and...
-
Senior Data Engineer
2 weeks ago
New York, New York, United States A Place For Mom Full timeJob Title: Senior Data EngineerA Place for Mom is seeking a highly skilled Senior Data Engineer to join our team. As a Senior Data Engineer, you will be responsible for designing, developing, and maintaining our data warehouse on Databricks within AWS, ensuring optimal performance and reliability.Key Responsibilities:Design and develop ETL processes to...
-
Senior Data Engineer
1 month ago
New York, New York, United States TENTH MOUNTAIN LLC Full timeJob Title: Senior Data EngineerWe are seeking a highly skilled Senior Data Engineer to join our team at TENTH MOUNTAIN LLC. As a Senior Data Engineer, you will play a crucial role in migrating our existing data platform to an on-premises Hadoop environment.Key Responsibilities:Data Pipeline Development: Design and develop scalable, efficient ETL pipelines...
-
Senior Data Engineer
2 weeks ago
New York, New York, United States Capital One Full timeJob Title: Senior Data EngineerCapital One is seeking a Senior Data Engineer to join our team. As a Senior Data Engineer, you will be responsible for designing, developing, and implementing data engineering solutions that drive business value.Key Responsibilities:Collaborate with cross-functional teams to design and develop data engineering solutionsDevelop...
-
Senior Data Engineer
4 days ago
New York, New York, United States TechnoGen Full timeJob Title: Senior Data EngineerJob Summary:We are seeking a Senior Data Engineer to join our Data Infrastructure team at TechnoGen. As a Senior Data Engineer, you will be responsible for building and maintaining tools and infrastructure to write, test, and schedule batch data pipelines. Your work will enable other developers, data scientists, and analysts to...
-
Senior Engineer
4 weeks ago
New York, New York, United States Acquired Data Solutions Full timeJob OverviewWe are seeking a highly skilled Senior Level Engineer to join our Transportation Security Laboratory (TSL) Team in Egg Harbor, NJ as Key Personnel to support Development Test & Evaluation (DT&E) of existing and emerging technologies for airport security equipment.Key ResponsibilitiesPerform in-depth engineering analysis of security related...
Senior Data Engineer
2 months ago
We are seeking a highly skilled Sr. Data Engineer to join our team at Professional Search Group (PSG). As a key member of our data engineering team, you will play a crucial role in shaping the future of entertainment through innovation.
Key Responsibilities- Contribute to the design, development, and maintenance of large-scale data pipelines using Scala and Python/Spark.
- Extend the functionality of our Core Data platform, including metadata parsing, API integrations, and data ingestion.
- Implement Lakehouse architecture, collaborating with stakeholders to shift towards a data platform-centric approach.
- Develop shared libraries in Scala and Python to abstract complex business logic and ensure consistent functionality across data pipelines.
- Collaborate with product managers, architects, and engineers to drive the success of the Core Data platform.
- Contribute to developing and documenting internal and external standards and best practices for pipeline configurations, naming conventions, and more.
- Ensure high operational efficiency and quality of the Core Data platform datasets to meet SLAs and project reliability and accuracy.
- Participate in agile/scrum ceremonies to improve processes and collaborate with the team.
- Engage with customers to understand their needs and prioritize innovative offerings and platform improvements.
- Maintain detailed documentation of work and changes to support data quality and governance requirements.
- 5+ years of data engineering experience developing large data pipelines.
- Strong algorithmic problem-solving expertise.
- Strong fundamental Scala and Python programming skills.
- Basic understanding of AWS or other cloud provider resources.
- Strong SQL skills and ability to create queries to analyze complex datasets.
- Hands-on production environment experience with distributed processing systems like Spark.
- Hands-on production experience with data pipeline orchestration systems like Airflow.
- Some scripting language experience.
- Willingness and ability to learn and pick up new skillsets.
- Self-starting problem solver with an eye for detail and excellent analytical and communication skills.
- Experience with at least one major Massively Parallel Processing (MPP) or cloud database technology.
- Experience in developing APIs with GraphQL.
- Deep understanding of AWS or other cloud providers as well as infrastructure as code.
- Familiarity with Data Modeling techniques and Data Warehousing standard methodologies and practices.
- Familiarity with Scrum and Agile methodologies.
