Current jobs related to Senior Data Engineer - New York - DBI Staffing
-
Senior Azure Data Engineer
4 days ago
New York, New York, United States Hudson Data Full timeJob Title: Senior Azure Data EngineerLocation: NYC, NYDuration: Long Term W2 RoleJob Description:The ideal candidate should have hands-on experience with various Azure services, including Azure Data Factory, Databricks, Data Lake, and Power BI. They should be able to design, build, and maintain ETL pipelines, manage data lakes, and create insightful reports...
-
Senior Data Engineer
1 week ago
New York, New York, United States The Data Sherpas Full timeJob SummaryWe are seeking a highly skilled Senior Data Engineer to lead our team in designing, developing, and deploying high-performance data analytics solutions on Google Cloud Platform (GCP). As a key member of our team, you will be responsible for architecting transformation and modernization of enterprise data solutions on GCP, integrating native GCP...
-
Senior Data Engineer
4 weeks ago
New York, New York, United States Net2Source Inc. Full timeJob Title: Senior Data EngineerWe are seeking a highly skilled Senior Data Engineer to join our team at Net2Source Inc. As a Senior Data Engineer, you will be responsible for designing and managing data ecosystems, particularly within the finance sector.Key Responsibilities:Building and maintaining data pipelines to ensure data quality and integrityDriving...
-
Senior Data Engineer
2 weeks ago
New York, New York, United States Capital One Full timeJob Title: Senior Data EngineerCapital One is seeking a Senior Data Engineer to join our team. As a Senior Data Engineer, you will be responsible for designing, developing, and implementing data engineering solutions that drive business value.Key Responsibilities:Collaborate with cross-functional teams to design and develop data engineering solutionsDevelop...
-
Senior Data Engineer
1 month ago
New York, New York, United States Harnham Full timeSenior Data EngineerAbout the RoleWe are seeking a highly skilled Senior Data Engineer to join our team at Harnham. As a Senior Data Engineer, you will be responsible for designing and developing comprehensive technical designs for both streaming and batch processing systems.Key ResponsibilitiesDevelop technical designs for streaming and batch processing...
-
Senior Data Engineer
3 weeks ago
New York, New York, United States Capital One Full timeJob Title: Senior Data EngineerCapital One is seeking a Senior Data Engineer to join our team. As a Senior Data Engineer, you will be responsible for designing, developing, and implementing data engineering solutions that drive business value.Key Responsibilities:Collaborate with cross-functional teams to design and develop data engineering solutions that...
-
Senior Data Engineer
2 weeks ago
New York, New York, United States Capital One Full timeJob Title: Senior Data EngineerCapital One is seeking a Senior Data Engineer to join our team. As a Senior Data Engineer, you will be responsible for designing, developing, and implementing data engineering solutions that drive business value.Key Responsibilities:Collaborate with cross-functional teams to design and develop data engineering solutionsDevelop...
-
Senior Data Engineer
2 weeks ago
New York, New York, United States Capital One Full timeJob Title: Senior Data EngineerCapital One is seeking a Senior Data Engineer to join our team. As a Senior Data Engineer, you will be responsible for designing, developing, and implementing data pipelines and architectures to support our business needs.About the Role:Collaborate with cross-functional teams to design and develop data pipelines and...
-
Senior Data Engineer
4 weeks ago
New York, New York, United States A Place For Mom Full timeJob Title: Senior Data EngineerWe are seeking a highly skilled Senior Data Engineer to join our team at A Place for Mom. As a Senior Data Engineer, you will be responsible for designing, developing, and maintaining our data warehouse on Databricks within AWS, ensuring optimal performance and reliability.Key Responsibilities:Design and develop ETL processes...
-
Senior Data Engineer
2 weeks ago
New York, New York, United States Silver Search, Inc Full timeSenior Data EngineerSilver Search, Inc is seeking a highly skilled Senior Data Engineer to join our data and analytics team. As a key member of our team, you will be responsible for designing and building data processing frameworks, working closely with data science and visualization teams, and ensuring the integrity and scalability of our data...
-
Senior Engineer
2 weeks ago
New York, New York, United States Acquired Data Solutions Full timeJob SummaryWe are seeking a highly skilled Senior Level Engineer to join our Transportation Security Laboratory (TSL) Team in Egg Harbor, NJ as Key Personnel to support Development Test & Evaluation (DT&E) of existing and emerging technologies for airport security equipment.Key ResponsibilitiesPerform in-depth engineering analysis of security related systems...
-
Senior Data Engineer
3 weeks ago
New York, New York, United States Coinbase Full timeJob Title: Senior Data EngineerWe are seeking a highly skilled Senior Data Engineer to join our team at Coinbase. As a Senior Data Engineer, you will be responsible for designing, building, and maintaining robust data pipelines, trusted data sources, and analytics/data products that inject automation into data science processes.Key Responsibilities:Design...
-
Senior Data Engineer
4 weeks ago
New York, New York, United States Coinbase Full timeJob Title: Senior Data EngineerWe are seeking a highly skilled Senior Data Engineer to join our team at Coinbase. As a Senior Data Engineer, you will be responsible for designing, building, and maintaining robust data pipelines, trusted data sources, and analytics/data products that inject automation into data science processes.Key Responsibilities:Design...
-
Senior Data Engineer
4 weeks ago
New York, New York, United States Tech Tammina Full timeSenior PySpark/Python EngineerWe are seeking a highly skilled Senior PySpark/Python Engineer to join our team at Tech Tammina. The ideal candidate will have a strong background in data engineering, with expertise in PySpark, Python, and related technologies.Key Responsibilities:Design and implement data pipelines using PySpark and PythonWork with data lakes,...
-
Senior Data Engineer
2 weeks ago
New York, New York, United States MidStream PA Full timeJoin Our Team as a Senior Data EngineerWe are seeking a highly skilled Senior Data Engineer to lead the development of our core data processing platform. As a key member of our engineering team, you will be responsible for designing and implementing scalable, reliable, and high-performance data systems.Your expertise in data modeling, warehousing, and...
-
Senior Data Engineer
2 weeks ago
New York, New York, United States A Place For Mom Full timeJob Title: Senior Data EngineerA Place for Mom is seeking a highly skilled Senior Data Engineer to join our team. As a Senior Data Engineer, you will be responsible for designing, developing, and maintaining our data warehouse on Databricks within AWS, ensuring optimal performance and reliability.Key Responsibilities:Design and develop ETL processes to...
-
Senior Data Engineer
1 month ago
New York, New York, United States TENTH MOUNTAIN LLC Full timeJob Title: Senior Data EngineerWe are seeking a highly skilled Senior Data Engineer to join our team at TENTH MOUNTAIN LLC. As a Senior Data Engineer, you will play a crucial role in migrating our existing data platform to an on-premises Hadoop environment.Key Responsibilities:Data Pipeline Development: Design and develop scalable, efficient ETL pipelines...
-
Senior Data Engineer
2 weeks ago
New York, New York, United States Capital One Full timeJob Title: Senior Data EngineerCapital One is seeking a Senior Data Engineer to join our team. As a Senior Data Engineer, you will be responsible for designing, developing, and implementing data engineering solutions that drive business value.Key Responsibilities:Collaborate with cross-functional teams to design and develop data engineering solutionsDevelop...
-
Senior Data Engineer
4 days ago
New York, New York, United States TechnoGen Full timeJob Title: Senior Data EngineerJob Summary:We are seeking a Senior Data Engineer to join our Data Infrastructure team at TechnoGen. As a Senior Data Engineer, you will be responsible for building and maintaining tools and infrastructure to write, test, and schedule batch data pipelines. Your work will enable other developers, data scientists, and analysts to...
-
Senior Engineer
4 weeks ago
New York, New York, United States Acquired Data Solutions Full timeJob OverviewWe are seeking a highly skilled Senior Level Engineer to join our Transportation Security Laboratory (TSL) Team in Egg Harbor, NJ as Key Personnel to support Development Test & Evaluation (DT&E) of existing and emerging technologies for airport security equipment.Key ResponsibilitiesPerform in-depth engineering analysis of security related...
Senior Data Engineer
2 months ago
The Data Engineer III will play a pivotal role in designing, developing, and maintaining the data architecture for our organization. This individual will be responsible for T-SQL development, ETL processes, and Python scripting to ensure efficient data transfer, transformation, and integration. The primary focus will be on automating data workflows, supporting diverse file formats, and utilizing APIs for seamless data import and export. The Data Engineer will collaborate closely with cross-functional teams to enhance data-driven decision-making and contribute to the overall success of our data infrastructure.
JOB RESPONSIBILITIES:
- Utilize advanced T-SQL skills to design, optimize, and maintain database structures.
- Develop complex SQL queries for reporting and data transformation.
- Design, implement, and optimize ETL processes for efficient data extraction, transformation, and loading.
- Develop and maintain ETL scripts using Python for seamless integration with existing data workflows.
- Automate SFTP file transfer processes, ensuring secure and reliable data exchange.
- Import and export data and files in various formats, including flat file, XML, JSON, X12, Excel, and Parquet using Python.
- Utilize Python to integrate with APIs for importing and exporting data.
- Collaborate with team members and stakeholders to review and optimize code for efficiency and maintainability.
- Collaborate with analysts and business stakeholders to understand data visualization requirements.
- Work closely with cross-functional teams to understand data requirements and ensure data integrity.
- Document data engineering processes, standards, and best practices.
- Use Git and Github for version control of scripts and queries, ensuring a collaborative and organized development environment.
- Integrate Tableau for effective data representation and reporting.
QUALIFICATIONS:
Education: Bachelor's Degree in Computer Science, Information Technology, or a related field.
Experience: Minimum of 5 years of hands-on experience in T-SQL development and ETL processes. Proven experience in Python scripting for data manipulation and automation.
Technical Skills: Strong expertise in database design, optimization, and maintenance using T-SQL. Proficient in developing and optimizing ETL processes. Experience with automating SFTP file transfers and handling diverse file formats. Knowledge of data formats such as XML, JSON, X12, Excel, and Parquet. Familiarity with API integration for data import and export using Python. Proficient in version controlling scripts and queries using Git and Github.
Preferred Skills: Experience in data visualization using Tableau. Strong problem-solving skills and ability to troubleshoot data-related issues effectively. Identify and implement solutions to complex technical projects. Ability to work independently and in a team environment. Excellent communication and collaboration skills. Knowledge of health care delivery and operations a plus.
If you are a data engineering professional with a solid background in T-SQL, ETL, Python scripting, and a passion for enhancing data infrastructure, we encourage you to apply and contribute to our dynamic and innovative team.
Please note this job description is not designed to cover or contain a comprehensive listing of activities, duties or responsibilities and activities may change at any time with or without notice.
[7038]
