AWS Data Engineer
3 weeks ago
IRIS direct end client which is one of the leading American provider of human resources management software and services is urgently looking to hire AWS Data Engineer – Parsippany, NJ 07054 (Hybrid - 3 days per week). This is a Contract to hire Role opportunity.
AWS Data Engineer
Parsippany, NJ 07054 (Hybrid - 3 days per week)
Nature of Contract – Contract to hire Opportunity
Focus is : Databricks Products, AWS (Glue/Athena/kinesis/aurora etc.), Python or PySpark Development experience, building Data pipelines.
We are seeking a highly skilled AWS Data Engineer with expertise in building Data pipelines and processing solutions on the AWS platform, focusing on Databricks, Delta Lake, and Python development. The ideal candidate will have a strong background in relational and non-relational data architecture, data classification, and working collaboratively with Data Scientists and Architects.
Key Responsibilities:
- Design, develop, and optimize Data pipelines and processing solutions on the AWS platform, emphasizing Databricks, Delta Lake, and Python.
- Collaborate with Data Scientists, Architects, and business stakeholders to gather and clarify requirements for Data Lake components.
- Utilize AWS services such as CloudFormation, Lambda, API Gateway, S3, DynamoDB, RDS, Glue, Athena, and QuickSight for data management and analysis.
- Develop metadata-driven Data Lake solutions for ingesting historic and real-time structured/semi-structured/unstructured data.
- Implement ETL/ELT pipelines and ensure data integrity, quality, and security throughout the process.
- Manage changes in enterprise-grade operational Data Lake environments and ensure scalability and efficiency.
- Utilize tools like Gliffy for creating diagrams representing Business Processes, ERD, and AWS Architecture.
- Develop solutions for data Ingestion, Transformation, Cataloging, In-Place Querying, Storage, and Security following AWS best practices.
- Experience in Relational/NOSQL database integration into an Enterprise Data Lake environment.
- Set up AWS CloudWatch, CloudTrail for monitoring, and optimizing Data Lake environments.
- Write SQL queries using AWS Athena and map various relational DB queries to Athena.
- Proficient in Python, PySpark, and AWS Glue ETL jobs for data processing and transformations.
- Follow and enforce strict standards for code quality, automated testing, infrastructure-as-code, and code maintainability.
- Lead the development of user stories and translate requirements into Problem Statements in an agile collaborative environment.
Qualifications:
- 10+ years of experience in data management with a focus on AWS Data solutions.
- Strong expertise in relational and non-relational data architecture and classification.
- Hands-on experience with Databricks, Delta Lake, AWS services, Python, or PySpark development.
- Experience in designing and implementing ETL/ELT pipelines for Data processing.
- Knowledge of AWS EMR and its application in data processing and analytics.
- Proficiency in SQL queries using AWS Athena and mapping relational DB queries.
- Experience in de-normalizing/flattening data structures in Parquet/ORC formats.
- Good understanding of AWS IAM policies for implementing Data Lake security best practices.
- Robust debugging skills and knowledge of automated testing platforms and unit tests.
Looking forward to hear from you...
Thanks and Regards,
Bharat Sharma
Sr. Technical Recruiter
IRIS Software, Inc.
-
Data Engineer
1 week ago
Parsippany, United States Diverse Lynx Full timeJob Title Data Engineer Skill Snowflake Minimum Experience 4 - 6 Years Qualification BACHELOR OF COMPUTER SCIENCE Location Newport Beach, C Job Description : Skill: Python, Snowflake, AWS, git, docker, azure DevOps, Control-M Enhance and maintain Python based ETL framework. Resolve any data issue or discrepancy in snowflake. Monitor...
-
Cloud Data Engineer
4 weeks ago
Parsippany, United States QData Full timeResponsibilities Create and maintain optimal data pipeline architecture Assemble large complex data sets that meet functional / non-functional business requirements. Identify design and implement internal process improvements automating manual processes optimizing data delivery re-designing infrastructure for greater scalability etc. Build the...
-
Cloud Data Engineer
3 days ago
Parsippany, New Jersey, United States QData Full timeResponsibilities Create and maintain optimal data pipeline architecture Assemble large complex data sets that meet functional / non-functional business requirements. Identify design and implement internal process improvements automating manual processes optimizing data delivery re-designing infrastructure for greater scalability etc. Build the infrastructure...
-
Lead Data Scientist
4 weeks ago
Parsippany, United States ADP Full time**ADP is hiring a Lead Data Scientist.** - _Does the thought of working with one of the most comprehensive employment data sets in the US excite you?_ - _Are you inspired by transformation and making an impact on the lives of millions of people every day?_ - _Are you a technologist first and foremost who approaches every problem wearing that hat while going...
-
GCP Data Engineer
3 weeks ago
Parsippany, United States Datalore Technologies Inc Full timePosition: GCP Data Engineer Location: Parsippany NJ (Hybrid) – weekly 3 days at client location Duration: Long Term contract Need Data Engineer with GCP Experience along with the below Primary Skills: * Python * Airflow * Cloud experience preferably with GCP * Version control - GIT * Terraform * SQL Skills * GCP Certification (Plus)
-
GCP Data Engineer
2 days ago
Parsippany, United States Avance Consulting Full timeJob DescriptionJob DescriptionGCP Data EngineerLocation: Parsippany / New JerseyTech stack: BigQuery , any ETL tool (Informatica, Talend, DataStage), Dataflow, Dataproc• 5 years Experience in Data warehouse and Data lake implementation• 3 years of experience in Google Cloud Platform (especially Big Query).• 1-2 years of working experience in converting...
-
Azure Data Engineer
4 weeks ago
Parsippany, United States QData Full timeData gets extracted using DataStage using FTP. The predictive modeling is done using R Python and Linux scripting.Primary Skills Python R SQL Datastage Linux scripting API knowledge SSIS. Supporting skills - Azure platform knowledge and Partykit. Experience on Azure Data factory and Databricks Candidate should have good Azure experience
-
Azure Data Engineer
3 weeks ago
Parsippany, New Jersey, United States QData Full timeData gets extracted using DataStage using FTP. The predictive modeling is done using R Python and Linux scripting.Primary Skills Python R SQL Datastage Linux scripting API knowledge SSIS. Supporting skills Azure platform knowledge and Partykit. Experience on Azure Data factory and Databricks Candidate should have good Azure experience
-
Data Science Intern
1 week ago
Parsippany, United States PNY Technologies Full timeMAIN FUNCTION: Support the IT department by assisting with data analysis, data visualization, and predictive modeling using tools such as Excel, PowerBI, and PNY's BI/Data Warehouse. Collaborate with team members to develop and implement data-driven solutions. Candidate is expected to grow and become more self-managed with providing status updates and...
-
Data Science Intern
4 weeks ago
Parsippany, United States PNY Technologies, Inc. Full timeJob DescriptionJob DescriptionMAIN FUNCTION:Support the IT department by assisting with data analysis, data visualization, and predictive modeling using tools such as Excel, PowerBI, and PNY's BI/Data Warehouse. Collaborate with team members to develop and implement data-driven solutions. Candidate is expected to grow and become more self-managed with...
-
Senior Database Administrator
1 week ago
Parsippany, United States Highbridge Consulting LLC Full timeOur client, a global leader in the hospitality industry is seeking to hire Senior Database Administrator with AWS Cloud Experience to join their team at Parsippany, New Jersey(Hybrid) office on contract to hire basis. Essential Job Functions: The Sr. Database Administrator is responsible for the administration and operations of the database systems....
-
Senior Oracle Database Administrator
6 days ago
Parsippany, United States Highbridge Consulting LLC Full timeTHIS IS W2 ONLY AND A RIGHT TO HIRE ROLE - NO SUBS OR AGENCIES PLEASE- NO VISA CANDIDATES EITHER - IT IS 3 DAYS A WEEK ON-SITEOur client, a global leader in the hospitality industry is seeking to hire a Senior Database Administrator with AWS Cloud Experience to join their team at Parsippany, New Jersey (Hybrid) office on a contract to hire basis.Essential...
-
Senior Oracle Database Administrator
2 days ago
Parsippany, United States Highbridge Consulting LLC Full timeTHIS IS W2 ONLY AND A RIGHT TO HIRE ROLE - NO SUBS OR AGENCIES PLEASE- NO VISA CANDIDATES EITHER - IT IS 3 DAYS A WEEK ON-SITE Our client, a global leader in the hospitality industry is seeking to hire a Senior Database Administrator with AWS Cloud Experience to join their team at Parsippany, New Jersey (Hybrid) office on a contract to hire basis. Essential...
-
Software Developer
1 week ago
Parsippany, United States MBIT Associates Full timeModify complex applications programs from detailed specifications, and code, test, debug, document, and maintain those programs. Experience must include: Sterling B2B Integrator, (SSP, PGP, CLA2), Sterling File Gateway, Gentran Integration Suite, EDI, ANSI X12, HL7, SQL Server, UNIX, Java, JDBC, REST API, AWS (S3). Perform requirement analysis and create...
-
Senior Oracle Database Administrator
3 weeks ago
Parsippany, United States High Bridge Consulting LLC Full timeTHIS IS W2 ONLY AND A RIGHT TO HIRE ROLE - NO SUBS OR AGENCIES PLEASE- NO VISA CANDIDATES EITHER - IT IS 3 DAYS A WEEK ON-SITEOur client, a global leader in the hospitality industry is seeking to hire a Senior Database Administrator with AWS Cloud Experience to join their team at Parsippany, New Jersey (Hybrid) office on a contract to hire basis.Essential...
-
Oracle DBA EBS
3 weeks ago
Parsippany, United States HIGH BRIDGE CONSULTING LLC Full timeJob DescriptionJob DescriptionOur client, a global leader in the hospitality industry is seeking to hire a Senior Oracle DBA with AWS Cloud Experience to join their team at Parsippany, NJ(Hybrid) office on a contract-to-hire basis.Essential Job Functions:The Sr. Database Administrator is responsible for the administration and operations of the database...
-
Senior Database Administrator
3 days ago
Parsippany, United States Diverse Lynx Full timeRole: Senior Database Administrator Type: Contract Contract Location: Parsippany, NJ (Hybrid 3 days in office, 2 days remote, locals only) Contract Duration: 4 months with possibility of right to hire Key Skills: Must have Oracle experience Must have AWS Cloud experience 10 + years exp in senior role Must have strong communication skills and be a...
-
Sr Software Engineer
19 hours ago
Parsippany, United States Agadia Systems Inc Full timeJob DescriptionJob DescriptionAbout AgadiaWe specialize in healthcare management technology and offer our clients a suite of utilization management software solutions. Our mission is dedicated to improving the quality of care and expediting the delivery of healthcare services by advancing and automating utilization management processes. We are based in...
-
DevOps Engineer
1 week ago
Parsippany, United States Dexter Technologies Full timeJob DescriptionJob DescriptionDexter Technologies Inc., is a leading provider of Staffing and Recruiting Services. For over two decades, we have put countless professionals to work at exciting opportunities. We are proud of the fact that many of them have been promoted to more senior roles: management, senior management, and senior executive leadership...
-
Principal Architect
2 days ago
Parsippany, United States ADP Full time**ADP Technology Services, Inc. is hiring a Principal Architect in our Parsippany, NJ location.** - Are you empathetic to client needs and inspired by transformation and impacting the lives of millions of people every day? - Are you looking to join a dynamic, inclusive team environment with a culture of collaboration and belonging? **Well, this may be the...