AWS Data Engineer

3 weeks ago


Parsippany, United States Iris Software Inc. Full time

IRIS direct end client which is one of the leading American provider of human resources management software and services is urgently looking to hire AWS Data EngineerParsippany, NJ 07054 (Hybrid - 3 days per week). This is a Contract to hire Role opportunity.

AWS Data Engineer

Parsippany, NJ 07054 (Hybrid - 3 days per week)

Nature of Contract – Contract to hire Opportunity

Focus is : Databricks Products, AWS (Glue/Athena/kinesis/aurora etc.), Python or PySpark Development experience, building Data pipelines.

We are seeking a highly skilled AWS Data Engineer with expertise in building Data pipelines and processing solutions on the AWS platform, focusing on Databricks, Delta Lake, and Python development. The ideal candidate will have a strong background in relational and non-relational data architecture, data classification, and working collaboratively with Data Scientists and Architects.

Key Responsibilities:

  • Design, develop, and optimize Data pipelines and processing solutions on the AWS platform, emphasizing Databricks, Delta Lake, and Python.
  • Collaborate with Data Scientists, Architects, and business stakeholders to gather and clarify requirements for Data Lake components.
  • Utilize AWS services such as CloudFormation, Lambda, API Gateway, S3, DynamoDB, RDS, Glue, Athena, and QuickSight for data management and analysis.
  • Develop metadata-driven Data Lake solutions for ingesting historic and real-time structured/semi-structured/unstructured data.
  • Implement ETL/ELT pipelines and ensure data integrity, quality, and security throughout the process.
  • Manage changes in enterprise-grade operational Data Lake environments and ensure scalability and efficiency.
  • Utilize tools like Gliffy for creating diagrams representing Business Processes, ERD, and AWS Architecture.
  • Develop solutions for data Ingestion, Transformation, Cataloging, In-Place Querying, Storage, and Security following AWS best practices.
  • Experience in Relational/NOSQL database integration into an Enterprise Data Lake environment.
  • Set up AWS CloudWatch, CloudTrail for monitoring, and optimizing Data Lake environments.
  • Write SQL queries using AWS Athena and map various relational DB queries to Athena.
  • Proficient in Python, PySpark, and AWS Glue ETL jobs for data processing and transformations.
  • Follow and enforce strict standards for code quality, automated testing, infrastructure-as-code, and code maintainability.
  • Lead the development of user stories and translate requirements into Problem Statements in an agile collaborative environment.

Qualifications:

  • 10+ years of experience in data management with a focus on AWS Data solutions.
  • Strong expertise in relational and non-relational data architecture and classification.
  • Hands-on experience with Databricks, Delta Lake, AWS services, Python, or PySpark development.
  • Experience in designing and implementing ETL/ELT pipelines for Data processing.
  • Knowledge of AWS EMR and its application in data processing and analytics.
  • Proficiency in SQL queries using AWS Athena and mapping relational DB queries.
  • Experience in de-normalizing/flattening data structures in Parquet/ORC formats.
  • Good understanding of AWS IAM policies for implementing Data Lake security best practices.
  • Robust debugging skills and knowledge of automated testing platforms and unit tests.

Looking forward to hear from you...

Thanks and Regards,

Bharat Sharma

Sr. Technical Recruiter

IRIS Software, Inc.


  • Data Engineer

    1 week ago


    Parsippany, United States Diverse Lynx Full time

    Job Title Data Engineer Skill Snowflake Minimum Experience 4 - 6 Years Qualification BACHELOR OF COMPUTER SCIENCE Location Newport Beach, C Job Description : Skill: Python, Snowflake, AWS, git, docker, azure DevOps, Control-M Enhance and maintain Python based ETL framework. Resolve any data issue or discrepancy in snowflake. Monitor...

  • Cloud Data Engineer

    4 weeks ago


    Parsippany, United States QData Full time

    Responsibilities Create and maintain optimal data pipeline architecture Assemble large complex data sets that meet functional / non-functional business requirements. Identify design and implement internal process improvements automating manual processes optimizing data delivery re-designing infrastructure for greater scalability etc. Build the...

  • Cloud Data Engineer

    3 days ago


    Parsippany, New Jersey, United States QData Full time

    Responsibilities Create and maintain optimal data pipeline architecture Assemble large complex data sets that meet functional / non-functional business requirements. Identify design and implement internal process improvements automating manual processes optimizing data delivery re-designing infrastructure for greater scalability etc. Build the infrastructure...

  • Lead Data Scientist

    4 weeks ago


    Parsippany, United States ADP Full time

    **ADP is hiring a Lead Data Scientist.** - _Does the thought of working with one of the most comprehensive employment data sets in the US excite you?_ - _Are you inspired by transformation and making an impact on the lives of millions of people every day?_ - _Are you a technologist first and foremost who approaches every problem wearing that hat while going...

  • GCP Data Engineer

    3 weeks ago


    Parsippany, United States Datalore Technologies Inc Full time

    Position: GCP Data Engineer Location: Parsippany NJ (Hybrid) – weekly 3 days at client location Duration: Long Term contract Need Data Engineer with GCP Experience along with the below Primary Skills: * Python * Airflow * Cloud experience preferably with GCP * Version control - GIT * Terraform * SQL Skills * GCP Certification (Plus)

  • GCP Data Engineer

    2 days ago


    Parsippany, United States Avance Consulting Full time

    Job DescriptionJob DescriptionGCP Data EngineerLocation: Parsippany / New JerseyTech stack: BigQuery , any ETL tool (Informatica, Talend, DataStage), Dataflow, Dataproc• 5 years Experience in Data warehouse and Data lake implementation• 3 years of experience in Google Cloud Platform (especially Big Query).• 1-2 years of working experience in converting...

  • Azure Data Engineer

    4 weeks ago


    Parsippany, United States QData Full time

    Data gets extracted using DataStage using FTP. The predictive modeling is done using R Python and Linux scripting.Primary Skills Python R SQL Datastage Linux scripting API knowledge SSIS. Supporting skills - Azure platform knowledge and Partykit. Experience on Azure Data factory and Databricks Candidate should have good Azure experience

  • Azure Data Engineer

    3 weeks ago


    Parsippany, New Jersey, United States QData Full time

    Data gets extracted using DataStage using FTP. The predictive modeling is done using R Python and Linux scripting.Primary Skills Python R SQL Datastage Linux scripting API knowledge SSIS. Supporting skills Azure platform knowledge and Partykit. Experience on Azure Data factory and Databricks Candidate should have good Azure experience

  • Data Science Intern

    1 week ago


    Parsippany, United States PNY Technologies Full time

    MAIN FUNCTION: Support the IT department by assisting with data analysis, data visualization, and predictive modeling using tools such as Excel, PowerBI, and PNY's BI/Data Warehouse. Collaborate with team members to develop and implement data-driven solutions. Candidate is expected to grow and become more self-managed with providing status updates and...

  • Data Science Intern

    4 weeks ago


    Parsippany, United States PNY Technologies, Inc. Full time

    Job DescriptionJob DescriptionMAIN FUNCTION:Support the IT department by assisting with data analysis, data visualization, and predictive modeling using tools such as Excel, PowerBI, and PNY's BI/Data Warehouse. Collaborate with team members to develop and implement data-driven solutions. Candidate is expected to grow and become more self-managed with...


  • Parsippany, United States Highbridge Consulting LLC Full time

    Our client, a global leader in the hospitality industry is seeking to hire Senior Database Administrator with AWS Cloud Experience to join their team at Parsippany, New Jersey(Hybrid) office on contract to hire basis. Essential Job Functions: The Sr. Database Administrator is responsible for the administration and operations of the database systems....


  • Parsippany, United States Highbridge Consulting LLC Full time

    THIS IS W2 ONLY AND A RIGHT TO HIRE ROLE - NO SUBS OR AGENCIES PLEASE- NO VISA CANDIDATES EITHER - IT IS 3 DAYS A WEEK ON-SITEOur client, a global leader in the hospitality industry is seeking to hire a Senior Database Administrator with AWS Cloud Experience to join their team at Parsippany, New Jersey (Hybrid) office on a contract to hire basis.Essential...


  • Parsippany, United States Highbridge Consulting LLC Full time

    THIS IS W2 ONLY AND A RIGHT TO HIRE ROLE - NO SUBS OR AGENCIES PLEASE- NO VISA CANDIDATES EITHER - IT IS 3 DAYS A WEEK ON-SITE Our client, a global leader in the hospitality industry is seeking to hire a Senior Database Administrator with AWS Cloud Experience to join their team at Parsippany, New Jersey (Hybrid) office on a contract to hire basis. Essential...

  • Software Developer

    1 week ago


    Parsippany, United States MBIT Associates Full time

    Modify complex applications programs from detailed specifications, and code, test, debug, document, and maintain those programs. Experience must include: Sterling B2B Integrator, (SSP, PGP, CLA2), Sterling File Gateway, Gentran Integration Suite, EDI, ANSI X12, HL7, SQL Server, UNIX, Java, JDBC, REST API, AWS (S3). Perform requirement analysis and create...


  • Parsippany, United States High Bridge Consulting LLC Full time

    THIS IS W2 ONLY AND A RIGHT TO HIRE ROLE - NO SUBS OR AGENCIES PLEASE- NO VISA CANDIDATES EITHER - IT IS 3 DAYS A WEEK ON-SITEOur client, a global leader in the hospitality industry is seeking to hire a Senior Database Administrator with AWS Cloud Experience to join their team at Parsippany, New Jersey (Hybrid) office on a contract to hire basis.Essential...

  • Oracle DBA EBS

    3 weeks ago


    Parsippany, United States HIGH BRIDGE CONSULTING LLC Full time

    Job DescriptionJob DescriptionOur client, a global leader in the hospitality industry is seeking to hire a Senior Oracle DBA with AWS Cloud Experience to join their team at Parsippany, NJ(Hybrid) office on a contract-to-hire basis.Essential Job Functions:The Sr. Database Administrator is responsible for the administration and operations of the database...


  • Parsippany, United States Diverse Lynx Full time

    Role: Senior Database Administrator Type: Contract Contract Location: Parsippany, NJ (Hybrid 3 days in office, 2 days remote, locals only) Contract Duration: 4 months with possibility of right to hire Key Skills: Must have Oracle experience Must have AWS Cloud experience 10 + years exp in senior role Must have strong communication skills and be a...

  • Sr Software Engineer

    19 hours ago


    Parsippany, United States Agadia Systems Inc Full time

    Job DescriptionJob DescriptionAbout AgadiaWe specialize in healthcare management technology and offer our clients a suite of utilization management software solutions. Our mission is dedicated to improving the quality of care and expediting the delivery of healthcare services by advancing and automating utilization management processes. We are based in...

  • DevOps Engineer

    1 week ago


    Parsippany, United States Dexter Technologies Full time

    Job DescriptionJob DescriptionDexter Technologies Inc., is a leading provider of Staffing and Recruiting Services. For over two decades, we have put countless professionals to work at exciting opportunities. We are proud of the fact that many of them have been promoted to more senior roles: management, senior management, and senior executive leadership...

  • Principal Architect

    2 days ago


    Parsippany, United States ADP Full time

    **ADP Technology Services, Inc. is hiring a Principal Architect in our Parsippany, NJ location.** - Are you empathetic to client needs and inspired by transformation and impacting the lives of millions of people every day? - Are you looking to join a dynamic, inclusive team environment with a culture of collaboration and belonging? **Well, this may be the...