AWS Data Engineer

4 weeks ago

ParsippanyTroy Hills, United States Iris Software Inc. Full time

IRIS direct end client which is one of the leading American provider of human resources management software and services is urgently looking to hire AWS Data Engineer – Parsippany, NJ 07054 (Hybrid - 3 days per week). This is a Contract to hire Role opportunity.

AWS Data Engineer

Parsippany, NJ 07054 (Hybrid - 3 days per week)

Nature of Contract – Contract to hire Opportunity

Focus is : Databricks Products, AWS (Glue/Athena/kinesis/aurora etc.), Python or PySpark Development experience, building Data pipelines.

We are seeking a highly skilled AWS Data Engineer with expertise in building Data pipelines and processing solutions on the AWS platform, focusing on Databricks, Delta Lake, and Python development. The ideal candidate will have a strong background in relational and non-relational data architecture, data classification, and working collaboratively with Data Scientists and Architects.

Key Responsibilities:

  • Design, develop, and optimize Data pipelines and processing solutions on the AWS platform, emphasizing Databricks, Delta Lake, and Python.
  • Collaborate with Data Scientists, Architects, and business stakeholders to gather and clarify requirements for Data Lake components.
  • Utilize AWS services such as CloudFormation, Lambda, API Gateway, S3, DynamoDB, RDS, Glue, Athena, and QuickSight for data management and analysis.
  • Develop metadata-driven Data Lake solutions for ingesting historic and real-time structured/semi-structured/unstructured data.
  • Implement ETL/ELT pipelines and ensure data integrity, quality, and security throughout the process.
  • Manage changes in enterprise-grade operational Data Lake environments and ensure scalability and efficiency.
  • Utilize tools like Gliffy for creating diagrams representing Business Processes, ERD, and AWS Architecture.
  • Develop solutions for data Ingestion, Transformation, Cataloging, In-Place Querying, Storage, and Security following AWS best practices.
  • Experience in Relational/NOSQL database integration into an Enterprise Data Lake environment.
  • Set up AWS CloudWatch, CloudTrail for monitoring, and optimizing Data Lake environments.
  • Write SQL queries using AWS Athena and map various relational DB queries to Athena.
  • Proficient in Python, PySpark, and AWS Glue ETL jobs for data processing and transformations.
  • Follow and enforce strict standards for code quality, automated testing, infrastructure-as-code, and code maintainability.
  • Lead the development of user stories and translate requirements into Problem Statements in an agile collaborative environment.

Qualifications:

  • 10+ years of experience in data management with a focus on AWS Data solutions.
  • Strong expertise in relational and non-relational data architecture and classification.
  • Hands-on experience with Databricks, Delta Lake, AWS services, Python, or PySpark development.
  • Experience in designing and implementing ETL/ELT pipelines for Data processing.
  • Knowledge of AWS EMR and its application in data processing and analytics.
  • Proficiency in SQL queries using AWS Athena and mapping relational DB queries.
  • Experience in de-normalizing/flattening data structures in Parquet/ORC formats.
  • Good understanding of AWS IAM policies for implementing Data Lake security best practices.
  • Robust debugging skills and knowledge of automated testing platforms and unit tests.

Looking forward to hear from you...

Thanks and Regards,

Bharat Sharma

Sr. Technical Recruiter

IRIS Software, Inc.

  • AWS Data Engineer

    4 weeks ago

    Parsippany, United States Iris Software Inc. Full time

    IRIS direct end client which is one of the leading American provider of human resources management software and services is urgently looking to hire AWS Data Engineer – Parsippany, NJ 07054 (Hybrid - 3 days per week). This is a Contract to hire Role opportunity.AWS Data EngineerParsippany, NJ 07054 (Hybrid - 3 days per week)Nature of Contract – Contract...

  • AWS Data Engineer

    3 weeks ago

    Parsippany, United States Iris Software Inc. Full time

    IRIS direct end client which is one of the leading American provider of human resources management software and services is urgently looking to hire AWS Data Engineer – Parsippany, NJ 07054 (Hybrid - 3 days per week). This is a Contract to hire Role opportunity.AWS Data EngineerParsippany, NJ 07054 (Hybrid - 3 days per week)Nature of Contract – Contract...

  • Lead AWS Data Engineer

    4 days ago

    Beverly Hills, United States GSPANN Technologies, Inc Full time

    About GSPANNWe work in an exploding market of retail and e-commerce. We have served as a trusted business partner for some of the world’s most respected brands. We’ve worked with more than 200 organizations and have served as a trusted business partner for some of the world’s most respected brands. Our solutions have the businesses create...

  • Lead AWS Data Engineer

    3 days ago

    Beverly Hills, United States GSPANN Technologies, Inc Full time

    About GSPANNWe work in an exploding market of retail and e-commerce. We have served as a trusted business partner for some of the world’s most respected brands. We’ve worked with more than 200 organizations and have served as a trusted business partner for some of the world’s most respected brands. Our solutions have the businesses create...

  • Lead AWS Data Engineer

    2 days ago

    Beverly Hills, United States GSPANN Technologies, Inc Full time

    About GSPANNWe work in an exploding market of retail and e-commerce. We have served as a trusted business partner for some of the world’s most respected brands. We’ve worked with more than 200 organizations and have served as a trusted business partner for some of the world’s most respected brands. Our solutions have the businesses create...

  • AWS Data Scientist

    1 week ago

    Troy, United States Talascend SL, LLC Full time

    Talascend is currently seeking an AWS Data Scientist for a temp-to-hire position in Benton Harbor, Michigan. HYBRID SCHEDULE: Monday through Thursday on-site. Friday remote. RESPONSIBILITIES: Collaborate with cross-functional teams to identify and define data science projects that align with business objectives. Gather, clean, and preprocess large...

  • Lead AWS Data Engineer

    2 weeks ago

    Beverly Hills, United States VeeRteq Solutions Inc. Full time

    Job DescriptionJob DescriptionLead AWS Data Engineer (DBT/Redshift)Duration- Long ContractLocation-Beverly Hills, CA (LA Area)Job Type- Onsite onlyExperience Range- 8+ years of experienceKey Expectation:If you are very strong with SQL & Pyspark & Databricks along with DBT tool use/AWS Redshift experience and a Lead Data Engineer with very strong hands on SQL...

  • Data Engineer

    1 week ago

    Parsippany, United States Diverse Lynx Full time

    Job Title Data Engineer Skill Snowflake Minimum Experience 4 - 6 Years Qualification BACHELOR OF COMPUTER SCIENCE Location Newport Beach, C Job Description : Skill: Python, Snowflake, AWS, git, docker, azure DevOps, Control-M Enhance and maintain Python based ETL framework. Resolve any data issue or discrepancy in snowflake. Monitor...

  • AI Data Engineer

    1 week ago

    Troy, United States Hearst Full time

    Job Description MOTOR Information Systems, an operating group of Hearst, is actively seeking a team of enthusiastic, creative, and driven technologists. People with a proven track record, who are willing to experiment with new ideas, invest time in them, fail-fast, and move on if they don't work out. We want team members who have shown a consistent interest...

  • Cloud Data Engineer

    4 weeks ago

    Parsippany, United States QData Full time

    Responsibilities Create and maintain optimal data pipeline architecture Assemble large complex data sets that meet functional / non-functional business requirements. Identify design and implement internal process improvements automating manual processes optimizing data delivery re-designing infrastructure for greater scalability etc. Build the...

  • Cloud Data Engineer

    3 days ago

    Parsippany, New Jersey, United States QData Full time

    Responsibilities Create and maintain optimal data pipeline architecture Assemble large complex data sets that meet functional / non-functional business requirements. Identify design and implement internal process improvements automating manual processes optimizing data delivery re-designing infrastructure for greater scalability etc. Build the infrastructure...

  • Senior AWS Cloud Engineer

    7 days ago

    Vernon Hills, Illinois, United States CDW Technologies LLC Full time

    CDW Technologies LLC seeks Senior AWS Cloud Engineers to engage with clients and internal teams to provide automated, cloud native pattern solutions primarily to the public cloud service provider, Amazon Web Services (AWS); serve as billable consultant providing cloud native pattern engineering services to DV clients; provide automated, cloud-native pattern...

  • Senior AWS Cloud Engineer

    4 days ago

    Vernon Hills, United States CDW Technologies LLC Full time

    CDW Technologies LLC seeks Senior AWS Cloud Engineers to engage with clients and internal teams to provide automated, cloud native pattern solutions primarily to the public cloud service provider, Amazon Web Services (AWS); serve as billable consultant providing cloud native pattern engineering services to DV clients; provide automated, cloud-native pattern...

  • Data Engineer

    3 weeks ago

    Bloomfield Hills, United States Unified Tech Group Inc Full time

    Job DescriptionJob DescriptionSalary: Job Title:  Data Engineer                                          Job Duties: Perform full life cycle of data project architecture implementation. Design, code and debug database and business intelligence applications in various platforms including Oracle and MS SQL Server....

  • Lead Data Scientist

    4 weeks ago

    Parsippany, United States ADP Full time

    **ADP is hiring a Lead Data Scientist.** - _Does the thought of working with one of the most comprehensive employment data sets in the US excite you?_ - _Are you inspired by transformation and making an impact on the lives of millions of people every day?_ - _Are you a technologist first and foremost who approaches every problem wearing that hat while going...

  • AWS Devops Engineer-Cloud

    3 weeks ago

    Fountain Hills, United States Zortech Solutions Full time

    6-10 years of experience as AWS DevOps engineer Must have Terraform experience Hands-on experience in Terraform for infrastructure provisioning automation Experience with scripting languages like PowerShell Good understanding of OS Windows and Linux Knowledge of Agile and DevSecOps process methodology Very Good communication skills Willingness to learn Exp...

  • Senior Oracle Database Administrator

    3 weeks ago

    Parsippany-Troy Hills, United States High Bridge Consulting LLC Full time

    THIS IS W2 ONLY AND A RIGHT TO HIRE ROLE - NO SUBS OR AGENCIES PLEASE- NO VISA CANDIDATES EITHER - IT IS 3 DAYS A WEEK ON-SITEOur client, a global leader in the hospitality industry is seeking to hire a Senior Database Administrator with AWS Cloud Experience to join their team at Parsippany, New Jersey (Hybrid) office on a contract to hire basis.Essential...

  • Data Engineer

    1 week ago

    Troy, United States Delphi-US Full time

    Job Title: Data Engineer (Neo4J Graph Developer) - Contract - Job#4478Location: Remote Hybrid Troy, MI (2-4 days per month onsite for key project meetings) Job Description: Our client based in Troy, MI has an immediate requirement for a Data Engineer with strong Neo4J Development skills. The selected candidate will possess a strong passion for designing,...

  • SAP BI Data Architect

    1 day ago

    Troy, MI, United States A-Line Staffing Solutions Full time

    Title: Data Architect Our client is actively seeking a Data Engineer/Database Architect who possesses talent, passion and expertise to help design and implement highly scalable and available database solutions to support our growing business needs. Client’s Insights team is a new team with an exponential growth opportunity - both in terms of technology...

  • Senior Software Engineer, Backend

    1 week ago

    El Dorado Hills, United States Keeper Security Full time

    We are seeking a highly motivated and experienced backend Senior Software Engineer (Java/MySQL/AWS), to join our Keeper development team. The ideal candidate will be a positive and collaborative team player with a strong background in backend development. We are looking for someone to grow with our team in a fresh, fun, and innovative environment. This is a...