Cloud Data Engineer, AWS

5 months ago

Jersey City, United States CyberTec Full time
Verisk
12+ Years
$65 C2C
No H1B, CPT
AWS Data Engineer
Position: Cloud Data Engineer, AWS
Location: Jersey City New Jersey 07310 (Hybrid, 3 days in a week) ( Only local)
Duration: 6+ Months Contract

Job Description:

Required Skills:
Description:
We are looking for a Cloud Data Engineer, who will be responsible to plan, design, develop and maintain the data architecture, data models, data pipelines and standards for various Data Integration & Data Lake and Data Warehouse projects in the AWS Cloud. Ensure new features and subject areas are modelled to integrate with existing structures and provide a consistent view. Develop and maintain documentation of the data architecture, data flow and data models of the data warehouse appropriate for various audiences. Provide direction on adoption of Cloud technologies (Redshift, Postgres, Snowflake,) and industry best practices in the field of data lakes and data warehouse architecture and modelling. Providing technical leadership to large enterprise scale projects.
This role requires a broad range of skills and the ability to step into different roles depending on the size and scope of the project.
Responsibilities: -
  • Demonstrated ability to have successfully completed multiple, complex technical data engineering projects and create high-level design and architecture of the solution.
  • Able to present the solution architecture strategy and define value proposition to key stake holders.
  • Able to communicate the capabilities and improvements offered by solution architecture with both the development teams and business user teams.
  • Develop POC's and conduct show and tell sessions.
  • Design, build & deploy the data pipelines using EMR, EMR studio, Databricks, Spark, Pyspark and Shell Scripting
  • Design the Data replication systems and integration systems by evaluating various products and deciding on the better technology that meets the corporate objectives.
  • Perform Data Analysis, Data Modeling, Data Management, and Data lineage.
  • Design data security framework considering both internal and external sharing aspects.
  • Design Data pipes and automate data ingestion and cleansing, transformation activities using the DevOps methodologies.
Required Skills:-
  • Must have total 7+ yrs. of experience in IT and working as a Data Engineer
  • Must have 5+ years of experience in EMR, Databricks, Spark, pyspark programming, Jupyter notebook and shell scripting
  • 3+ years in Data warehouse, ETL Projects.
  • Must have experience End to End implementation of cloud data warehouse (Redshift, Postgres, or Snowflake).
  • Hands-on experience with Postgres SQL, RedShift, Redshift spectrum, AWS Glue, Athena, Snowflake utilities, Snow SQL, Snow Pipe, AWS Lambda model techniques using Python.
  • Experience in Data Migration from RDBMS to Redshift/Snowflake cloud data warehouse.
  • Expertise in data modelling, ELT using Snowflake SQL, implementing complex stored Procedures and standard DWH and ETL/ELT concepts.
  • Expertise in advanced concepts like setting up resource monitors, Role-based access controls (RBAC), virtual warehouse sizing, query performance tuning, zero copy clone, time travel and understand how to use these features.
  • Expertise in deploying features such as data sharing, events, and lake-house patterns.
  • Deep understanding of relational as well as NoSQL data stores, Methods, and approaches (Star and Snowflake, Dimensional Modelling).
  • Experience with data security and data access controls and design
  • Experience with AWS or Azure data storage and management technologies such as S3 and ADLS.
  • Build processes supporting data transformation, data structures, metadata, dependency, and workload management.
  • Proficiency in RDBMS, complex SQL, PL/SQL, Unix Shell Scripting, performance tuning and troubleshoot.
  • Provide resolution to an extensive range of complicated data pipeline related problems, proactively and as issues surface.
  • Must have expertise in AWS and Azure Platform as a Service (PAAS).
  • Should be able to troubleshoot problems across infrastructure, platform, and application domains.
  • Must have experience of Agile development methodologies.
  • Strong written communication skills. Is effective and persuasive in both written and oral communication.

  • AWS Data Engineer

    1 month ago

    Jersey City, New Jersey, United States Tiger Analytics Full time

    Job Title: AWS Data EngineerTiger Analytics is a leading advanced analytics consulting firm, trusted by Fortune 500 companies to generate business value from data. We're seeking a top-notch AWS Data Engineer to join our global analytics team.Key Responsibilities:Design, develop, and deploy scalable data pipelines on AWS cloud infrastructure using services...

  • AWS Cloud Engineer

    3 weeks ago

    Jersey City, New Jersey, United States Bank of America Full time

    Job Title: AWS Cloud EngineerWe are seeking an experienced AWS Cloud Engineer to join our team at Bank of America. As a Cloud Engineer, you will be responsible for designing, deploying, and maintaining cloud-based systems and applications on the Amazon Web Services (AWS) platform.Key Responsibilities:Design and deploy cloud-based systems and applications on...

  • AWS Cloud Engineer

    3 weeks ago

    Jersey City, United States Compunnel Inc. Full time

    BS in Computer Science, Engineering or relevant fieldMust have experience with Dynatrace, AWS Cloud, Terraform and CloudwatchExperience as a DevOps Engineer or similar software engineering role.Need enhanced skills in AWS Cloud with front end skills.Should be able to maintain / enhance the existing AWS code pipeline across several revenue products Proficient...

  • AWS Cloud Engineer

    3 weeks ago

    Jersey City, United States Compunnel Inc. Full time

    BS in Computer Science, Engineering or relevant fieldMust have experience with Dynatrace, AWS Cloud, Terraform and CloudwatchExperience as a DevOps Engineer or similar software engineering role.Need enhanced skills in AWS Cloud with front end skills.Should be able to maintain / enhance the existing AWS code pipeline across several revenue products Proficient...

  • AWS Cloud Engineer

    1 week ago

    jersey city, United States Compunnel Inc. Full time

    BS in Computer Science, Engineering or relevant fieldMust have experience with Dynatrace, AWS Cloud, Terraform and CloudwatchExperience as a DevOps Engineer or similar software engineering role.Need enhanced skills in AWS Cloud with front end skills.Should be able to maintain / enhance the existing AWS code pipeline across several revenue products Proficient...

  • AWS Cloud Engineer

    2 weeks ago

    Jersey City, New Jersey, United States VDart Full time

    Job Summary:VDart is seeking a highly skilled AWS Senior DevOps Engineer to join our Infrastructure Automation Team. The ideal candidate will have strong technical skills in AWS, as well as excellent interpersonal skills to collaborate with cross-functional teams.Key Responsibilities: Design, develop, and implement cloud-based IaaS, PaaS, and SaaS solutions...

  • AWS Cloud Engineer

    1 month ago

    Jersey City, United States The Phoenix Group Full time

    Job OverviewAs an AWS Cloud Infrastructure Engineer, you will be responsible for designing, implementing, and managing scalable cloud solutions on AWS. Your expertise with Cisco technologies will be crucial in ensuring seamless integration between our cloud environments and on-premises infrastructures. You will collaborate with cross-functional teams to...

  • AWS Cloud Engineer

    1 month ago

    Jersey City, United States The Phoenix Group Full time

    Job OverviewAs an AWS Cloud Infrastructure Engineer, you will be responsible for designing, implementing, and managing scalable cloud solutions on AWS. Your expertise with Cisco technologies will be crucial in ensuring seamless integration between our cloud environments and on-premises infrastructures. You will collaborate with cross-functional teams to...

  • AWS Cloud Solutions Engineer

    2 weeks ago

    Jersey City, New Jersey, United States Compunnel Inc. Full time

    Job Title: AWS Cloud EngineerWe are seeking a highly skilled AWS Cloud Engineer to join our team at Compunnel Inc.Key Responsibilities:Design and implement scalable and secure cloud infrastructure on AWSDevelop and maintain cloud-based applications using AWS servicesCollaborate with cross-functional teams to ensure seamless integration with existing...

  • AWS Cloud Engineer with GenAI Expertise

    2 weeks ago

    Jersey City, New Jersey, United States Cloudious LLC Full time

    Job OverviewCloudious LLC is seeking a highly skilled AWS Cloud Engineer with expertise in GenAI to join our Chief Data Office team.The successful candidate will design and develop scalable model execution components using AWS core services, develop cost monitoring components, and implement notification and alerting systems using modern cloud...

  • AWS Cloud Engineer

    2 weeks ago

    Jersey City, New Jersey, United States Saxon Global Full time

    Job Summary: Saxon Global is seeking a highly skilled SRE Engineer with expertise in AWS cloud infrastructure and application support. The ideal candidate will have 9+ years of experience in DevOps/SRE and a proven track record of innovative contributions in system architecture. Key Responsibilities: * Build deployment automation within AWS-hosted services...

  • AWS Cloud Engineer

    2 weeks ago

    Jersey City, New Jersey, United States Bank of America Full time

    Job Title: AWS Cloud EngineerBank of America is seeking a highly skilled AWS Cloud Engineer to join our team. As a Cloud Engineer, you will be responsible for designing, deploying, and maintaining cloud-based systems and applications.The ideal candidate will have advanced knowledge of AWS cloud services, including RDS, Aurora PostgreSQL, DynamoDB, and Linux...

  • Cloud Data Architect

    4 weeks ago

    Jersey City, New Jersey, United States CyberTec Full time

    Job Title: Cloud Data Engineer, AWSWe are seeking a highly skilled Cloud Data Engineer to join our team at CyberTec. As a Cloud Data Engineer, you will be responsible for designing, developing, and maintaining data architecture, data models, data pipelines, and standards for various Data Integration & Data Lake and Data Warehouse projects in the AWS...

  • AWS Cloud Engineer

    4 days ago

    Jersey City, New Jersey, United States VDart Full time

    Job SummaryAs a Senior DevOps Specialist at VDart, you will play a key role in our growing Infrastructure Automation Team within Public Cloud. This position will be crucial in working with various infrastructure teams to develop, deploy, and support cloud and hybrid applications.Key Responsibilities Assist in architecting, designing, and implementing...

  • AWS Cloud Architect

    4 days ago

    Jersey City, New Jersey, United States HexaQuEST Global, Inc. Full time

    Job Title: AWS Cloud ArchitectAbout the Role:We are seeking an experienced AWS Cloud Architect to join our team at HexaQuEST Global, Inc. As a key member of our cloud infrastructure team, you will be responsible for designing, implementing, and maintaining large-scale cloud-based systems on AWS.Key Responsibilities:- Design and implement scalable, secure,...

  • AWS Cloud Database Administrator

    2 weeks ago

    Jersey City, New Jersey, United States Enterprise Engineering Full time

    AWS Cloud Database AdministratorWe are seeking an experienced AWS Cloud Database Administrator to join our team at Enterprise Engineering. The ideal candidate will have a strong background in cloud database administration, with a focus on AWS services.Key Responsibilities:Design and implement cloud database architectures using AWS services such as RDS,...

  • AWS Data Engineer

    1 week ago

    Jersey City, New Jersey, United States Tiger Analytics Full time

    About the Role:Tiger Analytics is a leading advanced analytics consulting firm, and we're looking for a highly skilled AWS Data Engineer to join our team. As a key member of our data engineering team, you will be responsible for designing, building, and maintaining scalable data pipelines on AWS cloud infrastructure.Key Responsibilities:Design and develop...

  • AWS Data Engineer

    2 weeks ago

    Jersey City, New Jersey, United States Tiger Analytics Full time

    Job OpportunityTiger Analytics is a leading advanced analytics consulting firm, trusted by Fortune 500 companies to generate business value from data.We are seeking a highly skilled AWS Data Engineer to join our team. As a key member of our data engineering team, you will be responsible for designing, building, and maintaining scalable data pipelines on AWS...

  • AWS Cloud Architect

    4 weeks ago

    Jersey City, New Jersey, United States Stellar Consulting Solutions, LLC Full time

    Job Title: AWS EngineerAt Stellar Consulting Solutions, LLC, we are seeking a highly skilled AWS Engineer to join our team. As an AWS Engineer, you will be responsible for designing, building, and maintaining scalable and secure cloud-based systems on Amazon Web Services (AWS).Key Responsibilities:Drive the adoption of AWS services across the organization,...

  • AWS Cloud Database Administrator

    2 weeks ago

    Jersey City, New Jersey, United States Enterprise Engineering Services Full time

    Job Title: AWS Cloud Database AdministratorEnterprise Engineering Services is seeking an experienced AWS Cloud Database Administrator to join our team.Key Responsibilities:Migrate data from on-prem to RDS and SnowflakeExceptional knowledge of AWS Console, AWS CLI, S3, DMS, and Cloud WatchExperience with RDS: Postgres, MYSOL, Aurora Postgres, and NoSQL...