Data Engineer

1 week ago

Newark, United States Seven Seven Software Full time
Qualifications:

* Bachelor's degree in computer science, Software Engineering, MIS or equivalent combination of education and experience

* Experience implementing, supporting data lakes, data warehouses and data applications on AWS for large enterprises

* Programming experience with Python, Shell scripting and SQL

* Solid experience of AWS services such as CloudFormation, S3, Athena, Glue, EMR/Spark, RDS, Redshift, DynamoDB, Lambda, Step Functions, IAM, KMS, SM etc.

* Solid experience implementing solutions on AWS based data lakes.

* Should have good experience with AWS Services - API Gateway, Lambda, Step Functions, SQS, DynamoDB, S3, Elasticsearch

* Serverless application development using AWS Lambda

* Experience in AWS data lake/data warehouse/business analytics

* Experience in system analysis, design, development, and implementation of data ingestion pipeline in AWS

* Knowledge of ETL/ELT

* End-to-end data solutions (ingest, storage, integration, processing, access) on AWS

* Architect and implement CI/CD strategy for EDP

* Implement high velocity streaming solutions using Amazon Kinesis, SQS, and Kafka (preferred)

* Migrate data from traditional relational database systems, file systems, NAS shares to AWS relational databases such as Amazon RDS, Aurora, and Redshift

* Migrate data from APIs to AWS data lake (S3) and relational databases such as Amazon RDS, Aurora, and Redshift

* Implement POCs on any new technology or tools to be implemented on EDP and onboard for real use-case

* AWS Solutions Architect or AWS Developer Certification preferred

* Good understanding of Lakehouse/data cloud architecture

Responsibilities:

* Designing, building and maintaining efficient, reusable, and reliable architecture and code.

* Build reliable and robust Data ingestion pipelines (within AWS, onprem to AWS ,etc.)

* Ensure the best possible performance and quality of high scale data engineering project

* Participate in the architecture and system design discussions

* Independently perform hands on development and unit testing of the applications.

* Collaborate with the development team and build individual components into complex enterprise web systems.

* Work in a team environment with product, production operation, QE/QA and cross functional teams to deliver a project throughout the whole software development cycle.

* Responsible to identify and resolve any performance issues

* Keep up to date with new technology development and implementation

* Participate in code review to make sure standards and best practices are met.

Job Requirements

Qualifications:

* Bachelor's degree in computer science, Software Engineering, MIS or equivalent combination of education and experience

* Experience implementing, supporting data lakes, data warehouses and data applications on AWS for large enterprises

* Programming experience with Python, Shell scripting and SQL

* Solid experience of AWS services such as CloudFormation, S3, Athena, Glue, EMR/Spark, RDS, Redshift, DynamoDB, Lambda, Step Functions, IAM, KMS, SM etc.

* Solid experience implementing solutions on AWS based data lakes.

* Should have good experience with AWS Services - API Gateway, Lambda, Step Functions, SQS, DynamoDB, S3, Elasticsearch

* Serverless application development using AWS Lambda

* Experience in AWS data lake/data warehouse/business analytics

* Experience in system analysis, design, development, and implementation of data ingestion pipeline in AWS

* Knowledge of ETL/ELT

* End-to-end data solutions (ingest, storage, integration, processing, access) on AWS

* Architect and implement CI/CD strategy for EDP

* Implement high velocity streaming solutions using Amazon Kinesis, SQS, and Kafka (preferred)

* Migrate data from traditional relational database systems, file systems, NAS shares to AWS relational databases such as Amazon RDS, Aurora, and Redshift

* Migrate data from APIs to AWS data lake (S3) and relational databases such as Amazon RDS, Aurora, and Redshift

* Implement POCs on any new technology or tools to be implemented on EDP and onboard for real use-case

* AWS Solutions Architect or AWS Developer Certification preferred

* Good understanding of Lakehouse/data cloud architecture

Responsibilities:

* Designing, building and maintaining efficient, reusable, and reliable architecture and code.

* Build reliable and robust Data ingestion pipelines (within AWS, onprem to AWS ,etc.)

* Ensure the best possible performance and quality of high scale data engineering project

* Participate in the architecture and system design discussions

* Independently perform hands on development and unit testing of the applications.

* Collaborate with the development team and build individual components into complex enterprise web systems.

* Work in a team environment with product, production operation, QE/QA and cross functional teams to deliver a project throughout the whole software development cycle.

* Responsible to identify and resolve any performance issues

* Keep up to date with new technology development and implementation

* Participate in code review to make sure standards and best practices are met.

  • Data Center Operations Specialist

    3 days ago

    Newark, California, United States T5 Data Centers Full time

    About T5 Data CentersFounded in 2008, T5 Data Centers is a leading provider of customized data center solutions for enterprise and hyperscale customers. Our commitment to quality and excellence has earned us a reputation as a trusted partner for mission-critical operations.We pride ourselves on our inclusive culture of excellence and progression, with over...

  • Data Engineer

    1 week ago

    Newark, United States Saxon Global Full time

    Primary Responsibilities: Data modeling and data warehousing. Cloud-based data migration. Database management (MSSQL, Azure SQL Database, Azure Data Lake Storage, and Azure Synapse). Leverage and implement shortcuts across workspaces to aggregate the data between different sources. Implement the different types of security for lakehouses and...

  • Data Engineer

    7 days ago

    Newark, United States Saxon Global Full time

    Primary Responsibilities: Data modeling and data warehousing. Cloud-based data migration. Database management (MSSQL, Azure SQL Database, Azure Data Lake Storage, and Azure Synapse). Leverage and implement shortcuts across workspaces to aggregate the data between different sources. Implement the different types of security for lakehouses and...

  • Data Engineer

    7 days ago

    Newark, United States Saxon Global Full time

    Primary Responsibilities: Data modeling and data warehousing. Cloud-based data migration. Database management (MSSQL, Azure SQL Database, Azure Data Lake Storage, and Azure Synapse). Leverage and implement shortcuts across workspaces to aggregate the data between different sources. Implement the different types of security for lakehouses and...

  • Data Engineer

    1 week ago

    Newark, United States JSR Tech Consulting Full time

    Data Tech team is looking for a Data Engineer to join a diverse team dedicated to providing best in class data services to our customers, stakeholders and partners. As a part of our organization, you will work with our Client Engineers, Data Scientist and various BUs to define solutions for operationalizing data-driven decision making in a cost effective and...

  • Data Engineer

    2 months ago

    newark, United States JSR Tech Consulting Full time

    Data Tech team is looking for a Data Engineer to join a diverse team dedicated to providing best in class data services to our customers, stakeholders and partners. As a part of our organization, you will work with our Client Engineers, Data Scientist and various BUs to define solutions for operationalizing data-driven decision making in a cost effective and...

  • Data Engineer

    2 months ago

    newark, United States JSR Tech Consulting Full time

    Data Tech team is looking for a Data Engineer to join a diverse team dedicated to providing best in class data services to our customers, stakeholders and partners. As a part of our organization, you will work with our Client Engineers, Data Scientist and various BUs to define solutions for operationalizing data-driven decision making in a cost effective and...

  • Data Engineer

    2 months ago

    Newark, United States JSR Tech Consulting Full time

    Data Tech team is looking for a Data Engineer to join a diverse team dedicated to providing best in class data services to our customers, stakeholders and partners. As a part of our organization, you will work with our Client Engineers, Data Scientist and various BUs to define solutions for operationalizing data-driven decision making in a cost effective and...

  • Data Engineer

    6 days ago

    Newark, United States BCForward Full time

    Job DescriptionJob DescriptionBCforward is looking for a motivated Data Engineer for an opportunity in Newark, DE.Title: Data EngineerLocation: Newark, DEPayrate: $70/hr-$75/hrDuration: 3 months with possible extensionShift: Mon- Fri 8am to 5pmJob Description:The Data Engineer is responsible for Enterprise Data Services (EDS) related technical design,...

  • Data Center Automation and Monitoring Expert

    1 day ago

    Newark, California, United States T5 Data Centers Full time

    Unlock Your Career PotentialWe are seeking an exceptional Data Center Automation and Monitoring Expert to join our team at T5 Data Centers. As a key member of our operations team, you will play a vital role in ensuring the smooth operation of our data centers.About the RoleThis is a unique opportunity for a highly skilled professional to make a real impact...

  • Data Engineer

    1 week ago

    Newark, United States Spectraforce Technologies Full time

    Job Title: AWS Data EngineerLocation: Newark, NJ (Hybrid)Duration: 12+ MonthsData Engineer Job Description for Data Journey USBIE* Experience developing and deploying application code using SQL, Python, spark.* 3-5 years‘ experience developing and deploying data pipeline in cloud.* 3-5 years‘ experience in AWS using glue, athena, lambda, secrets manager,...

  • Data Engineer

    3 weeks ago

    newark, United States Tata Consultancy Services Full time

    Must Have Technical/Functional Skills : Azure Data Engineer, Microsoft FabricExperience Required : 8+Roles & ResponsibilitiesData Management and Storage:Design and implement data storage systems using Azure services like Azure SQL Database, Azure Data Lake Storage, and Azure Synapse.Ensure scalability, performance, and cost-effectiveness.Data Integration and...

  • Data Engineer

    3 weeks ago

    newark, United States Tata Consultancy Services Full time

    Must Have Technical/Functional Skills : Azure Data Engineer, Microsoft FabricExperience Required : 8+Roles & ResponsibilitiesData Management and Storage:Design and implement data storage systems using Azure services like Azure SQL Database, Azure Data Lake Storage, and Azure Synapse.Ensure scalability, performance, and cost-effectiveness.Data Integration and...

  • Data Engineer

    3 weeks ago

    Newark, United States Tata Consultancy Services Full time

    Must Have Technical/Functional Skills : Azure Data Engineer, Microsoft FabricExperience Required : 8+Roles & ResponsibilitiesData Management and Storage:Design and implement data storage systems using Azure services like Azure SQL Database, Azure Data Lake Storage, and Azure Synapse.Ensure scalability, performance, and cost-effectiveness.Data Integration and...

  • Lead, Data Engineering

    1 week ago

    Newark, United States WebMD Full time

    Description Position at WebMD WebMD is the most recognized and trusted brand of health information and the leading provider of health information services, serving consumers, physicians, healthcare professionals, employers and health plans through our public and private online portals and WebMD the Magazine. The WebMD Health Network includes WebMD,...

  • Lead, Data Engineering

    1 week ago

    Newark, United States WebMD Full time

    Description Position at WebMD WebMD is the most recognized and trusted brand of health information and the leading provider of health information services, serving consumers, physicians, healthcare professionals, employers and health plans through our public and private online portals and WebMD the Magazine. The WebMD Health Network includes WebMD,...

  • Lead, Data Engineering

    7 days ago

    Newark, United States WebMD Full time

    Description Position at WebMD WebMD is the most recognized and trusted brand of health information and the leading provider of health information services, serving consumers, physicians, healthcare professionals, employers and health plans through our public and private online portals and WebMD the Magazine. The WebMD Health Network includes WebMD,...

  • AWS Data Engineer

    2 weeks ago

    Newark, United States Iris Software Inc. Full time

    Iris's client, a large insurance company, is currently searching for a strong AWS Data Engineer based in Newark, NJ to join their team. Our client has offices worldwide and has the global reach, advisory services, and distribution power to meet the needs of issuers and investors worldwide. Job title: AWS Data EngineerLocation: Hybrid (Newark, NJ)Duration: 24...

  • Chief Data Engineering Director

    7 days ago

    Newark, United States Mice Groups Full time

    Mice Groups Job OpportunityAs a leading organization, Mice Groups is seeking an experienced Principal Data Architect to join our team for a 4-month contract position. This role is ideal for individuals who thrive in onsite environments and are comfortable with the challenges of local candidates only.About the RoleThe successful candidate will be responsible...

  • Data Engineer

    7 days ago

    Newark, New Jersey, United States JSR Tech Consulting Full time

    At JSR Tech Consulting, we're seeking a highly skilled Data Engineer to join our team. As a key member of our data tech team, you will play a vital role in designing, building, and maintaining efficient architecture and code for our high-scale web applications and services.Job Summary:We offer a competitive salary of $120,000 - $180,000 per year, depending...