Data Engineer

3 days ago


Newark, United States Seven Seven Software Full time
Qualifications:

* Bachelor's degree in computer science, Software Engineering, MIS or equivalent combination of education and experience

* Experience implementing, supporting data lakes, data warehouses and data applications on AWS for large enterprises

* Programming experience with Python, Shell scripting and SQL

* Solid experience of AWS services such as CloudFormation, S3, Athena, Glue, EMR/Spark, RDS, Redshift, DynamoDB, Lambda, Step Functions, IAM, KMS, SM etc.

* Solid experience implementing solutions on AWS based data lakes.

* Should have good experience with AWS Services - API Gateway, Lambda, Step Functions, SQS, DynamoDB, S3, Elasticsearch

* Serverless application development using AWS Lambda

* Experience in AWS data lake/data warehouse/business analytics

* Experience in system analysis, design, development, and implementation of data ingestion pipeline in AWS

* Knowledge of ETL/ELT

* End-to-end data solutions (ingest, storage, integration, processing, access) on AWS

* Architect and implement CI/CD strategy for EDP

* Implement high velocity streaming solutions using Amazon Kinesis, SQS, and Kafka (preferred)

* Migrate data from traditional relational database systems, file systems, NAS shares to AWS relational databases such as Amazon RDS, Aurora, and Redshift

* Migrate data from APIs to AWS data lake (S3) and relational databases such as Amazon RDS, Aurora, and Redshift

* Implement POCs on any new technology or tools to be implemented on EDP and onboard for real use-case

* AWS Solutions Architect or AWS Developer Certification preferred

* Good understanding of Lakehouse/data cloud architecture

Responsibilities:

* Designing, building and maintaining efficient, reusable, and reliable architecture and code.

* Build reliable and robust Data ingestion pipelines (within AWS, onprem to AWS ,etc.)

* Ensure the best possible performance and quality of high scale data engineering project

* Participate in the architecture and system design discussions

* Independently perform hands on development and unit testing of the applications.

* Collaborate with the development team and build individual components into complex enterprise web systems.

* Work in a team environment with product, production operation, QE/QA and cross functional teams to deliver a project throughout the whole software development cycle.

* Responsible to identify and resolve any performance issues

* Keep up to date with new technology development and implementation

* Participate in code review to make sure standards and best practices are met.

Job Requirements

Qualifications:

* Bachelor's degree in computer science, Software Engineering, MIS or equivalent combination of education and experience

* Experience implementing, supporting data lakes, data warehouses and data applications on AWS for large enterprises

* Programming experience with Python, Shell scripting and SQL

* Solid experience of AWS services such as CloudFormation, S3, Athena, Glue, EMR/Spark, RDS, Redshift, DynamoDB, Lambda, Step Functions, IAM, KMS, SM etc.

* Solid experience implementing solutions on AWS based data lakes.

* Should have good experience with AWS Services - API Gateway, Lambda, Step Functions, SQS, DynamoDB, S3, Elasticsearch

* Serverless application development using AWS Lambda

* Experience in AWS data lake/data warehouse/business analytics

* Experience in system analysis, design, development, and implementation of data ingestion pipeline in AWS

* Knowledge of ETL/ELT

* End-to-end data solutions (ingest, storage, integration, processing, access) on AWS

* Architect and implement CI/CD strategy for EDP

* Implement high velocity streaming solutions using Amazon Kinesis, SQS, and Kafka (preferred)

* Migrate data from traditional relational database systems, file systems, NAS shares to AWS relational databases such as Amazon RDS, Aurora, and Redshift

* Migrate data from APIs to AWS data lake (S3) and relational databases such as Amazon RDS, Aurora, and Redshift

* Implement POCs on any new technology or tools to be implemented on EDP and onboard for real use-case

* AWS Solutions Architect or AWS Developer Certification preferred

* Good understanding of Lakehouse/data cloud architecture

Responsibilities:

* Designing, building and maintaining efficient, reusable, and reliable architecture and code.

* Build reliable and robust Data ingestion pipelines (within AWS, onprem to AWS ,etc.)

* Ensure the best possible performance and quality of high scale data engineering project

* Participate in the architecture and system design discussions

* Independently perform hands on development and unit testing of the applications.

* Collaborate with the development team and build individual components into complex enterprise web systems.

* Work in a team environment with product, production operation, QE/QA and cross functional teams to deliver a project throughout the whole software development cycle.

* Responsible to identify and resolve any performance issues

* Keep up to date with new technology development and implementation

* Participate in code review to make sure standards and best practices are met.
  • Data Engineer

    1 week ago


    Newark, United States JSR Tech Consulting Full time

    Data Tech team is looking for a Data Engineer to join a diverse team dedicated to providing best in class data services to our customers, stakeholders and partners. As a part of our organization, you will work with our Client Engineers, Data Scientist and various BUs to define solutions for operationalizing data-driven decision making in a cost effective and...

  • Data Engineer

    3 days ago


    Newark, United States JSR Tech Consulting Full time

    Data Tech team is looking for a Data Engineer to join a diverse team dedicated to providing best in class data services to our customers, stakeholders and partners. As a part of our organization, you will work with our Client Engineers, Data Scientist and various BUs to define solutions for operationalizing data-driven decision making in a cost effective and...

  • Data Engineer

    3 days ago


    Newark, United States JSR Tech Consulting Full time

    Data Tech team is looking for a Data Engineer to join a diverse team dedicated to providing best in class data services to our customers, stakeholders and partners. As a part of our organization, you will work with our Client Engineers, Data Scientist and various BUs to define solutions for operationalizing data-driven decision making in a cost effective and...

  • Data Engineer

    6 days ago


    Newark, United States V-Soft Consulting Group Full time

    Data Engineer Primary Location: Newark, New Jersey V-Soft Consulting is currently hiring for a Data Engineer for our premier client in Newark, New Jersey. Education and Experience " 5+ years of experience in building out data pipelines in Python or Java. 2+ years of experience working in Azure Cloud Service. Experience with data processing...


  • Newark, New Jersey, United States JSR Tech Consulting Full time

    JSR Tech Consulting is seeking a skilled Data Engineer to join our team of experts dedicated to delivering top-notch data services. As a key member of our organization, you will collaborate with our Client Engineers and Data Scientists to develop innovative solutions for operationalizing data-driven decision making.The ideal candidate will possess a...


  • Newark, New Jersey, United States V-Soft Consulting Group Full time

    About the Role">The V-Soft Consulting Group is looking for a highly skilled Data Engineer to join their team in Newark, New Jersey.Key Responsibilities:">Design and develop large-scale data pipelines using Python or Java.Collaborate with cross-functional teams to implement data processing platforms, such as Azure Data Factory.Work with transactional database...


  • Newark, United States Diverse Lynx Full time

    Role: Azure Data engineer Location: Newark, NJ- F2F Interview for final round Duration: 12+ Months Experience: 8-10 10+ years of data engineering experience 5+ years of experience in building data and analytics platform focused on Azure data and analytics solutions 5+ years of programming experience in Python/Pyspark Good experience in Azure services such...


  • Newark, United States Harris Blitzer Sports and Entertainment Full time

    Data Engineer, Hockey Analytics Newark, NJ WHO WE ARE: Founded by Josh Harris and David Blitzer, Harris Blitzer Sports & Entertainment (HBSE) includes in its portfolio the Philadelphia 76ers, the New Jersey Devils, leading venue Prudential Center in Newark, N.J., the Delaware Blue Coats, and the Utica Comets. Led by some of the best and brightest minds...


  • Newark, United States Harris Blitzer Sports & Entertainment Full time

    Job DescriptionJob DescriptionOverview of RoleFounded by Josh Harris and David Blitzer, Harris Blitzer Sports & Entertainment (HBSE) includes in its portfolio the Philadelphia 76ers, the New Jersey Devils, leading venue Prudential Center in Newark, N.J., the Delaware Blue Coats, the Utica Comets, and world-class e-sports franchise Dignitas. Led by some of...


  • Newark, United States Harris Blitzer Sports & Entertainment Full time

    Job DescriptionJob DescriptionOverview of RoleFounded by Josh Harris and David Blitzer, Harris Blitzer Sports & Entertainment (HBSE) includes in its portfolio the Philadelphia 76ers, the New Jersey Devils, leading venue Prudential Center in Newark, N.J., the Delaware Blue Coats, the Utica Comets, and world-class e-sports franchise Dignitas. Led by some of...

  • Electrical Engineer

    3 days ago


    Newark, United States Pkaza Full time

    Job DescriptionJob DescriptionElectrical Engineer - Newark, NJ Our client is an Engineering Design and Commissioning Company that is a leader in the data center space. They provide design, commissioning consulting and management expertise in Data Center / Mission Critical Facilities Space. They provide reliability, energy efficiency, sustainable design and...

  • Azure Data engineer

    3 days ago


    Newark, United States Syntricate Technologies Full time

    Position- Azure Data engineer (Banking Domain) Duration-Contract Location- Newark, NJ ( Need Local profile) JD Azure Data engineer (MS Fabric Experience) Banking experience Local To Newark , NJ Client Round F2F Regards, Pallavi Verma Sr. Technical Recruiter | Syntricate Technologies Inc. Direct : 781-552-4333 | Email :...


  • Newark, United States 4 Staffing Corp Full time

    About the job Business Systems Analyst - Data Engineering Job Title: Business Systems Analyst - Data Engineering (Financial Services) Full-time, direct employment Hybrid onsite/remote - Newark, NJ No visa sponsorship or C2C at this time Job Description: Our client is seeking an experienced Business Systems Analyst with a focus on Fixed Income to join their...


  • Newark, New Jersey, United States PSEG Full time

    Job DescriptionThis internship involves working as a software engineer to help build mobile GIS applications and support data transformation and distribution to utility crews. You will be part of a team that works on building innovative solutions to improve the efficiency of our operations.


  • Newark, New Jersey, United States Harris Blitzer Sports & Entertainment Full time

    Overview of the RoleHarris Blitzer Sports & Entertainment (HBSE) is a pioneering global sports and entertainment business, renowned for its innovative approach and commitment to excellence. We are seeking an exceptional Data Engineer to join our team and contribute to shaping the future of hockey analytics.


  • Newark, New Jersey, United States STV Full time

    Responsibilities:The ideal candidate will lead the design of our new Azure-based cloud environment and data lake, focusing on scalability, security, and cost-efficiency.Collaborate with stakeholders to understand business needs and translate them into architectural requirements for a big data platform and future application hosting.Define the architecture...


  • Newark, New Jersey, United States V-Soft Consulting Group Full time

    Data Engineer Job Description">The ideal candidate will have a strong background in software engineering, data analysis, and cloud computing.You will be responsible for designing, developing, and maintaining large-scale data systems, ensuring they are scalable, efficient, and secure.Additionally, you will collaborate with cross-functional teams to implement...


  • Newark, New Jersey, United States V-Soft Consulting Group Full time

    Job Overview">The V-Soft Consulting Group is seeking a talented Data Engineer to join their team in Newark, New Jersey.This role involves designing, developing, and maintaining large-scale data systems, collaborating with cross-functional teams, and implementing data processing platforms.Responsibilities:">Design and develop large-scale data pipelines using...


  • Newark, New Jersey, United States Harris Blitzer Sports and Entertainment Full time

    Join our dynamic team as a Data Engineer and contribute to the success of Harris Blitzer Sports and Entertainment! As a member of our analytics team, you will play a key role in developing and maintaining processes that ingest, clean, and organize hockey data.About Us:Harris Blitzer Sports and Entertainment is a leading global sports and entertainment...


  • Newark, United States MAXIMUS Full time

    Description & Requirements We are looking for an experienced Data Architect to build a cutting-edge data and analytics program for a Federal critical infrastructure agency. They will build on an existing concept by incorporating user feedback, applying rigorous and stringent governance processes, and integrating cutting edge technologies (like Artificial...