Sr. Data Engineer

2 weeks ago


Newark, United States JSR Tech Consulting Full time
Job Description :

8p - Engineering lead to help the design/build of the CDO enterprise data platforms
Design, Develop and Implement
  • End-to-end data solutions (ingest, storage, integration, processing, access) on AWS.
  • Data intake/ request/ onboarding services and service documentation.
  • Data ingestion services for batch/ real time data ingest and service documentation.
  • Data processing services for batch/ real time (Glue/ Kinesis/ EMR) and service documentation.
  • Data storage services for data lake (S3)/ data warehouses (RDS/ Redshift)/ data marts and service documentation.
  • Data services layer including Athena, Redshift, RDS, microservices and APIs.
  • Pipeline orchestration services including lambda, step functions, MWAA (optional).
  • Data security services (IAM/ KMS/ SM/ encryption/ anonymization/ RBAC) and service documentation.
  • Data access provisioning services (Accounts, IAM Roles RBAC), processes, documentation and education.
  • Data provisioning services for data consumption patterns including microservices, APIs and extracts.
  • Metadata capture and catalog services for data lake (S3/ Athena), data warehouses (RDS/ Redshift), Microservices/ APIs.
  • Metadata capture and catalog services for pipeline/ log data for monitoring / support.
  • Architect and implement CI/ CD strategy for EDP .
  • Implement high velocity streaming solutions using Amazon Kinesis, SQS, and SMS.
  • Migrate data from traditional relational database systems, file systems, NAS shares to AWS relational databases such as Amazon RDS, Aurora, and Redshift.
  • Migrate data from APIs to AWS data lake (S3) and relational databases such as Amazon RDS, Aurora, and Redshift.
  • Implement cost/ spend monitoring for AWS based data platform.
  • Implement audit reporting for access of AWS based data platform.
  • Contribute to the implementation of a data strategy to enable LOBs and Corporate Functions with a robust, holistic view of data - driven decision making.
  • Partner with immediate engineering team, product owner, IT, partners on EDP agenda.
  • Leverage and continuously develop best practices, standards, and frameworks.
  • Provide technology thought leadership, consulting, and coaching/ mentoring.
  • Work with scrum master to develop and own backlog, stories, epics, sprints.
  • System design and Architecture for products/ applications for EDP.
  • Work closely with various stakeholders (BI, AIML, MDM and other teams) to understand their use-cases and design optimal solution for them.
  • Execute technical design and infrastructure strategy for EDP .
  • Implement POCs on any new technology or tools to be implemented on EDP and onboard for real use-case.
Qualifications
  • Bachelor's degree in computer science, Software Engineering, MIS or equivalent combination of education and experience.
  • Experience implementing, supporting data platforms on AWS for large enterprises.
  • Full stack development experience building secure internal facing applications.
  • Programming experience with Java, Python/ Scala, Shell scripting.
  • Solid experience of AWS services such as CloudFormation, S3, Glue, EMR/ Spark, RDS, Redshift, DynamoDB, Lambda, Step Functions, IAM, KMS, SM etc.
  • Solid experience implementing solutions on AWS based data lakes preferred.
  • Experience implementing metadata solutions leveraging AWS non-relational data solutions such as ElastiCache and DynamoDB.
  • AWS Solutions Architect or AWS Big Data Certification preferred.
  • Experience in AWS data lake, data warehouse and business analytics.
  • Experience and understanding of various core AWS services such as IAM, Cloud Formation, EC2, S3, EMR/Spark, Glue, Datasync, CloudHealth, CloudWatch, Lambda, Athena, and Redshift.
  • Experience in system analysis, design, development, and implementation of data ingestion pipeline in AWS.
  • Experience with DevOps and Continuous Integration/ Delivery (CI/ CD) concepts and tools.
  • Experience with business intelligence tools such as Tableau, Power BI or equivalent.
  • Knowledge of ETL/ ELT.
  • Awareness of Data Management & Governance tools.
  • Working experience with Hadoop, HDFS, SQOOP, Hive, Python, and Spark is desired.
  • Experience working on Agile projects.


  • Newark, United States Dew Software Full time

    Dew Software is currently seeking a highly skilled and experienced Sr. Engineer, Systems Integration to join our dynamic team. As a global organization specializing in digital transformation, Dew Software collaborates with Fortune 500 companies to deliver innovative solutions at the forefront of the industry. The Sr. Engineer, Systems Integration will play a...


  • Newark, United States Dew Software Full time

    Dew Software is currently seeking a highly skilled and experienced Sr. Engineer, Systems Integration to join our dynamic team. As a global organization specializing in digital transformation, Dew Software collaborates with Fortune 500 companies to deliver innovative solutions at the forefront of the industry. The Sr. Engineer, Systems Integration will play a...


  • Newark, United States Dew Software Full time

    Job DescriptionJob DescriptionDew Software is currently seeking a highly skilled and experienced Sr. Engineer, Systems Integration to join our dynamic team. As a global organization specializing in digital transformation, Dew Software collaborates with Fortune 500 companies to deliver innovative solutions at the forefront of the industry. The Sr. Engineer,...


  • Newark, United States Lucid Motors Full time

    We are currently seeking a Sr. CFD Engineer , Aerodynamics. You will join our Aerodynamics team to contribute to the development of our CFD tools and applications. Our ideal candidate exhibits a can-do attitude and approaches his or her work with vigor and determination. Candidates will be expected to demonstrate excellence in their respective fields, to...


  • Newark, United States Unigen Full time

    Job Title: Sr. Manufacturing Engineer (SRME)Department: Manufacturing Engineering (ME)Job Overview: The Senior Manufacturing Engineer (Sr. ME) develops, validate, implements, and maintains methods, flow, and systems of Unigen production. The Manufacturing Engineer estimates manufacturing cost, determines manufacturing requirements, and coordinates the...


  • Newark, United States ContractTECH Inc Full time

    We are currently seeking Mid to Sr. Level Electrical Engineers to join the professional staff of our customer. This position offers the potential to play a strategic role in our company's growth and development. Experience in a consulting engineering firm is highliy preferred. Responsibilities: The person we hire will have many of the following skills and...


  • Newark, United States PEAK Technical Staffing USA Full time

    We are currently seeking Mid to Sr. Level Electrical Engineers to join the professional staff of our customer. This position offers the potential to play a strategic role in our company's growth and development. Experience in a consulting engineering firm is highliy preferred. Responsibilities: The person we hire will have many of the following skills and...


  • Newark, United States PEAK Technical Staffing USA Full time

    We are currently seeking Mid to Sr. Level Electrical Engineers to join the professional staff of our customer. This position offers the potential to play a strategic role in our company's growth and development. Experience in a consulting engineering firm is highliy preferred. Responsibilities: The person we hire will have many of the following skills and...

  • Sr. Software Engineer

    2 weeks ago


    Newark, United States Zobility Full time

    We are currently seeking Sr. Software Engineer to join our Infotainment Platform SW organization. This requires an experienced professional with a background in embedded software engineering. The ideal candidate exhibits a can-do attitude and approaches his or her work with determination. Candidates will be expected to demonstrate excellence in their...


  • Newark, United States Zobility Full time

    We are currently seeking Sr. Software Engineer to join our Infotainment Platform SW organization. This requires an experienced professional with a background in embedded software engineering. The ideal candidate exhibits a can-do attitude and approaches his or her work with determination. Candidates will be expected to demonstrate excellence in their...


  • Newark, United States Zobility Full time

    Job DescriptionJob DescriptionWe are currently seeking Sr. Software Engineer to join our Infotainment Platform SW organization. This requires an experienced professional with a background in embedded software engineering. The ideal candidate exhibits a can-do attitude and approaches his or her work with determination. Candidates will be expected to...


  • City of Newark, California, United States Dew Software Full time

    Dew Software is currently seeking a highly skilled and experienced Sr. Engineer, Systems Integration to join our dynamic team. As a global organization specializing in digital transformation, Dew Software collaborates with Fortune 500 companies to deliver innovative solutions at the forefront of the industry. The Sr. Engineer, Systems Integration will play a...


  • Newark, United States Dew Software Full time

    Job DescriptionJob DescriptionDew Software, a trusted name in the digital transformation industry, is seeking a highly skilled Sr. Embedded Security Engineer to join their team. As an ISO-certified and CMMi Level 3 organization, Dew Software works closely with Fortune 500 companies to deliver cutting-edge solutions and drive their digital transformation...

  • Data Engineer

    2 weeks ago


    Newark, United States Diverse Lynx Full time

    Snowflake Data Engineer- snowflake , python Diverse Lynx LLC is an Equal Employment Opportunity employer. All qualified applicants will receive due consideration for employment without any discrimination. All applicants will be evaluated solely on the basis of their ability, competence and their proven capability to perform the functions outlined in the...


  • Newark, United States CareerBuilder Full time

    We are currently seeking a skilled Sr Validation Engineer responsible for validation of viewing functions of the ADAS / Autonomous Driving team. This position requires an experienced professional with a track record of successfully bringing new automotive (ADAS) systems into production. Our ideal candidate exhibits a can-do attitude and approaches his or her...

  • Lead Data Engineer

    2 weeks ago


    Newark, United States JSR Tech Consulting Full time

    Long term contract to hire. Lead data engineer role with a major Financial Services company. Hybrid work environment. 2 - 3 days onsite in Newark, NJ. - Engineering lead to help the design/build of the enterprise data platforms Design, Develop and Implement End-to-end data solutions (ingest, storage, integration, processing, access) on AWS. Data intake/...

  • Data Engineer

    2 weeks ago


    Newark, United States 4 Staffing Corp Full time

    About the job Data Engineer (Financial Services) Data Engineer (Fixed Income Capital Markets) Full-time, direct employment Hybrid onsite/remote - Newark, NJ No visa sponsorship or C2C at this time Job Description: Our client is seeking a skilled and experienced Data Engineer with expertise in Fixed Income Capital Markets to join their dynamic team. The...

  • Data/Business Analyst

    2 weeks ago


    Newark, United States Diverse Lynx Full time

    Data/Business Analyst (Data Engineering) Newark - NJ onsite 2.Job summary Utilize knowledge of business analysis concepts and Software Development Life Cycle methodologies to support business initiatives and system enhancements within our Data Engineering Enablement team. Perform business process reviews and workflow changes by working with business users,...


  • Newark, United States Lucid Motors Full time

    As a Sr. Android Application Engineer, you will be a key member of our mobile development team. You will be responsible for building high-quality features and will prototype new features while maintaining and improving existing features. Your contributions always include test coverage, and you are constantly looking to improve our application structure,...

  • AWS Data Engineer

    3 weeks ago


    Newark, United States Iris Software Inc. Full time

    Iris's client, a large insurance company, is currently searching for a strong for AWS Data Engineer. Our client has offices all over the world and has the global reach, advisory services, and distribution power to meet the needs of issuers and investors worldwide. Job title: AWS Data EngineerLocation: Hybrid 2 days onsite (Newark, NJ)Duration: 24 monthsOnly...