Sr. Data Engineer

3 weeks ago

Newark, United States MDMS Recruiting LLC Full time
Job DescriptionJob Description

***W2 or Self Inc. Only | this is not open to subcontracting (no C2C)***

Senior Data Engineer to help the design/build of the enterprise data platforms

Design, Develop and Implement

  • End-to-end data solutions (ingest, storage, integration, processing, access) on AWS.
  • Data intake/ request/ onboarding services and service documentation.
  • Data ingestion services for batch/ real time data ingest and service documentation.
  • Data processing services for batch/ real time (Glue/ Kinesis/ EMR) and service documentation.
  • Data storage services for data lake (S3)/ data warehouses (RDS/ Redshift)/ data marts and service documentation.
  • Data services layer including Athena, Redshift, RDS, microservices and APIs.
  • Pipeline orchestration services including lambda, step functions, MWAA (optional).
  • Data security services (IAM/ KMS/ SM/ encryption/ anonymization/ RBAC) and service documentation.
  • Data access provisioning services (Accounts, IAM Roles RBAC), processes, documentation and education.
  • Data provisioning services for data consumption patterns including microservices, APIs and extracts.
  • Metadata capture and catalog services for data lake (S3/ Athena), data warehouses (RDS/ Redshift), Microservices/ APIs.
  • Metadata capture and catalog services for pipeline/ log data for monitoring / support.
  • Architect and implement CI/ CD strategy for EDP .
  • Implement high velocity streaming solutions using Amazon Kinesis, SQS, and SMS.
  • Migrate data from traditional relational database systems, file systems, NAS shares to AWS relational databases such as Amazon RDS, Aurora, and Redshift.
  • Migrate data from APIs to AWS data lake (S3) and relational databases such as Amazon RDS, Aurora, and Redshift.
  • Implement cost/ spend monitoring for AWS based data platform.
  • Implement audit reporting for access of AWS based data platform.
  • Contribute to the implementation of a data strategy to enable a robust, holistic view of data - driven decision making.
  • Partner with immediate engineering team, product owner, IT, partners on EDP agenda.
  • Leverage and continuously develop best practices, standards, and frameworks.
  • Provide technology thought leadership, consulting, and coaching/ mentoring.
  • Work with scrum master to develop and own backlog, stories, epics, sprints.
  • System design and Architecture for products/ applications for EDP.
  • Work closely with various stakeholders (BI, AIML, MDM and other teams) to understand their use-cases and design optimal solution for them.
  • Execute technical design and infrastructure strategy for EDP .
  • Implement POCs on any new technology or tools to be implemented on EDP and onboard for real use-case.

Qualifications

  • Bachelor's degree in computer science, Software Engineering, MIS or equivalent combination of education and experience.
  • Experience implementing, supporting data platforms on AWS for large enterprises.
  • Full stack development experience building secure internal facing applications.
  • Programming experience with Java, Python/ Scala, Shell scripting.
  • Solid experience of AWS services such as CloudFormation, S3, Glue, EMR/ Spark, RDS, Redshift, DynamoDB, Lambda, Step Functions, IAM, KMS, SM etc.
  • Solid experience implementing solutions on AWS based data lakes preferred.
  • Experience implementing metadata solutions leveraging AWS non-relational data solutions such as ElastiCache and DynamoDB.
  • AWS Solutions Architect or AWS Big Data Certification preferred.
  • Experience in AWS data lake, data warehouse and business analytics.
  • Experience and understanding of various core AWS services such as IAM, Cloud Formation, EC2, S3, EMR/Spark, Glue, Datasync, CloudHealth, CloudWatch, Lambda, Athena, and Redshift.
  • Experience in system analysis, design, development, and implementation of data ingestion pipeline in AWS.
  • Experience with DevOps and Continuous Integration/ Delivery (CI/ CD) concepts and tools.
  • Experience with business intelligence tools such as Tableau, Power BI or equivalent.
  • Knowledge of ETL/ ELT.
  • Awareness of Data Management & Governance tools.
  • Working experience with Hadoop, HDFS, SQOOP, Hive, Python, and Spark is desired.
  • Experience working on Agile projects.





  • Sr. Engineer, Systems Integration

    2 weeks ago

    Newark, United States Dew Software Full time

    Dew Software is currently seeking a highly skilled and experienced Sr. Engineer, Systems Integration to join our dynamic team. As a global organization specializing in digital transformation, Dew Software collaborates with Fortune 500 companies to deliver innovative solutions at the forefront of the industry. The Sr. Engineer, Systems Integration will play a...

  • Sr. Engineer, Systems Integration

    3 weeks ago

    Newark, United States Dew Software Full time

    Dew Software is currently seeking a highly skilled and experienced Sr. Engineer, Systems Integration to join our dynamic team. As a global organization specializing in digital transformation, Dew Software collaborates with Fortune 500 companies to deliver innovative solutions at the forefront of the industry. The Sr. Engineer, Systems Integration will play a...

  • Sr. Engineer, Systems Integration

    3 weeks ago

    Newark, United States Dew Software Full time

    Job DescriptionJob DescriptionDew Software is currently seeking a highly skilled and experienced Sr. Engineer, Systems Integration to join our dynamic team. As a global organization specializing in digital transformation, Dew Software collaborates with Fortune 500 companies to deliver innovative solutions at the forefront of the industry. The Sr. Engineer,...

  • Sr. CFD Engineer, Aerodynamics

    3 weeks ago

    Newark, United States Lucid Motors Full time

    We are currently seeking a Sr. CFD Engineer , Aerodynamics. You will join our Aerodynamics team to contribute to the development of our CFD tools and applications. Our ideal candidate exhibits a can-do attitude and approaches his or her work with vigor and determination. Candidates will be expected to demonstrate excellence in their respective fields, to...

  • Sr. Manufacturing Engineer

    2 weeks ago

    Newark, United States Unigen Full time

    Job Title: Sr. Manufacturing Engineer (SRME)Department: Manufacturing Engineering (ME)Job Overview: The Senior Manufacturing Engineer (Sr. ME) develops, validate, implements, and maintains methods, flow, and systems of Unigen production. The Manufacturing Engineer estimates manufacturing cost, determines manufacturing requirements, and coordinates the...

  • Sr. Security Engineer

    1 day ago

    Newark, United States Xoriant Corporation Full time

    Job Title: Sr. Embedded Security EngineerDuration: 6+ months (Possible Extension-Long Term Project)Location:  Newark, CA (onsite)Rate: $100/hr on w2 without benefitsDescriptionWe are currently seeking an Embedded Security Engineer for our Cyber Security team.This position requires an experienced professional with a proven track record of cyber security...

  • Electrical Engineers Mid Level to Sr. Level

    4 weeks ago

    Newark, United States ContractTECH Inc Full time

    We are currently seeking Mid to Sr. Level Electrical Engineers to join the professional staff of our customer. This position offers the potential to play a strategic role in our company's growth and development. Experience in a consulting engineering firm is highliy preferred. Responsibilities: The person we hire will have many of the following skills and...

  • Electrical Engineers Mid Level to Sr. Level

    2 days ago

    Newark, United States PEAK Technical Staffing USA Full time

    We are currently seeking Mid to Sr. Level Electrical Engineers to join the professional staff of our customer. This position offers the potential to play a strategic role in our company's growth and development. Experience in a consulting engineering firm is highliy preferred. Responsibilities: The person we hire will have many of the following skills and...

  • Sr. Cybersecurity Engineer

    1 day ago

    Newark, United States R Systems, Inc. Full time

    Looking for an experienced senior level Cybersecurity Engineer with a strong background in leading and building Cybersecurity for a medium size organization.The ideal candidate will have a proven track record of successfully building cybersecurity strategy/roadmap, implementing and operationally managing Governance, Risk and Compliance (GRC) framework,...

  • Electrical Engineers Mid Level to Sr. Level

    2 weeks ago

    Newark, United States PEAK Technical Staffing USA Full time

    We are currently seeking Mid to Sr. Level Electrical Engineers to join the professional staff of our customer. This position offers the potential to play a strategic role in our company's growth and development. Experience in a consulting engineering firm is highliy preferred. Responsibilities: The person we hire will have many of the following skills and...

  • Electrical Engineers Mid Level to Sr. Level

    3 weeks ago

    Newark, United States PEAK Technical Staffing USA Full time

    We are currently seeking Mid to Sr. Level Electrical Engineers to join the professional staff of our customer. This position offers the potential to play a strategic role in our company's growth and development. Experience in a consulting engineering firm is highliy preferred. Responsibilities: The person we hire will have many of the following skills and...

  • Sr. Software Engineer

    7 days ago

    Newark, United States Zobility Full time

    We are currently seeking Sr. Software Engineer to join our Infotainment Platform SW organization. This requires an experienced professional with a background in embedded software engineering. The ideal candidate exhibits a can-do attitude and approaches his or her work with determination. Candidates will be expected to demonstrate excellence in their...

  • POSITION TITLE: Sr. IT Engineering Specialist

    2 days ago

    Newark, United States Ecclesiastes Inc Full time

    Job DescriptionJob DescriptionPOSITION DUTIES:Develop Automation framework to automate the functionality of business-critical applications using Java, Selenium, Python, C#, HTTP Client/Server, API, REST Assured, Django, Maven, TFS and PIP as Build tools, Git and SVN as version control system. Develop, maintain, and refactor new and existing Automated...

  • Sr embedded software engineering

    4 weeks ago

    Newark, United States Zobility Full time

    Job DescriptionJob DescriptionWe are currently seeking Sr. Software Engineer to join our Infotainment Platform SW organization. This requires an experienced professional with a background in embedded software engineering. The ideal candidate exhibits a can-do attitude and approaches his or her work with determination. Candidates will be expected to...

  • Data Engineer

    2 days ago

    Newark, United States CognITek Group Full time

    We have a challenging opportunity for a Data Engineer for a high-growth and highly acquisitive $1B+ residential services company in Newark DE (this position can work remotely with periodic visits to corporate).The Data Engineer will design and maintain our client’s data Infrastructure and ETL processes and will collaborate with an amazing Data Analytics...

  • Data Engineer

    2 days ago

    Newark, United States CognITek Group Full time

    We have a challenging opportunity for a Data Engineer for a high-growth and highly acquisitive $1B+ residential services company in Newark DE (this position can work remotely with periodic visits to corporate).The Data Engineer will design and maintain our client’s data Infrastructure and ETL processes and will collaborate with an amazing Data Analytics...

  • Data Engineer

    1 day ago

    Newark, United States CognITek Group Full time

    We have a challenging opportunity for a Data Engineer for a high-growth and highly acquisitive $1B+ residential services company in Newark DE (this position can work remotely with periodic visits to corporate).The Data Engineer will design and maintain our client’s data Infrastructure and ETL processes and will collaborate with an amazing Data Analytics...

  • Sr. Engineer, Systems Integration

    4 weeks ago

    City of Newark, California, United States Dew Software Full time

    Dew Software is currently seeking a highly skilled and experienced Sr. Engineer, Systems Integration to join our dynamic team. As a global organization specializing in digital transformation, Dew Software collaborates with Fortune 500 companies to deliver innovative solutions at the forefront of the industry. The Sr. Engineer, Systems Integration will play a...

  • Sr. Embedded Security Engineer

    4 weeks ago

    Newark, United States Dew Software Full time

    Job DescriptionJob DescriptionDew Software, a trusted name in the digital transformation industry, is seeking a highly skilled Sr. Embedded Security Engineer to join their team. As an ISO-certified and CMMi Level 3 organization, Dew Software works closely with Fortune 500 companies to deliver cutting-edge solutions and drive their digital transformation...

  • Sr. Validation Engineer, ADAS Viewing features

    4 weeks ago

    Newark, United States CareerBuilder Full time

    We are currently seeking a skilled Sr Validation Engineer responsible for validation of viewing functions of the ADAS / Autonomous Driving team. This position requires an experienced professional with a track record of successfully bringing new automotive (ADAS) systems into production. Our ideal candidate exhibits a can-do attitude and approaches his or her...