Data Engineer

4 weeks ago

Newark, United States HireTalent - Diversity Staffing & Recruiting Firm Full time

High level requirements for the role:

-Data ingestion from various on-prem and cloud sources

-Ability to build ETL pipelines to transform raw data into format suitable for analysis (hands on experience working with ETL tools like AWS Glue, Informatica etc.) and orchestrate transformation (using Airflow, other DAG tools)

-Experience working with big data technologies and data formats (e.g., Parquet, Delta, Iceberg)

-Expertise in Python, Spark and SQL programming languages

-Strong experience working on cloud platforms (AWS, Azure)

-Proven track record of enterprise data modeling including building schemas for data warehousing.

-Knowledge of real-time data streaming and real-time analytics

-Knowledge of Microsoft suite of tools is desired (Power BI, Synapse suite of analytics tools, Azure Data Factory)

Your Impact:

  • ingestion from various on-prem and cloud sources optimize data for large data processing.

Build ETL pipelines to collect, blend, transform raw data into suitable formats for analysis (hands on experience working with ETL tools like AWS Glue, Informatica etc.) and orchestrate transformation (using Airflow, other DAG tools)

  • enterprise data models and define standards for data warehouse management adhering to data model definitions.

Interact with data analytics and reporting teams to understand how data needs to be structured for consumption.

Configure and maintains MDM tools and system processes to ensure proper function of MDM mechanisms.

Define master data quality validation criteria and implements automatic error detection schemes.

Implement data lineage capability to understand data movement across the enterprise.

Implement data governance and standards including data definitions, data quality rules, data lineage, business glossary functions.

Support domain owners and data stewards to analyze quality issue root causes and remediation efforts.

Monitor cross-BU data provisioning to ensure provisioning is done via official sources.

Your Skills and Experience:

Bachelors’ degree is required in a relevant field.

6+ years of experience working in a data engineering role supporting an on-prem Data Lake; experience within institutional asset management is a plus.

4+ years of strong experience with working on cloud platforms (AWS, Azure) (CloudFormation Templates, IAM, Aurora, EventBridge, Lambda, CloudWatch);

2+ years of experience with Snowflake (SnowSQL, SnowPark)

5+ years of experience with any relational database (SQL, Store procedures, functions)

5+ years of experience with Python, Spark and SQL programming languages.

Extensive hands-on experience in modern data lake architecture, database development, and data modeling.

Knowledge of real-time data streaming and real-time analytics

Knowledge of Microsoft suite of tools is desired (Power BI, Synapse suite of analytics tools, Azure Data Factory)

Strong implementation skills and working knowledge of data structures, algorithms and big data tools (Spark, Hadoop, Python, SQL, NoSQL, Hive); Must have hands-on experience using Spark.

Solid Linux OS and Shell Scripting experience.

Experience working with big data technologies and data formats (e.g., Parquet, Delta, Iceberg)

Extensive experience with at least one of the following RDMS: Oracle, SQL Server, Postgres or MySQL.

Strong communication skills: able to partner with technical and business stakeholders to drive innovative solutions.

Prior experience using data governance technology tools.

Prior experience in a lead role is desired but not required.

Experience working in an agile environment embracing collaboration within and across teams.

Excellent written and verbal communication skills.

Detail oriented; Analytical with strong problem-solving abilities.

Professional and energetic self-starter. Comfortable with ambiguity, able to effectively take the conceptual to the pragmatic.

  • Data Engineer

    2 weeks ago

    Newark, United States Diverse Lynx Full time

    Snowflake Data Engineer- snowflake , python Diverse Lynx LLC is an Equal Employment Opportunity employer. All qualified applicants will receive due consideration for employment without any discrimination. All applicants will be evaluated solely on the basis of their ability, competence and their proven capability to perform the functions outlined in the...

  • Lead Data Engineer

    2 weeks ago

    Newark, United States JSR Tech Consulting Full time

    Long term contract to hire. Lead data engineer role with a major Financial Services company. Hybrid work environment. 2 - 3 days onsite in Newark, NJ. - Engineering lead to help the design/build of the enterprise data platforms Design, Develop and Implement End-to-end data solutions (ingest, storage, integration, processing, access) on AWS. Data intake/...

  • Data Engineer

    2 weeks ago

    Newark, United States 4 Staffing Corp Full time

    About the job Data Engineer (Financial Services) Data Engineer (Fixed Income Capital Markets) Full-time, direct employment Hybrid onsite/remote - Newark, NJ No visa sponsorship or C2C at this time Job Description: Our client is seeking a skilled and experienced Data Engineer with expertise in Fixed Income Capital Markets to join their dynamic team. The...

  • Data/Business Analyst

    2 weeks ago

    Newark, United States Diverse Lynx Full time

    Data/Business Analyst (Data Engineering) Newark - NJ onsite 2.Job summary Utilize knowledge of business analysis concepts and Software Development Life Cycle methodologies to support business initiatives and system enhancements within our Data Engineering Enablement team. Perform business process reviews and workflow changes by working with business users,...

  • Sr. Data Engineer

    2 weeks ago

    Newark, United States JSR Tech Consulting Full time

    Job Description : 8p - Engineering lead to help the design/build of the CDO enterprise data platforms Design, Develop and Implement End-to-end data solutions (ingest, storage, integration, processing, access) on AWS. Data intake/ request/ onboarding services and service documentation. Data ingestion services for batch/ real time data ingest and service...

  • AWS Data Engineer

    3 weeks ago

    Newark, United States Iris Software Inc. Full time

    Iris's client, a large insurance company, is currently searching for a strong for AWS Data Engineer. Our client has offices all over the world and has the global reach, advisory services, and distribution power to meet the needs of issuers and investors worldwide. Job title: AWS Data EngineerLocation: Hybrid 2 days onsite (Newark, NJ)Duration: 24 monthsOnly...

  • AWS Data Engineer

    3 weeks ago

    Newark, United States Iris Software Inc. Full time

    Iris's client, a large insurance company, is currently searching for a strong for AWS Data Engineer. Our client has offices all over the world and has the global reach, advisory services, and distribution power to meet the needs of issuers and investors worldwide. Job title: AWS Data EngineerLocation: Hybrid 2 days onsite (Newark, NJ)Duration: 24 monthsOnly...

  • Cloud Data Engineer

    3 days ago

    Newark, United States Lucid Motors Full time

    As part of this position, you will work closely with experienced engineers to address intriguing and complex challenges within the ADAS/AD domain. Our team is actively gathering extensive data, amounting to Terabytes, to support autonomous driving operations. you will play a crucial role in developing and maintaining software solutions to process, manage,...

  • Data Analyst

    3 weeks ago

    Newark, United States Ecclesiastes Inc Full time

    Job DescriptionJob DescriptionPOSITION DUTIES:Analyze user’s data processing needs, manipulate or process large amounts of data using software applications, and convey the results of the data analysis to stakeholders. Position is based out of headquarters in Newark, DE but may be assigned to various unanticipated worksites throughout the US as determined...

  • Senior Data Scientist

    2 weeks ago

    Newark, United States ZAR IT Solutions Full time

    Job DescriptionJob DescriptionSenior Data Scientist, Product and Insights Candidate must have the breadth and depth in various domains like Marketing Measurement, Causal Inference. Experience with graph neural networks, reinforcement learning. Experience with MCMC would be best.Description:Good storytelling starts with great listening. At Client, that means...

  • Data BI Analyst

    2 weeks ago

    Newark, United States Remotely Full time

    Data BI Analyst (1 year experience, onsite) Be part of our future! This job posting builds our talent pool for potential future openings. We'll compare your skills and experience against both current and future needs. If there's a match, we'll contact you directly. No guarantee of immediate placement, and we only consider applications from US/Canada...

  • Big Data Engineer

    2 weeks ago

    Newark, United States JSR Tech Consulting Full time

    Responsibilities: Designing, building and maintaining efficient, reusable, and reliable architecture and code Ensure the best possible performance and quality of high scale web applications and services Design and build highly performant function-based API's Developing microservices using Node.js / python/Java Ensures all code has been unit tested...

  • Machine Learning Engineer

    6 days ago

    Newark, United States AMISEQ Full time

    ML EngineerData Tech team at Client is looking for a ML Engineer to join a diverse team dedicated to providing best-in-class data services to our customers, stakeholders, and partners.As a part of our CDO organization, you will work with our Data Science and BUs to define solutions for operationalizing data-driven decision-making in a cost-effective and...

  • Machine Learning Engineer

    5 days ago

    Newark, United States AMISEQ Full time

    ML EngineerData Tech team at Client is looking for a ML Engineer to join a diverse team dedicated to providing best-in-class data services to our customers, stakeholders, and partners.As a part of our CDO organization, you will work with our Data Science and BUs to define solutions for operationalizing data-driven decision-making in a cost-effective and...

  • Senior Data Architect

    2 weeks ago

    Newark, United States 4 Staffing Corp Full time

    About the job Senior Data Architect - VP Senior Data Architect (VP Level) - Financial Services Full-time, direct employment Hybrid onsite/remote - Newark, NJ No visa sponsorship or C2C at this time Job Description: Our client is seeking a highly skilled Senior Data Architect at the VP level with extensive experience in designing and implementing...

  • Manager, Engineering Tools Support

    3 days ago

    Newark, United States Lucid Motors Full time

    Lucid is looking for a talented and motivated Engineering Tools Technical Support Manager. This position reports to Director of Product Data and Software Tools and requires an experienced professional who will support the organization with assistance on engineering software tools (e.g., 3DExperience and CATIA etc. plus many others) while managing a diverse...

  • Machine Learning Engineer

    5 days ago

    Newark, United States AMISEQ Full time

    ML EngineerNewark, NJ - Hybrid6-12 Months Contract Responsibilities:Strong computer science fundamentals such as algorithms, data structures, multithreading, object-oriented development, distributed applications, client-server architecture.Design and implement Machine learning models and data ingestion pipelines.Develop and support a platform that enables...

  • Machine Learning Engineer

    4 days ago

    Newark, United States AMISEQ Full time

    ML EngineerNewark, NJ - Hybrid6-12 Months Contract Responsibilities:Strong computer science fundamentals such as algorithms, data structures, multithreading, object-oriented development, distributed applications, client-server architecture.Design and implement Machine learning models and data ingestion pipelines.Develop and support a platform that enables...

  • Engineer

    3 days ago

    Newark, United States Tata Consultancy Services Full time

    Skill: AWS Data Engineer Must have AWS Glue, Lambda, Athena, Pyspark, Redshift, EMR, AWS RDB, AWS DynamoDB, AWS Glacier, Python. Experience Required: Minimum 5 years of professional experience in data integration and management. 3+ years of hands on development experience in AWS Glue, Lambda functions, AWS Athena, Redshift, Pyspark. Hands on working...

  • Engineer

    7 days ago

    Newark, United States Tata Consultancy Services Full time

    Skill: AWS Data Engineer Must have AWS Glue, Lambda, Athena, Pyspark, Redshift, EMR, AWS RDB, AWS DynamoDB, AWS Glacier, Python. Experience Required: Minimum 5 years of professional experience in data integration and management. 3+ years of hands on development experience in AWS Glue, Lambda functions, AWS Athena, Redshift, Pyspark. Hands on working...