Data Engineer
1 month ago
Data Tech team is looking for a Data Engineer to join a diverse team dedicated to providing best in class data services to our customers, stakeholders and partners. As a part of our organization, you will work with our Client Engineers, Data Scientist and various BUs to define solutions for operationalizing data-driven decision making in a cost effective and scalable manner.
Qualifications:
- Bachelor's degree in Computer Science, Software Engineering, MIS or equivalent combination of education and experience
- Experience implementing, supporting data lakes, data warehouses and data applications on AWS for large enterprises
- AWS Solutions Architect or AWS Big Data Certification preferred
- Programming experience with Java, Python/ Scala, Shell scripting
- Solid experience of AWS services such as CloudFormation, S3, Glue, EMR/Spark, RDS, Redshift, DynamoDB, Lambda, Step Functions, IAM, KMS, SM etc.
- Solid experience implementing solutions on AWS based data lakes
- Experience implementing metadata solutions leveraging AWS non-relational data solutions such as ElastiCache and DynamoDB
- Experience in AWS data lake, data warehouse and business analytics
- Experience in system analysis, design, development, and implementation of data ingestion pipeline in AWS
- Knowledge of ETL/ ELT
- Working experience with Hadoop, HDFS, SQOOP, Hive, Python, and Spark is desired
- Experience working on Agile projects
Requirements :
- 3 - 5 years of experience as Data Engineer
- Experience developing business applications using NoSQL/ SQL databases.
- Experience working with Object stores (S3) and JSON is must have
- Should have good experience with AWS Services - API Gateway, Lambda, Step Functions, SQS, DynamoDB, S3, ElasticSearch.
- Serverless application development using AWS Lambda.
Responsibilities:
- Designing, building and maintaining efficient, reusable and reliable architecture and code
- Ensure the best possible performance and quality of high scale web applications and services
- Participate in the architecture and system design discussions
- Independently perform hands on development and unit testing of the applications
- Collaborate with the development team and build individual components into complex enterprise web systems
- Work in a team environment with product, frontend design, production operation, QE/ QA and cross functional teams to deliver a project throughout the whole software development cycle
- Responsible to identify and resolve any performance issues
- Keep up to date with new technology development and implementation
- Participate in code review to make sure standards and best practices are met
Plus
- Experience with business intelligence tools such as Tableau, Power BI or equivalent
- Aware of Machine learning algorithms (supervised/unsupervised)
- Nice to have AWS developer certificate
-
Data Engineer
2 months ago
newark, United States JSR Tech Consulting Full timeData Tech team is looking for a Data Engineer to join a diverse team dedicated to providing best in class data services to our customers, stakeholders and partners. As a part of our organization, you will work with our Client Engineers, Data Scientist and various BUs to define solutions for operationalizing data-driven decision making in a cost effective and...
-
Data Engineer
2 months ago
Newark, United States JSR Tech Consulting Full timeData Tech team is looking for a Data Engineer to join a diverse team dedicated to providing best in class data services to our customers, stakeholders and partners. As a part of our organization, you will work with our Client Engineers, Data Scientist and various BUs to define solutions for operationalizing data-driven decision making in a cost effective and...
-
Data Engineer
2 weeks ago
newark, United States Tata Consultancy Services Full timeMust Have Technical/Functional Skills : Azure Data Engineer, Microsoft FabricExperience Required : 8+Roles & ResponsibilitiesData Management and Storage:Design and implement data storage systems using Azure services like Azure SQL Database, Azure Data Lake Storage, and Azure Synapse.Ensure scalability, performance, and cost-effectiveness.Data Integration and...
-
Data Engineer
2 weeks ago
Newark, United States Tata Consultancy Services Full timeMust Have Technical/Functional Skills : Azure Data Engineer, Microsoft FabricExperience Required : 8+Roles & ResponsibilitiesData Management and Storage:Design and implement data storage systems using Azure services like Azure SQL Database, Azure Data Lake Storage, and Azure Synapse.Ensure scalability, performance, and cost-effectiveness.Data Integration and...
-
Data Engineer
2 weeks ago
newark, United States Tata Consultancy Services Full timeMust Have Technical/Functional Skills : Azure Data Engineer, Microsoft FabricExperience Required : 8+Roles & ResponsibilitiesData Management and Storage:Design and implement data storage systems using Azure services like Azure SQL Database, Azure Data Lake Storage, and Azure Synapse.Ensure scalability, performance, and cost-effectiveness.Data Integration and...
-
AWS Data Engineer
7 days ago
Newark, United States Iris Software Inc. Full timeIris's client, a large insurance company, is currently searching for a strong AWS Data Engineer based in Newark, NJ to join their team. Our client has offices worldwide and has the global reach, advisory services, and distribution power to meet the needs of issuers and investors worldwide. Job title: AWS Data EngineerLocation: Hybrid (Newark, NJ)Duration: 24...
-
Azure Data Engineer
1 month ago
newark, United States JSR Tech Consulting Full timeDesign and implement Azure data solutions using Azure SQL Database, Azure Data Lake Storage, and Azure Synapse.Develop and implement data integration processes using Azure Data Factory.Extract data from various sources, transform it, and load it into data warehouses or data lakesCreate data processing workflows and pipelines to support data analytics and...
-
Azure Data Engineer
2 months ago
newark, United States JSR Tech Consulting Full timeDesign and implement Azure data solutions using Azure SQL Database, Azure Data Lake Storage, and Azure Synapse.Develop and implement data integration processes using Azure Data Factory.Extract data from various sources, transform it, and load it into data warehouses or data lakesCreate data processing workflows and pipelines to support data analytics and...
-
Azure Data Engineer
2 months ago
Newark, United States JSR Tech Consulting Full timeDesign and implement Azure data solutions using Azure SQL Database, Azure Data Lake Storage, and Azure Synapse.Develop and implement data integration processes using Azure Data Factory.Extract data from various sources, transform it, and load it into data warehouses or data lakesCreate data processing workflows and pipelines to support data analytics and...
-
AWS Data Engineer
7 days ago
Newark, United States JSR Tech Consulting Full timeHybrid in Newark, NJ. Long term contract with major financial firm. Data Engineer Job Description for Data Journey • Experience developing and deploying application code using SQL, Python, spark. • 3-5 years' experience developing and deploying data pipeline in cloud. • 3-5 years' experience in AWS using glue, athena, lambda, secrets manager,...
-
AWS Data Engineer
1 month ago
newark, United States Themesoft Inc. Full timeRole: AWS Data EngineerLocation: Newark, NJ(Hybrid)Responsibilities:Lead geospatial data analysis projects to provide actionable insights.Oversee the integration of geospatial data with AWS services to enhance data processing capabilities. Provide expertise in AWS CloudWatch to monitor and manage geospatial data workflows. Utilize AWS Athena for efficient...
-
AWS Data Engineer
3 weeks ago
newark, United States Themesoft Inc. Full timeRole: AWS Data EngineerLocation: Newark, NJ(Hybrid)Responsibilities:Lead geospatial data analysis projects to provide actionable insights.Oversee the integration of geospatial data with AWS services to enhance data processing capabilities. Provide expertise in AWS CloudWatch to monitor and manage geospatial data workflows. Utilize AWS Athena for efficient...
-
AWS Data Engineer
1 week ago
Newark, United States MDMS Recruiting LLC Full time***W2 or Self Incorporated / independent consultants ONLY | No C2C / No corp to corp******Hybrid role (onsite 3 days per week)***AWS Data Engineer Job Description:• Experience developing and deploying application code using SQL, Python, spark.• Experience developing and deploying data pipeline in cloud.• Experience in AWS using glue, athena, lambda,...
-
AWS Data Engineer
1 month ago
Newark, United States Themesoft Inc. Full timeRole: AWS Data EngineerLocation: Newark, NJ(Hybrid)Responsibilities:Lead geospatial data analysis projects to provide actionable insights.Oversee the integration of geospatial data with AWS services to enhance data processing capabilities. Provide expertise in AWS CloudWatch to monitor and manage geospatial data workflows. Utilize AWS Athena for efficient...
-
Senior Software Engineer
4 weeks ago
Newark, United States Prudential Ins Co of America Full timeJob Classification: Technology - Engineering & Cloud Are you interested in building capabilities that enable the organization with innovation, speed, agility, scalability and efficiency? The Global Technology team takes great pride in our culture where digital transformation is built into our DNA! When you join our organization at Prudential, youll unlock an...
-
Director
2 days ago
Newark, United States NTT Data Full timeReq ID: 285135NTT DATA is a trusted global innovator of business and technology services, helping clients innovate, optimize and transform for success. We strive to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently...
-
Director
6 days ago
Newark, United States NTT Data Full timeReq ID: 285135NTT DATA is a trusted global innovator of business and technology services, helping clients innovate, optimize and transform for success. We strive to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently...
-
newark, United States Iris Software Inc. Full timeIris's client, a large insurance company, is currently searching for a strong AWS Data Engineer based in Newark, NJ to join their team. Our client has offices worldwide and has the global reach, advisory services, and distribution power to meet the needs of issuers and investors worldwide. Job title: AWS Data EngineerLocation: Hybrid (Newark, NJ)Duration: 24...
-
Senior Data Scientist
3 weeks ago
Newark, United States Prudential Ins Co of America Full timeJob Classification: Technology - Data Analytics & Management Are you interested in building capabilities that enable the organization with innovation, speed, agility, scalability and efficiency? The Global Technology team takes great pride in our culture where digital transformation is built into our DNA! When you join our organization at Prudential, youll...
-
Senior Data Architect
7 days ago
Newark, United States Zobility Full timeJob Responsibilities: Architectural Leadership: Lead the architecture, design, and development of big data streaming systems and business data consolidation based on business priorities and cost optimization.IoT System Design: Design IoT systems to facilitate communication and data movement between vehicles and the cloud.Technology Utilization: Leverage...