Data Engineer
1 day ago
About the job Data Engineer - AWS
OUR CLIENT
Our client provides data-driven, action-oriented solutions to business problems through statistical data mining, cutting-edge analytics techniques, and a consultative approach. Leveraging proprietary methodology and best-of-breed technology, our client's analytics team takes an industry-specific approach to transform decision-making and embed analytics more deeply into their business processes. They have a global footprint of 2,000+ data scientists and analysts who assist client organizations with complex risk minimization methods, advanced marketing, pricing and CRM strategies, internal cost analysis, and cost and resource optimization within the organization. They serve the insurance, healthcare, banking, capital markets, utilities, retail and e-commerce, travel, transportation and logistics industries.
ROLE
We are seeking 2 Data Engineers with 5-8 years of experience in developing enterprise-level applications on the AWS platform.
OVERVIEW
The person will be part of the CDO for a major Insurance client. He/ She will work with different stakeholders for architecting & Building enterprise data solutions to support clients' data requirements. This application would be architected using Micro Services Architecture to support different workloads like Data marts, Data warehouses, and AI/ML. The person will also be required to participate actively in brainstorming sessions for improvement opportunities and take it to completion
A suitable candidate should have 5-8 years of experience in developing enterprise-level applications and should possess a go-getter attitude. He/ She should be able to deal with ambiguity. Experience in life insurance is preferred but not mandatory.
KEY RESPONSIBILITIES & SKILLSETS:
- Common Skillsets:
- Superior analytical and problem-solving skills
- Should be able to work on a problem independently and prepare client-ready deliverables with minimal or no supervision
- Good communication skills for client interaction
- Cloud Data Engineering Skillsets:
- Experience in designing, implementing, and testing Python applications with an understanding of object-oriented programming, multi-tier architecture, and parallel/ multi-threaded programming.
- Programming experience with Python is a must; Java/Scala is nice to have
- Experience with AWS technologies including AppSync, Lambda, Step Functions, and Event Bridge.
- Solid experience in AWS services such as CloudFormation, S3, Glue, EMR/Spark, RDS, DynamoDB, Lambda, Step Functions, IAM, KMS, SM, etc.
- Knowledge of modern cloud-native data warehouses i.e., AWS Redshift, Snowflake, or Azure Synapse Analytics
- Experience implementing metadata solutions leveraging AWS non-relational data solutions such as ElastiCache and DynamoDB.
- Working experience with Python and Spark is desired Experience working on Agile projects
- AWS Solutions Architect or AWS Big Data Certification preferred
- Ability to thrive in a high-energy, high-growth, fast-paced, entrepreneurial environment. Willing to learn new skills and implement new technologies
- Strong organizational, written, and verbal communication skills with high attention to detail and the ability to work independently with minimal supervision
- Highly-collaborate team player who can build strong relationships at all levels of the technology and business organization.
- Bachelors/Master's degree in computer science/engineering, operations research, or related analytics areas welcome to apply
- 5+ years experience in AWS data engineering, preferably in Life Insurance but not mandatory
- Preferably located in the New Jersey area (US EST Considered)
- 100% hands-on role
- 3 rounds of interviews including a live coding exercise
- Start date: Immediately
- Duration: 12+ months
- Type: Contract
-
Sr. Azure Data Engineer
4 months ago
New York, United States Hudson Data Full timeJob Title: Sr. Azure Data Engineer Location: NYC, NY Duration: Long Term W2 Role Job Description: The candidate should have hands-on experience with various Azure services including but not limited to Azure Data Factory, Databricks, Data Lake, and Power BI. They should be able to design, build, and maintain ETL pipelines, manage data lakes, and...
-
Senior Systems Engineer
1 day ago
New York, United States VAST Data Full timeVAST Data is looking for a Senior Systems Engineer to join our growing team! This is a great opportunity to be part of one of the fastest-growing infrastructure companies in history, an organization that is in the center of the hurricane being created by the revolution in artificial intelligence. "VAST's data management vision is the future of the...
-
Data Engineer
4 weeks ago
New York, United States Brooksource Full timeData EngineerLocation: New York, NY (Hybrid)Contract-to-HireWe’re looking for an experienced Data Engineer to join a Fortune 50 Broadcast Media & Entertainment leader. This role involves designing, building, and optimizing data pipelines, integrating multiple datasets, and creating applications that drive strategic business decisions. You’ll collaborate...
-
Data Engineer
6 months ago
New York, United States Silver Search, Inc Full timeData Engineer New York, NY Senior Data Engineer--Redshift/AWS/Python/Scripting---**Will be hybrid onsite in January 2022 onwards** Contract-to-hire Our client is a cutting edge E-Learning company based in NYC and is looking to hire a Senior Data Engineer to join their data and analytics center of excellence. He/She will be building...
-
Data Engineer
2 weeks ago
New York, United States Walsh Employment Full timeOur client is a leading quantitative investment company with a focus on computer-driven trading for global financial markets. The company harnesses the power of data and advanced technologies to drive innovative strategies and superior investment returns through a platform that is driven by cutting-edge, cloud-based data solutions. We are now looking for a...
-
Data Engineer
2 weeks ago
New York, United States SimplifyVMS Full timeAs a Data Engineer, you will be responsible for building and optimizing data pipelines, architectures, and datasets for effective data analysis and machine learning applications. Responsibilities: Developing, constructing, testing, and maintaining architectures for data ingestion, processing, and extraction. Designing and implementing data pipelines to...
-
Data Engineer
21 hours ago
New York, United States TechnoGen Full timeData Engineer Remote Snowflake Expertise: Design, develop, and optimize data pipelines within the Snowflake data platform. Implement best practices for Snowflake data modeling, warehouse architecture, security and performance optimization. Proficient in using Snowflake Snowpipe streaming for real-time data streaming and ingestion and different batch load...
-
Data Engineer
2 hours ago
New York, United States TechnoGen Full timeData Engineer Remote Snowflake Expertise: Design, develop, and optimize data pipelines within the Snowflake data platform. Implement best practices for Snowflake data modeling, warehouse architecture, security and performance optimization. Proficient in using Snowflake Snowpipe streaming for real-time data streaming and ingestion and different batch load...
-
Data Engineer
15 minutes ago
New York, United States TechnoGen Full timeData Engineer Remote Snowflake Expertise: Design, develop, and optimize data pipelines within the Snowflake data platform. Implement best practices for Snowflake data modeling, warehouse architecture, security and performance optimization. Proficient in using Snowflake Snowpipe streaming for real-time data streaming and ingestion and different batch load...
-
Data Engineer
1 day ago
New York, United States Glow Networks Full timeRole: Data EngineerLocation: New York City, NY (Hybrid-3 days a week onsite)Duration: 6 Months with possible extensionsContract: C2C/ W2Job Requirements: Deep hands-on knowledge in big data engineering in a cloud environment, including: Excellent knowledge of SQL in a large scale data warehouse or data lakehouse environment such as Spark, Databricks,...
-
Data Engineer
4 weeks ago
New York, United States hackajob Full timeExciting Opportunity Alert! Join our Team as a Data Engineer!hackajob has partnered with an innovative company seeking a skilled Data Engineer to leverage data for impactful solutions. If you have expertise in big data tools like Spark and Kafka, and experience with cloud services like AWS, we want to hear from YOU!Role: Data EngineerLocation: Hybrid (New...
-
Data Engineer
6 months ago
New York, United States Capstone Investment Advisors Full timeRESPONSIBILITIES: Be part of Data Engineering team responsible for all market data in the firmDesign and implement data-ingestion and data-processing pipelines and tools for a diverse range of datasets using Python, Linux and AWS Cloud platform.Work with variety of backend database storage systems including MS SQL Server, AWS Redshift, Cassandra,...
-
Data Engineer
1 day ago
New York, United States BEHAVIORALLY, Inc. Full timeTitle: Data Engineer MUST: Hybrid in New York City, NYNo Sponsorship provided.Full-Time position Minimum Qualifications: The role is ideal for someone who thrives in a fast-paced, cutting-edge technology environment. Proven Experience with data modeling and developing Enterprise Data Warehouse solutions - OLTP, OLAP, Dimensions, Facts, and Data modeling....
-
Data Engineer
2 weeks ago
New York, United States Atlas Search Full timeResponsibilitiesCloud Data Engineer is responsible for building and maintaining data pipelines within an AWS cloud environment. Work heavily with MongoDB and Snowflake as well as Cypress, Selenium and Kafka. Requirements3+ years of experience in the Data Engineering space working heavily with Public cloud solutions.Experience with MongoDB or...
-
Healthcare Data Engineer Data Engineer
3 weeks ago
New York, United States Tek Leaders Inc Full timeTitle: Healthcare Data Engineer Duration: 12 Months Location: 100% Remote (NYC NY) Essential skills for the role: Minimum of 35 years of experience in Healthcare Domain Minimum of 10 years of experience in Data Engineering. Required technical skills: Python PySpark SQL AWS Required Domain: Healthcare/Insurance Candidate is expected to have...
-
Data Engineer
5 days ago
New York, United States Robert Half Full timeJob DescriptionJob DescriptionWe are offering an exciting opportunity for a Data Engineer in NEW YORK, New York. This role involves working in the industry, specifically focusing on AWS Technologies, Python, NoSQL, and Snowflake. The workplace is dynamic and requires someone who can efficiently handle data-related tasks. Responsibilities:• Build efficient...
-
Data Engineer
6 months ago
New York, United States Jane Street Full timeAbout the PositionWe are looking for a Data Engineer who can help us understand, clean, manage, and share the data that guides our trading. At Jane Street, having a thorough and accurate understanding of data is at the core of the work we do.Using our mix of in-house and open-source software, you will analyze datasets gathered from a variety of sources,...
-
Data Engineer
1 day ago
New York, United States City of New York Full timeCompany DescriptionJob Description The New York City Taxi and Limousine Commission (TLC) is the City agency responsible for regulating for-hire transportation in New York City, including taxis, street hail liveries, high-volume for-hire services such as Uber and Lyft, black cars, luxury limousines, livery vehicles, commuter vans, and paratransit vehicles....
-
Data Engineer
20 hours ago
New York, United States Open Systems Technologies Full timeA financial firm is looking for a Data Engineer to join their team in New York, NY. Pay: $120-125/hr Hybrid; 2 days per week onsite Top Skills: Databricks, Python, SQL, Spark, AWS, Trino Must be a US Citizen Responsibilities: • Design, develop, monitor, and maintain data pipelines in an AWS ecosystem with Databricks, Delta Lake, Python, SQL and Starburst...
-
GCP Machine Learning Engineer
4 weeks ago
New York, United States The Data Sherpas Full timeJ ob Summary : As a GCP Machine Learning Engineer, you will drive technology innovation by delivering world-class machine learning solutions. You will integrate GCP-native and third-party technologies to build scalable data infrastructures, focusing on modernizing data pipelines and machine learning platforms. You will collaborate with implementation teams...