AI Cloud Data Engineer

3 weeks ago

Cary, United States MetLife Services and Solutions, LLC Full time
Description and Requirements

Role Value Proposition:

MetLife Data & Analytics organization is the team of expert technologists responsible for building big data platforms and data services with innovative technologies to enable MetLife businesses to generate insights, and value to its customers. The team is the center of excellence in data engineering in MetLife and plays a key role in data enablement through multiple data stores, supporting different kind of analytical use cases to be able to derive predictive, prescriptive, and descriptive insights.

The Azure Data Engineer II serves as big data development expert within the data analytics engineering organization of MetLife Data & Analytics. This position has the responsibility of building ELT, data warehousing and reusable components using cutting edge big data and cloud technologies. The resource will collaborate with the business systems analyst, technical leads, project managers and business/operations teams in building data enablement solutions across different LOBs and use cases.

Key Responsibilities:

  • Collect, store, process and analyze large datasets to build and implement extract, transfer, load (ELT) processes
  • Develop reusable frameworks to reduce the development effort involved thereby ensuring cost savings for the projects.
  • Develop quality code with thought through performance optimizations in place right at the development stage.
  • Appetite to learn new technologies and be ready to work on new cutting-edge cloud technologies.
  • Work with team spread across the globe in driving the delivery of projects and recommend development and performance improvements.
Essential Business Experience and Technical Skills:
  • Ingesting huge volumes data from various platforms for Analytics needs and writing high-performance, reliable, and maintainable ELT code.
  • Strong analytic skills related to working with unstructured datasets.
  • Strong experience in building/designing Data warehouses, data stores for analytics consumption On prem and Cloud (real time as well as batch use cases)
  • Ability to interact with business analysts and functional analysts in getting the requirements and implementing the ELT solutions.
Required:
  • 8+ years of solutions development and delivery experience with 6+ years of recent experience in data engineering.
  • Proficiency and extensive Experience with Spark & Scala/Python and performance tuning
  • Hands on expertise in: Azure SQL Synapse, Cosmos DB, Data Factory, Python, Spark Scala experience is a MUST.
  • Building and Implementing data ingestion and curation process developed using Cloud data tools such as Azure SQL Synapse, Cosmos DB, Data Factory, Spark (Scala/python), Data bricks, Delta lake etc.
  • Performance tuning on Azure SQL Synapse dedicated SQL Pool and server SQL Pools, Cosmos SQL APIs loading and consumption optimizations.
  • Good scripting experience primarily on shell/bash/ PowerShell would be desirable.
  • Strong SQL knowledge and data analysis skills for data anomaly detection and data quality assurance.
  • Expertise using Generative AI models for creating SQL/Python code, debugging it and optimizing it.
  • Experience writing and using Large Language Models (LLMs) to create co-pilot kind of experience for creating datasets.
  • Building and deploying LLMs for data pipeline performance monitoring, data quality and deriving lineage out of SQL implementation.
  • Usage of NLP for querying datasets, LLM for calling Data APIs and experience building AI chatbots.
Preferred:
  • Expertise in Python and experience writing Azure functions using Python/Node.js.
  • Experience using Event Hub for data integrations.
  • Eagerness to learn new technologies on the fly and ship to production.
  • Hive database management and Performance tuning - Partitioning / Bucketing.
  • Code versioning experience using Bitbucket/Azure DevOps. Working knowledge of Azure DevOps pipelines would be a big plus.
  • Prior experience leveraging AI and ML capabilities to automate and optimize complex workflows with intelligent use of low or no-code.
  • Very good problem solver and excellent communication skills - both written and verbal


Benefits We Offer

Our U.S. benefits address holistic well-being with programs for physical and mental health, financial wellness, and support for families. We offer a comprehensive health plan that includes medical/prescription drug and vision, dental insurance, and no-cost short- and long-term disability. We also provide company-paid life insurance and legal services, a retirement pension funded entirely by MetLife and 401(k) with employer matching, group discounts on voluntary insurance products including auto and home, pet, critical illness, hospital indemnity, and accident insurance, as well as Employee Assistance Program (EAP) and digital mental health programs, parental leave, volunteer time off, tuition assistance and much more

About MetLife
Recognized on Fortune magazine's list of the 2023 "World's Most Admired Companies" as well as the 2023 Fortune 100 Best Companies to Work For ®, MetLife , through its subsidiaries and affiliates, is one of the world's leading financial services companies; providing insurance, annuities, employee benefits and asset management to individual and institutional customers. With operations in more than 40 markets, we hold leading positions in the United States, Latin America, Asia, Europe, and the Middle East.

Our purpose is simple - to help our colleagues, customers, communities, and the world at large create a more confident future. United by purpose and guided by empathy, we're inspired to transform the next century in financial services. At MetLife, it's #AllTogetherPossible . Join us

Equal Employment Opportunity/Disability/Veterans

If you need an accommodation due to a disability, please email us at accommodations@metlife.com. This information will be held in confidence and used only to determine an appropriate accommodation for the application process.

MetLife maintains a drug-free workplace.

  • Cloud Data Engineer

    4 days ago

    Cary, United States MetLife Full time

    Role Value Proposition: As a Cloud Data Engineer on the team, you will be responsible for leading the technical design and development of cloud-enabled, DevOps, multi-platform, and cross-functional applications that solve complex business problems. The role will be a highly visible hands-on technology driver supporting platform product development by...

  • Cloud Data Engineer

    1 week ago

    Cary, United States MetLife Full time

    Role Value Proposition: As a Cloud Data Engineer on the team, you will be responsible for leading the technical design and development of cloud-enabled, DevOps, multi-platform, and cross-functional applications that solve complex business problems. The role will be a highly visible hands-on technology driver supporting platform product development by...

  • AI Cloud Data Engineer

    3 weeks ago

    Cary, United States MetLife Full time

    AI Cloud Data Engineer General Information City/Cities Cary State(s) North Carolina Country United States Working Schedule Full-Time Work Arrangement Hybrid Relocation Assistance Available No Posted Date 08-Mar-2024 Job ID 1651 Description and Requirements Role Value Proposition: MetLife Data & Analytics organization is the team of expert technologists...

  • Lead Full Stack Engineer

    2 weeks ago

    Cary, United States Info Way Solutions Full time

    Lead Full Stack Engineer -AI Data Engineer Location Cary NC (Hybrid) Key Responsibilities: " Hands on development and setup of data pipelines, databases, and data sources to build Client and AI apps. " Develop architecture and solution designs to deliver capabilities and features. " Develop iterative plans and strategies. Estimate as part of release...

  • Principal Full Stack Engineer-AI Engineer

    2 weeks ago

    Cary, United States Info Way Solutions Full time

    Principal Full Stack Engineer-AI Engineer Location Cary NC (Hybrid) Key Responsibilities: Architecture, design and development of AI applications Lead POC's and drive technical decisions for developing new AI development stack Hands on work with requirements, application architecture, design, code, code-reviews, CI/CD, deployment, and...

  • Principal Full Stack Engineer-AI Engineer

    3 weeks ago

    Cary, United States Info Way Solutions Full time

    Principal Full Stack Engineer-AI Engineer Location - Cary NC (Hybrid) Key Responsibilities: rchitecture, design and development of AI applications Lead POC's and drive technical decisions for developing new AI development stack Hands on work with requirements, application architecture, design, code, code-reviews, CI/CD, deployment, and...

  • Principal Full Stack Engineer-AI Engineer

    2 weeks ago

    Cary, United States Info Way Solutions Full time

    Principal Full Stack Engineer-AI Engineer Location - Cary NC (Hybrid) Key Responsibilities: rchitecture, design and development of AI applications Lead POC's and drive technical decisions for developing new AI development stack Hands on work with requirements, application architecture, design, code, code-reviews, CI/CD, deployment, and...

  • Audit Director

    3 weeks ago

    Cary, United States MetLife Full time

    Description and Requirements Role Value Proposition: Internal Audit (IA) is an independent, global organization that plays an important role in partnering with the business to ensure that management anticipates, recognizes, and appropriately manages risks. We protect MetLife and our stakeholders through meaningful independent assurance and advice, while...

  • AVP, Senior Principal AI Engineer

    1 week ago

    Cary, North Carolina, United States MetLife Full time

    Description and Requirements Title: Sr. Principal AI Engineer Location(s): Cary, NCSetting: HybridReports to: AVP, Product Development Engineering Travel: Less than 5% The Team You Will Join Global Technology - RIS team is responsible for technology development, information and cyber security, and data strategy and analytics in support of the Retirement...

  • AVP, Senior Principal AI Engineer

    1 week ago

    Cary, United States MetLife Full time

    Description and Requirements Title: Sr. Principal AI Engineer Location(s): Cary, NCSetting: HybridReports to: AVP, Product Development Engineering Travel: Less than 5% The Team You Will Join Global Technology - RIS team is responsible for technology development, information and cyber security, and data strategy and analytics in support of the Retirement...

  • Service Line Specialist – Gen AI and Analytics

    3 weeks ago

    Cary, United States Cognizant Full time

    About Cognizant’s Generative AI Practice: Digital technologies, including analytics and AI, give companies a once-in-a-generation opportunity to perform orders of magnitude better than ever before. However, clients need new business models built from analyzing customers and business operations at every angle to really understand them. With the power to...

  • Senior AI Programmer, Unreal Engine

    3 weeks ago

    Cary, United States Epic Games Full time

    WHAT MAKES US EPIC?At the core of Epic’s success are talented, passionate people. Epic prides itself on creating a collaborative, welcoming, and creative environment. Whether it’s building award-winning games or crafting engine technology that enables others to make visually stunning interactive experiences, we’re always innovating.Being Epic means...

  • Senior AI Programmer, Unreal Engine

    3 weeks ago

    Cary, United States Epic Games Full time

    WHAT MAKES US EPIC?At the core of Epic’s success are talented, passionate people. Epic prides itself on creating a collaborative, welcoming, and creative environment. Whether it’s building award-winning games or crafting engine technology that enables others to make visually stunning interactive experiences, we’re always innovating.Being Epic means...

  • Senior AI Programmer, Unreal Engine

    2 weeks ago

    Cary, United States Epic Games Full time

    WHAT MAKES US EPIC?At the core of Epic’s success are talented, passionate people. Epic prides itself on creating a collaborative, welcoming, and creative environment. Whether it’s building award-winning games or crafting engine technology that enables others to make visually stunning interactive experiences, we’re always innovating.Being Epic means...

  • Senior AI Programmer, Unreal Engine

    3 weeks ago

    Cary, United States Epic Games Full time

    WHAT MAKES US EPIC?At the core of Epic’s success are talented, passionate people. Epic prides itself on creating a collaborative, welcoming, and creative environment. Whether it’s building award-winning games or crafting engine technology that enables others to make visually stunning interactive experiences, we’re always innovating.Being Epic means...

  • Senior AI Programmer, Unreal Engine

    1 week ago

    Cary, United States Epic Games Full time

    WHAT MAKES US EPIC?At the core of Epic’s success are talented, passionate people. Epic prides itself on creating a collaborative, welcoming, and creative environment. Whether it’s building award-winning games or crafting engine technology that enables others to make visually stunning interactive experiences, we’re always innovating.Being Epic means...

  • Senior AI Programmer, Unreal Engine

    1 week ago

    Cary, North Carolina, United States Epic Games Full time

    WHAT MAKES US EPIC?At the core of Epic's success are talented, passionate people. Epic prides itself on creating a collaborative, welcoming, and creative environment. Whether it's building award-winning games or crafting engine technology that enables others to make visually stunning interactive experiences, we're always innovating.Being Epic means being a...

  • Senior AI Programmer, Unreal Engine

    6 hours ago

    Cary, United States Epic Games Full time

    WHAT MAKES US EPIC? At the core of Epic’s success are talented, passionate people. Epic prides itself on creating a collaborative, welcoming, and creative environment. Whether it’s building award-winning games or crafting engine technology that enables others to make visually stunning interactive experiences, we’re always innovating. Being Epic...

  • Data engineer

    1 week ago

    Cary, United States eTeam Full time

    Job Title :- Data engineer (10+ years candidate required) Job Location :- Remote Job Description :- LinkedIn is Mandatory Description:- Bachelors degree in the areas of Computer Science, Engineering, Information Systems, Business, or equivalent field of study required 7+ years of experience in working with data solutions. 3+ years of...

  • Data engineer

    5 days ago

    Cary, United States eTeam Full time

    Job Title :- Data engineer (10+ years candidate required) Job Location :- Remote Job Description :- LinkedIn is Mandatory Description:- Bachelors degree in the areas of Computer Science, Engineering, Information Systems, Business, or equivalent field of study required 7+ years of experience in working with data solutions. 3+ years of...