Lead, Data Platform Engineer

2 months ago

Doral, United States Royal Caribbean Group Full time

Position Overview

Data Analytics & AI department at RCG is looking for a highly skilled and experienced Data Platform Lead to design, build, and manage our data platform on Azure and Databricks. The successful candidate will be responsible for managing the end-to-end data platform development process, including data ingestion, processing, storage, and analysis. This role requires a strong technical background in data platform architecture, cloud computing, and big data technologies.

This role carries primary responsibilities as a Platform Lead / Platform Engineer and Azure Platform Admin, while also contributing to ML Ops.

Responsibilities Design, build and configure a highly scalable and robust data platform on Azure and Databricks. Data platform shuld have capabilities of seamless integration & extensibility of existing cloud services to any new program/project initiative. Develop and implement data ingestion and processing pipelines using Azure services such as Azure Data Factory, Azure Stream Analytics, and Databricks Collaborate with cross-functional teams to ensure data platform meets business requirements and industry best practices Manage cloud infrastructure on Azure platform and maintain Azure environment to ensure maxium efficiency, scalability and security. Develop & implement cloud automation and orchestration using tools auch as Azure resource manager, Azure DevOps etc. Collaborate with offshore team members with development & deployment activities, per project requirements.

Required Skills

Platform Engineering: Proficiency in Python, Scala, or SQL. Expertise in Apache Spark, Hadoop, or Apache Kafka. Cloud experience in Azure (preferred) or AWS. Deployment and management of Databricks clusters. Mastery of Azure Data Factory (ADF) for integration. Expertise with Databricks workspace, runtime, and Databricks Connect. Understanding of Databricks Unity Catalog. Knowledge of Delta Live Tables and Delta Engine. Familiarity with Delta Lake architecture. Strong SQL skills.

Azure Platform Administration Management of Azure Cloud Services, including VMs, Storage Accounts, and networks. Azure Security Management for policies and access controls. Knowledge of Azure Active Directory and network security. Performance monitoring, resource optimization, backup, and recovery. High Availability (HA), Disaster Recovery (DR), and failover expertise. Azure Services/Resources cost optimization and monitoring. Azure DevOps and CI/CD proficiency. Configure Azure resources, native services, security, and monitoring. Design platform architecture with Azure Cloud Services and Databricks Delta Lake. Create and publish guidelines for Data Integration services. Participate in platform solution architecture, including data architecture. Implement Databricks workspace, runtime, and Databricks Connect. Configure Kafka integration services for real-time streaming and batch processing. Enable Databricks Unity Catalog (UC) for lineage and governance. Design and implement ML Ops for model deployments and inference pipelines. Configure Azure DevOps, CI/CD for seamless deployment. Implement monitoring and logging for Azure Service Groups and system metrics. Ensure platform security, compliance, and data privacy.

ML Ops Proficient in Python, R, or Java for ML algorithms. Experience with TensorFlow, PyTorch, and other ML frameworks. Efficient code for data processing, model training, and deployment. Cloud platform experience, preferably Azure. Familiarity with Azure ML Services and Azure DevOps. Strong data analytics skills for model training.

Qualifications Bachelor's degree in Computer Science, Information Technology, or related field. 7+ years of experience in cloud infrastructure management, Azure services, and infrastructure architecture Strong understanding of Azure services such as Virtual Machines, Virtual Networks, Storage Accounts, and App Services Experience in monitoring and optimizing Azure infrastructure for performance and efficiency Proven experience and expertise in the respective role's technical skillsets. Strong problem-solving skills and ability to work collaboratively. Excellent communication skills for effective cross-team collaboration.

If you're passionate about leveraging data for informed decisions and thrive in a dynamic, collaborative environment, we invite you to join our team.

#J-18808-Ljbffr

  • Senior Software Engineer, Orders Data Platform

    3 weeks ago

    Doral, United States Square Full time

    Company Description Since we opened our doors in 2009, the world of commerce has evolved immensely, and so has Square. After enabling anyone to take payments and never miss a sale, we saw sellers stymied by disparate, outmoded products and tools that wouldn’t work together. So we expanded into software and started building integrated, omnichannel solutions...

  • Lead, Platform Engineering Technology

    3 weeks ago

    Doral, United States Royal Caribbean Group Full time

    JOB DESCRIPTION Engineering at Royal Caribbean International's digital division plays an integral role in creating and improving systems that are reimagining the cruise vacation industry for guests and crew alike. Join our team of highly-skilled engineers to work in a fast-paced, ambitious environment that values innovative problem-solving in an industry in...

  • Senior Data Engineer

    1 week ago

    Doral, United States Human Security Full time

    HUMAN was founded in 2012 in a Brooklyn sci-fi bookstore by Tamer Hassan, Michael Tiffany, Dan Kaminsky, and Ash Kalb. Our humble beginnings led to the creation of the Human Defense Platform, the backbone of all our products that safeguards enterprises from sophisticated bots, fraud, and account abuse. Today we verify the humanity of more than 20 trillion...

  • Sr Data Engineer

    3 weeks ago

    Doral, United States Lennar Homes Full time

    Overview: The primary mission of the Data Engineer role is to help our business evolve into an AI-first, insights-driven organization. The position sits in our Enterprise Data and Analytics team, which aims to drive improved business outcomes using insights gleaned from data and analytics and infuse them into Lennars corporate fabric. The Data Engineer will...

  • Lead Systems Engineer

    2 weeks ago

    Doral, United States StaffChase Full time

    Title - Lead Systems Engineer Type - Contract Location - Remote Desired Experience: 7+ years of related experience working as an IT professional specifically focused on Data Protection (data backup, storage, disaster recovery) Required expertise with data protection technology: Veeam, Azure Backup and PowerProtect Data Manager preferred Rubrik, Commvault,...

  • Sr Data Engineer

    1 week ago

    Doral, United States Lennar Homes Full time

    Overview: The primary mission of the Data Engineer role is to help our business evolve into an AI-first, insights-driven organization. The position sits in our Enterprise Data and Analytics team, which aims to drive improved business outcomes using insights gleaned from data and analytics and infuse them into Lennars corporate fabric. The Data Engineer will...

  • Lead Software Engineer

    4 weeks ago

    Doral, United States Analytic Partners Full time

    We are always open to talking to folks with the relevant skills that match the profile for our Lead Software Engineer position. Please express your interest in connecting by submitting your resume. We are the Commercial Intelligence industry leader and the first to do it! We help brands use data to drive business growth, and we do this using a combination of...

  • TYB (Try Your Best): Senior Data Engineer

    2 months ago

    Doral, United States Philpar Full time

    TYB (Try Your Best): Senior Data Engineer Full-time, remote, at least 4 hours overlap with USA Eastern Time (New York City) About TYB: TYB (“Try Your Best”) is building a web3-enabled platform for top brands to build and engage communities of loyal customers. We have a unique B2B / B2C product and growing numbers of paying customers. We are backed by top...

  • TYB (Try Your Best): Senior Data Engineer

    1 week ago

    Doral, United States Philpar Full time

    TYB (Try Your Best): Senior Data Engineer Full-time, remote, at least 4 hours overlap with USA Eastern Time (New York City) About TYB: TYB (“Try Your Best”) is building a web3-enabled platform for top brands to build and engage communities of loyal customers. We have a unique B2B / B2C product and growing numbers of paying customers. We are backed by top...

  • Site Reliability Engineer

    3 weeks ago

    Doral, United States Hopper Full time

    About the job We are looking for a senior Site Reliability Engineer to join the Platform Infrastructure team at Hopper. We manage a large infrastructure in Google Cloud that is used by hundreds of engineers worldwide to provide a first class experience to millions of end users around the world. If the traits described below sounds like you, this role might...

  • Site Reliability Engineer

    1 week ago

    Doral, United States Hopper Full time

    About the job We are looking for a senior Site Reliability Engineer to join the Platform Infrastructure team at Hopper. We manage a large infrastructure in Google Cloud that is used by hundreds of engineers worldwide to provide a first class experience to millions of end users around the world. If the traits described below sounds like you, this role might...

  • Lead Data Analyst

    4 days ago

    Doral, United States Blankfactor Full time

    What we do At Blankfactor, we are dedicated to engineering impact. We are passionate about creating value by building best-in-class tech solutions for companies looking to transform, innovate, and scale. In every project, we aim to deliver work that moves the needle and drives measurable outcomes for our partners and clients. Our full-stack development,...

  • Remote GCP Data Architect Urgent

    3 weeks ago

    Doral, United States tekHouse Full time

    100% Remote Contract 1099 or C2C 6 -9 month plus MUST be USC The primary role of the Data Architect is to support and expand the Data & Analytics platforms that process, store, organize the data critical for the data and analytics team. This role will have expertise in data movement and database technologies support data analytics and Machine Learning (ML) /...

  • Remote GCP Data Architect Urgent

    1 week ago

    Doral, United States tekHouse Full time

    100% Remote Contract 1099 or C2C 6 -9 month plus MUST be USC The primary role of the Data Architect is to support and expand the Data & Analytics platforms that process, store, organize the data critical for the data and analytics team. This role will have expertise in data movement and database technologies support data analytics and Machine Learning (ML) /...

  • Manager, Platform Engineering

    1 month ago

    Doral, United States Royal Caribbean Group Full time

    JOB DESCRIPTION A Manager of Digital Engineering is responsible for overseeing the full life cycle of software applications including solution architecture, design, development, integration and performance testing, and maintenance. Additionally, the Manager is responsible for customer satisfaction for at least one of the critical business systems managed by...

  • Senior Data Engineer

    3 weeks ago

    Doral, United States Restaurant Brands International Full time

    About Restaurant Brands International: Restaurant Brands International Inc. is one of the world's largest quick service restaurant companies with over $40 billion in annual system-wide sales and over 30,000 restaurants in more than 100 countries. RBI owns four of the world's most prominent and iconic quick service restaurant brands - TIM HORTONS, BURGER...

  • Data and Analytics Consultant

    2 months ago

    Doral, United States SEI Full time

    WHAT WE DO Our Data and Analytics consultants work with clients at all levels of the organization, from the C-suite to the shop floor, helping them to deliver on their most strategic initiatives. We’re known for making realistic, data-driven decisions that deliver value in tangible ways to our clients. Our clients ask for us on projects that require a...

  • Data and Analytics Consultant

    4 days ago

    Doral, United States SEI Full time

    WHAT WE DO Our Data and Analytics consultants work with clients at all levels of the organization, from the C-suite to the shop floor, helping them to deliver on their most strategic initiatives. We’re known for making realistic, data-driven decisions that deliver value in tangible ways to our clients. Our clients ask for us on projects that require a...

  • Data Engineer AI

    4 weeks ago

    Doral, United States One Park Financial Full time

    Company Overview One Park Financial (OPF) is a fast-growing FinTech(Financial Technology) company headquartered in Coconut Grove, Florida. OPF connects small businesses with a wide variety of flexible financing and funding options to help entrepreneurs acquire the working capital they NEED to take their business to the next level. We want to work with...

  • Data Engineer AI

    1 week ago

    Doral, United States One Park Financial Full time

    Company Overview One Park Financial (OPF) is a fast-growing FinTech(Financial Technology) company headquartered in Coconut Grove, Florida. OPF connects small businesses with a wide variety of flexible financing and funding options to help entrepreneurs acquire the working capital they NEED to take their business to the next level. We want to work with...