Lead, Data Platform Engineer

2 weeks ago

Doral, United States Royal Caribbean Group Full time

Position Overview

Data Analytics & AI department at RCG is looking for a highly skilled and experienced Data Platform Lead to design, build, and manage our data platform on Azure and Databricks. The successful candidate will be responsible for managing the end-to-end data platform development process, including data ingestion, processing, storage, and analysis. This role requires a strong technical background in data platform architecture, cloud computing, and big data technologies.

This role carries primary responsibilities as a Platform Lead / Platform Engineer and Azure Platform Admin, while also contributing to ML Ops.

Responsibilities Design, build and configure a highly scalable and robust data platform on Azure and Databricks. Data platform shuld have capabilities of seamless integration & extensibility of existing cloud services to any new program/project initiative. Develop and implement data ingestion and processing pipelines using Azure services such as Azure Data Factory, Azure Stream Analytics, and Databricks Collaborate with cross-functional teams to ensure data platform meets business requirements and industry best practices Manage cloud infrastructure on Azure platform and maintain Azure environment to ensure maxium efficiency, scalability and security. Develop & implement cloud automation and orchestration using tools auch as Azure resource manager, Azure DevOps etc. Collaborate with offshore team members with development & deployment activities, per project requirements.

Required Skills

Platform Engineering: Proficiency in Python, Scala, or SQL. Expertise in Apache Spark, Hadoop, or Apache Kafka. Cloud experience in Azure (preferred) or AWS. Deployment and management of Databricks clusters. Mastery of Azure Data Factory (ADF) for integration. Expertise with Databricks workspace, runtime, and Databricks Connect. Understanding of Databricks Unity Catalog. Knowledge of Delta Live Tables and Delta Engine. Familiarity with Delta Lake architecture. Strong SQL skills.

Azure Platform Administration Management of Azure Cloud Services, including VMs, Storage Accounts, and networks. Azure Security Management for policies and access controls. Knowledge of Azure Active Directory and network security. Performance monitoring, resource optimization, backup, and recovery. High Availability (HA), Disaster Recovery (DR), and failover expertise. Azure Services/Resources cost optimization and monitoring. Azure DevOps and CI/CD proficiency. Configure Azure resources, native services, security, and monitoring. Design platform architecture with Azure Cloud Services and Databricks Delta Lake. Create and publish guidelines for Data Integration services. Participate in platform solution architecture, including data architecture. Implement Databricks workspace, runtime, and Databricks Connect. Configure Kafka integration services for real-time streaming and batch processing. Enable Databricks Unity Catalog (UC) for lineage and governance. Design and implement ML Ops for model deployments and inference pipelines. Configure Azure DevOps, CI/CD for seamless deployment. Implement monitoring and logging for Azure Service Groups and system metrics. Ensure platform security, compliance, and data privacy.

ML Ops Proficient in Python, R, or Java for ML algorithms. Experience with TensorFlow, PyTorch, and other ML frameworks. Efficient code for data processing, model training, and deployment. Cloud platform experience, preferably Azure. Familiarity with Azure ML Services and Azure DevOps. Strong data analytics skills for model training.

Qualifications Bachelor's degree in Computer Science, Information Technology, or related field. 7+ years of experience in cloud infrastructure management, Azure services, and infrastructure architecture Strong understanding of Azure services such as Virtual Machines, Virtual Networks, Storage Accounts, and App Services Experience in monitoring and optimizing Azure infrastructure for performance and efficiency Proven experience and expertise in the respective role's technical skillsets. Strong problem-solving skills and ability to work collaboratively. Excellent communication skills for effective cross-team collaboration.

If you're passionate about leveraging data for informed decisions and thrive in a dynamic, collaborative environment, we invite you to join our team.

#J-18808-Ljbffr

  • Senior Software Engineer, Orders Data Platform

    4 weeks ago

    Doral, United States Square Full time

    Company Description Since we opened our doors in 2009, the world of commerce has evolved immensely, and so has Square. After enabling anyone to take payments and never miss a sale, we saw sellers stymied by disparate, outmoded products and tools that wouldn’t work together. So we expanded into software and started building integrated, omnichannel solutions...

  • Lead, Platform Engineering Technology

    4 weeks ago

    Doral, United States Royal Caribbean Group Full time

    JOB DESCRIPTION Engineering at Royal Caribbean International's digital division plays an integral role in creating and improving systems that are reimagining the cruise vacation industry for guests and crew alike. Join our team of highly-skilled engineers to work in a fast-paced, ambitious environment that values innovative problem-solving in an industry in...

  • Senior Data Engineer

    3 weeks ago

    Doral, United States Human Security Full time

    HUMAN was founded in 2012 in a Brooklyn sci-fi bookstore by Tamer Hassan, Michael Tiffany, Dan Kaminsky, and Ash Kalb. Our humble beginnings led to the creation of the Human Defense Platform, the backbone of all our products that safeguards enterprises from sophisticated bots, fraud, and account abuse. Today we verify the humanity of more than 20 trillion...

  • Lead Analytical Data Engineer

    5 days ago

    Doral, Florida, United States National Black MBA Association Full time

    ADPis hiring a Lead Analytical Data Engineer for our newly formed HR Outsourcing (HRO) Data and Analytics organization. The Lead Analytical Data Engineer will play a key role in growing our newest chapter of analytics engineering professionals while interacting with cross-functional teams to address complex business requirements. We're seeking a value...

  • Sr Data Engineer

    4 weeks ago

    Doral, United States Lennar Homes Full time

    Overview: The primary mission of the Data Engineer role is to help our business evolve into an AI-first, insights-driven organization. The position sits in our Enterprise Data and Analytics team, which aims to drive improved business outcomes using insights gleaned from data and analytics and infuse them into Lennars corporate fabric. The Data Engineer will...

  • Lead Systems Engineer

    4 weeks ago

    Doral, United States StaffChase Full time

    Title - Lead Systems Engineer Type - Contract Location - Remote Desired Experience: 7+ years of related experience working as an IT professional specifically focused on Data Protection (data backup, storage, disaster recovery) Required expertise with data protection technology: Veeam, Azure Backup and PowerProtect Data Manager preferred Rubrik, Commvault,...

  • Sr Data Engineer

    3 weeks ago

    Doral, United States Lennar Homes Full time

    Overview: The primary mission of the Data Engineer role is to help our business evolve into an AI-first, insights-driven organization. The position sits in our Enterprise Data and Analytics team, which aims to drive improved business outcomes using insights gleaned from data and analytics and infuse them into Lennars corporate fabric. The Data Engineer will...

  • Lead Systems Engineer

    5 days ago

    Doral, Florida, United States StaffChase Full time

    Title Lead Systems EngineerType - ContractLocation RemoteDesired Experience: 7+ years of related experience working as an IT professional specifically focused on Data Protection (data backup, storage, disaster recovery)Required expertise with data protection technology:Veeam, Azure Backup and PowerProtect Data Manager preferredRubrik, Commvault, Netbackup,...

  • Senior Platform Engineer

    4 days ago

    Doral, United States Raytheon Full time

    Date Posted: 2024-06-04 Country: United States of America Location: CO102: 16800 E Centretech Pkwy,Aurora 16800 East Centretech Pkwy Building S75, Aurora, CO, 80011 USA Position Role Type: Onsite Position Title: Senior Platform Engineer At Raytheon, the foundation of everything we do is rooted in our values and a higher calling - to help our nation and...

  • Lead Software Engineer

    1 month ago

    Doral, United States Analytic Partners Full time

    We are always open to talking to folks with the relevant skills that match the profile for our Lead Software Engineer position. Please express your interest in connecting by submitting your resume. We are the Commercial Intelligence industry leader and the first to do it! We help brands use data to drive business growth, and we do this using a combination of...

  • Lead Software Engineer

    4 days ago

    Doral, United States Analytic Partners Full time

    We are always open to talking to folks with the relevant skills that match the profile for our Lead Software Engineer position. Please express your interest in connecting by submitting your resume. We are the Commercial Intelligence industry leader and the first to do it! We help brands use data to drive business growth, and we do this using a combination of...

  • Lead engineer data

    1 week ago

    Doral, United States Cepheid Full time

    At first glance, you’ll see that for more than 80 years we’ve been dedicated to advancing and optimizing the laboratory to move science and healthcare forward. Join a team where you can be heard, be supported, and always be yourself. We’re building a culture that celebrates backgrounds, experiences, and perspectives of all our associates. Look again...

  • TYB (Try Your Best): Senior Data Engineer

    2 months ago

    Doral, United States Philpar Full time

    TYB (Try Your Best): Senior Data Engineer Full-time, remote, at least 4 hours overlap with USA Eastern Time (New York City) About TYB: TYB (“Try Your Best”) is building a web3-enabled platform for top brands to build and engage communities of loyal customers. We have a unique B2B / B2C product and growing numbers of paying customers. We are backed by top...

  • TYB (Try Your Best): Senior Data Engineer

    3 weeks ago

    Doral, United States Philpar Full time

    TYB (Try Your Best): Senior Data Engineer Full-time, remote, at least 4 hours overlap with USA Eastern Time (New York City) About TYB: TYB (“Try Your Best”) is building a web3-enabled platform for top brands to build and engage communities of loyal customers. We have a unique B2B / B2C product and growing numbers of paying customers. We are backed by top...

  • Site Reliability Engineer

    4 weeks ago

    Doral, United States Hopper Full time

    About the job We are looking for a senior Site Reliability Engineer to join the Platform Infrastructure team at Hopper. We manage a large infrastructure in Google Cloud that is used by hundreds of engineers worldwide to provide a first class experience to millions of end users around the world. If the traits described below sounds like you, this role might...

  • Site Reliability Engineer

    3 weeks ago

    Doral, United States Hopper Full time

    About the job We are looking for a senior Site Reliability Engineer to join the Platform Infrastructure team at Hopper. We manage a large infrastructure in Google Cloud that is used by hundreds of engineers worldwide to provide a first class experience to millions of end users around the world. If the traits described below sounds like you, this role might...

  • Cloud Platform Lead I

    4 days ago

    Doral, Florida, United States World Fuel Services Full time

    At World Kinect, our employees are the key to our global success. We are industry leaders due to the innumerable talents of our approximately 5000 strong professional team. Our people thrive in an entrepreneurial and culturally-diverse environment, where innovative thinking, collaboration and efficient execution are highly valued. Our high-performance...

  • Lead Data Analyst

    1 week ago

    Doral, United States Blankfactor Full time

    What we do At Blankfactor, we are dedicated to engineering impact. We are passionate about creating value by building best-in-class tech solutions for companies looking to transform, innovate, and scale. In every project, we aim to deliver work that moves the needle and drives measurable outcomes for our partners and clients. Our full-stack development, data...

  • Lead Data Analyst

    2 weeks ago

    Doral, United States Blankfactor Full time

    What we do At Blankfactor, we are dedicated to engineering impact. We are passionate about creating value by building best-in-class tech solutions for companies looking to transform, innovate, and scale. In every project, we aim to deliver work that moves the needle and drives measurable outcomes for our partners and clients. Our full-stack development,...

  • Lead Data Analyst

    5 days ago

    Doral, Florida, United States Blankfactor Full time

    About the CompanyJoin us at Blankfactor, where we are committed to making a difference through our engineering efforts. Our focus is on generating value through top-notch tech solutions for businesses seeking innovation and growth.Located in Miami, Florida, with additional offices in Bulgaria, Colombia, and Romania, we are rapidly expanding globally. Our...