Data Platform Engineer

4 weeks ago

Atlanta, Georgia, United States GovHire Full time

About the Role:

We are seeking a highly skilled Data Platform Engineer to join our high-performing product and fulfillment center of excellence. As a Data Platform Engineer, you will contribute to implementing new product features and rapidly on-boarding new enterprise customers.

The ideal candidate will be a proactive problem solver with strong technical skills and meticulous attention to detail. This person will be intellectually curious with a relentless desire to learn the latest modern data architecture platforms and patterns.

Key Responsibilities:

  • Manage daily operations of DaaS product on on-premises and cloud-based technologies using open-source Linux-based data technologies.
  • Install, configure, and support CDP clusters in both cloud (AWS, Azure, GCP) and on-premises environments, ensuring seamless integration and functionality.
  • Lead/Mentor less experienced members of platform engineering and support teams.
  • Maintain, patch, and upgrade existing CDP setups, ensuring minimal downtime and adherence to Cloudera's best practices.
  • Evaluate and optimize complex distributed production deployments, identifying bottlenecks and recommending performance enhancements.
  • Configure and manage security using tools like Ranger and Kerberos, ensuring robust data protection and compliance.
  • Develop and maintain technical documentation, including administration runbooks and knowledge base articles, to support operational excellence and knowledge sharing.
  • Work in an agile team and Participate in an on-call rotation, providing expert-level support and troubleshooting for critical issues.
  • Lead and mentor junior team members, fostering a culture of continuous learning and improvement.
  • Collaborate with cross-functional teams, including data engineers, solution architects, and DevOps, to design and implement scalable data solutions.
  • Stay current with emerging technologies and industry trends, applying this knowledge to improve the CDP environment and drive innovation.

Requirements:

  • US Citizenship
  • In-depth understanding of both on-premises and cloud network architectures, ensuring seamless integration and efficient data flow.
  • Minimum of 5 years of experience in installing and administering the Cloudera Data Platform (Public or Private Cloud), with a proven track record of managing large-scale deployments.
  • Hands-on experience with open-source Linux-based data technologies, including Iceberg, Spark, Nifi, Jupyter Notebooks, Cloudera, Databricks, Kubeflow, MLFlow, and Kafka.
  • Proven ability to build and support solutions across major cloud platforms (AWS, Azure, GCP), leveraging cloud-native tools and open source for optimal performance.
  • Strong Cloudera expertise, with a deep understanding of Spark and Airflow for orchestrating complex data workflows.
  • Experience integrating Azure Active Directory with FreeIPA and other directory services such as LDAP, enhancing security and user management.
  • Up-to-date knowledge of the Hadoop Big Data ecosystem, staying current with the latest technologies and best practices.
  • Excellent troubleshooting skills, with a thorough understanding of CDP capacity planning, identifying bottlenecks, and optimizing memory utilization, CPU usage, OS performance, storage, and network configurations.
  • Strong analytical and problem-solving abilities, capable of diagnosing and resolving complex technical issues efficiently.

  • Senior Data Platform Engineer

    4 weeks ago

    Atlanta, Georgia, United States Intuit Full time

    Job Title: Senior Data Platform EngineerAbout the Role:We are seeking a highly skilled Senior Data Platform Engineer to join our Data Platform team at Intuit Mailchimp. As a Senior Data Platform Engineer, you will be responsible for designing, building, and maintaining our Big Data platform that enables our teams to make data-driven decisions.Key...

  • Engineering Manager, Data Platform

    3 weeks ago

    Atlanta, Georgia, United States Warner Bros. Discovery Full time

    Welcome to Warner Bros. Discovery, where innovation meets creativity. We are seeking an Engineering Manager to lead our Data Platform efforts, driving the development of scalable and efficient data solutions.The ideal candidate will have a strong technical background, with experience in building and managing complex data systems. They will be responsible for...

  • Senior Data Engineer

    4 weeks ago

    Atlanta, Georgia, United States Diverse Lynx Full time

    Job Title: Senior Data Engineer - Cloud PlatformJob Summary: We are seeking a highly skilled Senior Data Engineer to lead the design and development of analytical data pipelines on our cloud platform.Key Responsibilities:* Drive world-class design and development of analytical data pipelines* Provide thought leadership and propose industry standards and...

  • Senior Software Engineer, Data Platform

    4 weeks ago

    Atlanta, Georgia, United States Oracle Defunct Full time

    Job Title: Senior Software Engineer, Data PlatformAbout the Role:We are seeking a highly skilled and motivated Senior Software Engineer to play a pivotal role in the development and enhancement of our conversational AI and clinical automation platforms.Key Responsibilities:Lead the design and implementation of complex software systemsDevelop, maintain, and...

  • Data Engineering Leader for a Cloud-Driven Data Platform

    4 weeks ago

    Atlanta, Georgia, United States Warner Bros. Discovery Full time

    Company Overview:Welcome to Warner Bros. Discovery, where the magic of storytelling comes alive. Behind our vast portfolio of iconic content and beloved brands, are the creatives bringing our characters to life, the visionaries shaping the future of entertainment, and the dreamers creating what's next. As a global leader in the media and entertainment...

  • Senior Platform Engineer

    1 month ago

    Atlanta, Georgia, United States Quantifind Full time

    Job DescriptionQuantifind is seeking a Senior Platform Engineer to join our Platform Team in Atlanta, Georgia, or Washington, D.C. As a key member of our team, you will work on Quantifind's Apache Spark batch infrastructure to generate risk signal results from diverse data sources such as Sanctions, PEP records, Negative News, Court & Arrest records, and...

  • Senior Platform Engineer

    4 weeks ago

    Atlanta, Georgia, United States Quantifind Full time

    About the RoleWe are seeking a highly skilled Senior Platform Engineer to join our team at Quantifind. As a key member of our Platform Team, you will be responsible for designing and delivering data services and machine learning infrastructure that powers our SaaS products.Key ResponsibilitiesDefine and deliver data services and machine learning...

  • Data Scientist

    4 weeks ago

    Atlanta, Georgia, United States Square Capital Full time

    Job DescriptionAt Square Capital, we're looking for a talented Data Scientist to join our Payments Platform team. As a key member of our team, you will leverage analytics, engineering, and machine learning to empower data-driven decision making, ensuring a reliable, scalable, and secure Payments platform for Square and our third-party developers.Key...

  • Data Engineering Architect

    4 weeks ago

    Atlanta, Georgia, United States Deluxe Corporation Full time

    Data Engineering and Architecture LeadThis role focuses on designing and developing the Deluxe Data Platform, including data architecture, platform capabilities, data model, and delivery pipeline. The ideal candidate will have expertise in data governance, cataloging design, data store/lake design, transformation, and ingestion flows.The Data Engineering and...

  • Senior Backend Data Engineer

    4 weeks ago

    Atlanta, Georgia, United States Myticas Consulting Full time

    Myticas Consulting is seeking a skilled Senior Principal Backend Engineer to lead the development of our data platform.This is a direct hire opportunity, and we are looking for a professional with expertise in architecting, designing, and building end-to-end data platforms in the GCP environment using BigQuery and other services.The ideal candidate will have...

  • Cloud and Platform Engineering Director

    4 weeks ago

    Atlanta, Georgia, United States Boston Consulting Group Full time

    Job SummaryThe Boston Consulting Group is seeking a highly skilled and experienced Cloud and Platform Engineering Director to join our Cloud and Platform Engineering team. As a key member of this team, you will be responsible for supporting the team's digital platform and cloud agenda.Key ResponsibilitiesLead a Squad and work directly with its members to...

  • Data Engineering Consultant

    4 weeks ago

    Atlanta, Georgia, United States Inspire11 Full time

    We are seeking a highly skilled Data Engineering Consultant to join our team at Inspire11. As a Data Engineering Consultant, you will be responsible for designing and implementing data transformation solutions that optimize business outcomes.Key responsibilities include:Moving and transforming data optimally between different systemsLow-level design,...

  • Data Engineer

    4 weeks ago

    Atlanta, Georgia, United States TechnoGen Full time

    Job DescriptionTechnoGen is seeking a highly skilled Data Engineer to join our team. As a key member of our data team, you will be responsible for designing, building, and maintaining our data pipeline and ecosystem.You will work closely with cross-functional teams to understand business needs and requirements, transforming raw data into clean, actionable...

  • Senior Data Engineer

    1 month ago

    Atlanta, Georgia, United States Cypress Global Services Full time

    Job SummaryCypress Global Services is seeking a highly skilled Data Platform Architect to lead the development and implementation of our data strategy. The ideal candidate will have a strong background in data engineering, architecture, and leadership.Key ResponsibilitiesDefine and implement data strategy, including schema definitions, system contracts,...

  • Data Engineer

    1 month ago

    Atlanta, Georgia, United States TechnoGen Full time

    Job Title: Data EngineerWe are seeking a highly skilled Data Engineer to join our team at TechnoGen. As a Data Engineer, you will play a key role in designing, developing, and maintaining our data pipelines using Airflow, AWS, and Snowflake.Key Responsibilities:Design and develop data pipelines using Airflow and Snowflake to automate the extraction,...

  • Data Engineering Lead

    4 weeks ago

    Atlanta, Georgia, United States Booz Allen Hamilton Full time

    Job Title: Data Engineering LeadAbout the Role:Booz Allen Hamilton is seeking a Data Engineering Lead to join our team. As a Data Engineering Lead, you will be responsible for leading data engineering activities on mission-driven projects. You will oversee the development and deployment of pipelines and platforms that organize and make disparate data...

  • Senior Principal Backend Data Engineer

    3 weeks ago

    Atlanta, Georgia, United States Myticas Consulting Full time

    Data Platform Lead OpportunityMyticas Consulting is seeking a skilled Data Platform Lead to join our team. The ideal candidate will have experience in designing and developing core data platform components with a microservices architecture, abstracting platform and infrastructure intricacies. They will also have expertise in architecting, designing and...

  • Cloud Engineer

    1 month ago

    Atlanta, Georgia, United States Ford Motor Company Full time

    Job SummaryWe are seeking a highly motivated and technology-focused Cloud Engineer to join our team. As a Cloud Engineer, you will be responsible for implementing platform and API solutions, working collaboratively with a software delivery team to enable the creation and management of platforms and APIs deployed to the Ford mobility ecosystem.Key...

  • Cloud Data Engineer III

    4 weeks ago

    Atlanta, Georgia, United States Shift4 Full time

    Job Title: Cloud Data Engineer IIIAbout the Role:Shift4 is a leading commerce-enabling technology company that simplifies complex payments ecosystems across the world. As a Senior Cloud Data Engineer, you will contribute to the technology, architecture, and engineering delivery across an AWS Cloud Data Services team. This role requires prior experience as a...

  • Data Engineer

    4 weeks ago

    Atlanta, Georgia, United States Datafielder Full time

    Data Engineer Job DescriptionDataFielder is a woman-minority certified staffing and consulting services agency. We are seeking a Data Engineer to work remotely and support the acquisition, evaluation, management, and analytics of large healthcare data assets.Responsibilities:Provide operational, data management, technical/engineering, and analytic support...