Cloudera Consultant

3 days ago

Houston, Texas, United States My3Tech Full time $120,000 - $180,000 per year

Hi,

Hope you are doing well.

This is Ravali from My3 Tech.

Review the below job description and let me know your interest by replying to this email with updated resume and convenient time to discuss and also you can reach me @ or

Title: Lead Cloudera Consultant (Solution Architect)

Type: 6-month contract to start

Location: 100% Remote within US (Prefer Houston to go onsite occasionally or west coast if remote)

Job Summary:

We are seeking an experienced Lead Cloudera Consultant to provide architecture guidance, advisory services, and hands-on support for building secure, scalable, and decoupled data pipelines across non-production and production environments. This role includes training client teams on Cloudera platform best practices and ensuring successful delivery of data movement and curation solutions aligned with business KPIs.

Key Responsibilities:

  • Architecture & Design:
    Design and implement secure, scalable, and decoupled data pipelines across on-premises and cloud Cloudera platforms.
  • Provide architectural guidance for integrating message brokers (e.g., Kafka) and warehousing solutions (e.g., Snowflake Iceberg).
  • Development Support:
    Assist client teams with backlog execution and development of data products
  • Ensure end-to-end updates without negative impact on other data products.
  • Training & Knowledge Transfer:
    Develop and deliver tailored training sessions and materials for technical leads, data engineers, and architects.
  • Enable client teams to build, extend, and support pipelines independently.
  • Performance & Optimization:
    Implement cost-performance trade-offs to meet KPIs (e.g., data flow within 5 minutes at target resource cost).
  • Advise on cost optimization strategies during initial engagement phase.
  • Integration & Automation:
    Configure CI/CD pipelines using GitHub Actions.
  • Implement automated testing and logging (Datadog) for performance and error tracking.
  • Security & Compliance:
    Ensure secrets are managed securely using approved tools.
  • Document and transition all data flows, logic, and components to sustaining teams.

Required Qualifications:

  • Proven experience as a Cloudera Solution Architect or Lead Consultant in enterprise environments.
  • Expertise in Cloudera CDP, Hadoop ecosystem, Kafka, Flink, and SSB.
  • Strong knowledge of data curation, metadata management, and schema design.
  • Hands-on experience with Snowflake Iceberg or similar warehousing technologies.
  • Proficiency in CI/CD automation (GitHub Actions) and logging tools (Datadog).
  • Familiarity with cloud and on-premises Cloudera deployments.
  • Excellent communication and training skills.

Required Skills:

  1. Cloudera Platform Expertise:

  2. Deep experience with Cloudera CDP (on-prem and cloud)

  3. Strong understanding of Cloudera as an operational data store for transient/transactional data Familiarity with Cloudera tooling: Kafka, Flink, SSB

  4. Data Architecture & Integration:

  5. Proven ability to design secure, scalable, decoupled data pipelines

  6. Experience integrating message brokers (Kafka, Azure Service Bus)
  7. Knowledge of CDC (Change Data Capture) patterns using Kafka

  8. Experience with data ingestion from flat files, relational, document, and graph databases

  9. Data Warehousing & Catalogs

  10. Hands-on experience with Snowflake Iceberg, Delta Lake, and Databricks

  11. Understanding of Apache Polaris or similar cataloging solutions

  12. Ability to manage writebacks from multiple sources into Iceberg

  13. Automation & DevOps

  14. Experience configuring CI/CD pipelines using GitHub Actions

  15. Familiarity with automated testing, logging, and deployment tracking

  16. Proficiency with Datadog for observability and performance monitoring

  17. Security & Compliance

  18. Implementation of modern authentication protocols

  19. Knowledge of end-to-end encryption and secure secrets management

  20. Leadership & Enablement

  21. Ability to advise across distributed teams (Houston, Curitiba, Kuala Lumpur)

  22. Strong training and knowledge-sharing capabilities
  23. Experience working in consultative roles with enterprise clients

  24. Comfortable challenging conventional approaches and guiding best practices

  25. Communication & Collaboration

  26. Excellent communication skills to work with technical leads

  27. Ability to document and transition architecture and flows to sustaining teams
  28. Time zone alignment with Houston/west coast preferred

Preferred Skills:

  • Cloudera Certified Professional or equivalent certifications.
  • Experience with secret management tools and enterprise security practices.
  • Knowledge of cost optimization strategies for large-scale data platforms.

Thanks & Regards,

Ravali