Kafka Architecture Expert

4 weeks ago


San Francisco, California, United States Diverse Lynx Full time

Key Responsibilities:

As a seasoned Enterprise Middleware Specialist at Diverse Lynx LLC, you will be responsible for designing and implementing APIs with 10+ years of experience in Enterprise Middleware and Microservices. You will also architect, design, implement, and operate a streaming platform based on Confluent Kafka with 5+ years of experience.

Requirements:

  • 5+ years of experience in Confluent platform or Confluent Cloud
  • 5+ years of Java, Spring Boot experience
  • Strong fundamentals in distributed systems design and operations, microservice architecture, integration patterns
  • Deep understanding of different messaging paradigms (pub/sub, queuing), as well as delivery models, quality-of-service, and fault-tolerance architectures
  • Established track record with Kafka technology, with hands-on production experience and a deep understanding of the Kafka architecture and internals of how it works, along with interplay of architectural components: brokers, Zookeeper, producers/consumers, Kafka Connect, Kafka Streams
  • Practical experience with how to scale Kafka, KStreams, and Connector infrastructures
  • Experience with Kafka Streams / KSQL architecture and associated clustering model
  • Hands-on experience as a developer who has used the Kafka API to build producer and consumer applications, along with expertise in implementing KStreams components

Additional Requirements:

  • Experience with developing KSQL queries and best practices of using KSQL vs KStreams
  • Strong knowledge of the Kafka Connect framework, with experience using several connector types: HTTP REST proxy, JMS, File, SFTP, JDBC
  • Experience using Source/sink connectors as RDBMS, NoSQL data stores
  • Hands-on experience in designing, writing, and operationalizing new Kafka Connectors using the framework
  • Strong familiarity of data formats such as XML, JSON, Avro, CSV, etc.
  • Familiarity of the Schema Registry
  • Experience with monitoring Kafka infrastructure along with related components (Connectors, KStreams, and other producer/consumer apps)
  • Familiarity with Confluent Control

About Us:

Diverse Lynx LLC is an Equal Employment Opportunity employer. All qualified applicants will receive due consideration for employment without any discrimination. We promote and support a diverse workforce across all levels in the company.



  • San Francisco, California, United States Diverse Lynx Full time

    Expertise in Enterprise Middleware and Streaming Platforms:As a seasoned professional, you will leverage your 10+ years of experience in designing and implementing APIs, as well as your 5+ years of expertise in architecting, designing, implementing, operating a streaming platform based on Confluent Kafka. With a strong foundation in distributed systems...


  • San Francisco, California, United States Diverse Lynx Full time

    Expert Kafka Solutions EngineerWe are seeking a highly skilled Kafka Solutions Engineer to join our team at Diverse Lynx LLC. As a key member of our engineering team, you will be responsible for designing, implementing, and operating scalable and reliable streaming platforms based on Confluent Kafka.Key Responsibilities:Design and implement Kafka-based...

  • Kafka Architect

    1 month ago


    San Francisco, California, United States Diverse Lynx Full time

    Job Title: Kafka SMEJob Summary:We are seeking a highly experienced Kafka SME to join our team at Diverse Lynx LLC. The ideal candidate will have a strong background in Enterprise Middleware, Microservices, and streaming platforms, with a focus on Confluent Kafka.Key Responsibilities:Design and implement APIs and streaming platforms based on Confluent...

  • Software Developer

    1 month ago


    San Francisco, California, United States CyberTec Full time

    Job Title: Software Developer - Java ExpertJob Description:We are seeking a skilled Java Software Engineer to join our team at CyberTec. The ideal candidate will have experience with Java 17+, Spring Boot, and Automated Testing (JUnit or Spock).Key Responsibilities: Develop high-quality Java applications using Java 17+ and Spring Boot Design and implement...


  • San Francisco, California, United States BCforward Full time

    Job Title: Software Development ExpertJob Summary: BCforward is seeking a highly motivated Software Development Expert for an opportunity in Chicago, IL. As a key member of our team, you will be responsible for developing APIs in Java and expanding your skills in building high-volume mission-critical applications in the latest technology stack.Key...


  • San Jose, California, United States Vida Group International Full time

    Job Title: Kafka Engineering ManagerJob Summary:The Manager of Software Engineering Kafka is responsible for leading large transformation programs and building a framework for sustainable engineering. This role will drive operational excellence, including Delivery Pipeline Engineering, Quality Engineering, and Performance Engineering.Key Responsibilities:-...


  • San Diego, California, United States ServiceNow Full time

    Job TitlePrincipal Business Process Consultant, Enterprise Architecture Workflow Products ExpertJob DescriptionAt ServiceNow, we're committed to helping our customers achieve their business outcomes by providing prescriptive guidance. As a Principal Business Process Consultant, you'll work with our customers to drive consumption, adoption, and customer...

  • GCP Data Engineer

    4 weeks ago


    San Francisco, California, United States Tekfortune Inc Full time

    Job Description:At Tekfortune Inc, we are seeking a highly skilled GCP Data Engineer - Cloud Computing Expert to join our team. As a key member of our engineering team, you will be responsible for designing, developing, and maintaining large-scale data processing systems on Google Cloud Platform.Key Responsibilities: Provide technical guidance to a team of...


  • San Francisco, California, United States Hinge-Health Full time

    About Hinge Health:Hinge Health is revolutionizing the way healthcare is treated and prevented by combining advanced technology, AI, and a care team of experts to guide people through personalized care directly from their phone.We are looking for a highly experienced Staff Software Engineer - Fullstack to join our dynamic team. As a Staff Software Engineer -...


  • San Francisco, California, United States OpenAI Full time

    About the RoleAs a senior engineer for the Architecture Systems Team at OpenAI, you will be an expert on the frameworks used by OpenAI for large-scale training, efficient sampling, architecture and optimization research, and simulating model performance. You will collaborate closely with both researchers and engineers across the company to integrate new...

  • Senior Java Developer

    4 weeks ago


    San Francisco, California, United States CyberTec Full time

    Job Title: Java EngineerJob Description:At CyberTec, we are seeking a skilled Java Engineer to join our team. The ideal candidate will have experience with Java 17+, Spring Boot, and Automated Testing (JUnit or Spock).Key Responsibilities: Develop high-quality Java applications using Java 17+ and Spring Boot Implement Automated Testing using JUnit or Spock...


  • San Francisco, California, United States Coframe Full time

    About the Role:We're seeking a world-class growth engineer to join our team at Coframe. As a growth engineering expert, you'll be responsible for building and scaling our offering, helping shape the direction of the product, and driving business outcomes.Key Responsibilities:Architect robust, maintainable codebasesShip fast and balance quality vs. speed...


  • San Francisco, California, United States OpenGov Full time

    Transforming Government with Innovative TechnologyAt OpenGov, we're on a mission to power more effective and accountable government. As a Software Engineer II, you'll play a key role in building best-in-class SaaS solutions that enable efficiency, transparency, and accountability within government agencies.Our team is passionate about using modern...

  • SAP Security Expert

    4 weeks ago


    San Francisco, California, United States Centraprise Full time

    Job Title: SAP Security ExpertAbout the Role:Centraprise is seeking an experienced SAP Security Expert to join our team. As a key member of our security team, you will be responsible for implementing and delivering ECC SAP Security Solutions. Key Responsibilities:• Implement and deliver ECC SAP Security Solutions• Strong technical knowledge of SAP...


  • San Francisco, California, United States HashiCorp Full time

    About the RoleAs a Senior Solutions Architecture Specialist at HashiCorp, you will be part of a high-performance environment where you will serve as a product or solution domain expert, providing Customers with deep technical guidance at strategic points during their journey with HashiCorp.Through targeted engagement, you will help clear technical blockers,...


  • San Francisco, California, United States WSP Full time

    About the RoleWe are seeking a highly skilled and experienced Technical Excellence Center Lead to join our team at WSP. As a key member of our organization, you will be responsible for providing leadership and expertise in the development and implementation of architectural technical excellence initiatives.Key ResponsibilitiesProvide leadership and guidance...


  • San Francisco, California, United States Juul Labs Full time

    About Us:Juul Labs is a pioneering company dedicated to revolutionizing the lives of adult smokers worldwide by eliminating combustible cigarettes. Our mission is to drive exceptional quality, research, design, and innovation to make a lasting impact.Job Summary:We are seeking a highly skilled Principal Firmware Engineer to join our team. This is a hands-on...


  • San Francisco, California, United States TALENT Software Services Full time

    Unlock Your Potential as a Digital Transformation ExpertAbout the Role:Talent Software Services is seeking a seasoned Enterprise Architect to join our team. As a key member of our organization, you will play a crucial role in shaping our digital platform strategy and driving innovation across our business.Key Responsibilities:Lead the development of our...


  • San Francisco, California, United States Charles Schwab Full time

    Job SummaryAs a Software Development Specialist at Charles Schwab, you will be responsible for designing, developing, and deploying computer and network software or specialized utility programs. You will work on backend development in highly scalable systems using technologies like Java, SQL, and Apache Kafka in the Spring Boot Framework. Your tasks will...


  • San Diego, California, United States Servicenow Full time

    About ServiceNowServiceNow is a global market leader in providing innovative AI-enhanced technology to over 8,100 customers, including 85% of the Fortune 500. Our intelligent cloud-based platform seamlessly connects people, systems, and processes to empower organizations to find smarter, faster, and better ways to work.The RoleWe are seeking a highly skilled...