Kafka AWS Architect

2 weeks ago

Richmond, United States INA Solution Inc Full time
Job DescriptionJob Description

Kafka AWS Architect

Location: Richmond, VA (Onsite)

Duration: 6+ Months, Extendible

Experience: 10-15 Years

Job Description:

  • Kafka Cluster Management: Design, deploy, and manage Apache Kafka clusters, ensuring high availability, scalability, and fault tolerance.
  • Data Streaming Architecture: Develop and maintain real-time data streaming solutions using Kafka, Kafka Streams, and related technologies.
  • Performance Optimization: Monitor and optimize Kafka clusters for performance, including tuning brokers, topics, partitions, and configurations.
  • Security and Compliance: Implement and manage Kafka security measures, including encryption, authentication, and authorization, to ensure data integrity and compliance with industry standards.
  • Integration: Work closely with application developers, data engineers, and DevOps teams to integrate Kafka with other systems and services.
  • Monitoring and Alerts: Use tools such as Prometheus, Grafana, and Kafka Manager to set up monitoring, logging, and alerting for Kafka clusters.
  • Troubleshooting and Support: Diagnose and promptly resolve issues related to Kafka performance, connectivity, and data processing.
  • Documentation: Create and maintain detailed documentation for Kafka configurations, processes, and best practices.
  • Innovation and Improvement: Stay up-to-date with the latest developments in Kafka and related technologies, proposing improvements and new solutions as appropriate.
  • Proven experience with distributed systems, data streaming, and event-driven architectures.
  • Experience with Kafka Streams, KSQL, and other Kafka ecosystem tools.
  • Hands-on experience with cloud platforms (AWS, Azure, Google Cloud) is a plus.

Technical Skills:

  • Strong proficiency in Apache Kafka, including broker setup, topic management, and partitioning strategies.
  • Knowledge of data serialization formats such as Avro, Protobuf, and JSON.
  • Experience with Linux/Unix systems and scripting (Bash, Python, etc.).
  • Familiarity with DevOps practices and tools like Docker, Kubernetes, CI/CD pipelines, and Terraform.
  • Experience with monitoring tools (Prometheus, Grafana) and logging tools (Elasticsearch, Logstash, Kibana).

  • Kafka architect

    1 week ago

    richmond, United States Themesoft Inc. Full time

    Job Title: Kafka architectLocation: Richmond,, VA - OnsiteSkill (Primary) : Data Fabric-Big Data Processing-Kafka. Job Description (Posting)Kafka Cluster Management: Design, deploy, and manage Apache Kafka clusters, ensuring high availability, scalability, and fault tolerance.• Data Streaming Architecture: Develop and maintain real-time data streaming...

  • Kafka architect

    2 weeks ago

    Richmond, United States Themesoft Inc. Full time

    Job Title: Kafka architectLocation: Richmond,, VA - OnsiteSkill (Primary) : Data Fabric-Big Data Processing-Kafka. Job Description (Posting)Kafka Cluster Management: Design, deploy, and manage Apache Kafka clusters, ensuring high availability, scalability, and fault tolerance.• Data Streaming Architecture: Develop and maintain real-time data streaming...

  • Kafka architect

    2 weeks ago

    Richmond, United States Themesoft Inc. Full time

    Job Title: Kafka architectLocation: Richmond,, VA - OnsiteSkill (Primary) : Data Fabric-Big Data Processing-Kafka. Job Description (Posting)Kafka Cluster Management: Design, deploy, and manage Apache Kafka clusters, ensuring high availability, scalability, and fault tolerance.• Data Streaming Architecture: Develop and maintain real-time data streaming...

  • Kafka architect

    1 week ago

    richmond, United States Themesoft Inc. Full time

    Job Title: Kafka architectLocation: Richmond,, VA - OnsiteSkill (Primary) : Data Fabric-Big Data Processing-Kafka. Job Description (Posting)Kafka Cluster Management: Design, deploy, and manage Apache Kafka clusters, ensuring high availability, scalability, and fault tolerance.• Data Streaming Architecture: Develop and maintain real-time data streaming...

  • Kafka Cloud Architect

    1 week ago

    Richmond, Virginia, United States INA Solution Inc Full time

    Job DescriptionJob Title: Kafka Cloud ArchitectCompany: INA Solution IncJob Type: Full-timeLocation: RemoteDuration: 6+ Months, ExtendibleExperience: 10-15 YearsKey ResponsibilitiesKafka Cluster Management: Design, deploy, and manage highly available and scalable Apache Kafka clusters to ensure seamless data processing and streaming.Data Streaming...

  • Kafka Cloud Architect

    1 week ago

    Richmond, Virginia, United States INA Solution Inc Full time

    Job DescriptionJob Title: Kafka Cloud ArchitectCompany: INA Solution IncJob Type: Full-timeLocation: RemoteDuration: 6+ Months, ExtendibleExperience: 10-15 YearsKey ResponsibilitiesKafka Cluster Management: Design, deploy, and manage highly available and scalable Apache Kafka clusters to ensure seamless data processing and streaming.Data Streaming...

  • AWS Cloud Architect

    2 months ago

    Richmond, United States Crescens Full time

    Role: AWS Cloud Architect Location: Richmond VA(Hybrid) Duration: 6+Months Job Description: Job responsibilities includes Evaluate existing AWS instances and provide recommendations as required. Looking for ways to improve operations within the agency to digitize common tasks. Design and build enterprise wide cloud solutions on a global scale. Create a...

  • Java AWS engineer

    3 months ago

    Richmond, United States Diverse Lynx Full time

    Top 3 skills required: 1.Java, Spring boot, Spring Events, Rest API, Feign 2 AWS, Kafka, Jenkins, Docker, Postgres, Aurora 3 GraphQL/REST/GRPC Job Description/ Responsibilities: • Java+AWS • Min. 08+ years of IT experience in implementing Java 8, J2EE and related Java technologies, Good Knowledge in Java 17.Rest API • Must have Kafka and postgres db...

  • AWS Java Developer

    1 month ago

    Richmond, United States Global Soft Systems Full time

    Job DescriptionJob DescriptionRole: AWS Java DeveloperDuration: 6+ monthsLocation: Richmond,VA, Plano,TX, McLean,VA Spring Boot,Java,AngularAWS,KubernetesKafkaRequirement: Bachelor's degree in Computer Science or related field or equivalent combination of industry-related professional experience and education.

  • Lead Data Architect

    3 months ago

    Richmond, United States CapTech Consulting Full time

    Company Description CapTech is an award-winning consulting firm that collaborates with clients to achieve what's possible through the power of technology. At CapTech, we're passionate about the work we do and the results we achieve for our clients. From the outset, our founders shared a collective passion to create a consultancy centered on strong...

  • Senior Cloud AWS Engineer

    1 month ago

    Richmond, Virginia, United States Cynet Systems Full time

    Create automation services for builds using Terraform, Python, and OS shell scripts.Bachelors degree in Computer Science, Management Information Systems, Computer Engineering, or related field or equivalent work experience; advance degree preferred.Expertise in building and managing Cloud databases such as AWS RDS, DynamoDB, DocumentDB or analogous...

  • Senior Java developer w/Golang

    3 days ago

    Richmond, United States Cognizant Full time

    At Cognizant Digital Engineering, a small cross functional team comprised of a Product Manager, an Architect, Full-Stack Developers, UI/UX designers and Big Data analysts builds higher quality software faster siloed individuals working independently. Small, nimble engineering teams generate collective empathy and comradery, thus increasing their ability to...

  • Senior Java developer w/Golang

    3 days ago

    Richmond, United States Cognizant Full time

    At Cognizant Digital Engineering, a small cross functional team comprised of a Product Manager, an Architect, Full-Stack Developers, UI/UX designers and Big Data analysts builds higher quality software faster siloed individuals working independently. Small, nimble engineering teams generate collective empathy and comradery, thus increasing their ability to...

  • Senior Java developer w/Golang

    3 days ago

    Richmond, United States Cognizant Full time

    At Cognizant Digital Engineering, a small cross functional team comprised of a Product Manager, an Architect, Full-Stack Developers, UI/UX designers and Big Data analysts builds higher quality software faster siloed individuals working independently. Small, nimble engineering teams generate collective empathy and comradery, thus increasing their ability to...

  • Senior Java developer w/Golang

    1 day ago

    Richmond, United States Cognizant Full time

    At Cognizant Digital Engineering, a small cross functional team comprised of a Product Manager, an Architect, Full-Stack Developers, UI/UX designers and Big Data analysts builds higher quality software faster siloed individuals working independently. Small, nimble engineering teams generate collective empathy and comradery, thus increasing their ability to...

  • Senior Java developer w/Golang

    7 days ago

    Richmond, United States Cognizant Full time

    At Cognizant Digital Engineering, a small cross functional team comprised of a Product Manager, an Architect, Full-Stack Developers, UI/UX designers and Big Data analysts builds higher quality software faster siloed individuals working independently. Small, nimble engineering teams generate collective empathy and comradery, thus increasing their ability to...

  • Gold Images Architect

    2 weeks ago

    Richmond, United States Dexian Full time

    Title: Sr. Architect - Gold ImagesLocation - 100% RemoteLong term engagement About Project - Architect Gold images - pipeline of processes - amazon machine images for application and took snapshot of Operating System and developer use to provision the system and take a copy of that image to build that against our security systems so they will not buy from...

  • Sr. AWS Pyspark Developer

    1 week ago

    Richmond, United States Cognizant Full time

    Job Summary We are seeking an experienced Architect with 6 to 10 years of experience to join our team. The ideal candidate will have a strong background in Spark Optimization AWS IAM Big Data AWS EC2 Amazon S3 Apache Spark and Python. Additionally domain expertise in Cards and Payments is required. This role involves designing and optimizing big data...

  • Sr. AWS Pyspark Developer

    1 week ago

    Richmond, United States Cognizant Full time

    Job Summary We are seeking an experienced Architect with 6 to 10 years of experience to join our team. The ideal candidate will have a strong background in Spark Optimization AWS IAM Big Data AWS EC2 Amazon S3 Apache Spark and Python. Additionally domain expertise in Cards and Payments is required. This role involves designing and optimizing big data...

  • Senior Architect for Gold Images

    4 days ago

    Richmond, Virginia, United States Dexian Full time

    About the Role:We are seeking a highly skilled Senior Architect to join our team at Dexian. As a Senior Architect, you will be responsible for designing and implementing a pipeline of processes for creating and managing gold images in AWS and Azure.Key Responsibilities:Design and implement a gold images pipeline in AWS and AzureCollaborate with different...