kafka Administrator

2 weeks ago

Jersey City, United States OJUS LLC Full time

Kafka Admin

Mandatory Job Requirements

• Manage single and multi-node Kafka cluster deployed on VM, Docker and Kubernetes Container platform. Experience with Confluent Platform running on-prem

• Perform Kafka Cluster build, MRC, including Design, Infrastructure planning, High Availability and Disaster Recovery

• Implementing wire encryption using SSL, authentication using SASL/LDAP & authorization using Kafka ACLs in Zookeeper, Broker/Client, Connect cluster/connectors, Schema Registry, REST API, Producers/Consumers, Ksql

• Perform high-level, day-to-day administration and support functions

• Upgrades for the Kafka Cluster landscape comprising of Development, Test, Staging and Production/DR systems

• Creation of key performance metrics, measuring the utilization, performance, and overall health of the cluster.

• Capacity planning and implementation of new/upgraded hardware and software releases as well as for storage infrastructure.

• Research and recommend innovative ways to maintain the environment and where possible, automate key administration tasks.

• Ability to work with various infrastructure, administration, and development teams across business units

• Document and share design, build, upgrade and standard operating procedures. Conduct knowledge transfer sessions and workshops for other members in the team. Provide technical expertise and guidance to new and junior members in the team

• Create topics, setup Apache Kafka MirrorMaker 2, Confluent Replicator to replicate the topics, create connect clusters, Schemas for the topics using Confluent Schema Registry

• Configure various Opensource and licensed Kafka Source/Sink Connectors such as Kafka Connect for SAP HANA, Debezium Oracle and MySQL Connectors, Confluent JDBC source/sink, Confluent ADLS2 Sink connector and Confluent Oracle CDC source connector...

• Develop and maintain Unix scripts to perform day to day Kafka Admin and Security related functions using Confluent REST Proxy server

• Setting up monitoring tools such as Prometheus, Grafana to scrape metrics from various Kafka cluster components (Broker, Zookeeper, Connect, REST proxy, Mirror Maker, Schema Registry ...) and other endpoints such as webservers, databases, logs etc. and configure alerts for Kafka Cluster and supporting infrastructure to measure availability and performance SLAs

• Experience with Confluent ksql to query and process Kafka streams

• Knowledge of Kafka Producer and Consumer APIs, Kafka Stream Processing, Confluent Ksql

• Availability to work in shifts, extended hours and to provide on-call support as required. There will be work over weekends at times depending on the project needs.

• Must have excellent communications and interpersonal skills

Preferred but Optional skills

• Linux (SLES or RHEL) system administration (basic or advanced), creating shell scripts ..

• Working experience on docker and Kubernetes clusters (opensource, Rancher, RedHat OCP, Client Tanzu) involving administration of containers (Operator level skills), deployments, updates, integration with products running outside of the cluster

• Working knowledge with container registry such as Harbor, Quay, Nexus etc. Exposure to Container/artifact scanners such as Trivy, Claire ...

• Security related config for above listed software or any other tools in SSL for wire encryption, integration with AD for authentication and RBAC for authorizations

• Implemented and supported any enterprise product such as any well-known ERP products, Data warehouse, Middleware etc.

• Database administration skills in Oracle, MSSQL, SAP HANA, DB2, Aerospike, Postgres ..

• Exposure to SaaS based observability platform like New Relic

• Deployment of container images and pods using CI/CD pipelines using Jenkins or comparable tools.

• Experience in building Kafka deployment pipelines using Terraform, Ansible, Cloud formation templates, shells etc.

 

Worked in Public cloud environment such as Azure or AWS or Google Cloud Platform, preferably in Azure

  kafka Administrator

  • Kafka Administrator

    1 month ago

    Jersey City, NJ, United States Virtusa Full time

    DescriptionResponsibilities: Creation of key performance metrics, measuring the utilization, performance, and overall health of the cluster.Perform high-level, day-to-day administration and support functionsCapacity planning and implementation of new-upgraded hardware and software releases as well as for storage infrastructure.Research and recommend...

  • Kafka Architect

    6 days ago

    Oklahoma City, Oklahoma, United States TEKsystems Full time

    Description:The ideal candidate will be a Kafka Architect with experience setting up best practices in Cloud/DevOps environments related to data pipelines to databases, servers (front and backend), and security systems to ensure reliable system massaging and communication. Also, skilled in solutioning centralized processes using Kalfa as a centralized...

  • Senior Software Engineer

    2 weeks ago

    Jersey City, United States BayOne Solutions Full time

    Title: Senior Software Engineer (With Strong Kafka Messaging Experience)Location: Jersey City, NJJob Type: Contract to HireSkills Required: - Must have experience with Kafka, ActiveMQ- Proficiency in AWS and Terraform - Go lang is a plus, but proficiency in Python or Java is acceptableJob Summary: As a Senior Software Engineer, you will play a crucial role...

  • Splunk Engineer

    3 weeks ago

    Jersey City, United States Omni Inclusive Full time

    JD: • Strong knowledge of Splunk, especially Enterprise Security (ES): o Data onboarding activities, including custom parsing rules and custom Technology Add-On building according to Splunk's Common Information Model (CIM) o Good understanding of SPL, Dashboard development, Accelerated searches, and other Knowledge objects o Experience in creating and...

  • Splunk Engineer@ Jersey City, NJ; Plano, TX

    3 weeks ago

    Jersey City, United States Diverse Lynx Full time

    Splunk Engineer Location: Onsite at one of these locations - Jersey City, NJ; Plano, TX JD: Strong knowledge of Splunk, especially Enterprise Security (ES): o Data onboarding activities, including custom parsing rules and custom Technology Add-On building according to Splunk's Common Information Model (CIM) o Good understanding of SPL, Dashboard...

  • Senior Software Engineer

    6 days ago

    Jersey City, United States BayOne Solutions Full time

    Title: Senior Software Engineer Location: NJ, Chicago, IL, Palo Alto and SF, CA, Jersey City (3 days onsite) Job Type: Full-Time. Rate: $90 - $100/hr on only W2 Skills Required: - Must have experience with Kafka - Proficiency in AWS and Terraform - Go lang is a plus, but proficiency in Python or Java is acceptable Job Summary: As a Senior Software Engineer,...

  • Senior Software Engineer

    2 weeks ago

    Jersey City, United States BayOne Solutions Full time

    Title: Senior Software Engineer Location: NJ, Chicago, IL, Palo Alto and SF, CA, Jersey City (3 days onsite)Job Type: Full-Time. Rate: $90 - $100/hr on only W2Skills Required: - Must have experience with Kafka- Proficiency in AWS and Terraform- Go lang is a plus, but proficiency in Python or Java is acceptableJob Summary: As a Senior Software Engineer, you...

  • Senior Software Engineer

    2 weeks ago

    Jersey City, United States BayOne Solutions Full time

    Title: Senior Software Engineer Location: NJ, Chicago, IL, Palo Alto and SF, CA, Jersey City (3 days onsite)Job Type: Full-Time. Rate: $90 - $100/hr on only W2Skills Required: - Must have experience with Kafka- Proficiency in AWS and Terraform- Go lang is a plus, but proficiency in Python or Java is acceptableJob Summary: As a Senior Software Engineer, you...

  • Hadoop Systems Administrator

    3 weeks ago

    Oklahoma City, United States ndoiljobs Full time

                        Preview JOB SUMMARY As a Hadoop Systems Administrator, you will be responsible for daily operations and maintenance of IT systems centering around Continental’s big data platform. You will be required to keep these IT systems maintained and optimized through daily, weekly, and monthly system tuning and periodic...

  • Java with Python

    3 weeks ago

    Jersey City, United States Diverse Lynx Full time

    Java with Python Location: NJ Job responsibilities Executes creative software solutions, design, development, and technical troubleshooting with ability to think beyond routine or conventional approaches to build solutions or break down technical problems Develops secure high-quality production code, and reviews and debugs code written by others ...

  • Remote Database Engineer

    1 week ago

    Kansas City, United States Recruiting for Good Full time

    Need to Live in the United States Excellent Communication Skills Need HBase database admin for non-relational database experience Job Description: Database Engineers administer, test, and implement databases, applying knowledge of database management systems . Apache HBase database admin for non-relational database. Database Engineer Responsibilities and...

  • Lead Hadoop Admin-Foster City, CA,

    3 weeks ago

    Foster City, United States Georgia IT Inc Full time

    Lead Hadoop Admin Foster City, CA, (Onsite from Day 1) Max Rate: DOE Interview Process: 3 Rounds of Zoom Video Interview USC & GC Preferred. No Third-party C2C available for this job Job Description Responsible for implementation and ongoing administration of Hadoop infrastructure. Responsible for Cluster maintenance, trouble shooting,...

  • DevOps Engineer

    6 days ago

    Salt Lake City, United States Goldman Sachs Full time

    MORE ABOUT THIS JOB: Your Impact At Goldman Sachs, SREs Platforms team is responsible for designing, developing, and operating distributed systems which provide observability for Goldmans mission-critical applications and platform services. These systems span across on-premises data centers and multiple public cloud environments. We design, build and operate...

  • Sr Data Engineer

    7 days ago

    Ellicott City, United States Penn Foster Inc Full time

    Blackpoint Cyber is a provider of leading-edge cybersecurity threat hunting, detection, and response technology. Blackpoint was founded by former National Security Agency (NSA) cyber operations experts that applied their expertise to bring nation/state grade technologies to commercial customers around the world. We are looking for an experienced Sr. Data...

  • Senior Vice President, Domain Architect

    2 months ago

    Jersey City, NJ, United States BNY Mellon Full time

    Overview Job Title: Growth Venture Bridge Alternatives Domain Architect, Senior Vice President Location: New York, NY Hybrid role: three days per week in the office Who we are: BNY Mellon has been a pioneer in the global capital markets for nearly 240 years, providing the world's leading institutions the tools, capabilities, and services to be...

  • Senior Software Engineer, Data

    16 hours ago

    Salt Lake City, United States Social Finance Ltd Full time

    Employee Applicant Privacy Notice Who we are: Shape a brighter financial future with us. Together with our members, we're changing the way people think about and interact with personal finance. We're a next-generation financial services company and national bank using innovative, mobile-first technology to help our millions of members reach their goals. The...

  • Senior Staff Engineer, Product Software

    6 days ago

    Redwood City, United States Equinix Full time

    Senior Staff Engineer, Product Software page is loaded Senior Staff Engineer, Product Software Apply locations Redwood City time type Full time posted on Posted 2 Days Ago job requisition id JR-145031 Who are we? Equinix is the world’s digital infrastructure company , operating over 2 50 data centersacross the globe . Digital leaders harness Equinix's...

  • Senior Software Engineer

    5 days ago

    Jefferson City, United States Marriott Full time

    Marriott Senior Software Engineer Jefferson City , Missouri Apply Now Schedule Full-Time Located Remotely? Y Relocation? N Position Type Management JOB SUMMARY Marriott has an exciting opportunity for a Senior Software Engineer Loyalty Partner Engineering team. This role is part of the team focused on building out our next generation partner integrations....

  • Director of Software Engineering

    2 weeks ago

    Carson City, United States Marriott Full time

    Marriott Director of Software Engineering - Web Carson City , Nevada Apply Now Schedule Full-Time Located Remotely? Y Relocation? N Position Type Management JOB SUMMARY Oversees day to day application development projects and engineering while leading continuous improvement on process definition and compliance. Directly manages software engineers and project...

  • Senior Software Engineer

    3 weeks ago

    Oklahoma City, Oklahoma, United States Marriott Full time

    Job Number Job Category Information TechnologyLocation Marriott International HQ, 7750 Wisconsin Avenue, Bethesda, Maryland, United StatesSchedule Full-TimeLocated Remotely? YRelocation? NPosition Type ManagementJOB SUMMARYMarriott has an exciting opportunity for a Senior Software Engineer Loyalty Partner Engineering team. This role is part of the team...