Logo of Huzzle

Home

Matches

Explore

Manage

Kafka Admin

image

Virtusa

Yesterday

  • Job
    Full-time
    Senior Level
  • Data
    IT & Cybersecurity
  • Chennai

AI generated summary

  • You need 6+ years in Kafka Big Data admin, Kafka cluster management on VMs/Docker/Kubernetes, Kafka security setup, monitoring tools expertise, CI/CD skills, and experience in public cloud environments.
  • You will administer Kafka, monitor cluster metrics, support daily operations, plan capacity, automate tasks, collaborate across teams, document processes, and mentor junior staff.

Requirements

  • Minimum 6 years of experience in BigData administration using KAKFA and related tools like Spark etc.
  • Minimum 4 years of experience in setting up the environment for solutions that collects and process data using Kafka Spark, Scala
  • Expert on Kafka Big Data solutions along with sound understanding of Kafka architecture
  • Manage single and multi-node Kafka cluster deployed on VM, Docker and Kubernetes Container platform. Experience with Confluent Platform running on prem
  • Perform Kafka Cluster build, MRC, including Design, Infrastructure planning, High Availability and Disaster Recovery
  • Implementing wire encryption using SSL, authentication using SASL LDAP authorization using Kafka ACLs in Zookeeper, Broker Client, Connect cluster connectors, Schema Registry, REST API, Producers Consumers, KsqlDevelop and maintain Unix scripts to perform day to day Kafka Admin and Security related functions using Confluent REST Proxy server
  • Setting up monitoring tools such as Prometheus, Grafana to scrape metrics from various Kafka cluster components Broker, Zookeeper, Connect, REST proxy, Mirror Maker, Schema Registry and other endpoints such as webservers, databases, logs etc. and configure alerts for Kafka Cluster and supporting infrastructure to measure availability and performance SLAs
  • Experience with Confluent ksql to query and process Kafka streams
  • Knowledge of Kafka Producer and Consumer APIs, Kafka Stream Processing, Confluent Ksql
  • Security related config for above listed software or any other tools in SSL for wire encryption, integration with AD for authentication and RBAC for authorizations
  • Database administration skills in Oracle, MSSQL, SAP HANA, DB2, Aerospike, Postgres ..
  • Exposure to SaaS based observability platform like New Relic
  • Deployment of container images and pods using CI/CD pipelines using Jenkins or comparable tools.
  • Experience in building Kafka deployment pipelines using Terraform, Ansible, Cloud formation templates, shells etc.
  • Availability to work in shifts, extended hours and to provide on call support as required. There will be work over weekends at times depending on the project needs.
  • Worked in Public cloud environment such as Azure or AWS or GCP, preferably in Azure
  • Must have excellent communications and interpersonal skills

Responsibilities

  • Big Data Confluent KAFKA Administrator.
  • Creation of key performance metrics, measuring the utilization, performance, and overall health of the cluster.
  • Perform high-level, day-to-day administration and support functions
  • Capacity planning and implementation of new/upgraded hardware and software releases as well as for storage infrastructure.
  • Research and recommend innovative ways to maintain the environment and where possible, automate key administration tasks.
  • Ability to work with various infrastructure, administration, and development teams across business units
  • Document and share design, build, upgrade and standard operating procedures. Conduct knowledge transfer sessions and workshops for other members in the team. Provide technical expertise and guidance to new and junior members in the team
  • Implemented and supported any enterprise product such as any well-known ERP products, Data warehouse, Middleware etc.

FAQs

What are the primary responsibilities of a Kafka Admin at Virtusa?

The primary responsibilities include day-to-day administration and support of Big Data Confluent Kafka, creation of key performance metrics, capacity planning, implementation of new/upgraded hardware and software releases, documentation and sharing of best practices, and supporting enterprise products.

What skills are required for this position?

Required skills include a minimum of 6 years of Big Data administration experience using Kafka, expertise in Kafka architecture, experience managing Kafka clusters deployed on various platforms, implementing security configurations, and database administration skills in various databases.

Is experience with Confluent KSQL necessary for this role?

Yes, experience with Confluent KSQL to query and process Kafka streams is a required skill for this position.

Will there be opportunities for knowledge transfer and mentoring within the team?

Yes, the role involves conducting knowledge transfer sessions and workshops for team members and providing technical expertise and guidance to junior members.

What is the expected work schedule for Kafka Admins?

Kafka Admins are expected to work in shifts, extended hours, and be available for on-call support as required, with occasional weekend work depending on project needs.

Are there opportunities for professional development and growth at Virtusa?

Yes, Virtusa values professional and personal development and provides employees with exciting projects and opportunities to work with state-of-the-art technologies throughout their careers.

What kind of work environment can one expect at Virtusa?

Virtusa promotes a collaborative team environment, values quality of life, and encourages nurturing new ideas while fostering excellence among its employees.

Do you have any preferences for industry experience?

Experience in the Financial Services sector or a large complex global environment is preferred but not mandatory for this role.

Is knowledge of cloud environments necessary for this job?

Yes, experience working in public cloud environments such as Azure, AWS, or GCP, preferably Azure, is required for this position.

How does Virtusa approach diversity and inclusion in hiring?

Virtusa is founded on principles of equal opportunity and does not discriminate based on race, religion, color, sex, gender identity, sexual orientation, age, disability, national origin, veteran status, or any other basis protected by law. All employment decisions are based on qualifications, merit, and business need.

image

Virtusa

Business transformation that lasts starts with Engineering First.

Technology
Industry
10,001+
Employees
1996
Founded Year

Mission & Purpose

Virtusa Corporation provides digital engineering and technology services to Forbes Global 2000 companies worldwide. Our Engineering First approach ensures we can execute all ideas and creatively solve pressing business challenges. With industry expertise and empowered agile teams, we prioritize execution early in the process for impactful results. We combine logic, creativity and curiosity to build, solve, and create. Every day, we help clients engage with new technology paradigms, creatively building solutions that solve their most pressing business challenges and move them to the forefront of their industry.