Open Source Kafka Administration : Install, Configure and administer Open Source Kafka Integration: Integrate Kafka, HBase, and Spark to create seamless data flow across systems, ensuring data consistency and reliability. Performance Tuning: Monitor and tune the performance of Kafka, HBase, and Spark applications to ensure optimal operation and low latency. Collaboration: Work closely with data scientists, analysts, and other stakeholders to understand data needs and deliver solutions that support analytical objectives. Documentation & Best Practices: Create and maintain documentation for data architectures, processes, and best practices. Provide training and support to team members. Required Skills and Qualifications: Bachelor’s degree in Computer Science, Information Technology, or a related field. 5 years of experience in data engineering with a focus on Kafka and Spark. Strong understanding of Kafka architecture, including producers, consumers, and topics, with experience in managing Kafka clusters. Experience with Spark for distributed data processing, including knowledge of Spark SQL and Spark Streaming. Strong analytical and problem-solving skills. Preferred Qualifications: Experience with cloud platforms (AWS, Azure, GCP) and their big data services. Knowledge of data governance and data quality frameworks. Familiarity with containerization technologies (Docker, Kubernetes) for deploying data applications