Big Data Platform Administrator and Strategist

- Serve as the main liaison for all discussions related to the platform - Facilitate communication between the Hadoop administration team and application development groups - Ensure clarity and alignment among all stakeholders - Review upcoming Hadoop platform updates, including new features, patches, and library enhancements - Perform impact assessments on existing applications and services - Identify potential risks, opportunities, and necessary corrective actions - Coordinate and share upgrade timelines and technical requirements across teams - Evaluate new features and libraries within the Hadoop ecosystem that may improve platform performance or developer efficiency - Recommend the integration of relevant technologies and methodologies - Assist in the evolution and modernization of the big data environment - Monitor the health of the cluster, including performance metrics and resource utilization - Suggest and guide optimization projects to enhance efficiency, scalability, and cost-effectiveness - Collaborate with administrators to resolve complex issues at the platform level - Oversee resource management across applications, tenants, and workloads - Establish and enforce policies regarding resource quotas, data lifecycle management, and storage efficiency - Implement strategies for maintaining a clean and sustainable high-performance cluster - Document and advocate for best practices in the development, deployment, and operational use of the Hadoop platform - Support initiatives to improve platform stability, resilience, and uptime - Contribute to disaster recovery and business continuity strategies - Investigate emerging technologies and architectural solutions pertinent to big data ecosystems - Propose solutions to tackle performance challenges and evolving business requirements - Stay informed about industry trends and opportunities for ongoing improvements