Senior Databricks Platform Engineer

- Administer, standardize, and optimize Azure Databricks workspaces across development, testing, and production environments - Define, implement, and enforce platform standards; lead troubleshooting and root-cause analysis in collaboration with data, cloud, and security teams - Optimize Spark workloads and cluster configurations to enhance performance and reduce costs across data pipelines - Manage and enhance Unity Catalog governance, ensuring compliance with enterprise and regulatory requirements - Collaborate with Security and Cloud teams to implement Azure networking patterns and workspace isolation controls - Design, build, and maintain CI/CD pipelines and Git workflows for Databricks notebooks and other artifacts - Provision and manage Databricks infrastructure using Terraform to facilitate streamlined operations - Develop and promote lakehouse platform patterns and reusable frameworks for efficient data processing - Implement monitoring and alerting practices to improve platform observability and reliability - Mentor junior engineers, document standards, and contribute to ongoing improvements in processes and best practices