Platform Engineer with Cloud Expertise

- Oversee the administration of Databricks workspaces, clusters, jobs, Unity Catalog, compute policies, and platform guidelines - Implement and maintain Role-Based Access Control (RBAC) and Attribute-Based Access Control (ABAC) for secure data access - Define and uphold data ingestion standards, naming conventions, schema regulations, Delta Lake design methodologies, and data quality expectations - Establish platform-wide standards for ingestion pipelines, Delta architecture, data lineage, versioning, and validation processes - Collaborate with data engineering teams to enhance patterns and ensure consistency across the platform - Manage permissions for workspaces and catalogs, including row/column-level policies and attribute-based filtering - Work closely with security teams to ensure compliance with data protection standards - Set cost thresholds, alerts, compute policies, and usage dashboards to manage expenses effectively - Monitor costs associated with jobs and clusters, identify anomalies, and recommend optimization strategies - Ensure platform reliability through automated testing frameworks, CI/CD templates, and code governance practices - Define best practices for building on the platform, including ingestion, Delta conventions, CI/CD, observability, and AI/ML methodologies