Databricks Data Operations Specialist

Position Summary Scicom Infrastructure Services is seeking aDatabricks Data Operations Specialistto support the operational stability, reliability, performance, and security of a large-scale Databricks data platform. This role will work as part of a multidisciplinary Databricks team that includes data engineers, architects, business analysts, governance specialists, and technical managers. The Data Operations Specialist will be responsible for monitoring production data pipelines, responding to incidents, troubleshooting platform and data-processing issues, coordinating deployments, and ensuring that data products meet established availability, quality, and service-level requirements. The ideal candidate will have hands-on experience operating Databricks environments and supporting production data workloads using Apache Spark, Delta Lake, SQL, Python, cloud infrastructure, monitoring tools, and automated deployment practices. Key Responsibilities Databricks Platform Operations Monitor the health, availability, performance, and capacity of Databricks workspaces, jobs, pipelines, clusters, SQL warehouses, and related cloud services. Provide day-to-day operational support for production Databricks environments. Monitor scheduled and event-driven data pipelines for failures, delays, data-quality issues, and performance degradation. Troubleshoot Databricks jobs, Spark workloads, cluster failures, notebook errors, connectivity issues, and data-processing exceptions. Restart, rerun,