Senior DevOps Engineer, Azure & Databricks
Overview
You will own the design and implementation of automated deployment pipelines for an Azure-based data platform, supporting Databricks workloads at enterprise scale. You will partner with Data Engineering, Data Architecture, Security, and Platform Engineering teams to deliver secure, repeatable infrastructure. Your work will directly reduce deployment time and improve system reliability, enabling faster feature delivery across the organization.
What You'll Do8
- 1Design and implement CI/CD pipelines using Azure DevOps and GitHub Actions for infrastructure and application code.
- 2Build and manage infrastructure as code with Terraform and Bicep for Azure resources, including Databricks workspaces.
- 3Drive adoption of containerization with Docker and orchestration using Kubernetes or Azure Kubernetes Service (AKS).
- 4Implement monitoring and alerting using Prometheus, Grafana, and Azure Monitor to ensure system health and performance.
- 5Automate security and compliance checks across the deployment pipeline, integrating with Azure Policy and Defender for Cloud.
- 6Collaborate with data engineering teams to optimize Databricks clusters and jobs for performance and cost.
- 7Lead efforts to improve deployment frequency and reduce lead time for changes, targeting a 20% reduction within the first 6 months.
- 8Mentor junior engineers on DevOps best practices and tooling.
Requirements10
- 15+ years of experience in DevOps, SRE, or platform engineering roles.
- 2Strong experience with Azure services including Azure DevOps, Azure Kubernetes Service (AKS), and Azure Networking.
- 3Proficiency in infrastructure as code using Terraform or Bicep.
- 4Experience with Databricks and its integration with cloud platforms.
- 5Hands-on experience with Docker and Kubernetes in production environments.
- 6Working knowledge of scripting languages such as Python or Bash.
- 7Experience implementing CI/CD pipelines with Azure DevOps or GitHub Actions.
- 8Familiarity with monitoring and logging tools like Prometheus, Grafana, and ELK Stack.
- 9Certification such as Azure DevOps Engineer Expert or Azure Solutions Architect Expert is preferred.
- 10Onsite presence 3 days per week in Overland Park, Kansas.
Salary Insight
$146 - $177k per year
Location
Required Skills
Similar open positions
Explore active roles that match your skills and interests.
Trebecon LLC
VerifiedAzure Databricks Architect
Lead design of scalable enterprise data platforms using Azure Databricks and Lakehouse architecture. Own end-to-end data engineering initiatives to drive high-performance ETL/ELT pipelines. Implement solutions leveraging PySpark Spark SQL and Databricks Workflows. Differentiate by scaling data infrastructure for Tampa based teams.
AgreeYa Solutions
VerifiedSenior Azure DevOps Engineer
Lead design and execution of cloud infrastructure solutions to support large scale enterprise applications. Drive platform reliability and performance across hybrid environments. Azure Kubernetes CI/CD Infrastructure as Code Scalable systems.
Marathon Petroleum Company LP
VerifiedSenior Data Operations Engineer, Cloud Platforms
Own the reliability, scalability, security, and performance of MPC's enterprise data platforms, serving teams across Data Engineering, Platform Engineering, and SRE. Lead modernization and automation for cloud-native systems including Databricks, Azure, Cognite, and streaming technologies. Mentor engineers, set operational standards, and drive compliance with governance controls. This role shapes the future of data platform operations at a major energy company, with direct impact on AI-driven innovation.
Apex Systems
VerifiedData Engineering Lead, DevOps & Data Platforms
You own the core foundation of the Data Intelligence Platform Enablement Framework, building governance-as-code, infrastructure-as-code, CI/CD automation, and observability. You lead a team of engineers and collaborate with data scientists and analysts to ship a reliable, secure platform. Your work directly enables faster, compliant data product delivery across the organization. This role offers technical leadership and the chance to shape platform standards from day one.
Spear Staffing
VerifiedSr. Azure Data Engineer Technical Lead
Own Azure data infrastructure and drive technical strategy for large scale data pipelines. Lead a distributed team of 5 engineers delivering robust solutions. Differentiate by shaping cloud native architecture and mentoring junior staff.
Lorvenk Technologies LLC
VerifiedAzure DevOps Engineer, Cloud Platform & Automation
You will own the build, automation, and support of Azure cloud environments for enterprise applications and AI workloads. Your work will enable development teams with reliable infrastructure and CI/CD pipelines. Collaborating with the Cloud and Platform Engineering organization, you will drive infrastructure as code and operational excellence. This role stands out for its impact on emerging AI initiatives.