Databricks Data SCE Engineer, Google Cloud Platform
Overview
You will own data engineering and cloud architecture initiatives across customer and partner teams at Apolis. Your work spans Databricks, Google Cloud Platform data services, and infrastructure automation, delivering production-grade data platforms. You will partner with engineers to design scalable data pipelines and support managed Kafka clusters. This role centers on hands-on architecture and implementation with Databricks and GCP in a remote-friendly environment.
What You'll Do7
- 1Design data pipelines and cloud architectures with Databricks and Google Cloud Platform, ensuring production reliability.
- 2Build infrastructure automation for data platforms, using Terraform and GCP services.
- 3Own the lifecycle of managed Kafka clusters, including provisioning, monitoring, and performance tuning.
- 4Support customer and partner teams in data engineering workloads, troubleshooting Databricks jobs and GCP data services.
- 5Drive data architecture decisions, selecting GCP storage and compute solutions for batch and streaming.
- 6Implement data governance and security controls within Databricks and GCP environments.
- 7Scale data platforms by optimizing Spark workloads on Databricks and integrating with GCP BigQuery.
Requirements7
- 15+ years in data engineering or cloud architecture with Google Cloud Platform.
- 2Expertise in Databricks for data processing, including Delta Lake and Spark integrations.
- 3Strong experience with GCP data services: BigQuery, Dataflow, Pub/Sub, and Cloud Storage.
- 4Proficiency in infrastructure automation using Terraform or similar IaC tools.
- 5Hands-on experience managing Apache Kafka or Confluent Cloud in production.
- 6Ability to work effectively with customer and partner teams in a remote setting.
- 73+ years scripting in Python or Scala for data engineering tasks.
Salary Insight
$146 - $156k per year
Location
Required Skills
Similar open positions
Explore active roles that match your skills and interests.
Nityo Infotech Corporation
VerifiedDatabricks Architect, Data Engineering
You will own the architecture and delivery of Databricks-based data platforms for enterprise clients, defining technical direction across the full project lifecycle. You will design scalable data architectures, lead implementation teams, and drive innovation using Spark, Delta Lake, and cloud-native services. This role sits within a specialized Databricks practice, collaborating with data engineers and solution architects to solve complex data challenges. You will experiment with emerging data technologies and set the standard for best practices in a hands-on, client-facing capacity.
Healthcare Triangle Inc
VerifiedDatabricks Lead - Data Engineering
Own the design and delivery of scalable data engineering solutions on the Databricks platform, driving value across the full data lifecycle. Lead a team of engineers building PySpark, Spark SQL, and Delta Lake pipelines. Collaborate with data architects and stakeholders to shape the lakehouse architecture. This role offers direct ownership of technical strategy and a chance to set standards for data quality and performance.
SVCS Huron Consulting Services LLC
VerifiedDatabricks Technical Architect
Lead Databricks technical architecture and productionize Lakehouse platforms for clients. Translate business requirements into technical designs, build and scale Delta Lake pipelines, and integrate GenAI solutions. Partner with functional leads to ensure platform decisions support data quality and governance.
Headway Tek Inc
VerifiedDatabricks Architect, Enterprise Lakehouse Platform
You will own the Databricks platform architecture end-to-end, designing and implementing next-generation data platforms on the Lakehouse paradigm. You will drive scalability, governance, performance, and cost optimization across enterprise data ecosystems, partnering with data engineering, data science, and business teams. This role goes beyond pipeline development, offering leadership in platform strategy and adoption at scale. You will define the roadmap for Unity Catalog, Delta Lake, and Spark workloads in a hybrid environment.
Clera
VerifiedResident Solution Architect Databricks - Clera San Francisco
We seek a senior Resident Solution Architect specializing in the Databricks Lakehouse Platform to lead large-scale implementations for enterprise clients. This W2 contract role involves designing end-to-end Databricks solutions scaling across AWS Azure GCP while advising on platform best practices and MLOps workflows.
Apex Systems
VerifiedDatabricks Architect, Data Intelligence Platform
As the Databricks Architect, you own the architecture and implementation of the Data Intelligence Platform Enablement Framework at enterprise scale. You set the technical direction for a team of data engineers and platform engineers, defining standards that govern data access, security, and quality. This role stands apart because you shape the architecture from day one, working directly with leadership to align technical patterns with business goals.