Data Architect, Databricks Lakehouse & Semantic Layer
Overview
You will own the analytical data architecture for the Databricks Lakehouse, defining and governing the Silver and Gold layers to deliver trusted, business-ready data products. You will design the semantic layer and agentic decision intelligence frameworks that power next-generation analytics across the enterprise. Working with data engineers, analysts, and business stakeholders, you will set the standards for data modeling, quality, and consumption. This role goes beyond traditional modeling: you will shape how the enterprise consumes data through SQL, Python, and Databricks-native tooling, enabling self-service and AI-driven insights.
What You'll Do8
- 1Define and govern the Silver and Gold layer data models on Databricks, ensuring consistency and reusability across domains.
- 2Design the semantic layer to provide a unified, business-friendly view of key metrics, using tools like dbt or LookML.
- 3Implement agentic decision intelligence workflows that use MLflow and LangChain to automate data-driven decisions.
- 4Develop and enforce data quality and validation frameworks using Great Expectations or Delta Live Tables.
- 5Collaborate with data engineers to optimize Spark pipelines for performance and cost on the lakehouse.
- 6Create and maintain documentation and data lineage using OpenLineage or DataHub.
- 7Lead the migration of legacy SQL Server or Teradata models to the Databricks lakehouse.
- 8Own the enterprise data catalog and access controls for Silver and Gold layers, using Unity Catalog.
Requirements8
- 18+ years designing and implementing enterprise data models with Databricks, Snowflake, or BigQuery.
- 25+ years building semantic layers and metric layers using tools like dbt, LookML, or AtScale.
- 3Expert proficiency in SQL and Python for data transformation and orchestration.
- 4Hands-on experience with Spark and Delta Lake for large-scale data processing.
- 5Deep understanding of Unity Catalog for governance, lineage, and access control.
- 6Proven record of designing agentic AI or decision intelligence systems with LangChain or AutoGen.
- 7Strong communication skills to translate business needs into technical models.
- 8Bachelor's degree in Computer Science, Information Systems, or equivalent experience.
Salary Insight
Salary not disclosed in listing
Similar open positions
Explore active roles that match your skills and interests.
SVCS Huron Consulting Services LLC
VerifiedDatabricks Technical Architect
Lead Databricks technical architecture and productionize Lakehouse platforms for clients. Translate business requirements into technical designs, build and scale Delta Lake pipelines, and integrate GenAI solutions. Partner with functional leads to ensure platform decisions support data quality and governance.
MOONITSolutions Inc.
VerifiedSenior Data Engineer (Databricks)
Lead architectural ownership and end-to-end system design for production Databricks solutions. Scale high-performance data platforms to support enterprise-wide analytics. Differentiate by mastering Delta Lake and Unity Catalog while driving performance improvements.
Anblicks
VerifiedLead Databricks Engineer, Lakehouse & ETL Pipelines
You will own the Lakehouse platform architecture for Anblicks in Dallas, designing and implementing end-to-end data solutions on Databricks. You will define best practices and build scalable ETL/ELT pipelines that power Spark workloads. Working closely with stakeholders, you will shape technical strategy and deliver production-grade data systems. This role centers on driving performance, cost, and scalability across a growing data estate.
EXTEU-AC-CareerSite
VerifiedPrincipal Data Architect, Data Engineering & AI
You will own the enterprise data architecture and strategy, enabling scalable AI/ML, telemetry analytics, and business intelligence across a global organization. You will lead the design of cloud-native data platforms on AWS and Azure, from ingestion to insights, and set the blueprint for data storage, integration, and governance. Collaborating with Data Science and AI teams, you will industrialize ML pipelines and drive data as a strategic asset. This role combines deep technical leadership with executive influence, shaping the future of data-driven decision making.
brillio-2
VerifiedDatabricks Architect R01568474
Lead the design and implementation of modern data and AI platforms. The ideal candidate brings deep expertise in the Databricks ecosystem or Google Cloud Platform (GCP) combined with strong data engineering and architecture fundamentals. This role defines scalable data architectures enables AI adoption and drives modernization across data analytics and AI capabilities.
JPMorganChase
VerifiedSr Lead Software Engineer, Data Engineer
You will own the design and delivery of enterprise data platforms and pipelines for Securities Services Technology, serving millions of transactions. 5+ years of applied experience with Python, Java, and Spark positions you to lead an agile team in building secure, scalable products. You will define architecture, implement semantic layers with Agentic AI, and integrate data across AWS and Databricks. This role stands apart through its focus on agentic metadata mining and semantic modeling, driving firmwide innovation.