Databricks Senior Developer, Data Engineering & Migration
Overview
Own the end-to-end data engineering stack at scale, building and migrating data systems to the cloud. You will drive production-ready Databricks pipelines and collaborate with cloud and data teams to modernize on-prem data assets. This role emphasizes hands-on development, migration know-how, and translating legacy SQL to Spark SQL. You will contribute to a strong data platform that enables analytics and insights across the organization.
What You'll Do5
- 1Build and maintain production Databricks pipelines to process large data volumes.
- 2Migrate on-prem systems to cloud platforms, ensuring minimal disruption and data fidelity.
- 3Design and optimize data models using Python and SQL within PySpark environments.
- 4Collaborate with data engineers and cloud engineers to implement scalable data solutions.
- 5Convert legacy SQL dialects to Spark SQL and validate results in production.
Requirements5
- 15 to 7 years of data engineering experience
- 2At least 3+ years of hands-on Databricks in production environments
- 3Migration experience from on-prem to cloud platforms
- 4Strong proficiency in Python, PySpark, and SQL
- 5Experience converting legacy SQL to Spark SQL is a plus
Salary Insight
Salary not disclosed in listing
Location
Required Skills
Similar open positions
Explore active roles that match your skills and interests.
Parkar Consulting Group, LLC
VerifiedSenior Data Engineer, Databricks & Cloud Migration
Own data engineering initiatives at scale in a client environment, building robust data pipelines and migrating on-prem systems to cloud platforms. You will work with a cross functional team of data engineers, cloud engineers, and analytics partners in New York City onsite. This role emphasizes hands on Databricks development, Python, and SQL while collaborating to design scalable data architectures. What makes this role unique is leading migration projects from legacy systems to modern cloud data platforms while delivering measurable data capabilities for business users.
Donato Technologies Inc
VerifiedSenior Data Engineer, Databricks & ETL Pipelines
Own the design and delivery of scalable data pipelines on Databricks for a Houston-based enterprise. You join a data engineering team of 6 inside a larger analytics organization, collaborating with architects, analysts, and application teams. Build reliable ETL/ELT solutions that move millions of records daily. This contract role demands hands-on coding in Python and Spark from day one, with direct influence on platform architecture.
RMS IT Solutions Inc
VerifiedSenior Data Engineer, Databricks & Structured Finance
You own the end-to-end migration of structured finance datasets from a legacy platform to Databricks. You lead architecture decisions, data modeling, and pipeline builds. You work independently with a team of data engineers and analysts in New York. This role stands out because you design the future state while unraveling legacy business logic.
Healthcare Triangle Inc
VerifiedDatabricks Lead - Data Engineering
Own the design and delivery of scalable data engineering solutions on the Databricks platform, driving value across the full data lifecycle. Lead a team of engineers building PySpark, Spark SQL, and Delta Lake pipelines. Collaborate with data architects and stakeholders to shape the lakehouse architecture. This role offers direct ownership of technical strategy and a chance to set standards for data quality and performance.
Nityo Infotech Corporation
VerifiedDatabricks Architect, Data Engineering
You will own the architecture and delivery of Databricks-based data platforms for enterprise clients, defining technical direction across the full project lifecycle. You will design scalable data architectures, lead implementation teams, and drive innovation using Spark, Delta Lake, and cloud-native services. This role sits within a specialized Databricks practice, collaborating with data engineers and solution architects to solve complex data challenges. You will experiment with emerging data technologies and set the standard for best practices in a hands-on, client-facing capacity.
WB Solutions LLC
VerifiedData Tech Lead, Java & Cloud Data Platform
Databricks and streaming data expertise to design, develop, and support scalable cloud data platforms at scale. Lead data pipelines using PySpark and Java streaming technologies and own cloud migration initiatives. Collaborate with cross functional teams, build robust CI/CD with GitLab CI/CD and drive architecture decisions. This role offers a chance to influence data platform strategy and accelerate data driven outcomes.