4 BMCAP
4 BMCAPVerified Source

Senior Data Engineer Seattle AWS Spark Airflow Python

Onsite · Boston, Massachusetts
Posted August 1, 2026
payroll

Overview

Design and lead scalable data pipelines for enterprise analytics. Own development of ETL processes using Python and Spark. Scale infrastructure on AWS. Drive improvements in data quality and performance. This role differs by focusing on cloud-native architecture and cross-functional leadership.

What You'll Do8

  • 1Build robust ETL pipelines using Python and Spark
  • 2Design and implement scalable data architectures on AWS
  • 3Lead Kubernetes clusters for data processing workloads
  • 4Optimize data workflows using Airflow orchestration
  • 5Ship production-grade solutions within 90 days
  • 6Drive automation and debugging of complex systems
  • 7Collaborate with stakeholders to define technical requirements
  • 8Mentor junior engineers and foster best practices

Requirements5

  • 15+ years building ETL pipelines with Python and Spark
  • 23-5 seasons managing AWS environments
  • 35+ years experience with Kubernetes and Airflow
  • 4Expertise in AWS services and data engineering
  • 5Strong understanding of data pipeline optimization techniques

Salary Insight

Salary not disclosed in listing

Location

Typeonsite
LocationBoston, Massachusetts

Required Skills

pythonawssparkairflowkubernetes
Share:

Similar open positions

Explore active roles that match your skills and interests.

4 BMCAP

4 BMCAP

8d agoBoston, Massachusettspayroll

Senior Data Engineer Seattle AWS Spark Airflow

Design and lead scalable data pipelines for large-scale analytics. Own ETL processes using Python and Spark. Scale infrastructure on AWS. Drive performance improvements. Differentiate by leading cross-functional teams.

Competitive salary
pythonawsspark+2 more

Rivia Mind - Mental Healthcare

14d agoPittsburgh, Pennsylvaniapayroll

Optimize Data Pipeline with Python AWS Spark Airflow

Lead ownership of scalable data infrastructure delivering insights across 5+ years of ETL pipelines using Python Spark Airflow. Drive technical strategy and execution at enterprise scale. Shape culture and mentor team members.

Competitive salary
pythonawsspark+2 more
RightTalents

RightTalents

9h agoNew York, New Yorkpayroll

Senior Data Engineer

Lead design and development of scalable data pipelines. Own end-to-end ETL processes. Drive performance improvements across large datasets. Shape architecture for cloud-native data platforms. Differentiate by delivering production-grade solutions.

Competitive salary
**python****spark****airflow**+2 more
CCS Global Tech

CCS Global Tech

5h agoRaleigh, North Carolinapayroll

AWS Java ETL Developer

Lead development of scalable data processing systems using Python and AWS. Own and ship Spark and Airflow workflows. Drive performance improvements across enterprise data pipelines. Collaborate with cross-functional teams to architect robust solutions. This role offers unique exposure to cloud-native technologies and fast growth.

Competitive salary
sparkairflowkubernetes+2 more
Finoit Inc.

Finoit Inc.

5h agoSan Francisco, Californiapayroll

Senior Software Engineer Data Infrastructure

Design and lead development of scalable data pipelines for AI/ML platforms. Own design and implementation of distributed systems using Python and cloud services. Drive improvements in data quality and visualization. Lead cross-functional teams to deliver high-performance solutions.

180K–270K
PythonAWSGoogle Cloud Platform+3 more
CCS Global Tech

CCS Global Tech

5d agoMinneapolis, Minnesotapayroll

Senior Data Engineer - Python AWS React Kubernetes CPC Card

Design and own scalable data pipelines using Python and AWS. Lead development of React dashboards and implement Kubernetes orchestration. Drive performance improvements and mentor junior engineers. This role offers ownership of critical systems at a fast-growing firm. What you will own includes building robust ETL processes and scaling cloud infrastructure.

Competitive salary
**python****aws****react**+2 more