Principal Data Engineer Spar Information Systems
Overview
Lead architect and engineer enterprise-scale ELT ETL pipelines for finance and cloud solutions. Design scalable data pipelines using Python and AWS. Drive implementation of Spark and Airflow architectures. Own full pipeline lifecycle from ingestion to transformation. Scale data infrastructure to support high volume demands. Differentiate by delivering robust, automated data solutions.
What You'll Do7
- 1Build and maintain ELT ETL pipelines using Python and AWS
- 2Design cloud-native data architectures leveraging Spark and Airflow
- 3Lead development of finance sector data pipelines
- 4Ship and optimize data transformation workflows
- 5Ensure high availability and performance of data systems
- 6Collaborate with cross-functional teams to define data requirements
- 7Monitor and debug pipeline failures in production environments
Requirements6
- 15+ years building ETL pipelines with Spark and Airflow
- 23-5 seasons leading large-scale data engineering projects
- 3AWS Certified cloud architecture expertise
- 4Python proficiency for data processing tasks
- 5SQL knowledge for database interactions
- 6Data orchestration experience with modern tools
Salary Insight
Salary not disclosed in listing
Similar open positions
Explore active roles that match your skills and interests.
Spar Information Systems
VerifiedPrincipal Data & Solutions Architect
Lead design and implementation of revenue data management platform for center of excellence. Own architecture and drive delivery at scale. Shape technology landscape for financial reporting solutions.
4 BMCAP
VerifiedSenior Data Engineer Seattle AWS Spark Airflow Python
Design and lead scalable data pipelines for enterprise analytics. Own development of ETL processes using Python and Spark. Scale infrastructure on AWS. Drive improvements in data quality and performance. This role differs by focusing on cloud-native architecture and cross-functional leadership.
4 BMCAP
VerifiedSenior Data Engineer Seattle AWS Spark Airflow
Design and lead scalable data pipelines for large-scale analytics. Own ETL processes using Python and Spark. Scale infrastructure on AWS. Drive performance improvements. Differentiate by leading cross-functional teams.
Finoit Inc.
VerifiedSenior Software Engineer Data Infrastructure
Design and lead development of scalable data pipelines for AI/ML platforms. Own design and implementation of distributed systems using Python and cloud services. Drive improvements in data quality and visualization. Lead cross-functional teams to deliver high-performance solutions.
MMD Services, Inc
VerifiedSenior Data Engineer MMD Services Cloud Pipeline Specialist
Lead ownership of scalable data infrastructure supporting over one thousand locations. Build robust ETL systems using Spark and Airflow. Drive performance improvements across massive datasets. Shape architecture for future growth. This role impacts enterprise-wide data strategy.
Motion Recruitment Partners, LLC
VerifiedSr. Data Engineer, Financial Services Contract
You will own data pipelines and analytics solutions at a top-tier financial institution, serving millions of customers. The team builds high-scale platforms on AWS and Snowflake, with a stack of Python, Spark, and Airflow. You'll work alongside senior engineers and product managers in a hybrid Charlotte office. This role stands out for its long-term contract stability and direct impact on core banking systems.