Data Analytics Engineer - EXL Service San Francisco
Overview
We seek a skilled Data Analytics Engineer to architect and maintain scalable data pipelines for financial products. This role blends software engineering and data analytics to deliver high-quality data for reporting risk and product teams. The ideal candidate will own end-to-end pipelines while collaborating with cross-functional teams.
What You'll Do9
- 1Design and build scalable ETL/ELT pipelines across cloud and on-prem sources ensuring data quality lineage and auditability
- 2Develop and optimize Python PySpark SQL transformations for large volume financial datasets
- 3Architect and manage orchestration using Airflow Databricks Workflows or Step Functions
- 4Create CI/CD pipelines with GitHub Actions for automated testing deployment and version controlled infrastructure changes
- 5Deploy cloud solutions on AWS S3 Glue EMR Redshift Lambda IAM supporting analytics and ML
- 6Monitor and optimize pipeline performance query efficiency and cost across the data stack
- 7Partner with data scientists and compliance teams to translate business requirements into robust data solutions
- 8Enforce data governance security and regulatory compliance for financial data PII SOX PCI
- 9Document architecture data models and processes contributing to engineering standards and code reviews
Requirements19
- 1Advanced proficiency in Python for scripting automation and data engineering workflows
- 2Strong hands-on experience with PySpark for distributed data processing at scale
- 3Expert-level SQL and advanced techniques including window functions query optimization and complex joins
- 4Solid experience with AWS services such as S3 Glue EMR Redshift Lambda IAM CloudWatch
- 5Proven expertise building and orchestrating pipelines using Airflow Databricks Workflows Step Functions or equivalent
- 6Hands-on CI/CD experience using GitHub or GitHub Actions for automated builds tests and deployments
- 7Deep understanding of ETL ELT design patterns data modeling and data warehousing concepts
- 8Experience deploying infrastructure via code e.g. version controlled deployments
- 9Ability to optimize pipeline performance query execution and cloud resource cost efficiency
- 10Preferred experience with Databricks Delta Lake Unity Catalog notebooks and cluster optimization
- 11Familiarity with Terraform or CloudFormation for infrastructure as code
- 12Exposure to streaming technologies Kafka Kinesis Spark Structured Streaming
- 13Knowledge of data quality testing frameworks Great Expectations Dbt tests
- 14Understanding of financial data domains payments lending risk fraud or accounting
- 15Relevant certifications AWS Certified Data Analytics Solutions Architect Databricks Certified Data Engineer
- 16Bachelor’s degree in computer science engineering data science or related field
- 175+ years of experience in data engineering analytics engineering or related technical role
- 18Prior experience in banking fintech or financial services with regulatory awareness
- 19Track record delivering production grade data pipelines in cloud environments
Salary Insight
$140 - $155k per year
Location
Required Skills
Similar open positions
Explore active roles that match your skills and interests.
Motion Recruitment Partners, LLC
VerifiedSr. Data Engineer, Financial Services Contract
You will own data pipelines and analytics solutions at a top-tier financial institution, serving millions of customers. The team builds high-scale platforms on AWS and Snowflake, with a stack of Python, Spark, and Airflow. You'll work alongside senior engineers and product managers in a hybrid Charlotte office. This role stands out for its long-term contract stability and direct impact on core banking systems.
Guidehouse Digital, LLC
VerifiedSenior Data Engineer, ETL & Cloud Analytics
You will own the design, development, and optimization of scalable data pipelines and cloud-based analytics solutions for mission-critical projects. This role centers on Python, SQL, and Spark to build modern data ecosystems. You will join a multidisciplinary team of architects, analysts, and engineers, collaborating on cloud platforms like AWS and Azure. Your work will directly support analytics, reporting, and operational workloads. This position requires 3+ years of hands-on experience and offers the chance to lead technical efforts in a federal consulting environment.
Expeditors
VerifiedData Engineer III Senior Analytics
Design and build enterprise analytics solutions using Microsoft Fabric and Databricks to drive data-driven decisions across the organization. Lead technical strategy and collaborate with cross-functional teams to create scalable reporting and self-service analytics.
TECHNEPTUNE CONSULTING INC
VerifiedData Solution Architect - Expertise in AWS and Data Platforms
Lead ownership of scalable data solutions at Technep Tuning Inc. in San Francisco. Design and deliver enterprise-grade data platforms leveraging advanced cloud technologies. This role focuses on architecting robust data ecosystems that drive business insights and operational efficiency.
INSPYR Solutions
VerifiedData Engineer, Cloud Data & Analytics
Own the design and delivery of scalable cloud-based data products that power business decisions across the enterprise. Work within a high-performing technology team alongside application teams and Product Owners, building data solutions on Azure and Databricks. This role offers a contract-to-hire path in Dallas, TX, with direct impact on data architecture and analytics outcomes.
Expeditors
VerifiedData Engineer III Senior Analytics
Design and build enterprise analytics solutions using Microsoft Fabric and Databricks to drive data‑driven decisions across the Americas. Lead the creation of scalable data models, semantic layers, and reporting datasets that empower self‑service analytics and executive dashboards. Own the end‑to‑end pipeline from requirement gathering to solution deployment while collaborating with product, architecture, and business teams.