Data Technical Support Engineer, AWS & PySpark
Overview
You will own the technical support lifecycle for AWS-based data platforms at Digital Dhara LLC, ensuring uptime and performance across AWS Glue, Amazon Redshift, and Amazon S3. You will work alongside data engineers and software teams to troubleshoot and optimize distributed data workloads. This role demands deep PySpark and Databricks expertise, with a focus on production stability and root-cause resolution. You will drive incident response and proactive monitoring improvements, making you the bridge between engineering and operations.
What You'll Do8
- 1Debug and resolve production issues in AWS Glue, Amazon Redshift, and Amazon S3 pipelines within the first 90 days.
- 2Support and troubleshoot Databricks jobs, notebooks, workflows, clusters, and runtime environments to minimize downtime.
- 3Optimize PySpark and Spark SQL queries for performance and cost efficiency across distributed data processing.
- 4Drive root-cause analysis for data pipeline failures and implement preventive measures with CloudWatch monitoring.
- 5Collaborate with data engineers to tune IAM policies and access controls for secure data operations.
- 6Build and maintain runbooks and troubleshooting guides for recurring data platform issues.
- 7Scale monitoring and alerting for critical data workloads using Amazon CloudWatch and Databricks metrics.
- 8Lead incident response triage for data platform outages, coordinating with cross-functional teams.
Requirements8
- 15+ years in technical support or data engineering with AWS data services.
- 23+ years hands-on with PySpark and Spark SQL for distributed data processing.
- 33+ years supporting Databricks jobs, notebooks, and clusters in production.
- 4Advanced SQL skills including complex joins, analytical functions, and stored procedures.
- 5Strong experience with AWS Glue, Amazon Redshift, Amazon S3, and IAM.
- 6Proven ability to debug performance issues in distributed data systems.
- 7Experience with CloudWatch for monitoring and alerting.
- 8Excellent communication skills for cross-team collaboration.
Salary Insight
$104 - $125k per year
Location
Required Skills
Similar open positions
Explore active roles that match your skills and interests.
Galactic Minds Inc.
VerifiedTechnical Support Engineer L3 Galactic Minds Inc.
We seek an experienced Technical Support Engineer at the L3 level to provide onsite support for enterprise data engineering platforms. The successful candidate will serve as the primary technical interface at the customer location, own complex production issues through resolution, and coordinate closely with offshore engineering and support teams. This role demands deep expertise in AWS-based data services PySpark AWS Glue Databricks Amazon Redshift SQL
VBest Software Inc
VerifiedData Engineer VBest Software Inc
Own large scale data infrastructure scaling across cloud platforms. Lead development of ETL pipelines using Databricks and Snowflake. Drive performance improvements through advanced analytics and automation. Shape data strategy within a fast paced environment.
TECHNEPTUNE CONSULTING INC
VerifiedData Solution Architect - Expertise in AWS and Data Platforms
Lead ownership of scalable data solutions at Technep Tuning Inc. in San Francisco. Design and deliver enterprise-grade data platforms leveraging advanced cloud technologies. This role focuses on architecting robust data ecosystems that drive business insights and operational efficiency.
Mindsource Inc
VerifiedAWS Data Engineer, ETL & Data Warehousing
A doer who builds and maintains cloud data platforms for enterprise analytics in AWS. Own the full data lifecycle: ingest, transform, and model for reporting and insights. Collaborate with analysts, scientists, and leadership. Python and SQL drive every pipeline. AWS services like S3, Glue, and Redshift form the backbone. In the first year, ship a real-time streaming solution with Kinesis and Lambda. This contract-to-hire role puts you in a data-driven culture where your work directly fuels operational decisions.
BURGEON IT SERVICES LLC
VerifiedSr Technical Lead Data Bricks
Senior Technical Lead responsible for designing and enhancing large scale applications using Python Spark Pyspark on AWS Databricks. Must have realtime experience with Databricks and develop scalable solutions.
P2PSoftTek Inc
VerifiedAWS Support Engineer P2PSoftTek Inc Detroit MI
Own AWS cloud services including Glue RDS S3 Lambda CloudWatch Snowflake. Provide day-to-day operational support and troubleshooting for Snowflake data platform workloads. Support Microsoft SQL Server databases.