Innovation and Automation Data Engineer Lead (WDP) at Bespoke Technologies Inc.
Overview
Lead a specialized team designing reusable data pipelines and automation frameworks at Bespoke Technologies Inc. Set technical vision while mentoring a team and tackling complex challenges. Own the end-to-end data infrastructure from design to deployment.
What You'll Do8
- 1Lead and mentor a team of automation-focused data engineers responsible for building and maintaining core data infrastructure frameworks
- 2Design and develop standardized reusable ETL/ELT data pipeline templates for ingestion transformation and data product creation
- 3Architect and implement CI/CD for Data strategy enabling automated testing validation and deployment of pipelines
- 4Integrate automated data quality testing and monitoring tools such as Great Expectations directly into core pipeline templates
- 5Develop and maintain IaC modules using Terraform for provisioning common data engineering resources
- 6Collaborate with platform and data engineering teams to identify bottlenecks and engineer automated solutions
- 7Drive innovation by researching prototyping and implementing new technologies to improve data engineering efficiency and reliability
- 8Document data workflows and automation processes to ensure organizational adoption
Requirements10
- 15+ years experience in data engineering focusing on automation and platform development
- 22 years technical leadership or mentorship experience supervising teams or guiding junior engineers
- 3Expert-level skills in Python and SQL
- 4Proven experience building and optimizing data pipelines on Databricks or Snowflake
- 5Hands-on expertise with Infrastructure-as-Code using Terraform and CI/CD tools like GitLab CI or Jenkins
- 6Deep understanding of data architecture data modeling and modern data warehousing concepts
- 7Direct experience with the data platform
- 8Experience with data orchestration tools like Airflow
- 9Familiarity with containerization technologies Docker Kubernetes
- 10Strong project management skills with cross-functional initiative experience
Salary Insight
Salary not disclosed in listing
Location
Required Skills
Similar open positions
Explore active roles that match your skills and interests.
Apex Systems
VerifiedData Engineering Lead, DevOps & Data Platforms
You own the core foundation of the Data Intelligence Platform Enablement Framework, building governance-as-code, infrastructure-as-code, CI/CD automation, and observability. You lead a team of engineers and collaborate with data scientists and analysts to ship a reliable, secure platform. Your work directly enables faster, compliant data product delivery across the organization. This role offers technical leadership and the chance to shape platform standards from day one.
VBest Software Inc
VerifiedData Engineer VBest Software Inc
Own large scale data infrastructure scaling across cloud platforms. Lead development of ETL pipelines using Databricks and Snowflake. Drive performance improvements through advanced analytics and automation. Shape data strategy within a fast paced environment.
TECHNEPTUNE CONSULTING INC
VerifiedData Solution Architect - Expertise in AWS and Data Platforms
Lead ownership of scalable data solutions at Technep Tuning Inc. in San Francisco. Design and deliver enterprise-grade data platforms leveraging advanced cloud technologies. This role focuses on architecting robust data ecosystems that drive business insights and operational efficiency.
Delviom LLC
VerifiedData Engineer, AWS & Python
Data Engineer will own the build of scalable data pipelines on AWS, transforming raw data into analytics-ready assets. You will join a platform team of 6 engineers, working with Python, PySpark, Snowflake, and dbt to unify data for product and business units. This contract role offers direct ownership of cloud infrastructure and data flow, with a focus on Terraform and CI/CD automation. You will bring 5+ years of experience and a track record of shipping production data systems.
Kanshe Infotech
VerifiedSenior Data Engineer Kanshe Infotech Charlotte NC
Design and maintain scalable enterprise data pipelines and analytics solutions. Lead development of robust data infrastructure. Drive optimization of data processing workflows. Ensure high availability and performance of data systems. Shape future data architecture.
MMD Services, Inc
VerifiedSenior Data Engineer MMD Services Cloud Pipeline Specialist
Lead ownership of scalable data infrastructure supporting over one thousand locations. Build robust ETL systems using Spark and Airflow. Drive performance improvements across massive datasets. Shape architecture for future growth. This role impacts enterprise-wide data strategy.