Data Engineer, AWS OpenSearch
Overview
Build and own the data infrastructure that powers real-time search across the organization. In this role, you will design and maintain scalable data pipelines and OpenSearch clusters that process millions of records daily. You will join a collaborative data team within Incedo Inc, working from Fort Mill, SC in a hybrid setup. This position offers a chance to influence cloud architecture decisions and shape the future of our data platform with AWS services.
What You'll Do8
- 1Design and build data pipelines to feed OpenSearch clusters, ensuring low-latency indexing and search performance.
- 2Develop Python-based ETL jobs to ingest data from RDS, S3, and Kafka into OpenSearch.
- 3Tune OpenSearch mappings, shards, and replicas to optimize query performance.
- 4Build and maintain AWS infrastructure using CloudFormation or Terraform for scalable, reproducible deployments.
- 5Implement monitoring and alerting for pipeline health and data freshness using CloudWatch.
- 6Collaborate with data scientists to define search relevance and indexing strategies.
- 7Write complex SQL queries to validate data quality and support ad-hoc analytics.
- 8Automate deployment of OpenSearch domains across dev, staging, and production environments.
Requirements8
- 15+ years of experience in data engineering, with 3+ years focused on AWS services.
- 2Hands-on experience with AWS OpenSearch (or Elasticsearch) in production environments.
- 3Strong proficiency in Python and SQL for data manipulation and pipeline development.
- 4Experience with streaming data platforms such as Kafka or Kinesis.
- 5Deep understanding of CloudFormation or Terraform for infrastructure-as-code.
- 6Familiarity with OpenSearch performance tuning, cluster sizing, and index strategies.
- 7Ability to design data models for both batch and real-time processing.
- 8Experience working with S3, RDS, and other AWS data services.
Salary Insight
$140 - $160k per year
Similar open positions
Explore active roles that match your skills and interests.
USA 3M Company
VerifiedEnterprise Search Tech Lead
Lead the design development and optimization of 3M’s enterprise search platform to drive scalable high-performance search capabilities supporting digital experiences and emerging AI applications. Own the end-to-end search ecosystem including ingestion pipelines search APIs index architecture and cloud infrastructure while advancing hybrid retrieval approaches combining traditional and semantic search to enable RAG LLM and agentic AI use cases.
Delviom LLC
VerifiedData Engineer, AWS & Python
Data Engineer will own the build of scalable data pipelines on AWS, transforming raw data into analytics-ready assets. You will join a platform team of 6 engineers, working with Python, PySpark, Snowflake, and dbt to unify data for product and business units. This contract role offers direct ownership of cloud infrastructure and data flow, with a focus on Terraform and CI/CD automation. You will bring 5+ years of experience and a track record of shipping production data systems.
Sabio infotech
VerifiedAWS Data Engineer, Streaming & ETL
Design and build AWS-based batch and streaming data pipelines for enterprise-scale systems. Collaborate with data architects and analysts to deliver real-time insights. Own the data quality framework from day one. This role drives mission-critical data reliability across hybrid deployments.
Mindsource Inc
VerifiedAWS Data Engineer, ETL & Data Warehousing
A doer who builds and maintains cloud data platforms for enterprise analytics in AWS. Own the full data lifecycle: ingest, transform, and model for reporting and insights. Collaborate with analysts, scientists, and leadership. Python and SQL drive every pipeline. AWS services like S3, Glue, and Redshift form the backbone. In the first year, ship a real-time streaming solution with Kinesis and Lambda. This contract-to-hire role puts you in a data-driven culture where your work directly fuels operational decisions.
absiusa
VerifiedSEO Specialist for Cloud Analytics Platform
The ideal candidate will own search engine optimization strategies for a cloud analytics platform at scale. This role focuses on driving visibility and traffic growth. The position requires expertise in technical SEO and market analysis. Success is measured by measurable organic reach improvements. This is a hybrid role based in Columbus Ohio.
Inadev
VerifiedSenior Data Engineer, AWS & Database Development
You will design and build the data layer for a high-volume filing platform, owning schemas, queries, and pipelines on AWS data services. You will join a collaborative team of developers and data architects, working onsite in Washington, D.C. with a hybrid schedule. This contract role focuses on performance tuning, data integrity, and security, with AI-assisted tooling accelerating your work. You will make an immediate impact by optimizing Aurora, RDS, and DynamoDB systems.