Lead Software Engineer Python Vector Databases AWS
Overview
Design and build the Content Hub vector database and graph database infrastructure for semantic retrieval. Own the indexing pipeline query layer and integration with AI content generation platform. Build and operate embedding pipelines generate embeddings manage chunking strategies and handle index refresh as content evolves. Lead a portfolio of diverse technology projects and a team of developers with deep experience in distributed microservices and full stack systems to create solutions that help meet regulatory needs.
What You'll Do7
- 1Design and build the Content Hub vector database and graph database infrastructure for semantic retrieval
- 2Own the indexing pipeline query layer and integration with AI content generation platform
- 3Build and operate embedding pipelines generate embeddings manage chunking strategies and handle index refresh as content evolves
- 4Own embedding model selection and refresh strategy evaluate tradeoffs between embedding model quality and operational cost design refresh pipelines that keep the index current as the underlying content corpora changes
- 5Lead a portfolio of diverse technology projects and a team of developers with deep experience in distributed microservices and full stack systems to create solutions that help meet regulatory needs
- 6Collaborate with digital product managers deliver robust cloud-based solutions that drive powerful experiences to help millions of Americans achieve financial empowerment
- 7Utilize programming languages such as JavaScript Java HTML CSS TypeScript SQL Python and Go Open Source RDBMS and NoSQL databases Container Orchestration services including Docker and Kubernetes and a variety of AWS tools and services
Requirements10
- 1Bachelor’s Degree
- 2At least 4 years of experience in software engineering
- 3At least 1 year experience with cloud computing AWS
- 4Experience with data infrastructure search systems or AI ML engineering
- 5Experience working with vector databases or embedding-based search
- 6Experience with data pipeline engineering ingestion transformation chunking and indexing at scale familiarity with batch and streaming pipeline patterns
- 7Experience with Python for data pipeline and backend service development
- 8Experience with RAG architecture
- 92+ years of experience in Agile practices
- 10Leveraging interactive AI tooling to accelerate productivity utilizing capabilities beyond basic code completion
Salary Insight
Salary not disclosed in listing
Location
Required Skills
Similar open positions
Explore active roles that match your skills and interests.
JPMorganChase
VerifiedSr Lead Software Engineer, Data Engineer
You will own the design and delivery of enterprise data platforms and pipelines for Securities Services Technology, serving millions of transactions. 5+ years of applied experience with Python, Java, and Spark positions you to lead an agile team in building secure, scalable products. You will define architecture, implement semantic layers with Agentic AI, and integrate data across AWS and Databricks. This role stands apart through its focus on agentic metadata mining and semantic modeling, driving firmwide innovation.
Global Digital Resources LLC
VerifiedDigital Program Manager Data Products & AI Center of Excellence
Lead digital program management for Data Products & AI Center of Excellence. Own strategy and execution at scale. Drive cross‑functional teams to deliver innovative solutions. Shape product roadmap and align with business goals.
Finoit Inc.
VerifiedSenior Software Engineer Data Infrastructure
Design and lead development of scalable data pipelines for AI/ML platforms. Own design and implementation of distributed systems using Python and cloud services. Drive improvements in data quality and visualization. Lead cross-functional teams to deliver high-performance solutions.
Finoit Inc.
VerifiedSenior Full Stack AI Engineer Python React AWS
Lead ownership of building and deploying production-grade AI-powered applications. Drive development of scalable web applications and APIs using modern full-stack technologies. Collaborate across teams to design and ship innovative solutions.
Deloitte
VerifiedLead Software Engineer TS/SCI Clearance
Design and lead high‑impact technology platforms for the Deloitte AI & Engineering team. Drive innovation that improves client financial performance accelerates digital ventures and fuels growth. Lead a team of ten developers engineers and data scientists delivering secure mission‑focused solutions.
Compunnel Inc.
VerifiedAWS Data & AI Platform Engineer
Design and build secure scalable AI platforms on AWS for enterprise and regulated environments. Develop generative AI solutions using Amazon Bedrock and deploy models. Operate containerized AI services on Amazon EKS with Python inference and orchestration. Create serverless AI workflows via AWS Lambda API Gateway and event-driven architecture. Ensure secure networking and access controls using VPC and IAM.