Cloud Infrastructure Engineer, AWS & ML Systems
Overview
You own the AWS foundation and LLM platform at Beacon AI, delivering mission-critical aviation systems. Work with a small team of aviators and engineers to scale infrastructure for RAG and IoT. You design, build, and operate services that power safe, efficient flight. This role offers direct impact on defense and airline partnerships, with no silos.
What You'll Do10
- 1Design and provision AWS infrastructure with CDK or Terraform, building CI/CD with GitHub Actions and CodePipeline.
- 2Stand up model endpoints on Bedrock or SageMaker, choosing ECS/EKS, Lambda, or Batch for inference jobs.
- 3Implement RAG pipelines with ingestion, chunking, and embedding, orchestrating with Step Functions and Airflow.
- 4Operate vector search via OpenSearch Serverless, Aurora PostgreSQL with pgvector, or Pinecone, tuning recall, latency, and cost.
- 5Build eval harnesses for prompts and retrievers, instrumenting telemetry with CloudWatch and OpenTelemetry.
- 6Enforce safety and compliance with PII detection, access controls, and Bedrock Guardrails, maintaining audit trails.
- 7Construct data pipelines for structured and unstructured data using Glue, Lake Formation, and Athena.
- 8Manage edge deployment and communication with secure messaging and over-the-air updates.
- 9Integrate retrieval and LLM chains into user features, providing expert troubleshooting for uptime.
- 10Optimize inference with model selection, quantization, and autoscaling, using Redis for caching.
Requirements8
- 14+ years building cloud infrastructure with AWS and Terraform or CDK.
- 2Experience shipping LLM-powered apps in production, including RAG with LangChain.
- 3Deep knowledge of VPC, IAM, KMS, CloudWatch, S3, ECS/EKS, Lambda, and Step Functions.
- 4Proficiency in Python for building data pipelines and automation.
- 5Hands-on with vector search engines such as OpenSearch or pgvector.
- 6Understanding of security best practices: least privilege, secrets management, and network isolation.
- 7Ability to apply quantitative evals and A/B testing to drive improvements.
- 8Clear communication for aligning with product, security, and engineering teams.
Salary Insight
$135 - $260k per year
Location
Required Skills
Similar open positions
Explore active roles that match your skills and interests.
Hi Marley
VerifiedSr. Software Engineer II DevOps
Lead design and operation of cloud infrastructure on AWS to support core SaaS platform and agentic AI services. Build AI/ML infrastructure and monitoring for LLM-powered services. Establish IaC standards using Terraform. Implement observability beyond availability. Support big data pipelines, warehousing, and analytics. Drive disaster recovery and improve infrastructure parity. Lead architecture reviews and innovate on developer experience. This role differs by focusing on scaling autonomous AI agents in regulated insurance workflows.
Bain & Co.
VerifiedSenior AI/ML Engineer, LLMOps & RAG Systems
You build production inference, serving, and LLMOps infrastructure for Python-based ML systems, taking models from prototype to governed deployment. Bain's Private Equity Group Innovation team creates proprietary data and software products, and your work supports over 1,000 professionals across the investment lifecycle. You collaborate with Data Scientists, Data Engineers, and the Agent/AI squad to deliver reliable, observable ML systems. This hands-on role sets engineering standards and mentors mid-level engineers, with daily use of MLflow, Kubernetes, and Databricks.
Bain & Co.
VerifiedSenior AI/ML Engineer
Senior AI/ML Engineer builds and operates the serving, deployment, and LLMOps infrastructure that carries models, prompts, and retrieval pipelines from prototype to governed production at Bain's Private Equity Group Innovation team. You own the model and prompt lifecycle end-to-end, from packaging and registry to promotion and rollback, and build evaluation harnesses, inference services, and observability that keep production ML measurable and reliable. Partnering with Data Scientists, Data Engineers, and the Agent/AI squad, you set the standard for production ML systems and mentor mid-level engineers. This hands-on role demands deploying, measuring, and operating models and pipelines at scale in a hybrid work environment.
Bain & Co.
VerifiedSenior AI/ML Engineer, LLMOps & Production RAG
You will build and operate the deployment, serving, and LLMOps infrastructure for Bain & Co.'s private equity data products, taking models from prototype to governed production. You own the model and prompt lifecycle end-to-end, including packaging, registry, promotion, staged rollout, and rollback. You partner with Data Scientists on productionizing models and with Data Engineers on feature and embedding pipelines to serve ML and retrieval outputs into agent workflows. This hands-on role sets the standard for production ML systems, with a focus on measurable reliability and operational excellence. You will mentor mid-level engineers and drive incident response, making MLflow, Kubernetes, and AWS your daily toolkit.
Everforth, Cybercoders
VerifiedSenior AI/ML Engineer, LLM & Agent Orchestration
You will design, build, and operate production AI systems that power the intelligence layer for enterprise portfolio management. You'll join a product team shipping LLM-powered features used by 30,000+ customers, including Amazon, Disney, and PayPal. The stack includes Python, Kotlin, TypeScript, and AWS Bedrock with Claude. You'll own the AI components from signal detection to agent orchestration, working alongside domain engineers and product managers. This role stands out for its focus on evaluation-driven development and production discipline rather than research silos.
Compunnel Inc.
VerifiedAWS Data & AI Platform Engineer
Design and build secure scalable AI platforms on AWS for enterprise and regulated environments. Develop generative AI solutions using Amazon Bedrock and deploy models. Operate containerized AI services on Amazon EKS with Python inference and orchestration. Create serverless AI workflows via AWS Lambda API Gateway and event-driven architecture. Ensure secure networking and access controls using VPC and IAM.