Required AI Infrastructure Engineer
Description
We are building its internal AI infrastructure layer from the ground up. We have real agents running in production, a growing base of employees using AI in their daily work, and a clear architectural direction. What we don't have yet is a dedicated engineer to own it.
You'll be the first. Your job is to close the gap between "working prototype" and "production platform" - owning the foundation that hosts our agents, the pipelines that ship them, and the reliability layer (observability, cost controls, audit trails, evals) that makes it safe to run AI at scale in a trust & safety company.
This is an infrastructure-first role with deep AI fluency - not a prompt engineer, not a wrapper-framework operator, not a no-code builder. You should be equally comfortable writing a Terraform module, debugging a Kubernetes pod, and tracing an agent's tool-call chain.
We dont operate with a predefined backlog here; you will be responsible for identifying high-impact needs and bringing them to life. The perfect fit for this role has a track record of deploying agentic systems that have held up under real-world usage, balances a focus on infrastructure with a deep concern for user experience, and recognizes that the primary hurdle in AI integration is rarely the model itself.
Responsibilities:
Platform & Infrastructure:
Architect, build, and run the AWS/Kubernetes platform that hosts our internal AI agents and tools; drive AWS Well-Architected pillars (operational excellence, security, reliability, performance, cost, sustainability).
Own Infrastructure-as-Code: Terraform modules, standards, and reviews for Bedrock, agent runtimes, vector DBs, and supporting services.
AI Systems:
Design and ship production-grade agents and multi-agent pipelines using the Anthropic Agent SDK, Claude Code, AWS Bedrock, and MCP - not wrapper frameworks.
Own the full agent lifecycle: scoping → prototyping → eval → deploy → monitor → iterate.
Integrate agentic workflows into internal and product systems via APIs, databases, webhooks, Slack, and email.
Reliability, Observability, Cost:
Build first-class observability across apps and infra: OpenTelemetry, Prometheus, plus LLM-specific tracing (Langfuse or equivalent), token/cost metrics, and eval pipelines.
Define SLOs/SLIs and error budgets for AI services - latency, model fallback chains, eval regression gates, agent success rates. Lead incident readiness, response, and post-mortems.
Drive FinOps: model routing by cost, cache hit rates, batch vs. realtime tradeoffs, budget alarms, per-team chargeback visibility.
Implement guardrails: prompt-injection defenses, PII redaction, model allowlists, human-in-the-loop checkpoints, audit trails.
Org Impact:
Identify high-leverage workflows across the organization and translate them into scalable agentic automations.
Partner with R&D, Delivery, security, and external vendors to deliver platform capabilities.
דרישות:
Requirements (must-have)
3-5 years in software engineering, shipping and operating production-grade systems.
2+ years hands-on AWS, Kubernetes, and Terraform in production - not familiarity, ownership.
1-2 years hands-on building and deploying LLM-powered or agentic systems in production.
Proficiency in Python: async patterns, REST APIs, cloud-native architecture.
Production experience with native agentic SDKs (Anthropic Agent SDK, Claude Code) and MCP - tool-calling patterns, server configuration, memory systems, vector DBs.
Hands-on AWS Bedrock for model access, IAM-based auth, and enterprise deployment patterns.
Production CI/CD ownership (GitHub Actions, Argo CD, or equivalent) and observability stack experience (OpenTelemetry + Prometheus, plus LLM tracing).
Proven ownership: design → implement → release → operate → improve, independently and within a team.
Strong debugging instincts across multi-step agent chains and distributed המשרה מיועדת לנשים ולגברים כאחד.