דרושים » AI » Senior AI Ops / MLOps Engineer

We are looking for a highly skilled Senior Machine Learning Engineer to lead our transition from on-demand, third-party LLM APIs to a fully self-hosted, scalable model ecosystem.
Our core product is an advanced, agentic support chatbot capable of complex reasoning, API tool calling, database lookups, and orchestrating specialized Small Language Models (SLMs) for targeted NLP tasks. As we scale, our current deployment infrastructure (AWS SageMaker) is becoming unsustainable. You will be responsible for architecting, deploying, and optimizing an infrastructure capable of supporting 50 to 100 distinct models ranging from 100M to 70B parameters.
What Youll Do:
Inference Optimization: Deploy and manage large-scale models using high-performance inference engines (like vLLM) to ensure low latency and high throughput for our agentic chatbot.
Agentic Workflows: Develop and refine the chatbot's agentic capabilities, ensuring reliable tool-use, routing, and interactions between massive LLMs and specialized SLMs.
Model Fine-Tuning: Design and execute fine-tuning strategies to improve model accuracy on specific domain tasks and tool-calling execution.
Rigorous Evaluation: Build comprehensive offline and online evaluation frameworks to constantly measure model performance and business impact through structured A/B testing.

Join our companys AI research group, a cross-functional team of ML engineers, researchers and security experts building the next generation of AI-powered security capabilities. Our mission is to leverage large language models to understand code, configuration, and human language at scale, and to turn this understanding into security AI capabilities which will drive our company AI future security solutions.
We foster a hands-on, research-driven culture where youll work with large-scale data, modern ML infrastructure, and a global product footprint that impacts over 100,000 organizations worldwide.
Key Responsibilities
As a Senior ML Research Engineer, you will be responsible for the end-to-end lifecycle of large language models: from data definition and curation, through training and evaluation, to providing robust models that can be consumed by product and platform teams.
Own training and fine-tuning of LLMs / seq2seq models: Design and execute training pipelines for transformer-based models (encoder-decoder, decoder-only, retrievalaugmented, etc.), and fine-tune open-source LLMs on our company-specific data (security content, logs, incidents, customer interactions).
Apply advanced LLM training techniques such as instruction tuning, preference / contrastive learning, LoRA / PEFT, continual pre-training, and domain adaptation where appropriate.
Work deeply with data: define data strategies with product, research and domain experts; build and maintain data pipelines for collecting, cleaning, de-duplicating and labeling large-scale text, code and semi-structured data; and design synthetic data generation and augmentation pipelines.
Build robust evaluation and experimentation frameworks: define offline metrics for LLM quality (task-specific accuracy, calibration, hallucination rate, safety, latency and cost); implement automated evaluation suites (benchmarks, regression tests, redteaming scenarios); and track model performance over time.
Scale training and inference: use distributed training frameworks (e.g. DeepSpeed, FSDP, tensor/pipeline parallelism) to efficiently train models on multi-GPU / multi-node clusters, and optimize inference performance and cost with techniques such as quantization, distillation and caching.
Collaborate closely with security researchers and data engineers to turn domain knowledge and threat intelligence into high-value training and evaluation data, and to expose your models through well-defined interfaces to downstream product and platform teams.

We're looking for an AI Engineer who is equal parts builder, enabler, and visionary.
This is a rare opportunity to join a small, elite team at the ground floor and have outsized impact on how AI is designed, built, and shipped across a globally recognized cybersecurity platform.
If you thrive at the intersection of cutting-edge AI research and real-world production systems and you want your fingerprints on something that matters - read on.
Why Join Us?
Greenfield opportunity - you're not joining a mature team with fixed patterns, you're helping define them.
Real impact at scale - your work will influence products used by thousands of organizations worldwide.
A team of great people - small, senior, and genuinely collaborative.
Freedom to innovate - we encourage bold ideas, fast experiments, and honest feedback.
our company's AI moment - AI is a company-wide strategic priority, and this group is at the center of it.
*we are an equal opportunity employer committed to diversity and inclusion.
Key Responsibilities
What You'll Do:
Build AI infrastructure - Design and develop the foundational tools, frameworks, and pipelines that power the group's AI capabilities, with a focus on LLMs and Generative AI.
Enable AI across the team - Act as the group's AI enablement engine: establish best practices, create internal tooling, and uplift teammates to work effectively with AI systems.
Own AI agents & agentic workflows - Design, implement, and iterate on autonomous agents and multi-step AI pipelines integrated with a variety of tools and environments.
Bring AI to production - Take models and capabilities from prototype to production-grade systems - reliable, scalable, and observable.
Shape the big picture - Contribute to the group's AI strategy, not just its execution. We want someone who asks "why" before diving into "how."
Stay ahead of the curve - Continuously research and evaluate emerging AI techniques, models, and tools - and bring what's relevant back to the team.
Collaborate and communicate - Write clearly. Think clearly. Work closely with researchers, engineers, and product stakeholders to align on goals and drive outcomes.

Required Al Infrastructure & Reliability Engineer
What this role is really about
Youll join a 3-person platform team within our Business Technology group -owning the internal infrastructure that our AI platform and its users depend on. This isnt a product engineering role, and it isnt ticket work or babysitting pipelines someone else built. Youre building and operating the internal foundation that the company runs on. The work covers the full stack of platform engineering: core cloud infrastructure (AWS, Kubernetes, IaC), CI/CD pipelines, AI-driven infrastructure components, and the SRE and observability practice that keeps it all honest -metrics, alerting, incident response, and reliability standards. As our AI capabilities grow, so does the complexity underneath them, and staying ahead of that is central to the role. If you treat infrastructure as a product -reusable, automated, observable, and built to last -this is your kind of role.
Job responsibilities
DevOps & AI-Driven Infrastructure - own CI/CD, deployment processes, and release reliability. Build and operate cloud infrastructure that is automated, intelligent, and continuously self-improving - not just managed.
Design and build our Terraform repository and IaC pipeline from scratch -AI-assisted generation, drift detection, and policy enforcement built in.
Build AI-driven GitHub Actions pipelines -automated code review, risk assessment, and intelligent deployment decisions.
Manage Kubernetes workloads across AWS accounts -zero downtime, fully automated, nothing left behind.
Embed AI into the operational layer -proactive drift detection, automated remediation, and intelligent scaling toward a self-healing runtime.
Reliability & SRE -improve uptime, resilience, and incident response.
Define and enforce SLOs/SLIs, error budgets, and on-call practices.
Lead incident response, postmortems, and systemic reliability improvements.
Own AI-specific reliability: model latency SLOs, token quota monitoring, rate limit handling, fallback and retry strategies, and cost-per-request alerting.
Observability & Telemetry - increase visibility, reduce noise, improve troubleshooting.
Establish and continuously evolve the observability stack: metrics, logs, distributed tracing, and alerting tuned for both application and AI workloads.
AI / LLM Operations- bringing AI systems to production and operating them at scale, with a focus on reliability, performance, and trust.
Own the AI infrastructure layer: rate limits, quota management, latency SLOs, and fallback strategies (retries, circuit breakers).
Operate LLM APIs in production with resilience and cost attribution per team/model.

Required Machine Learning Engineer - AI Coding Agents & LLM Infrastructure
Tel Aviv
Full-time
A bit about us:
We are redefining how software gets built. Trusted by over 1M+ developers, we build AI-first developer experiences powered by state-of-the-art coding agents and code reasoning models. With support for 30+ programming languages and 15+ IDEs, our platform is pushing the limits of LLM-based software engineering - enabling teams to design, write, review, and ship code faster than ever. Were committed to advancing code-native AI models, multi-agent systems, agent orchestration frameworks, memory, and autonomous dev tooling to empower developers at every step of the software lifecycle.
Were growing fast, and our team is passionate about pushing AI engineering to new heights - solving complex problems in LLM training, inference optimization, reasoning, and agent orchestration at scale.
About the Role:
As a Machine Learning Engineer, youll work on cutting-edge
code-focused LLMs and AI agent systems
that power our next-generation developer platform. Youll be at the center of research, model training, and productionization of intelligent systems that understand software deeply, collaborate with developers, and help automate engineering workflows end-to-end. Your work will immediately impact millions of engineers worldwide.
Responsibilities:
Push LLM Innovation: Research, design, and fine-tune domain-specific LLMs for code generation, refactoring, debugging, and multi-turn reasoning.
Agent-Oriented Development: Build multi-agent coding systems that integrate retrieval-augmented generation (RAG), code execution, testing, and tool use to create autonomous, context-aware coding workflows.
Production-Grade AI: Own the training-to-inference pipeline for large code models-optimize inference with quantization, distillation, and caching techniques.
Rapid Experimentation: Prototype and validate ideas quickly; leverage reinforcement learning, human feedback, and synthetic data generation to push accuracy and reasoning.
Cross-Functional Collaboration: Partner with product, engineering, and design teams to ship AI-powered features that help developers focus on high-impact work.
Scale the Platform: Contribute to distributed training, scalable serving systems, and GPU/TPU-efficient architectures for ultra-low-latency developer tools.

As a Senior or Principal Software Engineer in Cortex Cloud, you will contribute to the development and scaling of cloud-native security solutions for enterprise organizations. This role involves working within an established team to evolve a high-traffic product, with a focus on refining architecture, optimizing the technology stack, and maintaining engineering standards.
Your responsibilities include writing reliable code, influencing product direction, and designing distributed systems. You will be expected to make technical decisions that impact the long-term stability and performance of cloud workload protection services.
AI Integration & Engineering Workflow
A core component of our development process is the use of AI. Rather than basic code completion, we integrate AI assistants as functional components of our workflow. Our team utilizes a multi-agent AI system (IDEX/ProDex) that assists across the development lifecycle: from planning and architecture to code analysis and security reviews.
In this role, you will:
Work with AI Tools:Utilize platforms such asGemini, Claude, and Cursorfor tasks beyond code generation, including root-cause analysis, system design reviews, and architectural assessment.
Develop AI-Augmented Workflows:Help refine how AI is integrated into the SDLC, including the orchestration of agents and the development of internal tools that extend AI capabilities across our codebase.
Maintain Quality Standards:While AI assists in increasing velocity, you are responsible for the technical output. This includes critical review of all generated code and ensuring that AI-assisted work aligns with our architectural requirements and security benchmarks.
Interact with Specialized Agents:Coordinate with AI agents (Product, Architecture, Security) that operate on shared context to assist in managing complex engineering tasks.
We are looking for engineers who are interested in leveraging AI as a technical tool to manage complexity and who want to contribute to the practical application of human-AI collaboration in a cloud environment.

The Vision
We believe that Software Engineering is the highest-leverage human workflow in the company. In an AI-native world, the bottleneck is no longer how fast we can type, but how quickly we can validate, iterate, and deploy. Engineering excellence is our ultimate competitive advantage. As a Senior Software Engineer for AI Assisted Engineering Support, you will build the "intelligence layer" for our development teams. You aren't just building tools; you are building agents that understand our codebase, our standards, and our intent. Your goal is to move the company toward a "Demo to Prod" reality where AI handles the boilerplate, the testing, and the initial PR generation, leaving humans to focus on architecture and high-level logic.
The Mission: Agentic Engineering
Consistent with our "Human Centric Workflows" philosophy, you will treat LLMs as programmable functions grounded in our specific codebase. You will build the specialized assistants that integrate into our IDEs and CI/CD pipelines to unblock developers, automate reviews, and ensure that "gold-standard" code is the default, not the exception.
What Youll Do:
Build AI Engineering Assistants: Develop and scale the internal agents that assist with code generation, automated refactoring, and documentation.
Enable the "Demo to Prod" Pipeline: Work on the technical implementation of tools that allow for one-shot workflows-moving from a prototype or a spec directly to a production-ready Pull Request.
Deterministic Engineering Evals: Drive quality by prioritizing determinism. You will build the serialization formats and retrieval systems (RAG) that give engineering agents the exact context they need from our repositories to be precise and useful.
Automated Code Stewardship: Create agents that help maintain our "Immune System"-automated drift detection, visual regression testing, and security scanning for AI-assisted contributions.
Systemic Optimization: Implement a culture of rigour. You will run experiments across different models and tools, using engineering-specific benchmarks to ensure our assistants are actually increasing velocity and quality.
Global Collaboration: Partner with the US and Israel-based teams to integrate your assistants into our global developer platform and telemetry frameworks.

As a Senior or Principal Software Engineer in Cortex Cloud, you will contribute to the development and scaling of cloud-native security solutions for enterprise organizations. This role involves working within an established team to evolve a high-traffic product, with a focus on refining architecture, optimizing the technology stack, and maintaining engineering standards.
Your responsibilities include writing reliable code, influencing product direction, and designing distributed systems. You will be expected to make technical decisions that impact the long-term stability and performance of cloud workload protection services.
AI Integration & Engineering Workflow
A core component of our development process is the use of AI. Rather than basic code completion, we integrate AI assistants as functional components of our workflow. Our team utilizes a multi-agent AI system (IDEX/ProDex) that assists across the development lifecycle: from planning and architecture to code analysis and security reviews.
In this role, you will:
Work with AI Tools: Utilize platforms such as Gemini, Claude, and Cursor for tasks beyond code generation, including root-cause analysis, system design reviews, and architectural assessment.
Develop AI-Augmented Workflows: Help refine how AI is integrated into the SDLC, including the orchestration of agents and the development of internal tools that extend AI capabilities across our codebase.
Maintain Quality Standards: While AI assists in increasing velocity, you are responsible for the technical output. This includes critical review of all generated code and ensuring that AI-assisted work aligns with our architectural requirements and security benchmarks.
Interact with Specialized Agents: Coordinate with AI agents (Product, Architecture, Security) that operate on shared context to assist in managing complex engineering tasks.
We are looking for engineers who are interested in leveraging AI as a technical tool to manage complexity and who want to contribute to the practical application of human-AI collaboration in a cloud environment.

We are looking for a Senior AI Engineer to join a strong and dynamic AI Engineering team. We are the focal point for AI initiatives, striving to constantly bring innovation and leverage AI capabilities across all company teams and products.
Today, AI is central to how we operate, across the entire organization. It allows us to move fast and release features at a rapid pace, empowers non-technical Forterians to utilize AI tools for increased efficiency, and provides the backdrop for much of the innovation currently occurring in the company.
If this kind of working environment sounds exciting to you, if you understand that Engineering is about building the most effective and elegant solution within a given set of constraints - consider applying for this position.
Why should you join us?
This is a great opportunity to be at the cutting edge of the AI revolution, helping to shape and build the AI platform for the future. Together, well build infrastructure for autonomous and interactive agents, enact AI guardrails and evaluation frameworks to ensure performance and safety, and implement state-of-the-art
AI and Agentic patterns.
This role presents a unique opportunity to enter the AI domain. For those with some experience in AI infrastructure, it offers the chance to grow within a team that is evolving us from the AI experimentation phase to building and leveraging AI-powered products.
What you will be doing:
Design, build, and maintain reusable AI capabilities - including models, tools, APIs, and platforms that power both internal and customer-facing solutions.
Develop and maintain our internal MCP server that easily and securely exposes our vast data stores to AI agents.
Create and implement robust evaluation frameworks and AI guardrails to safeguard our value and ensure model reliability.
Establish deep expertise and sustainable AI engineering practices.
Promote AI readiness and track adoption across the company to build lasting impact.
Build and optimize RAG (Retrieval-Augmented Generation) systems.
Take full ownership of projects: from gathering requirements from non-technical internal users to development, deployment, and operation.
Act as a consultant and advocate for AI engineering, helping other teams leverage the platforms and tools you build.
Partner with teams across to accelerate AI adoption and productization efforts.