דרושים » ניהול ביניים » Principal/Senior ML Platform Engineer (Cortex)

We are looking for a Principal MLOps Engineer with a deep focus on ML Platforms and Infrastructure to join our Data & AI group at Cortex Research. Our team is responsible for designing, building, and scaling the foundational MLOps and LLMOps platforms that power both our Data Scientists and Security Researchers. You will architect the high-performance core infrastructure that enables these roles to build, train, and deploy advanced AI systems-ranging from optimized Small Language Models (SLMs) to complex agentic workflows and RAG systems. If you are passionate about building scalable compute platforms and automating the full ML lifecycle to solve complex data and security challenges, we want to hear from you.
Key Responsibilities
Scale Distributed Training: Design and optimize infrastructure for training and fine-tuning LLMs and SLMs, leveraging distributed GPU workloads, efficient clustering, and compute optimization.
Automate the ML Lifecycle: Architect robust, automated pipelines for continuous training (CT) and deployment (CD) of models, ensuring a seamless flow from raw data collection to production environments.
Build Model Infrastructure: Own the serving architecture for LLMs/SLMs, balancing latency, throughput, and GPU utilization under production traffic.
Implement Advanced Monitoring: Establish comprehensive observability systems to monitor live model performance, data drift, and computational metrics, feeding insights back into the automated training loops for continuous improvement.
Collaborative Architecture: Partner closely with data scientists and security researchers to productize complex model architectures and streamline their workflows, while collaborating with our DevOps team to integrate with core cloud infrastructure.

We are looking for a Principal MLOps Engineer with a deep focus on ML Platforms and Infrastructure to join our Data & AI group at Cortex Research. Our team is responsible for designing, building, and scaling the foundational MLOps and LLMOps platforms that power both our Data Scientists and Security Researchers. You will architect the high-performance core infrastructure that enables these roles to build, train, and deploy advanced AI systems-ranging from optimized Small Language Models (SLMs) to complex agentic workflows and RAG systems. If you are passionate about building scalable compute platforms and automating the full ML lifecycle to solve complex data and security challenges, we want to hear from you.
Key Responsibilities
Scale Distributed Training: Design and optimize infrastructure for training and fine-tuning LLMs and SLMs, leveraging distributed GPU workloads, efficient clustering, and compute optimization.
Automate the ML Lifecycle: Architect robust, automated pipelines for continuous training (CT) and deployment (CD) of models, ensuring a seamless flow from raw data collection to production environments.
Build Model Infrastructure: Own the serving architecture for LLMs/SLMs, balancing latency, throughput, and GPU utilization under production traffic.
Implement Advanced Monitoring: Establish comprehensive observability systems to monitor live model performance, data drift, and computational metrics, feeding insights back into the automated training loops for continuous improvement.
Collaborative Architecture: Partner closely with data scientists and security researchers to productize complex model architectures and streamline their workflows, while collaborating with our DevOps team to integrate with core cloud infrastructure.

We are looking for a strong Backend Software Engineer to bridge the gap between our Machine Learning research team and our enterprise production systems. You will act as the technical backbone for our ML Scientists - by advising, designing and implementing the production facing features. If you are a backend expert who wants to solve complex system architecture challenges and dive into the world of ML platforms & Agentic LLM pipelines, this is the role for you - An exciting role collaborating with ML science team, data/infra team and DevOps to drive real customer impact.



As a ML Engineer, you will:



Lead ML delivery: transforming research output (code, models, ideas) into robust, scalable, low-latency microservices in production

Help architect e2e solutions to real customer pains ranging from ingestion, integration, ETLs, DB design up to low-latency services

Design, build, and maintain automated workflows for ML models, including auto-trains, benchmarking, testing, performance gating, and production deployment.

Tackle complex backend challenges: optimizing API response times, managing database connectivity and concurrency at scale, balancing accuracys drive for complex questions with the business needs of fast responsiveness by making hard technical trade-offs between customer gains and business costs.

Design and optimize data pipelines and ETL processes, connecting our Snowflake data warehouse to our training environments.

Work within our existing ML infrastructure (Kubeflow, MLflow, KServe) to ensure smooth model lifecycles and performance monitoring.

Collaborate closely with ML Scientists, guiding them on software engineering best practices without slowing down their research.

Monitor and optimize production models for performance, cost efficiency, availability, and observability.

We are a well-funded, early-stage startup looking for a talented and motivated Backend Engineer specializing in infrastructure to join our founding team. The focus of this role is to build and scale the infrastructure that powers autonomous AI agents automating complex enterprise workflows. You will own the systems, pipelines, and platforms that let our AI agents run reliably, securely, and at scale in production.

Your Impact
Infrastructure & Platform

Design, build, and own the core infrastructure powering our AI agent platform, from data pipelines to production deployment systems.

Build and scale the backend systems that support high-throughput document processing and data extraction workloads.

Cloud Infrastructure and Scalability

Architect and deploy infrastructure on cloud platforms (AWS, GCP, or Azure) with a focus on scalability, reliability, and cost efficiency.

Own containerization and orchestration (Docker, Kubernetes) for all production workloads.

Build and maintain CI/CD pipelines and DevOps practices that let the team ship fast without breaking things.

Data Infrastructure

Design and manage data pipelines to process and analyze large volumes of documents and unstructured data at scale.

Build the infrastructure layer connecting AI agents to databases, vector stores, and enterprise systems (ERP, CRM).

API & Systems Integration

Build and maintain robust, well-documented APIs connecting AI agents with external systems and enterprise software.

Design for reliability: retries, observability, and graceful degradation across distributed systems.

Security and Compliance

Implement authentication and authorization mechanisms (OAuth2, JWT) to secure AI-driven systems.

Ensure compliance with data privacy standards (e.g. GDPR, HIPAA) and drive best practices for secure data handling across the infrastructure.

Monitoring and Optimization

Build observability and monitoring systems to track infrastructure health, performance, and cost.

Continuously optimize system performance for speed, reliability, and cost-efficiency at scale.

Collaboration

Work closely with AI/ML engineers, product, and the founding team to make sure infrastructure decisions support fast iteration and production-grade reliability.

Participate in code reviews, design discussions, and architecture planning to drive infrastructure strategy.

As a Machine Learning Engineering Manager, you will lead a team focused on the foundational ML & Data layers to power the ranking & recommendation systems in scope. You will drive the development of robust data & ML pipelines at scale, lead the implementation of the tools for ML scientists to test and productionize advanced ML RecSys solutions.

As a technical manager of Machine Learning Engineers and Data engineers, you should be passionate about technology, keep up to date with recent breakthroughs in the field, define and shape the teams ML and platforms roadmap, and not be afraid to get your hands dirty with code when needed.

You are expected to be the focal point for all technical aspects, make sure your team members deliver on their tasks, and work together with other stakeholders to define and shape the roadmap of our products. You will work independently and will also be responsible for making technical decisions within your team.

When it comes to management, your expertise in handling people will motivate and inspire them to reach outstanding success! You should have experience in developing people. You will mentor and coach your team while working closely with a Product Manager.



Key Job Responsibilities and Duties:

Lead and develop a high-performing team, fostering individual growth and collaboration.

Manage and mentor ML engineers and Data engineers, ensuring their professional development and effectiveness.

Develop scalable ML infrastructure and pipelines for efficient data processing and evaluations deployment.

Evaluate architecture solutions based on cost, business needs, and emerging technologies.

Collaborate closely with software engineers to ensure seamless deployment and model inference.

Monitor application health, set and track relevant metrics, and implement effective maintenance strategies.

Collaborate with stakeholders to translate business requirements into viable ML solutions.

Evaluate and integrate new ML technologies to enhance productivity and performance.

We are looking for an MLOps Team Leadto drive the development of an internal machine learning platform for a group of ML teams. This is a hands-on leadership role: you will guide a small team of MLOps engineers that builds the automation and infrastructure powering our research (R&D) workflows and runs our pipelines to production. You will take ownership of end-to-end initiatives and drive the team toward critical infrastructure and model-lifecycle milestones, while staying close enough to the code to set technical direction and raise the bar by example.

You will be responsible for building and maintaining the models and data pipelines behind our data science workflows, ensuring the accuracy, consistency, and efficiency of the data used for training and inference, working across structured and unstructured data from many sources on a large-scale, distributed platform.

Responsibilities:

Lead, mentor, and grow a team of MLOps engineers, owning delivery and technical quality.
Take end-to-end ownership of infrastructure and pipeline initiatives across the LMM group, from design through production.
Stay hands-on: contribute to design and code, review work, and set engineering standards.
Drive the team through critical milestones in ML model-lifecycle and infrastructure ownership.
Partner with R&D and other stakeholders to translate research needs into robust, scalable systems.
Help evolve the platform, including our ongoing migration from Dask to Ray.

We're looking for a Backend Engineer to help build and scale the Machine Learning Platform that powers how our company uses AI across the business. You'll be part of the ML Platform team, designing the infrastructure that lets our data scientists move faster, ship smarter, and operate with confidence in production.
We believe three things matter for every role at our company: drive to push through challenges, efficiency that keeps standards high while moving fast, and adaptability that lets you pivot with data and AI insights. These aren't buzzwords, they're how we actually work. Our AI-first approach isn't just a tagline either. We're building the future of insurance with AI at the center, and we need people who are genuinely excited to learn and grow alongside these tools.
In this role you'll
Design and build the foundational ML platform and AI agents to accelerate data science model delivery across all business units
Architect cloud-native microservices running on Kubernetes, using infrastructure-as-code to automate model deployment and management
Own the end-to-end ML lifecycle, covering training, testing, deployment, and real-time monitoring
Evaluate and choose the right tools and technologies based on workload demands and performance requirements
Collaborate with engineering, data science, and product teams to keep ML projects aligned with business goals
Identify and fix reliability, scalability, and performance gaps before they become problems.

We are looking for a hands-on AI Platform Team Lead to build and lead the team behind this platform: a high-throughput, low-latency engine that runs GPU-based models, from MMBERT-style models to LLMs, together with CPU-based heuristics and security logic.
This is a core infrastructure role for someone who wants to own the runtime layer of AI security at scale: performance, reliability, orchestration, GPU efficiency, and production-grade execution in the traffic path.
The team will also own the model lifecycle required to take AI security algorithms from research to large-scale production, working closely with research and algorithm teams.


Responsibilities
Build and lead Catos AI Platform team: hiring, mentoring, architecture, technical direction, and execution.
Own the AI security runtime platform for high-throughput, low-latency inline security decisions across Catos global cloud and PoPs.
Design the orchestration layer for running GPU models, CPU heuristics, and security logic as one production engine.
Own production readiness: observability, SLOs, autoscaling, reliability, rollout, rollback, and operational health.
Own the model lifecycle platform: registry, versioning, deployment, monitoring, and safe production rollout.
Work closely with research and algorithm teams to productionize AI security models and algorithms at scale.
Define the long-term platform strategy for AI runtime and model serving at Cato.

We're forming a new AI Group and looking for a Senior AI Engineer to help shape it from an early stage - a greenfield, long-term effort to evolve how decisions are made across the platform using AI-driven systems. You won't just integrate APIs or build demos; you'll build the AI brain that works alongside (and increasingly drives) our core automation engine, with real production impact from day one and room to grow into technical leadership as the group scales.

Agentic AI Architecture: Design and build autonomous AI agents that analyze infrastructure in real time and make intelligent decisions. Work with modern agentic frameworks (LangGraph, PydanticAI) and conversational AI to create multi-agent systems - including troubleshooting, optimization, FinOps, and how-to agents. Leverage core LLM capabilities (tool-use, memory, retrieval) to operate safely in production.
Platform Integration & Intelligent Decision Systems: Develop MCPs to expose capabilities to AI agents that reason over infrastructure environments, metrics, configurations, and cost signals. Build integrations with tools like Slack, Jira, and AI-powered IDEs (Cursor, Windsurf) to deliver context-aware insights, from "why is this pod not scheduling?" to "how can we reduce costs by 30% safely?"
AI Model Development & MLOps: Build and deploy machine learning models that learn from infrastructure patterns - detecting the right resource policies for workloads, predicting optimal scaling triggers, and recommending GPU configurations. Own the complete ML pipeline from training to production, ensuring models are reliable, monitored, and continuously improving.
R&D AI Tools Development & Adoption: Build and embed internal AI tools to accelerate engineering, development, research, and support.
AI Tools for Business Impact: Develop AI-powered tools that help Sales and Support teams demonstrate value instantly - agents that analyze customer infrastructure, generate cost optimization reports automatically, and turn technical data into clear business recommendations.
End-to-End Ownership: Own AI systems from concept to production, ensuring they're fast (sub-2-second responses), reliable, safe, and cost-effective. Build evaluation frameworks to measure quality, implement security controls, and balance performance tradeoffs in production.
Technical Leadership: Define AI architecture and best practices as a founding member of the AI team. Make key technical decisions - choosing frameworks, designing multi-agent systems, establishing data governance - and shape how evolves from AI-enhanced internal tools to customer-facing AI products.

Join our company, an innovative startup building a fully-managed LLM-inference platform, that enables data heavy enterprises to perform any AI task at any scale without limits.
We're looking for an Experienced Performance Researcher to join our founding team. Youll be responsible for building and optimizing scalable cloud infrastructure solutions tailored for AI workloads. This role offers a unique opportunity to directly shape our infrastructure strategy, improve system reliability and performance, and contribute to establishing our company as a leader in adaptive AI compute management.
Join us to tackle the magic that make AI tick under the hood and build the backbone powering the AI revolution.
What Youll Do
- Design and build high-performance distributed inference pipelines for LLMs, focused on large-batch, non-real-time scenarios.
- Optimize GPU memory usage, kernel execution, and communication across nodes (NCCL, MPI, etc.).
- Own CUDA kernels, compiler-level tricks, and multi-GPU scheduling logic.
- Lead profiling and performance tuning for throughput, and cost- down to the kernel level.
- Collaborate with infra, product, and research teams to define SLAs, resource allocation logic, and runtime behaviors.
- Help build the core infrastructure that will run LLM workloads across hybrid GPU environments (cloud/on-prem/self-hosted).