דרושים » תוכנה » Senior ML Engineer (Token Factory)

We are building a high-performance inference and fine-tuning platform designed to push foundation models to their hardware limits. Our mission is to maximize throughput, minimise latency, and optimise cost-per-token across tens of thousands of GPUs.



Some directions we are currently working on, and which you can be a part of:

Inference Optimization: Identifying LLM inference bottlenecks to drive production speedups. Squeezing the maximum performance for a wide range of LLM architectures at scale (e.g., GPT-OSS, Kimi K2.5, DeepSeek V3.1/V3.2, GLM-5).
Inference engines support: Implement novel speculative decoding architectures, optimise components of various LLM designs (dense/MoE, autoregressive/parallel), and contribute to open-source inference engines.
Low Precision Training & Inference: Design and productionise low-precision (FP8, NVFP4/MXFP4) training and inference pipelines with measurable gains in throughput and cost-efficiency.

Join our companys AI research group, a cross-functional team of ML engineers, researchers and security experts building the next generation of AI-powered security capabilities. Our mission is to leverage large language models to understand code, configuration, and human language at scale, and to turn this understanding into security AI capabilities which will drive our company AI future security solutions.
We foster a hands-on, research-driven culture where youll work with large-scale data, modern ML infrastructure, and a global product footprint that impacts over 100,000 organizations worldwide.
Key Responsibilities
Your Impact & Responsibilities
As a Senior ML Research Engineer, you will be responsible for the end-to-end lifecycle of large language models: from data definition and curation, through training and evaluation, to providing robust models that can be consumed by product and platform teams.
Own training and fine-tuning of LLMs / seq2seq models: Design and execute training pipelines for transformer-based models (encoder-decoder, decoder-only, retrievalaugmented, etc.), and fine-tune open-source LLMs on our company-specific data (security content, logs, incidents, customer interactions).
Apply advanced LLM training techniques such as instruction tuning, preference / contrastive learning, LoRA / PEFT, continual pre-training, and domain adaptation where appropriate.
Work deeply with data: define data strategies with product, research and domain experts; build and maintain data pipelines for collecting, cleaning, de-duplicating and labeling large-scale text, code and semi-structured data; and design synthetic data generation and augmentation pipelines.
Build robust evaluation and experimentation frameworks: define offline metrics for LLM quality (task-specific accuracy, calibration, hallucination rate, safety, latency and cost); implement automated evaluation suites (benchmarks, regression tests, redteaming scenarios); and track model performance over time.
Scale training and inference: use distributed training frameworks (e.g. DeepSpeed, FSDP, tensor/pipeline parallelism) to efficiently train models on multi-GPU / multi-node clusters, and optimize inference performance and cost with techniques such as quantization, distillation and caching.
Collaborate closely with security researchers and data engineers to turn domain knowledge and threat intelligence into high-value training and evaluation data, and to expose your models through well-defined interfaces to downstream product and platform teams.

We are looking for a Principal MLOps Engineer with a deep focus on ML Platforms and Infrastructure to join our Data & AI group at Cortex Research. Our team is responsible for designing, building, and scaling the foundational MLOps and LLMOps platforms that power both our Data Scientists and Security Researchers. You will architect the high-performance core infrastructure that enables these roles to build, train, and deploy advanced AI systems-ranging from optimized Small Language Models (SLMs) to complex agentic workflows and RAG systems. If you are passionate about building scalable compute platforms and automating the full ML lifecycle to solve complex data and security challenges, we want to hear from you.
Key Responsibilities
Scale Distributed Training: Design and optimize infrastructure for training and fine-tuning LLMs and SLMs, leveraging distributed GPU workloads, efficient clustering, and compute optimization.
Automate the ML Lifecycle: Architect robust, automated pipelines for continuous training (CT) and deployment (CD) of models, ensuring a seamless flow from raw data collection to production environments.
Build Model Infrastructure: Own the serving architecture for LLMs/SLMs, balancing latency, throughput, and GPU utilization under production traffic.
Implement Advanced Monitoring: Establish comprehensive observability systems to monitor live model performance, data drift, and computational metrics, feeding insights back into the automated training loops for continuous improvement.
Collaborative Architecture: Partner closely with data scientists and security researchers to productize complex model architectures and streamline their workflows, while collaborating with our DevOps team to integrate with core cloud infrastructure.

We are currently looking for senior- and staff-level ML engineers to work on research in areas such as:

Guided search and reinforcement learning for agentic systems
Reinforcement learning for reasoning models
Web-scale problem collection for training agents
Efficient model distillation
Some examples of what your responsibilities might include are:

Conducting experiments to figure out efficient ways to train a large language model on traces of interactions with various environments
Exploring methods of guided generation and search in the trajectory space
Coming up with ways to mine relevant data at web scale and figuring out efficient ways to use this data in model post-training
Conducting experiments with different reinforcement learning configurations in verifiable domains
Exploring methods to train AI agents on tasks with non-verifiable reward signals

We are looking for a Principal MLOps Engineer with a deep focus on ML Platforms and Infrastructure to join our Data & AI group at Cortex Research. Our team is responsible for designing, building, and scaling the foundational MLOps and LLMOps platforms that power both our Data Scientists and Security Researchers. You will architect the high-performance core infrastructure that enables these roles to build, train, and deploy advanced AI systems-ranging from optimized Small Language Models (SLMs) to complex agentic workflows and RAG systems. If you are passionate about building scalable compute platforms and automating the full ML lifecycle to solve complex data and security challenges, we want to hear from you.
Key Responsibilities
Scale Distributed Training: Design and optimize infrastructure for training and fine-tuning LLMs and SLMs, leveraging distributed GPU workloads, efficient clustering, and compute optimization.
Automate the ML Lifecycle: Architect robust, automated pipelines for continuous training (CT) and deployment (CD) of models, ensuring a seamless flow from raw data collection to production environments.
Build Model Infrastructure: Own the serving architecture for LLMs/SLMs, balancing latency, throughput, and GPU utilization under production traffic.
Implement Advanced Monitoring: Establish comprehensive observability systems to monitor live model performance, data drift, and computational metrics, feeding insights back into the automated training loops for continuous improvement.
Collaborative Architecture: Partner closely with data scientists and security researchers to productize complex model architectures and streamline their workflows, while collaborating with our DevOps team to integrate with core cloud infrastructure.

We are looking for a Principal MLOps Engineer with a deep focus on ML Platforms and Infrastructure to join our Data & AI group at Cortex Research. Our team is responsible for designing, building, and scaling the foundational MLOps and LLMOps platforms that power both our Data Scientists and Security Researchers. You will architect the high-performance core infrastructure that enables these roles to build, train, and deploy advanced AI systems-ranging from optimized Small Language Models (SLMs) to complex agentic workflows and RAG systems. If you are passionate about building scalable compute platforms and automating the full ML lifecycle to solve complex data and security challenges, we want to hear from you.
Key Responsibilities
Scale Distributed Training: Design and optimize infrastructure for training and fine-tuning LLMs and SLMs, leveraging distributed GPU workloads, efficient clustering, and compute optimization.
Automate the ML Lifecycle: Architect robust, automated pipelines for continuous training (CT) and deployment (CD) of models, ensuring a seamless flow from raw data collection to production environments.
Build Model Infrastructure: Own the serving architecture for LLMs/SLMs, balancing latency, throughput, and GPU utilization under production traffic.
Implement Advanced Monitoring: Establish comprehensive observability systems to monitor live model performance, data drift, and computational metrics, feeding insights back into the automated training loops for continuous improvement.
Collaborative Architecture: Partner closely with data scientists and security researchers to productize complex model architectures and streamline their workflows, while collaborating with our DevOps team to integrate with core cloud infrastructure.

we are looking for a Senior Machine Learning Engineer.
As a Senior Machine Learning Engineer at MyHeritage, you will play a crucial role in developing and implementing machine learning models that drive our products and user experiences. You will have a significant impact on our large and growing user base by leveraging the latest AI technologies to solve challenging problems at scale. This is a unique opportunity to join a forward-thinking team that is passionate about innovation, data, and machine learning.
What youll do:
Design, develop, and deploy machine learning models for various business needs.
Collaborate with cross-functional teams, product managers, and software engineers, to integrate ML solutions into production systems.
Experiment with and iterate on model architectures to improve accuracy, efficiency, and scalability.
Work with large datasets to preprocess, clean, and extract meaningful features for model training.
Utilize MLOps best practices to automate and streamline the development lifecycle of ML models.
Monitor model performance and fine-tune for optimization.
Stay updated with the latest research and advancements in machine learning and AI.

Were looking for a Senior MLOps Engineer to be a core driver in how our product empowers security teams. You will be expected to deeply understand customer needs and translate them directly into product features that deliver real value. You'll own key parts of our frontend stack, drive key architectural decisions, and turn complex security data into clear, actionable business insights.

As we scale our AIDR product and expand deeper into model-driven security intelligence, we are looking for a Senior MLOps Engineer to own the infrastructure, tooling, and operational foundations that power our NLP and LLM training, evaluation, and deployment workflows.

You will architect and operate the systems that enable us to train, fine-tune, deploy, and monitor models at scale making our ML reliable, fast, cost-efficient, and production-ready.

This is a high-visibility, high-impact role where you will partner closely with DevOps, Backend, Data, and Product to establish world-class ML infrastructure from the ground up.

What Youll Do
Build & Scale ML Pipelines
Design, build, and maintain pipelines for training, fine-tuning, evaluating, and deploying NLP and LLM models across GPU and CPU environments.
Establish LLM-Focused CI/CD
Implement automated CI/CD workflows for ML models, including benchmarking, testing, performance gating, and production deployment.
Optimize Runtime & Inference
Select and optimize serving frameworks for low-latency, high-throughput inference, ensuring reliability and scalability.
Own ML Infrastructure
Manage training environments, experiment tracking, model registries, artifact versioning, and distributed training systems.
Operational Excellence
Monitor and optimize production models for performance, cost efficiency, availability, and observability.

We are seeking an MLOps Engineer to help us grow our technical team's capabilities. The ideal candidate has relevant experience in data engineering, preferably within the AI field. Aviation industry experience would be a great addition.

You will be responsible for building and maintaining models and data pipelines that power our data science workflows. You'll play a crucial role in ensuring the accuracy, consistency, and efficiency of the data we use for model training and inference. This involves working with both structured and unstructured data from various sources, leveraging your expertise in data engineering and machine learning to create a robust and scalable system.

We are looking for a highly skilled and visionary Senior Machine Learning Engineer to lead the architecture, design, and deployment of enterprise-grade AI/ML projects on AWS. In this role, you will take full technical ownership of advanced AI initiatives, leveraging both native managed services (such as Amazon SageMaker and Bedrock) and custom-built GenAI models to deliver transformative predictive insights and automation to our customers.

As a Senior ML Engineer, you will bridge the gap between complex data engineering and state-of-the-art data science. You will drive the design of scalable MLOps architectures, optimize high-volume data pipelines, and act as a trusted technical advisor to our clients. You will work closely with solutions architects, project managers, and data scientists, while also mentoring junior and mid-level engineers to elevate the team's technical capabilities.

Responsibilities

Architect and Lead ML Solutions: Spearhead the end-to-end architecture, development, and production deployment of robust Machine Learning models, including advanced predictive analytics, NLP, and Generative AI/RAG systems.
Enterprise MLOps & Automation: Define, design, and implement enterprise-grade MLOps strategies. Establish CI/CD pipelines for ML, automated model training, monitoring, versioning, and governance at scale.
AWS AI/ML Mastery: Architect innovative solutions leveraging AWS AI/ML managed services (e.g., SageMaker, Bedrock) to accelerate time-to-market while ensuring high performance and cost-efficiency.
Advanced Data Engineering: Lead the design of highly scalable infrastructure for extracting, transforming, and loading (ETL) data from diverse sources to support complex ML feature stores and model training.
Unstructured Data & Vector Search: Architect systems for the optimal ingestion, processing, and semantic retrieval of unstructured data (text, images, documents) using Vector Databases (e.g., OpenSearch, Pinecone) and graph-based reasoning.
Strategic Advisory & Collaboration: Act as a trusted AI advisor to external enterprise customers and internal C-level executives. Translate complex business constraints into scalable ML architectures and guide clients through their AI adoption journey.
Technical Leadership & Mentorship: Mentor mid-level and junior engineers, establish coding and architectural best practices, and foster a culture of continuous learning and innovation within the team.