We are building a high-performance inference and fine-tuning platform designed to push foundation models to their hardware limits. Our mission is to maximize throughput, minimise latency, and optimise cost-per-token across tens of thousands of GPUs.



Some directions we are currently working on, and which you can be a part of:

Inference Optimization: Identifying LLM inference bottlenecks to drive production speedups. Squeezing the maximum performance for a wide range of LLM architectures at scale (e.g., GPT-OSS, Kimi K2.5, DeepSeek V3.1/V3.2, GLM-5).
Inference engines support: Implement novel speculative decoding architectures, optimise components of various LLM designs (dense/MoE, autoregressive/parallel), and contribute to open-source inference engines.
Low Precision Training & Inference: Design and productionise low-precision (FP8, NVFP4/MXFP4) training and inference pipelines with measurable gains in throughput and cost-efficiency.

Join our companys AI research group, a cross-functional team of ML engineers, researchers and security experts building the next generation of AI-powered security capabilities. Our mission is to leverage large language models to understand code, configuration, and human language at scale, and to turn this understanding into security AI capabilities which will drive our company AI future security solutions.
We foster a hands-on, research-driven culture where youll work with large-scale data, modern ML infrastructure, and a global product footprint that impacts over 100,000 organizations worldwide.
Key Responsibilities
Your Impact & Responsibilities
As a Senior ML Research Engineer, you will be responsible for the end-to-end lifecycle of large language models: from data definition and curation, through training and evaluation, to providing robust models that can be consumed by product and platform teams.
Own training and fine-tuning of LLMs / seq2seq models: Design and execute training pipelines for transformer-based models (encoder-decoder, decoder-only, retrievalaugmented, etc.), and fine-tune open-source LLMs on our company-specific data (security content, logs, incidents, customer interactions).
Apply advanced LLM training techniques such as instruction tuning, preference / contrastive learning, LoRA / PEFT, continual pre-training, and domain adaptation where appropriate.
Work deeply with data: define data strategies with product, research and domain experts; build and maintain data pipelines for collecting, cleaning, de-duplicating and labeling large-scale text, code and semi-structured data; and design synthetic data generation and augmentation pipelines.
Build robust evaluation and experimentation frameworks: define offline metrics for LLM quality (task-specific accuracy, calibration, hallucination rate, safety, latency and cost); implement automated evaluation suites (benchmarks, regression tests, redteaming scenarios); and track model performance over time.
Scale training and inference: use distributed training frameworks (e.g. DeepSpeed, FSDP, tensor/pipeline parallelism) to efficiently train models on multi-GPU / multi-node clusters, and optimize inference performance and cost with techniques such as quantization, distillation and caching.
Collaborate closely with security researchers and data engineers to turn domain knowledge and threat intelligence into high-value training and evaluation data, and to expose your models through well-defined interfaces to downstream product and platform teams.

We are looking for a Principal MLOps Engineer with a deep focus on ML Platforms and Infrastructure to join our Data & AI group at Cortex Research. Our team is responsible for designing, building, and scaling the foundational MLOps and LLMOps platforms that power both our Data Scientists and Security Researchers. You will architect the high-performance core infrastructure that enables these roles to build, train, and deploy advanced AI systems-ranging from optimized Small Language Models (SLMs) to complex agentic workflows and RAG systems. If you are passionate about building scalable compute platforms and automating the full ML lifecycle to solve complex data and security challenges, we want to hear from you.
Key Responsibilities
Scale Distributed Training: Design and optimize infrastructure for training and fine-tuning LLMs and SLMs, leveraging distributed GPU workloads, efficient clustering, and compute optimization.
Automate the ML Lifecycle: Architect robust, automated pipelines for continuous training (CT) and deployment (CD) of models, ensuring a seamless flow from raw data collection to production environments.
Build Model Infrastructure: Own the serving architecture for LLMs/SLMs, balancing latency, throughput, and GPU utilization under production traffic.
Implement Advanced Monitoring: Establish comprehensive observability systems to monitor live model performance, data drift, and computational metrics, feeding insights back into the automated training loops for continuous improvement.
Collaborative Architecture: Partner closely with data scientists and security researchers to productize complex model architectures and streamline their workflows, while collaborating with our DevOps team to integrate with core cloud infrastructure.

We are seeking a Machine Learning Engineer to join the team that builds the predictive intelligence powering the Hello Heart app. You will own the ML models behind user engagement, cardiovascular risk stratification, and personalized health recommendations - the systems that determine what users see, when they're nudged, and how their health trajectories are shaped.

This role demands both statistical depth and engineering proficiency - you will be expected to take models from research through to deployment, write code built for production, and use AI coding assistants fluently as part of how you get work done.

Responsibilities
Lead end-to-end development of predictive ML models. From data exploration and feature engineering through training, validation, deployment, and ongoing monitoring across engagement and clinical risk domains.
Apply strong statistical foundations to model design, feature selection, uncertainty quantification, and interpretation of results
Write production-grade Python code that is clean, tested, and built for maintainability and scale.
Use AI coding assistants to accelerate development, code review, and documentation without sacrificing quality or rigor.
Partner with product managers, data engineers, and software engineers to translate strategic questions and user behavior patterns into measurable, data-driven solutions.
Research and implement cutting-edge ML techniques spanning supervised and unsupervised learning, causal inference, deep learning, and reinforcement learning to tackle complex healthcare challenges.
Contribute to MLOps infrastructure: model serving, versioning, evaluation pipelines, and monitoring.
Design and interpret A/B tests and other experimental methodologies to measure the impact of models, features, and interventions.

The MLIL DataPlane team is looking for a Software Development Engineer to own the design and implementation of our inference data plane. We build the software that makes large models run efficiently on custom hardware - spanning model execution, memory management, data movement, and serving integration.
Our work covers the full inference path: integrating serving engines with custom hardware, developing high-performance compute kernels, enabling efficient data movement, and driving models from early validation through production. We operate at frontier scale with large distributed models.
This is a ground-up effort with rapidly evolving hardware and software. We need an individual contributor who can write and optimize low-level code for custom hardware, validate model architectures end-to-end, build test and profiling infrastructure, and drive performance across the stack.

Key job responsibilities
- Develop and optimize compute kernels for a custom ML accelerator architecture, targeting production-level performance for large language model inference.
- Implement and validate LLM architectures end-to-end - from PyTorch model definition through distributed execution on custom hardware.
- Integrate custom accelerator backends into open-source ML serving frameworks (vLLM, PyTorch), including scheduler extensions, memory management, and model parallelism.
- Build and maintain test infrastructure for model correctness validation across CPU, GPU, simulator, and hardware targets.
- Profile and optimize inference workloads - identify bottlenecks, instrument critical paths, and drive latency and throughput improvements from simulation through hardware bringup.
- Own features end-to-end: from design through implementation, testing, and integration into the broader software stack.
- Contribute to CI/CD pipelines that gate model and kernel changes on correctness and performance regressions.

We are looking for a Software Development Engineer to own the design and implementation of our inference data plane. We build the software that makes large models run efficiently on custom hardware - spanning model execution, memory management, data movement, and serving integration.
Our work covers the full inference path: integrating serving engines with custom hardware, developing high-performance compute kernels, enabling efficient data movement, and driving models from early validation through production. We operate at frontier scale with large distributed models.
This is a ground-up effort with rapidly evolving hardware and software. We need an individual contributor who can write and optimize low-level code for custom hardware, validate model architectures end-to-end, build test and profiling infrastructure, and drive performance across the stack.

Key job responsibilities
- Develop and optimize compute kernels for a custom ML accelerator architecture, targeting production-level performance for large language model inference.
- Implement and validate LLM architectures end-to-end - from PyTorch model definition through distributed execution on custom hardware.
- Integrate custom accelerator backends into open-source ML serving frameworks (vLLM, PyTorch), including scheduler extensions, memory management, and model parallelism.
- Build and maintain test infrastructure for model correctness validation across CPU, GPU, simulator, and hardware targets.
- Profile and optimize inference workloads - identify bottlenecks, instrument critical paths, and drive latency and throughput improvements from simulation through hardware bringup.
- Own features end-to-end: from design through implementation, testing, and integration into the broader software stack.
- Contribute to CI/CD pipelines that gate model and kernel changes on correctness and performance regressions.

We are seeking a highly motivated Senior Deep Learning Researcher to join our team! This is an outstanding opportunity to conduct impactful research and develop the next generation of large language model (LLM) inference algorithms. You will work on technologies that directly enhance our software, making the latest LLMs more efficient and accessible for users worldwide.

By joining us, you will be part of a strategic effort to establish us as the definitive platform for high-performance LLM inference. You will engage with our skilled problem-solvers and top organizations, crafting AI technology advancements.

What you'll be doing:
Research, invent, and implement groundbreaking algorithms for LLM inference to advance the state of the art in both low-latency and high-throughput scenarios.

Translate research into practical software solutions that directly impact our products and customers.

Collaborate with internal research, engineering, and product teams across the globe to drive the development of advanced inference technologies.

Analyze the performance of new algorithms on our latest hardware, identifying bottlenecks and opportunities for algorithmic optimizations.

Partner with leading scientific organizations and industry pioneers to remain at the forefront of technological advancements and integrate the latest innovations into practical applications.

We are seeking a talented and motivated Data Scientist for a temporary position to support our growing data, analytics, and AI automation needs. This role focuses on turning large volumes of data into models, insights, and intelligent automation - combining classic data science (statistical analysis, feature engineering, machine learning) with the emerging Agentic AI stack (LLMs, MCP, agent orchestration). You will work closely with data engineers and internal teams to prototype and productionise models, build LLM-powered agents and workflows, and support the integration of AI capabilities across the organization.

The ideal candidate is passionate about data and AI, comfortable navigating complex systems, and excited by the opportunity to operationalize AI within a modern enterprise environment. We value curiosity as much as experience: we are looking for someone eager to show what they know, and equally eager to keep learning in a field that moves fast.


Responsibilities
Explore, analyze, and model large volumes of structured and unstructured data in Python, from exploratory analysis and feature engineering through to model validation and communication of results.
Design, train, evaluate, and deploy machine learning models, and monitor their performance, accuracy, and drift in production.
Build and orchestrate Agentic AI solutions - LLM-based agents, RAG pipelines, prompt design, and evaluation frameworks - to automate data quality checks, investigation, and reporting workflows.
Integrate models and agents with internal systems and data sources using MCP servers and clients, and workflow automation platforms such as n8n.
Write efficient and maintainable SQL queries to support analysis, reporting, and data exploration needs.
Collaborate with data engineers to productionise models and agents: reliable data flows, logging, alerting, and performance tuning.
Participate in the development of internal tools and dashboards that make data and AI capabilities accessible across the organization.
Share findings with the team and help evaluate emerging AI tooling as the ecosystem evolves.

As a Machine Learning Engineering Manager, you will lead a team focused on the foundational ML & Data layers to power the ranking & recommendation systems in scope. You will drive the development of robust data & ML pipelines at scale, lead the implementation of the tools for ML scientists to test and productionize advanced ML RecSys solutions.

As a technical manager of Machine Learning Engineers and Data engineers, you should be passionate about technology, keep up to date with recent breakthroughs in the field, define and shape the teams ML and platforms roadmap, and not be afraid to get your hands dirty with code when needed.

You are expected to be the focal point for all technical aspects, make sure your team members deliver on their tasks, and work together with other stakeholders to define and shape the roadmap of our products. You will work independently and will also be responsible for making technical decisions within your team.

When it comes to management, your expertise in handling people will motivate and inspire them to reach outstanding success! You should have experience in developing people. You will mentor and coach your team while working closely with a Product Manager.



Key Job Responsibilities and Duties:

Lead and develop a high-performing team, fostering individual growth and collaboration.

Manage and mentor ML engineers and Data engineers, ensuring their professional development and effectiveness.

Develop scalable ML infrastructure and pipelines for efficient data processing and evaluations deployment.

Evaluate architecture solutions based on cost, business needs, and emerging technologies.

Collaborate closely with software engineers to ensure seamless deployment and model inference.

Monitor application health, set and track relevant metrics, and implement effective maintenance strategies.

Collaborate with stakeholders to translate business requirements into viable ML solutions.

Evaluate and integrate new ML technologies to enhance productivity and performance.

We are looking for a strong Backend Software Engineer to bridge the gap between our Machine Learning research team and our enterprise production systems. You will act as the technical backbone for our ML Scientists - by advising, designing and implementing the production facing features. If you are a backend expert who wants to solve complex system architecture challenges and dive into the world of ML platforms & Agentic LLM pipelines, this is the role for you - An exciting role collaborating with ML science team, data/infra team and DevOps to drive real customer impact.



As a ML Engineer, you will:



Lead ML delivery: transforming research output (code, models, ideas) into robust, scalable, low-latency microservices in production

Help architect e2e solutions to real customer pains ranging from ingestion, integration, ETLs, DB design up to low-latency services

Design, build, and maintain automated workflows for ML models, including auto-trains, benchmarking, testing, performance gating, and production deployment.

Tackle complex backend challenges: optimizing API response times, managing database connectivity and concurrency at scale, balancing accuracys drive for complex questions with the business needs of fast responsiveness by making hard technical trade-offs between customer gains and business costs.

Design and optimize data pipelines and ETL processes, connecting our Snowflake data warehouse to our training environments.

Work within our existing ML infrastructure (Kubeflow, MLflow, KServe) to ensure smooth model lifecycles and performance monitoring.

Collaborate closely with ML Scientists, guiding them on software engineering best practices without slowing down their research.

Monitor and optimize production models for performance, cost efficiency, availability, and observability.