דרושים » תוכנה » Senior Machine Learning Engineer- LLMs & Self-Hosted AI

Join our companys AI research group, a cross-functional team of ML engineers, researchers and security experts building the next generation of AI-powered security capabilities. Our mission is to leverage large language models to understand code, configuration, and human language at scale, and to turn this understanding into security AI capabilities which will drive our company AI future security solutions.
We foster a hands-on, research-driven culture where youll work with large-scale data, modern ML infrastructure, and a global product footprint that impacts over 100,000 organizations worldwide.
Key Responsibilities
As a Senior ML Research Engineer, you will be responsible for the end-to-end lifecycle of large language models: from data definition and curation, through training and evaluation, to providing robust models that can be consumed by product and platform teams.
Own training and fine-tuning of LLMs / seq2seq models: Design and execute training pipelines for transformer-based models (encoder-decoder, decoder-only, retrievalaugmented, etc.), and fine-tune open-source LLMs on our company-specific data (security content, logs, incidents, customer interactions).
Apply advanced LLM training techniques such as instruction tuning, preference / contrastive learning, LoRA / PEFT, continual pre-training, and domain adaptation where appropriate.
Work deeply with data: define data strategies with product, research and domain experts; build and maintain data pipelines for collecting, cleaning, de-duplicating and labeling large-scale text, code and semi-structured data; and design synthetic data generation and augmentation pipelines.
Build robust evaluation and experimentation frameworks: define offline metrics for LLM quality (task-specific accuracy, calibration, hallucination rate, safety, latency and cost); implement automated evaluation suites (benchmarks, regression tests, redteaming scenarios); and track model performance over time.
Scale training and inference: use distributed training frameworks (e.g. DeepSpeed, FSDP, tensor/pipeline parallelism) to efficiently train models on multi-GPU / multi-node clusters, and optimize inference performance and cost with techniques such as quantization, distillation and caching.
Collaborate closely with security researchers and data engineers to turn domain knowledge and threat intelligence into high-value training and evaluation data, and to expose your models through well-defined interfaces to downstream product and platform teams.

Required Machine Learning Engineer - AI Coding Agents & LLM Infrastructure
Tel Aviv
Full-time
A bit about us:
We are redefining how software gets built. Trusted by over 1M+ developers, we build AI-first developer experiences powered by state-of-the-art coding agents and code reasoning models. With support for 30+ programming languages and 15+ IDEs, our platform is pushing the limits of LLM-based software engineering - enabling teams to design, write, review, and ship code faster than ever. Were committed to advancing code-native AI models, multi-agent systems, agent orchestration frameworks, memory, and autonomous dev tooling to empower developers at every step of the software lifecycle.
Were growing fast, and our team is passionate about pushing AI engineering to new heights - solving complex problems in LLM training, inference optimization, reasoning, and agent orchestration at scale.
About the Role:
As a Machine Learning Engineer, youll work on cutting-edge
code-focused LLMs and AI agent systems
that power our next-generation developer platform. Youll be at the center of research, model training, and productionization of intelligent systems that understand software deeply, collaborate with developers, and help automate engineering workflows end-to-end. Your work will immediately impact millions of engineers worldwide.
Responsibilities:
Push LLM Innovation: Research, design, and fine-tune domain-specific LLMs for code generation, refactoring, debugging, and multi-turn reasoning.
Agent-Oriented Development: Build multi-agent coding systems that integrate retrieval-augmented generation (RAG), code execution, testing, and tool use to create autonomous, context-aware coding workflows.
Production-Grade AI: Own the training-to-inference pipeline for large code models-optimize inference with quantization, distillation, and caching techniques.
Rapid Experimentation: Prototype and validate ideas quickly; leverage reinforcement learning, human feedback, and synthetic data generation to push accuracy and reasoning.
Cross-Functional Collaboration: Partner with product, engineering, and design teams to ship AI-powered features that help developers focus on high-impact work.
Scale the Platform: Contribute to distributed training, scalable serving systems, and GPU/TPU-efficient architectures for ultra-low-latency developer tools.

We are always looking for exceptional talent to join us on the journey!
We are always looking for exceptional talent to join us on the journey!


Your Mission

As an MLOps Engineer at Nuvei, your mission is to design, build, and operate the platforms that power our machine learning and generative AI products spanning real-time use cases such as large-scale fraud scoring, MCP & agentic workflows support. Youll create reliable CI/CD for models and Agents, robust data/feature pipelines, secure model serving, and comprehensive observability. You will also support our agentic AI ecosystem and Model Context Protocol (MCP) services so that models can safely use tools, data, and actions across .
You will partner closely with Data Scientists, Data/Platform Engineers, Product, and SRE to ensure every model from classic ML to LLM/RAG agents moves from prototype to production with strong reliability, governance, cost efficiency, and measurable business impact.
Responsibilities:
Operate & Develop ML/LLM platforms on Kubernetes + cloud (Azure; AWS/GCP ok) with Docker, Terraform, and other relevant tools
Manage object storage, GPUs, and autoscaling for training & low-latency model serving
Manage cloud environment, networking, service mesh, secrets, and policies to meet PCI-DSS and data-residency requirements
Build end-to-end CI/CD for models/agents/MCP tooling (versioning, tests, approvals)
Deliver real-time fraud/risk scoring & agent signals under strict latency SLOs.
Maintain MCP servers/clients: tool/resource definitions, versioning, quotas, isolation, access controls
Integrate agents with microservices, event streams, and rule engines; provide SLAs, tracing, and on-call runbooks
Measure operational metrics of ML/LLM (latency, throughput, cost, tokens, tool success, safety events)
Enforce governance: RBAC/ABAC, row-level security, encryption, PII/secrets management, audit trails.
Partner with DS on packaging (wheels/conda/containers), feature contracts, and reproducible experiments.
lead incident response and post-mortems.
Drive FinOps: right-sizing, GPU utilization, batching/caching, budget alerts.

At our company, we aren't building a single, generic chatbot. We are building a Composable AI Microservice Architecture, a swarm of hundreds of hyper-specialized AI services, each meticulously "programmed" to solve small, focused tasks with high precision. This fleet powers Ava, our AI support engine, and a suite of cutting-edge generative tools for travel and expense management.
As a Senior AI Ops / MLOps Engineer, you are the architect of the platform that makes this scale possible. You will move beyond traditional MLOps to manage a "factory" of Language Models. Your challenge is one of orchestration and standardization, ensuring that every service in the swarm meets a rigorous bar for quality, reliability, and cost-efficiency.
What You'll Do
Orchestrate the AI Fleet: Build and own the runtime environment for 100+ specialized AI services. Manage model routing, context versioning, and standardized memory/history stores.
High-Density Inference Optimization: Design and implement SageMaker Multi-Model Endpoints (MME) and Inference Components to serve multiple tuned SLMs per GPU, maximizing hardware utilization while minimizing latency.
Deterministic Service Excellence: Treat reliability as a layered engineering problem. Build deterministic "shells" around probabilistic LM outputs, prioritizing data-layer validation and strict serialization.
Automated Evaluation & Observability: Implement "LLM-as-a-judge" patterns and automated benchmarking to detect semantic drift and hallucinations across the fleet before they impact the user.
Standardize the Workflow: Obsess over building reusable patterns and Terraform-based infrastructure that eliminate "snowflake" configurations, allowing us to deploy new specialized AI tasks in minutes.
Agency Strategy: Partner with AI Researchers to find the "Goldilocks zone" for agentic autonomy-balancing the flexibility of LLM tool-use with the precision required for production stability.

we are looking for a Senior Machine Learning Engineer I.
As Senior Machine Learning Engineer, youll work with top notch engineers and data scientists from the team on bringing it to the next level and enabling optimal user experience. The work will focus on building, deploying and serving GenAI capabilities (Agents, Tools and the orchestration between them) using the most advanced technologies and models.
Key Job Responsibilities and Duties:
Deploying machine learning models: Design, develop and deploy in collaboration with scientists, scalable machine learning models and algorithms that provide content related insights and generative AI applications, ensuring scalability, efficiency, and accuracy.
Evaluating possible architecture solutions by taking into account cost, business requirements, emerging technologies, and technology requirements, like latency, throughput, and scale.
Generative AI Development: Contribute to the development of generative models such as GPT (Generative Pre-trained Transformer) variants or similar architectures for creative content generation, Q&A, translation or other innovative applications.
Deployment and integration: Work closely with software engineers to integrate machine learning models into production systems. Ensure seamless deployment and efficient model inference in real-time environments. Collaborate with DevOps to implement effective monitoring and maintenance strategies.
Owning a service end to end by actively monitoring application health and performance, setting and monitoring relevant metrics and acting accordingly when violated.
Maintain clean, scalable code, ensuring reproducibility and easy integration of models into production environments, including CI/CD.
Collaborate with multidisciplinary teams: Collaborate with product managers, data scientists, and analysts to understand business requirements and translate them into machine learning solutions.
20031

we are looking for a Machine Learning Engineer II .
As a Machine Learning Engineer, you will work closely with experienced engineers and ML scientists to build scalable, production-grade GenAI applications. Your work will focus on designing, training, and deploying ML systems leveraging LLMs,, recommendation systems, and agent-based architectures, using state-of-the-art technologies. These solutions will directly power customer-facing experiences and play a key role in shaping the future of AI-driven travel products.
Key Job Responsibilities and Duties:
Deploying machine learning models: Design, develop and deploy in collaboration with scientists, scalable machine learning models and algorithms that provide content related insights and generative AI applications, ensuring scalability, efficiency, and accuracy.
Evaluating possible architecture solutions by taking into account cost, business requirements, emerging technologies, and technology requirements, like latency, throughput, and scale.
Generative AI Development: Contribute to the development of generative models such as GPT (Generative Pre-trained Transformer) variants or similar architectures for creative content generation, Q&A, chatbots, translation or other innovative applications.
Deployment and integration: Work closely with software engineers to integrate machine learning models into production systems. Ensure seamless deployment and efficient model inference in real-time environments. Collaborate with DevOps to implement effective monitoring and maintenance strategies.
Owning a service end to end by actively monitoring application health and performance, setting and monitoring relevant metrics and acting accordingly when violated.
Maintain clean, scalable code, ensuring reproducibility and easy integration of models into production environments, including CI/CD.
Collaborate with multidisciplinary teams: Collaborate with product managers, data scientists, and analysts to understand business requirements and translate them into machine learning solutions.

we are looking for a Data science Team Lead.
As the Data Science Team Lead, you will lead a talented team of data scientists and ML engineers building the infrastructure, systems, and workflows for designing, training, evaluating, and deploying machine learning models that protect millions of users worldwide from fraud and account compromise.
This role combines hands-on technical leadership with people management and strategic ownership. You will drive innovation across real-time model serving, customer-specific model tuning, offline AI evaluations, and scalable ML systems in a production-grade SaaS environment.
If you are passionate about applied machine learning, fraud detection, and building intelligent systems at scale - we want you on our team.
What youl do:
Lead and mentor a team of Data Scientists and ML Engineers focused on fraud detection and response capabilities.
Build ML infrastructure focused on design, train, evaluate, and optimize machine learning models for real-time fraud prevention and risk assessment.
Own the lifecycle of ML models in production, including experimentation, deployment, monitoring, retraining, and performance optimization.
Drive customer-specific model training and tuning strategies to improve accuracy and adaptability across different customer environments.
Build and improve offline AI evaluation frameworks to measure model quality, drift, effectiveness, and business impact.
Collaborate closely with Engineering, Product, Security, and Data teams to deliver scalable and reliable AI-powered capabilities.
Define best practices for model serving, feature engineering, experimentation, observability, and operational excellence.
Balance model performance, latency, scalability, explainability, and operational constraints in high-scale production environments.
Promote a culture of technical excellence, continuous improvement, ownership, and innovation.

we are looking for a Senior Data Engineer I.
As a Senior Data Engineer, youll collaborate with top-notch engineers and data scientists to elevate our platform to the next level and deliver exceptional user experiences. Your primary focus will be on the data engineering aspects-ensuring the seamless flow of high-quality, relevant data to train and optimize content models, including GenAI foundation models, supervised fine-tuning, and more.
Youll work closely with teams across the company to ensure the availability of high-quality data from ML platforms, powering decisions across all departments. With access to petabytes of data through MySQL, Snowflake, Cassandra, S3, and other platforms, your challenge will be to ensure that this data is applied even more effectively to support business decisions, train and monitor ML models and improve our products.
Key Job Responsibilities and Duties:
Rapidly developing next-generation scalable, flexible, and high-performance data pipelines.
Dealing with massive textual sources to train GenAI foundation models.
Solving issues with data and data pipelines, prioritizing based on customer impact.
End-to-end ownership of data quality in our core datasets and data pipelines.
Experimenting with new tools and technologies to meet business requirements regarding performance, scaling, and data quality.
Providing tools that improve Data Quality company-wide, specifically for ML scientists.
Providing self-organizing tools that help the analytics community discover data, assess quality, explore usage, and find peers with relevant expertise.
Acting as an intermediary for problems, with both technical and non-technical audiences.
Promote and drive impactful and innovative engineering solutions
Technical, behavioral and interpersonal competence advancement via on-the-job opportunities, experimental projects, hackathons, conferences, and active community participation
Collaborate with multidisciplinary teams: Collaborate with product managers, data scientists, and analysts to understand business requirements and translate them into machine learning solutions. Provide technical guidance and mentorship to junior team members.
21679

Are you an AI Analyst ready to translate raw model output into a reliable, high-quality production system? Do you excel at the craft of Prompt Engineering and thrive on the challenge of ensuring Generative AI output meets rigorous quality standards in mission-critical applications? Join our R&D Operations Team. You will be the AI analyst responsible for the end-to-end quality, performance, and operational tuning of our Generative AI-driven support system (Co-Pilot). Your mission is to actively shape the model's intelligence, govern the data it uses, and implement the mechanisms that guarantee its accuracy, directly accelerating our customer support engineering velocity.
Key Responsibilities
Support & Customer Advocacy: Champion the Support Journey in Engineering. Develop in-product support instructions that reflect and address real incoming cases, enhancing the quality and effectiveness of AI feature solutions.
Model Quality Validation: Use existing evaluation platforms and methodologies to validate production models. Monitor quality metrics to continuously assess and rank AI answers for accuracy and reliability.
Prompt Engineering & CT Loop: Drive the Continuous Training loop through systematic prompt engineering (refining and versioning inputs). Analyze failures to define R&D actions or features needed to close model performance gaps.
AI Knowledge Governance: Act as AI Content Governor, implementing controls to verify and ingest compliant knowledge base content, ensuring a quality data source.
Cross-Functional SME: Serve as the AI Support Co-pilot Subject Matter Expert, partnering with R&D and Support Enablement to translate quality issues into core model logic improvements and feature development.

Were looking for driven and talented people like you to join our R&D team and our mission to change the future of cloud security. Ready to dive in and swim with our pod?
As a Senior Software Engineer - AI , youll design, build, and own production grade AI agents that operate at the core of cloud security platform. Youll work on distributed, cloud native services that embed agentic AI workflows into existing microservices architecture.
This role goes beyond building AI logic: youll be responsible for operating AI systems in production, ensuring they are observable, reliable, and continuously improving through systematic evaluation and data driven iteration.
On a typical day youll:
Design and implement cloud-native, distributed services that power AI-driven security features
Build and maintain agentic AI systems that reason over large-scale cloud security data and interact with multiple internal services
Own AI agents in production, including deployment, monitoring, troubleshooting, and performance optimization
Implement observability for AI systems, including metrics, logging, tracing, and alerting for agent behavior, quality, latency, and cost
Develop continuous evaluation pipelines for agentic solutions, including offline testing, regression detection, and production feedback loops
Design and optimize RAG pipelines that operate reliably over high-volume, high-variance security data
Apply strong software engineering practices: clear APIs, clean abstractions, robust error handling, and scalable data flows
Lead services end to end - from design and implementation to deployment and long-term operation
Collaborate closely with Data Platform, Product, and Security Research teams to ensure AI behavior is correct, explainable, and trustworthy