Senior data Scientist / ML Engineer - LLMs & Decision Models | Maternity Leave Replacement | 50% Position | Ramat Gan
A leading high-tech company powering large-scale AI agents for thousands of global businesses is looking to optimize LLM usage and cut operational costs without compromising quality.
What youll do:
Phase 1 - Decision Models: Partner with feature teams to identify and replace expensive LLM calls with in-house decision models. Build evaluation datasets and Python benchmarks, analyze failures, define quality criteria, and validate cost savings against production volumes. Guide implementation alongside data scientists and ML serving teams.
Phase 2 - Fine-Tuning: Fine-tune small open-source models for targeted or broad use cases, validating and rolling them out to drive real cost reduction at full quality.
Requirements: What you bring
Hands-on experience fine-tuning open language models, using methods such as supervised fine-tuning, distillation, or LoRA, with PyTorch and Hugging Face.
Strong Python skills and experience designing ML or LLM evaluations and analyzing quality and cost tradeoffs.
Experience collaborating with engineering teams to bring models into production, with an understanding of inference and serving constraints.
Ability to drive work across teams, communicate findings clearly, and identify worthwhile model replacement opportunities.
Nice to Have
Experience with KServe, vLLM, or similar model serving infrastructure is a strong plus.
Experience with classification or decision models built on LLMs, including probability calibration.
The Details
Contract for 6-12 months, about 50% time. Freelancers are welcome.
We are also hiring for a Senior Applied AI Scientist role.
This position is open to all candidates.