דרושים » הנדסה » ML Software Engineer, Data Plane

The MLIL DataPlane team is looking for a Senior Software Development Engineer to own the design and implementation of our inference data plane. We build the software that makes large models run efficiently on custom hardware - spanning model execution, memory management, data movement, and serving integration.
Our work covers the full inference path: integrating serving engines with custom hardware, developing high-performance compute kernels, enabling efficient data movement, and driving models from early validation through production. We operate at frontier scale with large distributed models.
This is a ground-up effort with rapidly evolving hardware and software. We need a senior IC who can write and optimize low-level code for custom hardware, validate model architectures end-to-end, build test and profiling infrastructure, and drive performance across the stack.

Key job responsibilities
- Develop and optimize compute kernels for a custom ML accelerator architecture, targeting production-level performance for large language model inference.
- Implement and validate LLM architectures (decoder-only, mixture-of-experts) end-to-end - from PyTorch model definition through distributed execution on custom hardware.
- Integrate custom accelerator backends into open-source ML serving frameworks (vLLM, PyTorch), including scheduler extensions, memory management, and model parallelism.
- Build and maintain test infrastructure for model correctness validation across CPU, GPU, simulator, and hardware targets.
- Profile and optimize inference workloads - identify bottlenecks, instrument critical paths, and drive latency and throughput improvements from simulation through hardware bringup.
- Own features end-to-end: from design through implementation, testing, and integration into the broader software stack.
- Contribute to CI/CD pipelines that gate model and kernel changes on correctness and performance regressions.
- Mentor engineers, drive design reviews, and raise the engineering bar across the team.

At our company, we redefine cyber defense vision by combining AI and human expertise to create products that protect nations and critical infrastructure. This is more than a job; its a Dream job. we are where we tackle real-world challenges, redefine AI and security, and make the digital world safer. Lets build something extraordinary together.
our company's AI cybersecurity platform applies a new, out-of-the-ordinary, multi-layered approach, covering endless and evolving security challenges across the entire infrastructure of the most critical and sensitive networks. Built as part of a broader sovereign AI platform, our technology is designed to operate in on-premise, private cloud, and air-gapped environments, enabling nations to maintain full control over their data, infrastructure, and AI capabilities. Central to our company's proprietary Cyber Language Models are innovative technologies that provide contextual intelligence for the future of cybersecurity.
At our company, our talented team, driven by passion, expertise, and innovative minds, inspires us daily. We are not just dreamers, we are dream-makers.
Responsibilities
Build and operate ML training infrastructure - distributed training pipelines, compute scheduling, and reproducible experiment workflows that data scientists rely on daily.
Own model serving and inference systems - packaging, deployment, autoscaling, A/B testing, canary rollouts, and latency/cost optimization for production models.
Run feature stores, model registries, and dataset versioning - enabling self-serve feature engineering, model lineage, and reproducible experiments across teams.
Build experiment tracking and evaluation infrastructure - automated evals, comparison dashboards, drift detection, and monitoring that give teams visibility into model behavior and performance.
Build and maintain production pipelines for training, fine-tuning workflows, and serving domain models - owning reliability, reproducibility, and scale.
Build and maintain the monitoring and observability layer - model performance tracking, data and prediction drift detection, data quality validation, and alerting.
Improve performance and cost across the ML stack - training throughput, inference latency, batch vs. real-time tradeoffs, and compute cost management.
Ship shared tooling - libraries, templates, CI/CD for models, IaC, and runbooks - while collaborating across Data Platform, AI, Data Science, Engineering, and DevOps. Own architecture, documentation, and operations end-to-end.

We are seeking an AI Networking Architect to join the Networking Research Group. This role will help bridge the gap between emerging tasks supported by advanced technologies and the data center infrastructure that powers them. In this role, you will work at the intersection of AI applications, distributed systems, networking hardware, and software architecture.

You will join a focused team of multidisciplinary engineers driving AI workload optimization through deep application understanding, network analysis, and end-to-end systems thinking. Your insights will directly shape our products across the full stack - from applications and software libraries to hardware architecture and physical design.


What Youll Be Doing:

Model the performance of complex AI workloads to identify bottlenecks and recommend system-level optimizations.

Analyze brand-new AI models, distributed training techniques, and inference workloads to understand their infrastructure requirements.

Build Platforms, simulations and HW platforms, execute AI workloads and build analytical tools to evaluate trade-offs across compute, memory, storage, and network behavior.

Translate research insights and workload behavior into actionable software, hardware, and networking architecture requirements.

Partner with architecture, software, and product teams to influence future NVIDIA networking and AI infrastructure roadmaps.

Drive architectural innovation by applying deep workload analysis to real-world advanced machine learning frameworks.

At our company, we redefine cyber defense vision by combining AI and human expertise to create products that protect nations and critical infrastructure. This is more than a job; its a Dream job. we are where we tackle real-world challenges, redefine AI and security, and make the digital world safer. Lets build something extraordinary together.
our company's AI cybersecurity platform applies a new, out-of-the-ordinary, multi-layered approach, covering endless and evolving security challenges across the entire infrastructure of the most critical and sensitive networks. Built as part of a broader sovereign AI platform, our technology is designed to operate in on-premise, private cloud, and air-gapped environments, enabling nations to maintain full control over their data, infrastructure, and AI capabilities. Central to our company's proprietary Cyber Language Models are innovative technologies that provide contextual intelligence for the future of cybersecurity.
At our company, our talented team, driven by passion, expertise, and innovative minds, inspires us daily. We are not just dreamers, we are dream-makers.
Responsibilities
Set technical direction for the ML platform - training pipelines, model serving, feature stores, experiment tracking, and compute orchestration - through RFCs, prototypes, design reviews, and build-vs-buy decisions
Lead and grow a team of ML Engineers - hire, mentor, pair on hard problems, and raise the bar through code and design reviews
Contribute to critical systems, debug production issues, and maintain deep context on the codebase to inform technical decisions
Own operational excellence for model serving - set and enforce SLAs, run capacity planning, and keep compute costs predictable
Establish ML engineering standards - reproducible experiments, automated evals, model packaging, CI/CD for models, and observability
Support the full lifecycle of our company's models - from training on domain-specific data to low-latency inference powering production systems
Work closely with Data Platform, AI, Data Science, and Product teams - translate business priorities into engineering work and manage cross-team dependencies
Measure and improve developer experience - deploy friction, onboarding time, CI turnaround - as seriously as model performance.

In this role you'll design and build features that shape how customers discover products - tailored to their preferences, helping them find exactly what they need, even before they know they need it. We're defining how LLMs integrate into real-time personalization, how noisy behavioral signals become durable customer understanding, and how AI-powered experiences ship reliably at scale. You'll work across multiple technical teams, ship iteratively, and see your work in the hands of customers quickly. This organization values experimentation, moves fast, and gives engineers real ownership over what they build.

We are looking for a Senior Software Development Engineer who leads through technical depth and sound judgment. Someone who owns team-level architecture, provides system-wide design guidance, and brings perspective on both current and future technology choices. You take on customer problems where the technological strategy is not yet defined, and you drive productive discussions to align teams on the best path forward. You dont just deliver high-quality software yourself - you set the standard that others follow. You actively mentor multiple engineers, drive adoption of engineering best practices, and ensure your team has strong operational foundations. You make the team permanently stronger, not dependent on your presence. When the right solution isnt technical - when its a process change, a culture shift, or a staffing decision - you recognize that and act accordingly.

Key job responsibilities
- Own team architecture of personalized recommendation system operating in our scale.
- Lead the design and delivery of cross-teams projects end-to-end, with focus on maintainability, scalability, performance, and reliability.
- Collaborate with Product and Science to define technical roadmap and experiences based on data.
- Build AI-powered experiences including personalized recommendations, relevance explanations, and knowledge-driven features using LLMs and generative AI.
- Define and drive measurement strategies including analytics events and experiment configurations to track business and technical metrics.
- Create clarity from ambiguity and make sound technical decisions in a problem space where established patterns don't apply.
- Drive adoption of engineering best practices through exemplary personal coding practices.
- Proactively simplify existing systems and resolve endemic, root-cause problems.

We are seeking an experienced engineer to join our team that owns the network stack for EC2 distributed AI/ML systems. The team develops support for a variety of frameworks and communication libraries including NCCL, NVSHMEM, NIXL, NCCL GIN, and Perplexity kernels. Solid knowledge of Linux, networking, and performant coding is important. Experience with embedded systems is valued, and experience with high-speed networking or HPC/RDMA interconnects is highly valued.

If you like solving hard problems, want to work with HPC and ML customers, iterate fast and deliver meaningful solutions at scale, then come join us! This truly is a role at the forefront of AI/ML-you'll be working on features for the largest clusters, with the largest customers, for the largest AI models.

Key job responsibilities
Be a senior engineer on a team that builds and maintains the infrastructure that monitors and reports on functionality and performance of massive testing workloads run at scale. Use our internal CI/CD tools, Linux, and public AWS products to automate the delivery of our software to customers, saving developer time. Write Python code that effortlessly spools up large clusters and runs benchmarks and applications for ML and HPC workloads. Use AWS Managed Grafana and Athena to digest the massive amount of performance data generated by these workloads and create dashboards for developers and stakeholders. Invent automatic mechanisms to alert developers to functional and performance regressions so they never reach reach customers. Manage the complexity of infrastructure that covers many instance types, software stacks, Linux operating systems, cutting-edge releases and make it easy to evolve.

We're looking for a Senior Data Scientist to join the AI cybersecurity team in the Security and Networking Architecture group. As a Senior Data Scientist youll have the opportunity to take an active part in the research and development of our world-class networking and data center security products. This role involves creative problem solving alongside engineering teams, and is key for the continued success of AI networking security.

What youll be doing:

Developing agentic AI systems for security, combining generative models, RAG, and tool-augmented reasoning to automate threat analysis and response workflows.

Optimizing and fine-tuning models for performance, scalability, and resource utilization, considering factors such as latency, efficiency, and cost.

Developing, implementing and improving models and algorithms across media types, whether time series, images, text, audio or video.

Leveraging data pipelines to efficiently process and transform large volumes of data for training and inference purposes.

Applying alignment techniques and parameter efficient fine-tuning to improve model performance.

Measuring and benchmarking model and application performance to drive improvements.

Driving the gathering, building, and annotation of domain specific datasets for benchmarking and training.

Collaborating closely with software and hardware engineers on new features and improvements. Participate in developing and reviewing code, design documents, use case reviews, and test plan reviews.

We're looking for a Senior AI Infrastructure Engineer to join a group that specializes in Security and Networking, and specifically ML/AI, MLOps, and agentic AI development. As a Senior AI Infrastructure Engineer, youll build and maintain the infrastructure, tools and processes necessary to support the AI lifecycle in a production environment. You will collaborate closely with data scientists, software engineers, and security architects to ensure smooth development, deployment, evaluation, and optimization of AI pipelines, models, and agents. This role requires a balance of high-level engineering rigor and a collaborative spirit; youll be a technical anchor and a supportive peer for teams across the organization.



What youll be doing:

Architecting, developing and optimizing scalable infrastructure for deploying security and networking AI models and agents in production.

Managing ML/agentic workflows to ensure performance, high availability, resource efficiency, and cost-effectiveness.

Designing and implementing pipelines and frameworks for AI training, inference, and experimentation.

Partnering with data scientists and security architects to operationalize AI agents, including packaging and integration with existing systems. This includes contributing to and reviewing code, design documents, and test plans.

Partnering with DevOps teams to integrate pipelines and workflows into CI/CD processes, ensuring reliable deployments and rollbacks.

Building proactive monitoring systems to identify issues in quality and infrastructure before they impact production.

Implementing access controls, authentication mechanisms, and encryption standards to keep our AI models and data secure.

Documenting guidelines and leading knowledge-sharing sessions to elevate the teams collective development expertise.

You'll design and build features that shape how hundreds of millions of customers discover products. The problems here are genuinely novel - we're defining how LLMs integrate into real-time recommendation experiences, not applying established playbooks. You'll work across multiple technical teams, ship iteratively, and see your work in the hands of customers quickly. This team values experimentation, moves fast, and gives engineers real ownership over what they build.

We are looking for a Software Development Engineer with sound technical judgment and a bias for action who takes ownership of problems end to end, communicates clearly, and cares about operational excellence, not just launching features, but making sure they hold up at scale. Someone who naturally raises the bar for the team: mentoring junior developers, advocating for engineering best practices, and thinking beyond the immediate sprint.

Key job responsibilities
- Design, build, test, and operate features for a personalized recommendation system used by multiple teams and operating at our scale.
- Deliver end-to-end solutions with focus on maintainability, scalability, performance, and reliability.
- Collaborate with Product and Science to define experiences, run experiments, and iterate based on data.
- Define and implement measurement strategies including analytics events and experiment configurations to track engagement and retention.
- Navigate ambiguity and make sound technical decisions in a problem space where established patterns don't always apply.

we are seeking a Hands-on Architect to design, build, and evolve the core of next-generation AI cybersecurity platform.This is not an ivory-tower role; it is for a builder at heart. You will write code, build functional prototypes, and own critical services from inception to production. This role demands a unique blend of deep, code-level execution with a broad, system-wide architectural vision that spans our entire data, cloud, and AI stack.
Responsibilities:
Rapidly code and build functional proofs of concept (PoCs) and prototypes to explore and validate new architectures, data platforms, data processing frameworks, and GenAI capabilities.
Validate technical feasibility, scalability, and business impact through working software, not just diagrams or documents.
Partner closely with engineering, product and data science teams to translate emerging technologies into production-ready, scalable systems.
Lead architecture design reviews, proactively identify scalability and performance bottlenecks, and embed security principles into the design process from day one.
Serve as a technical leader and mentor, elevating the team's skills through pair programming, in-depth code reviews, and deep-dive sessions on system design and software craftsmanship.