דרושים » הנדסה » Senior Software Research Architect, AI Networking

We are seeking a sharp, innovative, and hands-on Architect to help shape the future of LLM inference at scale. Join our dynamic E2E Architecture group, where we build cutting-edge systems powering the next generation of generative AI workloads. In this role, you will work across software and hardware domains to design and optimize inference infrastructure for large language models running on some of the most advanced GPU clusters in the world.

Youll help define how AI models are deployed and scaled in production, driving decisions on everything from memory orchestration and compute scheduling to inter-node communication and system-level optimizations. This is an opportunity to work with top engineers, researchers, and partners across us and leave a mark on the way generative AI reaches real-world applications.

What Youll Be Doing:

Design and evolve scalable architectures for multi-node LLM inference across GPU clusters.

Develop infrastructure to optimize latency, throughput, and cost-efficiency of serving large models in production.

Collaborate with model, systems, compiler, and networking teams to ensure holistic, high-performance solutions.

Prototype novel approaches to KV cache handling, tensor/pipeline parallel execution, and dynamic batching.

Evaluate and integrate new software and hardware technologies relevant to Core Spectrum-X technologies, such as load balancing, telemetry, congestion control, vertical application integration.

Work closely with internal teams and external partners to translate high-level architecture into reliable, high-performance systems.

Author design documents, internal specs, and technical blog posts and contribute to open-source efforts when appropriate.

We are searching for world-class Scientist Engineers to join our growing software architecture Research team. The ideal candidate will be conducting cutting-edge research at the intersection of Networking, Security, Communications, AI and Distributed GPU computing, and working alongside top experts in these fields. With incredible resources in networking and compute, you will be able to impact, contribute and advance these domains for scalable accelerated computing. Topics include but are not limited to remote direct memory access, hardware offloading and hardware acceleration, distributed accelerator networks, AI for networking and security, storage management, cryptography accelerators and architecture, LLM network traffic optimizations and AI collectives. With its unique open culture, We are one of the best industry labs to do Accelerated Computing research.

What youll be doing:

Enhance our GPU Networking offerings for accelerating AI workloads, such as our Dynamo or our NIXL.

Develop and evaluate new technologies, innovations relevant for scientific, Deep Learning, and data-intensive workloads.

Create proof-of-concept to evaluate and drive such new technologies.

Work on impactful projects involving state-of-the-art high-performance computing software and hardware.

Designing and implementing services, runtime systems, and applications over SDK.

Partner and collaborate with other forward-thinking team members and external researchers.

We are seeking an AI Networking Exploration Architect for our Networking Insights Group to bridge the gap between cutting-edge, hyper-scale AI workloads and the datacenter infrastructure that enables them. You will join a small, focused team of multidisciplinary engineers driving AI workload optimization through deep application understanding and end-to-end systems thinking. Your insights will directly shape our products across the full stackfrom applications and software libraries to hardware architecture and physical design.

What You'll Be Doing:

Model the performance of complex AI workloads to identify bottlenecks and recommend system-level optimizations.

Translate state-of-the-art research into actionable infrastructure, software, and hardware features in partnership with architecture teams.

Rapidly master new AI domains (LLMs, generative models, multimodal systems) and distill key findings for product teams.

Incorporate your deep knowledge of AI applications into our hardware and software roadmaps.

Conduct independent research by formulating hypotheses about workload behavior and validating them through rigorous analysis.

Drive architectural innovation and network optimization by applying your domain expertise to exploratory analysis of real-world Deep Learning (DL) workloads.

We are seeking a highly motivated Senior Deep Learning Researcher to join our team! This is an outstanding opportunity to conduct impactful research and develop the next generation of large language model (LLM) inference algorithms. You will work on technologies that directly enhance our software, making the latest LLMs more efficient and accessible for users worldwide. By joining us, you will be part of a strategic effort to establish us as the definitive platform for high-performance LLM inference. You will engage with skilled problem-solvers and top organizations, crafting AI technology advancements.

What you'll be doing:
Research, invent, and implement groundbreaking algorithms for LLM inference to advance the state of the art in both low-latency and high-throughput scenarios.
Translate research into practical software solutions that directly impact our products and customers.
Collaborate with internal research, engineering, and product teams across the globe to drive the development of sophisticated inference technologies.
Analyze the performance of new algorithms on our latest hardware, identifying bottlenecks and opportunities for algorithmic optimizations.
Partner with leading scientific organizations and industry pioneers to remain at the forefront of technological advancements and integrate the latest innovations into practical applications.

We are seeking a highly motivated Senior Deep Learning Researcher to join our team! This is an outstanding opportunity to conduct impactful research and develop the next generation of large language model (LLM) inference algorithms. You will work on technologies that directly enhance NVIDIA's software, making the latest LLMs more efficient and accessible for users worldwide. By joining us, you will be part of a strategic effort to establish NVIDIA as the definitive platform for high-performance LLM inference. You will engage with skilled problem-solvers at NVIDIA and top organizations, crafting AI technology advancements.

What you'll be doing:
Research, invent, and implement groundbreaking algorithms for LLM inference to advance the state of the art in both low-latency and high-throughput scenarios.
Translate research into practical software solutions that directly impact NVIDIA's products and customers.
Collaborate with internal research, engineering, and product teams across the globe to drive the development of sophisticated inference technologies.
Analyze the performance of new algorithms on NVIDIAs latest hardware, identifying bottlenecks and opportunities for algorithmic optimizations.
Partner with leading scientific organizations and industry pioneers to remain at the forefront of technological advancements and integrate the latest innovations into practical applications.

We are seeking a Technical Marketing Engineer to join our Ethernet Networking team to keep improving our performance leadership in AI. In this pivotal role, you will be the hands-on expert for our Spectrum-X Ethernet platform, showcasing its superiority for emerging AI use cases. You will develop and implement rigorous benchmarks on various GPU clusters, analyzing everything from LLM training to groundbreaking inference workloads. Your primary mission is to translate these performance results into compelling technical content, including white papers, blogs, and presentations, that clearly articulates why our Spectrum-X Ethernet solutions are the definitive choice for modern AI infrastructure.

What you'll be doing:

Design and execute performance benchmarks using industry-standard tools (e.g., MLPerf, UCX, our Collective Communications Library - NCCL and CloudAI) and customer-representative AI workloads on our state-of-the-art GPU clusters.

Translate your benchmark data and technical insights into compelling, high-impact marketing assets and performance-driven sales enablement materials.

Collaborate closely with Product Management, ASIC and Software architecture and Sales teams, provide feedback on product features, and ensure our performance results are technically accurate and impactful.

We are looking for a creative AI/HPC software architecture intern to define the future high performance computing and networks. As a part of the team you will lead research, development, and deployment of innovative solutions in the networking hardware, programming environments, and system software to make future high-end computer systems more performant, scalable, and more usable. Come join the team and see how you can make a lasting impact on the world.

What you will be doing:
Creating prototypes to evaluate and motivate extensions in programming models (CUDA, NCCL, MPI, OpenSHMEM), new designs in runtimes, and new features in the network hardware.
Research, design and implement features for HPC communication middleware and Deep Learning frameworks such as TensorFlow and PyTorch.
Work with hardware architects to define the future hardware relevant for scientific applications, Deep learning, and data-intensive workloads.

We have been transforming computer graphics, PC gaming, and accelerated computing for more than 25 years. Its a unique legacy of innovation thats fueled by great technologyand amazing people. Today, were tapping into the unlimited potential of AI to define the next era of computing. An era in which our GPU acts as the brains of computers, robots, and self-driving cars that can understand the world. Doing whats never been done before takes vision, innovation, and the worlds best talent. Youll be immersed in a diverse, supportive environment where everyone is inspired to do their best work. Come join the team and see how you can make a lasting impact on the world.

We are in need of skilled engineers to join our autonomous driving team to invent, execute, and deploy pioneering end-to-end autonomous driving systems. Our strategy has progressed from AI 1.0 constructing a driver from the ground up to AI 2.0 training an intelligent agent to drive. This is achieved by developing LLMs, VLMs, and VLAs to offer exceptional reasoning, planning capabilities, and interaction with the driving system for autonomous driving and general robotics. Lets innovate the future of autonomytogether!

What you will be doing:

Build and train innovative large-scale modelsincluding generative, imitation, and reinforcement learningto improve the planning and reasoning capabilities of our driving systems.

Explore novel data generation and collection strategies to improve diversity and quality of training datasets. Develop, pre-train, and optimize LLM/VLM/VLA models for autonomous driving and robotics applications.

Collaborate cross-functionally to deploy and integrate AI models into vehicle firmware.

Deliver production-quality, safety-critical software that meets performance, safety, and reliability standards.

We are seeking a highly motivated architect to join our team of experts and take part in shaping the future of high-performance ML / AI computing. Our next-generation Spectrum-X, InfiniBand and NVLink systems will be at the heart of connecting and powering the world's most advanced compute clusters, from supercomputers used in AI research to high-performance clusters used at almost every industry today. As a system/software architect, you will have the opportunity to work on some of the most innovative technology that is currently driving the world forward.

What youll be doing:

Define the next generations of Spectrum-X, InfiniBand and NVLink SW architecture.

Research of various solutions by defining and running POCs, evaluate SW and HW impact and conveying the solution architecture to the relevant teams. The solutions can span over various layers: from algorithms and high level software to firmware and HW.

Collaborate with multi-functional teams, including other architecture teams, VLSI logic design, system software, firmware, and research teams, to ensure the successful execution of the project.

We are seeking a passionate and innovative Senior Software Engineer with expertise in Linux services and internals to join our Cumulus Linux team. Cumulus Linux is a leading open-networking operating system and a cornerstone of the AI Factory the next-generation data center designed to power the training, fine-tuning, and deployment of AI models at scale. As part of the team, you will design and implement core features of Cumulus Linux that enable the worlds most advanced data centers. You will work closely with cross-functional architecture and design teams, shaping the future of our networking technologies while gaining hands-on experience across our hardware and software ecosystem from advanced networking ASICs to large-scale distributed systems.

What you'll be doing:

Lead the development and integration of Cumulus Linux on next-generation our switch platforms.

Design and develop new functionalities, while also maintaining and enhancing existing Linux system services.

Work collaboratively with team members, product managers, architects, QA, and other engineering teams to deliver high-quality solutions.

Innovate and rapidly develop proof-of-concept (POC) prototypes that can evolve into fully developed products or solutions.

Engage closely with customers to understand their challenges, use cases, and deployment strategies, and devise innovative solutions.