דרושים » חשמל ואלקטרוניקה » Senior Deep Learning Researcher, LLM Inference

We are seeking a highly motivated Senior Deep Learning Researcher to join our team! This is an outstanding opportunity to conduct impactful research and develop the next generation of large language model (LLM) inference algorithms. You will work on technologies that directly enhance NVIDIA's software, making the latest LLMs more efficient and accessible for users worldwide. By joining us, you will be part of a strategic effort to establish NVIDIA as the definitive platform for high-performance LLM inference. You will engage with skilled problem-solvers at NVIDIA and top organizations, crafting AI technology advancements.

What you'll be doing:
Research, invent, and implement groundbreaking algorithms for LLM inference to advance the state of the art in both low-latency and high-throughput scenarios.
Translate research into practical software solutions that directly impact NVIDIA's products and customers.
Collaborate with internal research, engineering, and product teams across the globe to drive the development of sophisticated inference technologies.
Analyze the performance of new algorithms on NVIDIAs latest hardware, identifying bottlenecks and opportunities for algorithmic optimizations.
Partner with leading scientific organizations and industry pioneers to remain at the forefront of technological advancements and integrate the latest innovations into practical applications.

We are searching for world-class Scientist Engineers to join our growing software architecture Research team. The ideal candidate will be conducting cutting-edge research at the intersection of Networking, Security, Communications, AI and Distributed GPU computing, and working alongside top experts in these fields. With incredible resources in networking and compute, you will be able to impact, contribute and advance these domains for scalable accelerated computing. Topics include but are not limited to remote direct memory access, hardware offloading and hardware acceleration, distributed accelerator networks, AI for networking and security, storage management, cryptography accelerators and architecture, LLM network traffic optimizations and AI collectives. With its unique open culture, We are one of the best industry labs to do Accelerated Computing research.

What youll be doing:

Enhance our GPU Networking offerings for accelerating AI workloads, such as our Dynamo or our NIXL.

Develop and evaluate new technologies, innovations relevant for scientific, Deep Learning, and data-intensive workloads.

Create proof-of-concept to evaluate and drive such new technologies.

Work on impactful projects involving state-of-the-art high-performance computing software and hardware.

Designing and implementing services, runtime systems, and applications over SDK.

Partner and collaborate with other forward-thinking team members and external researchers.

we are a fast-growing digital health SaaS company thats on a mission to transform the way physicians interact with patient data. Thousands of clinicians across the United States already use our companys AI-powered solution that transforms complex and fragmented patient data into concise patient portraits" and actionable clinical insights at the point of care. With our company, physicians experience less burnout, reduce missed diagnoses, and can devote more time giving better care to their patients.
our company has been named one of the Top 100 AI companies globally by CB Insights and made the list of the Top 50 Digital Health startups. We are already working with industry-leading value-based organizations including Privia Health and Agilon.
We're looking for talented, versatile and highly independent Machine Learning Engineers to join our winning team. You will be in charge of end-to-end development and you'll have a massive impact on the product and the technical decisions made.
The ML Engineers are part of our infrastructure group, working closely with the exceptional research team, taking trained models and scaling them out to production.
Responsibilities
Take ownership of the entire machine learning engineering lifecycle - from building scalable training and evaluation pipelines to deploying models in production, with robust monitoring and maintenance systems.
Help in creating scalable solutions by enabling us to continuously increase the accuracy of our algorithms across thousands of clinics.
Designing a secured large-scale system that is suitable for sensitive patient data.
Continue to enhancing our deep learning infrastructure to supports our AI models at scale, including CI/CD, automation, testing and monitoring.
Collaborate with the research, medical and product teams in implementing ML solutions to the digital health space.

We are seeking a Technical Marketing Engineer to join our Ethernet Networking team to keep improving our performance leadership in AI. In this pivotal role, you will be the hands-on expert for our Spectrum-X Ethernet platform, showcasing its superiority for emerging AI use cases. You will develop and implement rigorous benchmarks on various GPU clusters, analyzing everything from LLM training to groundbreaking inference workloads. Your primary mission is to translate these performance results into compelling technical content, including white papers, blogs, and presentations, that clearly articulates why our Spectrum-X Ethernet solutions are the definitive choice for modern AI infrastructure.

What you'll be doing:

Design and execute performance benchmarks using industry-standard tools (e.g., MLPerf, UCX, our Collective Communications Library - NCCL and CloudAI) and customer-representative AI workloads on our state-of-the-art GPU clusters.

Translate your benchmark data and technical insights into compelling, high-impact marketing assets and performance-driven sales enablement materials.

Collaborate closely with Product Management, ASIC and Software architecture and Sales teams, provide feedback on product features, and ensure our performance results are technically accurate and impactful.

Be part of a team that pushes boundaries, developing custom silicon solutions that power the future of our company's direct-to-consumer products. You'll contribute to the innovation behind products loved by millions worldwide. Your expertise will shape the next generation of hardware experiences, delivering unparalleled performance, efficiency, and integration.
As a CPU Workload Analysis Researcher within our company Cloud's MSCA organization, you will be integral to developing silicon solutions powering our company's direct-to-consumer products. You will join a Research and Development team focused on analyzing and profiling workloads requirements within the company Cloud environment. Your role will involve conducting in-depth research on CPU optimization, feature development, and ML usages over compute platforms, contributing to identifying key areas of investment and future opportunities. This role offers a unique opportunity to perform groundbreaking research with a significant impact on both research methodologies and industry products, within the server chip architecture team. Your work will directly influence the next generation of hardware experiences for millions of our company users and Cloud customers.
The AI and Infrastructure team is redefining whats possible. We empower our company customers with breakthrough capabilities and insights by delivering AI and Infrastructure at unparalleled scale, efficiency, reliability and velocity. Our customers, our company Cloud customers, and billions of our company users worldwide.
We're the driving force behind our company's groundbreaking innovations, empowering the development of our cutting-edge AI models, delivering unparalleled computing power to global services, and providing the essential platforms that enable developers to build the future. From software to hardware our teams are shaping the future of world-leading hyperscale computing, with key teams working on the development of our TPUs, Vertex AI for our company Cloud, our company Global Networking, Data Center operations, systems research, and much more.
Responsibilities
Plan and execute detailed analysis of CPU workloads within the company Cloud infrastructure, analyze trends and map future requirements.
Collaborate closely with architecture and modeling owners to understand design specifications and identify critical scenarios related to CPU performance and efficiency.
Develop and implement custom workload generation tools and methodologies to simulate real-world usage patterns on our company Cloud platforms.
Analyze the impact of machine learning applications on CPU usage, identifying opportunities for optimization and feature enhancements.
Lead the investigation and development of metrics to measure CPU performance and efficiency, presenting findings to stakeholders and contributing to strategic decisions.

We are looking for a creative and experienced Senior Firmware Engineer to join our PCIe Firmware teamsomeone passionate about using artificial intelligence to engineer the foundational hardware of the AI revolution.

As an integral part of our team, you'll architect and implement the core of our next-generation devices. This senior role places you at the center of innovation, where you will have a direct impact on our business and technology by solving sophisticated technical challenges. Its a unique opportunity to shape our technology and empower customers to build the supercomputers and AI fabrics of tomorrow.

What You'll Be Doing:
Lead the architectural design, development, and optimization of cutting-edge PCIe firmware, using AI-driven modeling and insights to deliver exceptional performance.

Serve as a trusted technical expert by investigating, debugging, and resolving challenging PCIe firmware issues for our most important customers.

Collaborate closely with our Chip Design, Verification, Software, and Architecture engineers to find root causes and develop robust, long-term solutions.

Champion the integration of AI-assisted diagnostics and generative AI tools across the entire development lifecycle to boost team productivity and innovation.

Translate customer needs and field data into actionable feedback that directly shapes the future of our products.

As a Machine Learning Engineer, youll work on cutting-edge
code-focused LLMs and AI agent systems
that power our companys next-generation developer platform. Youll be at the center of research, model training, and productionization of intelligent systems that understand software deeply, collaborate with developers, and help automate engineering workflows end-to-end. Your work will immediately impact millions of engineers worldwide.
Responsibilities:
Push LLM Innovation: Research, design, and fine-tune domain-specific LLMs for code generation, refactoring, debugging, and multi-turn reasoning.
Agent-Oriented Development: Build multi-agent coding systems that integrate retrieval-augmented generation (RAG), code execution, testing, and tool use to create autonomous, context-aware coding workflows.
Production-Grade AI: Own the training-to-inference pipeline for large code modelsoptimize inference with quantization, distillation, and caching techniques.
Rapid Experimentation: Prototype and validate ideas quickly; leverage reinforcement learning, human feedback, and synthetic data generation to push accuracy and reasoning.
Cross-Functional Collaboration: Partner with product, engineering, and design teams to ship AI-powered features that help developers focus on high-impact work.
Scale the Platform: Contribute to distributed training, scalable serving systems, and GPU/TPU-efficient architectures for ultra-low-latency developer tools.

We are seeking a highly motivated architect to join our team of experts and take part in shaping the future of high-performance ML / AI computing. Our next-generation Spectrum-X, InfiniBand and NVLink systems will be at the heart of connecting and powering the world's most advanced compute clusters, from supercomputers used in AI research to high-performance clusters used at almost every industry today. As a system/software architect, you will have the opportunity to work on some of the most innovative technology that is currently driving the world forward.

What youll be doing:

Define the next generations of Spectrum-X, InfiniBand and NVLink SW architecture.

Research of various solutions by defining and running POCs, evaluate SW and HW impact and conveying the solution architecture to the relevant teams. The solutions can span over various layers: from algorithms and high level software to firmware and HW.

Collaborate with multi-functional teams, including other architecture teams, VLSI logic design, system software, firmware, and research teams, to ensure the successful execution of the project.

This is a senior leadership role focused on technical excellence and innovation. You will mentor a talented team of engineers and scientists, guide the end to end technical strategy from innovative research to production deployment and ultimately define the art of the possible for our most critical operational systems.

Responsibilities:

Lead the design and architecture of complex, end to end AI systems, guiding projects from initial conception and research through to production deployment and impact analysis.

Own the technical vision for the next generation of intelligent automation, creating patented technologies that directly impact Salesforce Field Service's core competitive advantage and market differentiation.

Provide technical leadership and set the strategic direction for the research and development of novel optimization and machine learning solutions.

Drive fast paced experimentation by independently or collaboratively prototyping solutions that showcase how new AI technologies can address real world business challenges. Collaborate with cross functional teams to translate prototypes into actionable solutions and define incremental delivery plans for implementation.

Mentor and guide a team of AI developers and scientists, fostering a culture of innovation, technical excellence, and continuous learning.

Stay at the forefront of academic and industry advancements by attending top tier conferences, networking with experts, and continuously learning about the latest in optimization, AI, and large language models (LLMs) to identify, evaluate, and apply emerging techniques that drive a significant competitive advantage.
JR314441

Be part of a team that pushes boundaries, developing custom silicon solutions that power the future of our company's direct-to-consumer products. You'll contribute to the innovation behind products loved by millions worldwide. Your expertise will shape the next generation of hardware experiences, delivering unparalleled performance, efficiency, and integration.
As a SOC Performance Technical Lead, you will drive the success of our System-on-Chip (SoC) products. You will be focused on ensuring our SoCs deliver maximum performance, power efficiency, and cost-effectiveness. You will be a multi-disciplinary expert who can bridge the gap between deep learning, advanced algorithms, and hardware/software design to create innovative solutions for current and future product lines.
You will lead and oversee a team, setting the technical direction and making critical decisions on frameworks, methodologies, and tools. You will require a collaborative approach with various teams to ensure alignment with organizational goals.
The AI and Infrastructure team is redefining whats possible. We empower our company customers with breakthrough capabilities and insights by delivering AI and Infrastructure at unparalleled scale, efficiency, reliability and velocity. Our customers, our company Cloud customers, and billions of our company users worldwide.
We're the driving force behind our company's groundbreaking innovations, empowering the development of our cutting-edge AI models, delivering unparalleled computing power to global services, and providing the essential platforms that enable developers to build the future. From software to hardware our teams are shaping the future of world-leading hyperscale computing, with key teams working on the development of our TPUs, Vertex AI for our company Cloud, our company Global Networking, Data Center operations, systems research, and much more.
Responsibilities
Utilize performance and power models from the architecture team, as well as lab measurements, to validate and tune performance against established goals.
Exercise open source benchmarks, analyze the results, and find optimization opportunities.
Develop and implement advanced technologies for running benchmark representations on pre-silicon environments.
Analyze complex problems, identify core design weaknesses, and drive the resolution of performance issues in both pre and post-silicon environments.
Develop performance measurement frameworks, including Key Performance Indicators (KPIs), to produce regular reports and dashboards that support stakeholder decision-making.