דרושים » הנדסה » Senior LLM Agents Architect

Join the AI & Automation Supply Chain Business Transformations team in our Operations to architect the future of agentic AI at scale. We Implement AI agents to transform employee productivity and accelerate business impact. As the senior systems architect in Operations, you implement our vision for codifying our decision logics, decision intelligence, AI agent design, build and deployment, integration, security, and lifecycle management, ensuring the AI Agents delivers value that are trusted, scalable, and innovative. This is a rare opportunity to define the AI agents for Supply Chain Operations inside one of the worlds most advanced AI companies. If you thrive at the intersection of AI innovation, and Supply Chain transformation, join us and make your mark on the future of agentic AI.

What you will be doing:

Capture business requirements, translate requirements into functional design, user stories, technical design, drive end to end integration testing, support data set up and issue remediation during UAT, manage development team activities, develop hypercare support model

Define and architect AI agents for Supply Chain use cases, using the right frameworks, multi-agent coordination, RAG, deployment, monitoring, and life cycle management.

Be hands on in quick proof of concepts development to demonstrate technical feasibility and implement enterprise grade Agentic Supply Chain solutions

Partner with Enterprise IT engineering, product, and research teams while evaluating LLMs, agentic frameworks, and our own NeMo technologies.

Ensure integration with enterprise IT and Operations data sources and Industrys best Agentic platforms with strong content security focus.

Drive architectural decisions across deployment models (on-prem, cloud, hybrid, containerized) to deliver scalable, reliable, and efficient solutions.

Lead design reviews, develop technical documentation, and guide developers in principles of architecture and code development.

Champion observability, monitoring, versioning, and telemetry to ensure trustworthy and auditable AI agents.

Influence Supply Chain Operations adoption of the platform by partnering with stakeholders across IT, supply chain and serve as a reference adopter providing feedback to strengthen our ecosystem.

We are looking for an AI Test Architect joining E2E Verification group to profile Innovative large scale Distributed training on our AI End-to-End solutions in a large scale supercomputing clusters. Provide insights on at-scale system design and tuning mechanisms for large-scale compute runs. You will work with the latest Accelerated Computing and Deep Learning software and hardware platforms, with researchers, developers, and customers to craft improved workflows and develop new, leading differentiated solutions. You will interact with HPC, OS, Switch, HCA, CPU and GPU compute, and systems specialist to architect, develop and bring up large scale performance platforms.

What youll be doing:

Profiling, benchmarking, and analyzing deep learning models to identify areas for optimization and improvement in terms of performance, efficiency, and accuracy, with a strong emphasis on networking aspects.

Collaborating closely with data scientists, researchers, development, automation teams to design and implement scalable training pipelines and frameworks that demonstrate large scale high -performance networking capabilities.

Staying up-to-date with the latest advancements in deep learning algorithms, architectures, our GPU technologies, and high-performance networking solutions.

Optimizing deep learning models for performance, memory usage, and power efficiency while maximizing high-performance networking features on our supercomputers.

Providing insights and recommendations based on the analysis of large-scale training results, specifically focusing on networking bottlenecks and optimizations, to improve model outcomes and achieve business objectives.

Collaborating with hardware engineers to guide the development and integration of efficient networking solutions for deep learning, including exploring network architecture optimizations and bringing to bear technologies such as RDMA or InfiniBand.

Our Networking Research group is seeking a forward-thinking Engineering Manager with a product leadership approach to manage a team of Software Engineers, AI Agent Developers, and Researchers.

In this role, you will bridge the gap between brand-new AI research and practical engineering. You will lead the charge in integrating autonomous AI agents into the daily workflows of our architects, hardware designers, and researchers. You will be responsible for understanding internal engineering bottlenecks, researching the latest academic and industry advancements, and translating them into deployed production tools using our AI stack.

What you'll be doing:

Team Leadership & Strategy: Lead and mentor a mixed team of SW engineers and researchers, balancing the agility of research with the responsibility of production software engineering.

Product Engineering: Partner with internal engineering teams (Hardware, Architecture, Research) to analyze their workflows, identify friction points, and architect Agentic AI solutions to accelerate their work.

Applied Research: Actively monitor the latest AI trends, academic papers, and technical blogs (LLMs, Agents, RAG). Translate these insights into concrete features and tools for the team.

Agent Architecture: Be responsible for the design of scalable frameworks for AI agent interaction, ensuring they can reason, plan, and orchestrate tasks within complex engineering environments.

SW-Focused MLOps: Define and implement the software lifecycle for AI models - from fine-tuning to deployment - utilizing our AI deployment tools and ensuring seamless CI/CD.

Production Deployment: Ensure reliable operation of agent fleets, optimizing for latency and resource consumption while maintaining security and access controls.

We are looking for a passionate, modern software engineer or junior architect early in their career. The role involves developing and prototyping new scalable training and inference advancements using our Spectrum-X AI fabric.

This role offers a rare opportunity to work on innovative AI and networking technologies, building prototypes that influence the development of large-scale AI systems. You will help improve AI application-network interaction by refining communication, crafting congestion control, contributing to NIC and switch capabilities, and enhancing AI factory performance at scale.


What youll be doing:

Prototype end-to-end solutions to improve distributed training and disaggregated inference performance.

Analyze and optimize communication flows across application, transport, and network layers.

Develop system software spanning communication libraries, drivers, and firmware integrations.

Collaborate with hardware, firmware, and SDK teams to co-design network features.

Validate and integrate prototypes into our AI infrastructure and products.

we are building state-of-the-art accelerated computing platforms that know no boundaries. Our technology is crucial for global innovators, scientists, researchers, and engineersempowering them to transform their boldest concepts into tangible outcomes. Our next-generation Infiniband, NVLink, and Ethernet systems will continue to be at the forefront of connecting and powering the world's most advanced AI clusters.
We seek a highly motivated and experienced Software Architect specializing in Ethernet Switch ASICs to join our team of experts and help shape the future of high-performance ML/AI computing. You will have the opportunity to work on some of the most pioneering technologies and help drive the innovation of our next-generation networks. You will play a key role in defining switching software stacks and Linux kernel networking, and help address new business opportunities in exciting areas. Our Architects also represent our company in open-source projects, technical conferences, and standard development organizations.
What you'll be doing:
Explore networking technologies, features and protocols, hardware/software capabilities, open-source software and drivers for our Ethernet Switch ASICs and Networking platforms.
Be familiar with the Ethernet Switch ASIC hardware and software stacks, as well as with the Ethernet Switch platforms design and characteristics.
Define robust architectures and technical requirements for embedded software, meeting AI/ML workloads' needs and highly performing network operations.
Lead the work with R&D and Validation teams, providing technical guidelines and close support and thorough reviews for detailed designs and test plans.
Collaboration with architects across various fields, including Chip Design, Firmware, Hardware Platforms, and System teams.
Close work with product marketing, program managers, and account managers to ensure the successful execution of projects.
Support engagements with key customers, issue patents, publish white papers and blogs, and be proactive in technical forums and industry working groups.
Promote innovation through the design and implementation of Proof-of-Concept (PoC).

We are now looking for a TensorRT-LLM Software Development Engineer! We are hiring software engineers for its TensorRT-LLM team. Academic and commercial groups around the world are using GPUs to power a revolution in deep learning-powered AI, enabling breakthroughs in areas like LLM, ChatGPT and Generative AI that have put DL at the iPhone moment for AI. Join the team which is building the inferencing software which is foundational to product lines within us and across the industry! The ability to work on a fast-paced delivery-focused team is required and excellent interpersonal skills are a must.

What you'll be doing:

Craft and develop robust inference software that can be scaled to multiple platforms for functionality and performance.

Performance analysis, optimization, and tuning for Large Language Models (LLMs)

Conduct unit tests and performance tests for different stages of the inference pipeline.

Closely follow academic developments in the field of artificial intelligence and feature update TensorRT-LLM.

Write safe, scalable, modular, and high-quality (C++/Python) code for our core backend software for LLM inference.

Collaborate across the company to guide the direction of deep learning inference, working with software, research and product teams.

We seek a highly motivated and experienced System Architect specializing in Data-Center, AI Fabric, and Ethernet Networking to join our team of experts and help shape the future of high-performance ML/AI computing. You will have the opportunity to work on some of the most pioneering technologies and help drive the innovation of our next-generation networks. You will play a key role in defining end-to-end solutions, networking protocols and features, interworking with orchestration systems, and help address new business opportunities in exciting areas. Our Architects also represent us in open-source projects, technical conferences, and standard development organizations.

What you'll be doing:

Explore new technologies and end-to-end solutions for our Ethernet Networking Platforms.

Be familiar with data-center and AI fabric network topologies, AI/ML clusters operation and network usage, as well as with the Ethernet Switch platforms' design and characteristics.

Define robust architectures and technical requirements for network operating systems and end-to-end solution offering for AI/ML workloads' needs and highly performing network operations.

Lead the work with R&D and Validation teams, providing technical guidelines and close support and thorough reviews for detailed designs and test plans.

Collaboration with architects across various fields, including Chip Design, Firmware, Hardware Platforms, and System teams.

Close work with product marketing, program managers, and account managers to ensure the successful execution of projects.

Support engagements with key customers, issue patents, publish white papers and blogs, and be proactive in technical forums and industry working groups.

Promote innovation through the design and implementation of Proof-of-Concept (PoC).

What you'll be doing:

Supervise and coordinate a senior software engineering team responsible for constructing post-silicon power and performance infrastructure and automation tools.

Define the architecture and roadmap for scalable characterization and stress frameworks used in production and validation environments.

Deliver tools that enable power, transient, and functional stress at both silicon and system levels.

Drive automation, CI, and infrastructure guidelines to support regression, data collection, analytics, and reproducibility.

Partner with architecture, hardware, firmware, performance, and production teams to translate silicon requirements into robust software solutions.

Ensure high software quality, maintainability, and documentation aligned with our engineering standards.

Support silicon bring-up, characterization and high-volume manufacturing readiness.

We seek a highly motivated and experienced Software Architect specializing in Ethernet Switch ASICs to join our team of experts and help shape the future of high-performance ML/AI computing. You will have the opportunity to work on some of the most pioneering technologies and help drive the innovation of our next-generation networks. You will play a key role in defining switching software stacks and Linux kernel networking, and help address new business opportunities in exciting areas. Our Architects also represent us in open-source projects, technical conferences, and standard development organizations.

What you'll be doing:

Explore networking technologies, features and protocols, hardware/software capabilities, open-source software and drivers for our Ethernet Switch ASICs and Networking platforms.

Be familiar with the Ethernet Switch ASIC hardware and software stacks, as well as with the Ethernet Switch platforms design and characteristics.

Define robust architectures and technical requirements for embedded software, meeting AI/ML workloads' needs and highly performing network operations.

Lead the work with R&D and Validation teams, providing technical guidelines and close support and thorough reviews for detailed designs and test plans.

Collaboration with architects across various fields, including Chip Design, Firmware, Hardware Platforms, and System teams.

Close work with product marketing, program managers, and account managers to ensure the successful execution of projects.

Support engagements with key customers, issue patents, publish white papers and blogs, and be proactive in technical forums and industry working groups.

Promote innovation through the design and implementation of Proof-of-Concept (PoC).

We are spearheading the AI revolution and the creation of state-of-the-art accelerated compute platforms for global utilization. Our Network Modeling and Performance Insights group is seeking a skilled and driven Software Developer for the design and development of our infrastructure for a complex networking simulation as a service. In this role, you will be responsible for developing and optimizing our network simulation software, and to enhance its performance and quality. You will work on integrating this infrastructure with cloud computation services for various use cases and ensure the simulation is available as a service for internal and external customers. If you're passionate about tackling intricate challenges and contributing to comprehensive software solutions, we want to hear from you.

What you'll be doing:

Enhance simulation runtime and memory consumption through innovative optimization techniques.

Improve the quality of the simulation as a software product, ensuring robustness and reliability.

Expends the simulation versatility to accommodate new various and complex user use cases and bleeding-edge requirements.

Design and expose the simulation as a service to facilitate easier access for different stakeholders.

Integrate a new simulation management system, making simulated experiments data accessible to all users.

Design and develop a CI/CD infrastructure for our complex networking simulation tool, ensuring efficient deployment and smooth integration processes.