דרושים » תוכנה » Software Engineer - AI Datacenter Networking

We are seeking a talented and passionate Software Engineer to join our NIC team, working at the forefront of AI datacenter infrastructure. In this role, you will develop and optimize the software stack powering high- performance NICs deployed in large-scale AI training and inference clusters. You will collaborate closely with hardware, networking, and AI framework teams to ensure our NIC stack delivers maximum throughput, minimal latency, and seamless integration with GPU computing frameworks and collective communication libraries.
Key Responsibilities
● Design, implement, and optimize L2 and RDMA features for third-party NIC hardware
● Design and develop tools for real-time NIC performance monitoring, profiling, and telemetry in AI datacenter environments. Analyze end-to-end distributed training and inference bottlenecks.
● Develop, maintain, and extend NIC drivers and firmware interfaces within the Linux kernel network subsyste
● Collaborate in the evaluation and integration of upstream kernel, vendor, open-source NIC features,
Hardware, Networking, QA, and AI Framework Integration teams
● Implement, integrate and tune RoCEv2 / lossless Ethernet transport for AI workloads requiring ultra- low latency with GPU programming frameworks (CUDA, ROCm)
● Write production-grade, well-tested, and thoroughly documented code following team engineering standards and participate actively in code reviews, architecture discussions, and technical design sessions.

We are looking for an experienced MCP (Model Context Protocol) Software Engineer to design, develop, and optimize Model Context Protocol implementations.
You'll work on building robust MCP servers, client integrations, and tools that allow AI systems to securely access and interact with various data sources and services.
Key Responsibilities:
MCP Development & Implementation:
Design and develop MCP servers for various data sources (databases, APIs, file systems, cloud services)
Build and maintain MCP client integrations for AI applications and platforms
Implement secure authentication and authorization mechanisms for MCP connections
Develop custom MCP tools and resources to extend AI capabilities
Architecture & Design:
Architect scalable MCP solutions that handle high-volume data access patterns
Design efficient protocol implementations that minimize latency and maximize throughput
Create reusable MCP components and libraries for internal and external use
Establish best practices for MCP server development and deployment
Integration & Collaboration:
Integrate to our identity platform
Work with DevOps teams to deploy and monitor MCP services in production environments
Partner with security teams to ensure MCP implementations meet compliance and security requirements
Integrate MCP solutions with existing infrastructure and third-party services
Quality & Performance:
Write comprehensive tests for MCP implementations including unit, integration, and end-to-end tests
Monitor and optimize MCP server performance and resource utilization
Debug complex issues in distributed MCP environments
Maintain detailed documentation for MCP servers and integration patterns
Contribute to Open Source:
Engage with the open-source community, contributing to the development and improvement of MCP.

We are looking for a passionate and experienced Software Engineer (C/Rust) to join our vibrant Networking Group.
In this role, you will play a key part in designing and developing our high-performance and highly-scalable backbone platform.
The ideal candidate brings a strong background in systems programming (C/C++/Rust/Go), a solid understanding of networking concepts, and experience building and operating mission-critical services.
Responsibilities:
End-to-end ownership of solution delivery: from design, implementation to testing, rollout and monitoring
Drive highly performant and highly efficient designs
Leading collaborative efforts with cross-functional teams.

As a Site Reliability Engineer on the SASE Platform team, you will play a critical role in building and operating highly available, secure, and globally distributed services. Your mission is to ensure our cloud-native security and networking platform is reliable, scalable, and performant from day one, protecting the users, applications, and data for the world's largest enterprises as they adopt cloud, remote work, and AI.
Key Responsibilities
Proactively collaborate with development teams to embed reliability, scalability, and operability into services from the earliest design stages.
Design, review, and evolve cloud-native architectures to improve availability, performance, cost efficiency, and fault tolerance.
Build and operate automation for provisioning, deploying, and managing global infrastructure using Infrastructure as Code (IaC).
Improve CI/CD pipelines and release processes to enable safe, fast, and repeatable deployments.
Drive observability best practices, including metrics, logs, traces, and SLIs/SLOs to enable data-driven incident analysis.
Participate in on-call rotations, reducing mean time to resolution (MTTR) through automation and proactive reliability improvements.
Challenge existing processes by championing reliability, security, and operational maturity across the organization.

We are seeking an experienced technical leader to head our collective communication library development team. This role involves leading a team of engineers in developing high-performance collective communication implementations for multi-NPU and multi-node AI workloads.
Key Responsibilities
Lead the design and development of collective communication primitives (All-Reduce, All-to-All, Gather/Scatter and etc)
Architect scalable communication protocols for multi-NPU and multi-node systems
Optimize communication performance for NPU architectures
Provide technical leadership to the team members in NPU programming, distributed systems, and communication protocols
Work with a success-driven worldwide international team (Network, NPU, QA, AI, DL/ML Framework)
Define project milestones, deliverables, and technical roadmaps
Ensure compatibility with major AI frameworks (PyTorch, TensorFlow, JAX).

Your Opportunity:
Serve as the primary technical authority and mentor for the team, providing expert guidance, performing code reviews, and setting the bar for engineering excellence.
Partner closely the leadership team to define and evolve the architecture of our end-to-end OT solution, spanning from network data collection to complex on-prem and cloud deployment scenarios.
Own architectural decisions and drive critical tech choices that ensure system scalability, reliability, and seamless integration with the broader our product suite.
Lead the systems evolution by shaping the target architecture and integrating AI-driven capabilities and advanced analytics to proactively identify network threats and failures.
Leverage complex cross-domain data and metrics to drive product performance and stability improvements.
Lead technical initiatives and discussions across Backend, Frontend, and other teams to ensure high-quality software delivery.
Collaborate with cross-functional partners, including product management and design, within an Agile environment to shape and deliver new features.

We are on a mission to secure the AI transformation that every company is going through, building a platform that protects organizations as they adopt AI tools at scale. This is your chance to join one of the fastest-growing areas in our company and develop technology that will define how cybersecurity operates in the AI era. You will be part of a multidisciplinary team of backend engineers, endpoint developers, AI researchers, and product experts from Israel and global acquisitions, all working together to deliver cutting-edge, end-to-end security solutions to the worlds largest enterprises.
As a Software Developer on our team, you will work across both backend services and endpoint components, designing scalable systems that connect endpoint-level data collection with cloud-based analysis and enforcement. Youll play a key role in building the agents and services that monitor and control interactions with AI tools, shaping a new category of security products that operate seamlessly across platforms and environments.
Key Responsibilities
Develop and maintain backend services alongside endpoint components for a cross-platform security platform
Design scalable systems that integrate endpoint-collected data with cloud-based processing and enforcement
Build and enhance endpoint agents responsible for monitoring and controlling interactions with AI tools (e.g., coding assistants, web-based AI services)
Implement data pipelines, policy enforcement logic, and secure data handling mechanisms across endpoint and backend layers
Collaborate with AI and product teams to deliver end-to-end solutions
Troubleshoot and resolve complex issues across distributed system and endpoint components.

At our company, we build AI-powered vision systems that enhance safety and decision-making for some of the worlds largest vessels.
Our platform processes live video streams from multiple onboard cameras to provide real-time situational awareness, detecting and tracking marine objects, even in low visibility and highly congested environments. These systems directly support navigational decisions and help prevent collisions, reduce human error, and improve operational efficiency.
Our systems are already deployed across thousands of vessels and have processed hundreds of millions of nautical miles of real-world data, operating in unpredictable and safety-critical conditions.
This role sits at the intersection of AI and high-performance systems engineering, focused on solving real-world problems under strict constraints. You will work on systems where performance and reliability are critical and where improvements have a direct, measurable impact on real-world safety.
This is a senior, systems-focused role with end-to-end ownership over performance and reliability of production computer vision pipelines. You will define optimization strategies, identify bottlenecks across the system, and drive improvements under real-world constraints.
What youll do
Build and optimize real-time computer vision pipelines running on edge systems processing live maritime video streams (e.g, NVIDIA Jetson, Triton Inference Server)
Take models from research and turn them into production-ready, reliable components deployed on vessels
Profile and improve end-to-end system performance across: multi-camera video ingestion; preprocessing; inference; postprocessing
Identify and resolve bottlenecks across CPU, GPU, memory, and pipeline coordination
Make and justify tradeoffs between latency, accuracy, stability, and resource utilization
Design and implement robust data and inference pipelines (video -> model -> actionable output for crew)
Develop benchmarking and evaluation workflows to measure performance end-to-end and support release gating
Build and improve observability tools, including logging, monitoring, and debugging workflows for production systems
Define and maintain clear interfaces between research code and production systems
Work closely with research and backend teams to integrate new models into production systems
Continuously improve system efficiency and reliability under hardware and runtime constraints.

We are seeking an experienced Senior Delivery Consultant - Modernization with deep expertise in Artificial Intelligence to join AWS Professional Services (ProServe). This role combines strategic architectural vision with hands-on technical leadership to deliver innovative AI solutions that drive customer success and business transformation across diverse industries and use cases.

Key job responsibilities
* Architecture & Design: Design and architect end-to-end AI-powered application solutions aligned with customer business objectives and technical requirements.
* Define application architecture patterns, standards, and best practices for AI/ML integration on our company.
* Create technical roadmaps for customer AI application development and modernization initiatives.
* Evaluate and recommend our AI/ML services and technologies including Amazon Bedrock, SageMaker, and generative AI solutions.
* Design data pipelines and ETL processes to support AI model training and inference using our services.
* Customer Engagement & Consulting:
Lead customer engagements from discovery through implementation, serving as trusted technical advisor.
* Conduct AI readiness assessments and develop adoption strategies tailored to customer maturity levels.
* Facilitate architecture workshops and design sessions with customer stakeholders.
* Deliver Well-Architected reviews focused on AI/ML workloads.
* Build strong relationships with customer technical teams and executive leadership.
* Guide customers in constructing AI processes aligned with AWS best practices.
* Technical Leadership: Lead cross-functional teams in implementing AI solutions from concept to production.
* Provide technical guidance on AI model integration, deployment strategies, and optimization on our company.
* Conduct architecture reviews ensuring solutions meet scalability, performance, security, and cost-efficiency requirements.
* Mentor customer teams and junior ProServe consultants on AI best practices and AWS technologies.
* Collaborate with data scientists, ML engineers, and software developers to translate AI models into production applications.
* AI Solution Development: Design architectures for generative AI applications including RAG (Retrieval-Augmented Generation) systems, chatbots, and intelligent agents using our Bedrock.
* Architect real-time and batch AI inference pipelines with appropriate monitoring and observability.
* Implement MLOps practices using SageMaker for model versioning, deployment automation, and continuous improvement.
* Design solutions for responsible AI including bias detection, explainability, and governance frameworks.
* Optimize AI application performance, cost, and resource utilization across AWS services.
Knowledge Sharing & Thought Leadership:
* Develop reusable assets, reference architectures, and best practice documentation.
* Contribute to AWS ProServe knowledge base and customer-facing content.
* Present at customer events, workshops, and industry conferences.
* Stay current with emerging AI technologies and AWS service innovations.
* Share learnings across the ProServe organization.

We are looking for an excellent SW Engineer to join the InfiniBand Switch and NVLink Core FW group in Tel-Aviv / Raanana. As the team member, you will be part of a major development effort for the next-generation networking products. The verification team develops cutting-edge networking features for cloud, HPC and storage. We drive the data growth of the worlds biggest companies. With talented engineers around the globe, the work environment is dynamic, meaningful, and fast-paced. Are you ready for the challenge?
What you will be doing:
As a SW Engineer, you will part of a group of firmware verification engineers, using your expertise in C++ and Python in an Agile methodology.
Develop the verification process, aligning with quality standards and project timelines.
Design and implement new features in the core of Switch and GPUs
Drive and facilitate the planning, scheduling, and execution of the project and activities of the team
Collaborate with architecture and different software design teams as part of the software development lifecycle.
Work in pre and post-silicon development environments of next-generation networking products.
Gain a deep understanding of networking technology, system debugging and stacks, as well as the HW/FW/SW relationship.
Innovate! Bring our FW switching products to shine in customers view.