דרושים » תוכנה » Senior Software Engineer, AI Infrastructure

The PerfTech team is looking for a talented C++ Software Engineer to help build the next generation of AI-powered developer tools. You will apply strong C++ and software-engineering fundamentals while gaining hands-on experience with agentic workflows, retrieval systems, and AI services.

In this role, you will contribute to Genie, our company-wide AI knowledge and developer-productivity service. You will work across C++ tools and AI services to help engineers find information, understand complex systems, and work more effectively.

What Youll Be Doing:
Develop production-quality C++ components, APIs, and integrations for our AI-powered developer-tools ecosystem.
Build capabilities connecting native C++ tools with Genies retrieval and agentic features.
Contribute to agentic workflows, retrieval systems, ingestion pipelines, MCP tools, APIs, and enterprise integrations.
Build benchmarks and improve retrieval quality, reliability, performance, and resource usage.
Own features from investigation and design through implementation, testing, and delivery.
Collaborate with graphics, software, and hardware teams developing performance-analysis and developer tools.

Were looking for a senior engineer who is ready to move beyond traditional software development and take full ownership of product delivery.

This is not a classic backend engineering role. You will work directly with Product to turn ideas and requirements into production-ready solutions, make the technical decisions, and use AI coding agents as a core part of your engineering workflow.

You will own the outcome, not just the code. AI-generated code is your code, and you are accountable for its quality, security, performance, and maintainability.


Own product features end-to-end, from requirements through production and monitoring.
Work with Product to translate business problems into clear technical solutions and execution plans.
Design scalable and maintainable solutions, including architecture, APIs, data models, and integrations.
Use AI coding agents to accelerate implementation, testing, debugging, and automation.
Review and improve AI-generated code, ensuring high standards for correctness, security, performance, and maintainability.
Make independent technical decisions and communicate architectural trade-offs clearly.
Contribute across backend, frontend, QA, CI/CD, and infrastructure when needed to deliver a feature.
Investigate and solve complex production and performance issues.
Continuously improve how we build, test, and ship software using AI-native development practices.

We are looking for a Senior AI Engineer to design and build production-grade, LLM-powered systems. You'll work at the intersection of software engineering and applied AI - shipping agents, RAG pipelines, and tool-using systems that solve real problems at scale. This is a hands-on, high-ownership role for someone who thrives at the frontier of what's possible with modern LLMs and isn't afraid to write the glue, the infrastructure, and the prompts that make it all work.
This is a **cross-functional, company-wide role**. You won't be embedded in a single product team - instead, you'll partner with every department to identify high-leverage opportunities and build AI-powered tools and workflows that boost productivity and efficiency across the entire organization.
This is a great opportunity to be part of one of the fastest-growing infrastructure companies in history, an organization that is in the center of the hurricane being created by the revolution in artificial intelligence.
What You'll Do:
- Design, build, and operate LLM-powered applications, agents, and workflows end-to-end - from prototype to production.
- Architect retrieval, context engineering, and tool-use strategies that make models reliable, accurate, and cost-efficient.
- Integrate LLMs with internal services, third-party APIs, and data stores to automate complex business and engineering workflows.
- Build, evaluate, and continuously improve evaluation harnesses for non-deterministic systems.
- Collaborate closely with product, research, and platform teams to translate ambiguous problems into shipped capabilities.
- Stay ahead of the rapidly evolving LLM ecosystem (models, frameworks, agentic patterns) and bring the best ideas into our stack.

The PerfTech team is looking for an outstanding Senior C++ Software Engineer to build the next generation of AI-powered developer tools. You will apply deep expertise in modern C++, systems architecture, performance, and debugging to extend our developer-tools ecosystem into the emerging world of agentic software. In this role, you will help develop Genie, our company-wide AI knowledge and developer-productivity service. You will build production-quality C++ components and integrations while contributing to agentic workflows and retrieval systems that help engineers find information, understand complex systems, and work more effectively.

What Youll Be Doing:
Architect and develop production-quality C++ components, APIs, and integrations for NVIDIAs AI-powered developer-tools ecosystem.
Build reliable, performance-sensitive systems connecting native C++ tools with Genies retrieval and agentic capabilities.
Design maintainable interfaces between C++ applications and AI services exposed through Python, MCP, REST APIs, and structured tool calling.
Contribute to agentic workflows, retrieval systems, ingestion pipelines, evaluation infrastructure, and enterprise integrations.
Drive technical initiatives from early exploration through production deployment, working closely with multidisciplinary engineering teams.
Mentor engineers and help establish best practices for production-quality AI-powered systems.

Join our company, an innovative startup building a fully-managed LLM-inference platform, that enables data heavy enterprises to perform any AI task at any scale without limits.
We're looking for an Experienced Software engineer to join our founding team. Youll be responsible for building and optimizing scalable cloud infrastructure solutions tailored for AI workloads. This role offers a unique opportunity to directly shape our infrastructure strategy, improve system reliability and performance, and contribute to establishing our company as a leader in adaptive AI compute management.
Join us to tackle the magic that make AI tick under the hood and build the backbone powering the AI revolution.
What Youll Do
- Design and implement the control plane that orchestrates distributed inference across cloud GPU infrastructure.
- Own backend systems responsible for job scheduling, SLA tracking, usage metering, tenancy, auth, and data coordination.
- Build robust APIs that glue together infra automation, ML workloads, and user-facing dashboards.
- Work across multiple cloud providers and BYOC environments-build systems that expect chaos and still work.
- Collaborate with infra, ML, and product teams to abstract complex infra flows into clean interfaces.
- Help define system architecture and lay the groundwork for a platform that adapts to varied customer deployments.

Join our company, an innovative startup building a fully-managed LLM-inference platform, that enables data heavy enterprises to perform any AI task at any scale without limits.
We're looking for an Experienced Performance Researcher to join our founding team. Youll be responsible for building and optimizing scalable cloud infrastructure solutions tailored for AI workloads. This role offers a unique opportunity to directly shape our infrastructure strategy, improve system reliability and performance, and contribute to establishing our company as a leader in adaptive AI compute management.
Join us to tackle the magic that make AI tick under the hood and build the backbone powering the AI revolution.
What Youll Do
- Design and build high-performance distributed inference pipelines for LLMs, focused on large-batch, non-real-time scenarios.
- Optimize GPU memory usage, kernel execution, and communication across nodes (NCCL, MPI, etc.).
- Own CUDA kernels, compiler-level tricks, and multi-GPU scheduling logic.
- Lead profiling and performance tuning for throughput, and cost- down to the kernel level.
- Collaborate with infra, product, and research teams to define SLAs, resource allocation logic, and runtime behaviors.
- Help build the core infrastructure that will run LLM workloads across hybrid GPU environments (cloud/on-prem/self-hosted).

We are looking for a Senior Software Engineer to solve complex technical problems and build dependable backend and platform systems that enable our product to scale. You will own work from design through production, balance near-term delivery with long-term maintainability, and help teammates grow.

What youll do

Design, implement, and operate scalable backend services, APIs, and platform capabilities.
Build robust systems and services in Go and Python.
Own technical design, delivery, reliability, security, and operational quality for your domains.
Work with Product, Design, Data, and other engineers to deliver customer value quickly and safely.
Improve engineering foundations, including test coverage, observability, CI/CD, performance, and developer experience.
Apply AI-assisted engineering tools responsibly while maintaining strong technical judgment.
Evaluate and build production AI capabilities where they are relevant to the product.
Review code, mentor engineers, and contribute to architecture and technical standards.

We are looking for a Senior II Software Engineer to join the CX Platform team, the foundational engineering team powering our entire Customer Experience group. This is a high-impact, hands-on role at the intersection of backend engineering, AI infrastructure, and customer-facing product.

You'll work across the full platform stack (backend services, data pipelines, security, cost, and scale) with a meaningful and growing focus on AI infrastructure. We own the agentic platform for the entire Product Offering group: from building the LLM infrastructure and agentic workflows to ensuring they're reliable, observable, and safe in production.

What you'll be doing:
Own AI infrastructure for the Product Offering group. Design, build, and evolve the shared AI platform (agentic workflows, LLM integrations, observability, and guardrails) that CX product teams build on.
Ship agentic features end to end. Lead development of AI-driven capabilities using LangChain, LangFuse, and AWS Bedrock, from architecture through production deployment and monitoring.
Drive platform architecture. Set the technical direction for the CX backend (services, data pipelines, API patterns) with an eye for scalability, reliability, and developer experience.
Own core data foundations. Design resilient data-access patterns across Snowflake, Elasticsearch, Kafka, Redis, and MySQL; keep pipelines fast, fresh, and reliable.
Mentor and elevate. Help engineers across the CX group grow in backend craft, AI engineering, and system design thinking.
Collaborate cross-functionally. Work with product, design, and customer-facing teams to turn ambiguous problems into well-scoped, high-quality solutions.

We are seeking an experienced Solutions Data Engineer who possess both technical depth and strong interpersonal skills to partner with internal and external teams to develop scalable, flexible, and cutting-edge solutions. Solutions Engineers collaborate with operations and business development to help craft solutions to meet customer business problems.
A Solutions Engineer works to balance various aspects of the project, from safety to design. Additionally, a Solutions Engineer researches advanced technology regarding best practices in the field and seek to find cost-effective solutions.
Were looking for a Solutions Engineer with deep experience in Big Data technologies, real-time data pipelines, and scalable infrastructure-someone whos been delivering critical systems under pressure, and knows what it takes to bring complex data architectures to life. This isnt just about checking boxes on tech stacks-its about solving real-world data problems, collaborating with smart people, and building robust, future-proof solutions.
In this role, youll partner closely with engineering, product, and customers to design and deliver high-impact systems that move, transform, and serve data at scale. Youll help customers architect pipelines that are not only performant and cost-efficient but also easy to operate and evolve.
We want someone whos comfortable switching hats between low-level debugging, high-level architecture, and communicating clearly with stakeholders of all technical levels.
Key Responsibilities:
Build distributed data pipelines using technologies like Kafka, Spark (batch & streaming), Python, Trino, Airflow, and S3-compatible data lakes-designed for scale, modularity, and seamless integration across real-time and batch workloads.
Design, deploy, and troubleshoot hybrid cloud/on-prem environments using Terraform, Docker, Kubernetes, and CI/CD automation tools.
Implement event-driven and serverless workflows with precise control over latency, throughput, and fault tolerance trade-offs.
Create technical guides, architecture docs, and demo pipelines to support onboarding, evangelize best practices, and accelerate adoption across engineering, product, and customer-facing teams.
Integrate data validation, observability tools, and governance directly into the pipeline lifecycle.
Own end-to-end platform lifecycle: ingestion → transformation → storage (Parquet/ORC on S3) → compute layer (Trino/Spark).
Benchmark and tune storage backends (S3/NFS/SMB) and compute layers for throughput, latency, and scalability using production datasets.
Work cross-functionally with R&D to push performance limits across interactive, streaming, and ML-ready analytics workloads.
Operate and debug object store-backed data lake infrastructure, enabling schema-on-read access, high-throughput ingestion, advanced searching strategies, and performance tuning for large-scale workloads.

We're forming a new AI Group and looking for a Senior AI Engineer to help shape it from an early stage - a greenfield, long-term effort to evolve how decisions are made across the platform using AI-driven systems. You won't just integrate APIs or build demos; you'll build the AI brain that works alongside (and increasingly drives) our core automation engine, with real production impact from day one and room to grow into technical leadership as the group scales.

Agentic AI Architecture: Design and build autonomous AI agents that analyze infrastructure in real time and make intelligent decisions. Work with modern agentic frameworks (LangGraph, PydanticAI) and conversational AI to create multi-agent systems - including troubleshooting, optimization, FinOps, and how-to agents. Leverage core LLM capabilities (tool-use, memory, retrieval) to operate safely in production.
Platform Integration & Intelligent Decision Systems: Develop MCPs to expose capabilities to AI agents that reason over infrastructure environments, metrics, configurations, and cost signals. Build integrations with tools like Slack, Jira, and AI-powered IDEs (Cursor, Windsurf) to deliver context-aware insights, from "why is this pod not scheduling?" to "how can we reduce costs by 30% safely?"
AI Model Development & MLOps: Build and deploy machine learning models that learn from infrastructure patterns - detecting the right resource policies for workloads, predicting optimal scaling triggers, and recommending GPU configurations. Own the complete ML pipeline from training to production, ensuring models are reliable, monitored, and continuously improving.
R&D AI Tools Development & Adoption: Build and embed internal AI tools to accelerate engineering, development, research, and support.
AI Tools for Business Impact: Develop AI-powered tools that help Sales and Support teams demonstrate value instantly - agents that analyze customer infrastructure, generate cost optimization reports automatically, and turn technical data into clear business recommendations.
End-to-End Ownership: Own AI systems from concept to production, ensuring they're fast (sub-2-second responses), reliable, safe, and cost-effective. Build evaluation frameworks to measure quality, implement security controls, and balance performance tradeoffs in production.
Technical Leadership: Define AI architecture and best practices as a founding member of the AI team. Make key technical decisions - choosing frameworks, designing multi-agent systems, establishing data governance - and shape how evolves from AI-enhanced internal tools to customer-facing AI products.