דרושים » AI » LLM Applications Developer

As a Senior LLM Applications Developer, youll design and integrate Large Language Models (LLMs), agentic AI, and AI agents into production at scale. Youll architect backend systems, optimize prompts, and lead technical decisions that define how AI powers our caregiving platform. Beyond coding, youll mentor the team and pioneer new agent-driven AI capabilities that drive our mission forward.



What Youll Do

Design and develop backend services for AI-driven applications
Architect and optimize prompts for LLMs in production
Integrate AI/LLM models into scalable, secure, cloud-based systems
Collaborate with AI, Product, and Data teams to deliver impactful features
Mentor developers and set best practices in backend engineering
Explore new AI models and tools, leading adoption into production

Were looking for a highly motivated AI Developer to help design, build, and deploy intelligent agentic systems across our product ecosystem. In this role, you'll work at the intersection of machine learning, backend systems, and modern frontend technologies to deliver AI-first features that feel magical to users.

This is a hands-on, cross-functional role ideal for engineers who love building full-fledged featuresfrom data pipelines and LLM orchestration to intuitive UI experienceswith a strong product mindset.

Responsibilities:
AI Agent Design & Integration
Design and implement autonomous or semi-autonomous agents using LLMs (e.g., OpenAI, Anthropic, open-source models).
Work with prompt engineering, RAG pipelines, and tool/plugin integrations to enable agents to interact with internal and external systems.
Build scalable agent runtimes and orchestration layers (e.g., LangChain, Semantic Kernel, ReAct-based agents).
Fullstack Product Development
Own full-stack features end-to-end: from backend APIs and data models to React-based frontend interfaces.
Integrate AI/agent capabilities into customer-facing products with clean UX and measurable performance.
Collaborate closely with design, product, and data teams to bring ideas from concept to production.
Systems & Infrastructure
Build and maintain backend services and pipelines that support AI agents, including vector search, embeddings, function calling, and observability.
Optimize inference flows for performance and cost, potentially using streaming, caching, or local model inference.
Ensure systems are secure, reliable, and compliant with InfoSec standards.
Experimentation & Continuous Improvement
Rapidly prototype and iterate on new AI capabilities and user experiences.
Analyze performance and usage metrics to drive product and model improvements.
Stay up to date with the evolving AI toolchain and emerging agent architectures.

Were hiring a ML Engineer to accelerate AI-driven innovation across B2B SaaS platform.
Youll be at the forefront of building intelligent systems that power core product experiences and automate internal operations, driving efficiency, speed, and scale across the organization. This is a high-impact, hands-on role in a fast-growing, AI-first company where machine learning is a foundational pillar, not a bolt-on feature. You'll partner with product, engineering, and operations teams to design and implement powerful ML and LLM-based solutions that make a measurable difference.
What You Will Do.:
Build Intelligent Systems: Design and develop ML/LLM-powered solutions that solve real-world challenges across product and internal workflows.
Own Full Lifecycles: Take projects from concept all the way to production, including model training, evaluation, integration, and monitoring.
Leverage State-of-the-Art Tools: Work with leading frameworks like LangChain, Hugging Face, TensorFlow, and PyTorch to deliver cutting-edge functionality.
Collaborate Cross-Functionally: Partner with product managers, engineers, and stakeholders to embed AI capabilities into user-facing features and backend services.
Ship at Scale: Build and maintain scalable APIs and services, integrating best practices in CI/CD, observability, and cloud infrastructure.
Report with Impact: Share progress, challenges, and results clearly with technical and executive stakeholders.

we are looking for an AI Platform Engineer to revolutionize engineering productivity and drive AI-powered innovation across the organization. This role is part of our Platform Engineering initiative, focused on enabling engineers and product teams with cutting-edge AI tools, automation, and scalable AI platforms.
If youre an innovator at heart, passionate about leveraging AI to solve complex problems, and thrive in an environment where experimentation and entrepreneurship are encouragedthis role is for you.
Responsibilities:
 Develop and integrate AI-powered solutions to enhance engineering productivity, automate workflows, and improve developer efficiency.
Evaluate and implement state-of-the-art AI platforms (ChatGPT, Claude, Gemini, custom models) to solve engineering and operational challenges.
Design and maintain AI-driven internal platforms such as knowledge management systems, AI-enhanced coding assistants, intelligent automation tools, and AI-powered chatbots.
Work alongside engineering, DevOps, and product teams to embed AI into everyday development workflows.
Lead Proof-of-Concept (PoC) projects, experimenting with LLMs, generative AI, and automation frameworks to create tangible business impact.
Stay ahead of emerging AI trends, researching and implementing cutting-edge AI models and tools.
Build scalable AI infrastructure that integrates with cloud environments (AWS, GCP, Azure) and engineering toolchains.
Promote a culture of innovation, empowering teams to embrace AI-driven solutions and fostering AI adoption across the organization.

We are seeking a highly skilled and motivated Team Leader to build and lead a new team dedicated to developing orchestration tools and software solutions for AI datacenters.
The main goal of this team is to design and deliver customer-focused orchestration platforms that simplify the deployment, management, and monitoring of large-scale AI workloads.
This role combines technical leadership with hands-on development, covering the entire AI datacenter ecosystem including switches, hosts, smart NICs, GPUs, ROCm, and RCCL. The team will primarily develop in Python, complemented by modern full-stack technologies for user interfaces and control systems.
Key Responsibilities:
Lead and mentor a team of engineers building orchestration tools that manage complex AI datacenter infrastructures.
Define the teams vision, roadmap, and architecture for orchestration solutions that enhance customer experience and operational efficiency.
Design and implement distributed control and orchestration systems using Python and full-stack frameworks.
Collaborate with networking, compute, and AI acceleration teams to integrate orchestration capabilities across all datacenter components (switches, NICs, GPUs, and software stacks).
Work closely with product, QA, and DevOps teams to identify customer requirements and translate them into scalable, production-grade orchestration platforms.
Ensure software reliability, scalability, and maintainability through strong design principles, testing, and CI/CD practices.
Foster a culture of innovation, technical excellence, and cross-functional collaboration.

Come and be you with us
Being a worker is all about being you. We want you to bring all parts of yourself to work. giving you the freedom and confidence to be the best you and do your best work.
were waiting with open arms. Come join us.
About the Team
The AI team at our company is at the forefront of integrating cutting-edge AI technologies into our product, delivering features that enhance user experience, empower decision-making, and drive business insights.
We work in a true continuous delivery environment, with fully automated QA processes and a modern microservices architecture deploying to
Design, build, and maintain backend infrastructure and microservices supporting AI-driven features.
Collaborate closely with the infra and data groups to ensure smooth integration of AI models and services into our companys core systems.
Develop and optimize APIs, data pipelines, and background processing workflows.
Ensure performance, scalability, and resilience of production systems handling real-time AI interactions.
Drive engineering excellence through code reviews, architecture discussions, and automation.
Mentor other backend developers and promote best practices in software design, testing, and deployment.

About the role:
As an AI Backend Engineer at our company, you will be a key player in building our new AI platform, AI Studio. This platform aims to provide users with instant answers to complex market research questions, generate world-class reports, and create live, interactive, and powerful dashboards. Our goal is to reduce the complexity and time-to-insight for our users, helping them streamline their market tasks and achieve automation that drives real value.
Responsibilities:
Design and develop LLM-based intelligent agents that can handle complex market research queries.
Utilize LangGraph and other frameworks to create state of the art AI agents that integrate various tools and data sources.
Implement integrations that allow agents to take automated actions on behalf of users, streamlining workflows and reducing overhead.
Collaborate with product, data, and UX teams to ensure that AI solutions are aligned with user needs and business goals.
Continuously evaluate and improve the performance of AI models to ensure high-quality and data-driven results.

Harmony SASE is building the next generation of secure access services enabling organizations to connect users, sites, and applications safely and seamlessly from anywhere.
As part of our ongoing innovation, were expanding our capabilities around AI-driven development and automation. The Dev AI Infra & Tools team leads this transformation building the internal platforms and tools that empower our engineers to design, test, and deliver faster, smarter, and more securely.
Youll work hands-on with Generative AI frameworks and agents, developing the systems and integrations that change the way our engineering teams work.
Key Responsibilities
Design and build AI-driven internal tools that enhance developer productivity.
Develop and maintain the infrastructure supporting GenAI agents and automation frameworks.
Prototype and experiment rapidly, turning ideas into practical solutions.
Collaborate with DevOps, backend, and product engineers to identify and implement high-impact GenAI use cases.
Evaluate new Generative AI and agent-based technologies and integrate the most promising ones into production.
Define and track efficiency metrics to continuously improve developer velocity and experience.

We are seeking a highly skilled and motivated Backend Engineer with a Generative AI orientation to join our Infra team.

We are building a new AI Platform from scratch to standardize AI development methods, ensure excellence and efficiency, and deliver robust, scalable, and compliant AI capabilities across our product line.

This platform will handle cross-team concerns, such as prompt management, model access, data filtering, logging, and monitoring, centrally, so individual teams can focus on their own business-specific logic.

As a Backend Engineer with a Generative AI orientation, you will be instrumental in designing, developing, and implementing the core services of this foundational AI Platform. You will build components that enable our development teams to quickly innovate with AI while adhering to high standards for quality, cost-effectiveness, and compliance.

Responsibilities:

Develop and maintain a centralized microservice that handles all AI model interactions.
Build shared services and libraries to maximize development speed and cost-efficiency for AI based features/systems across the company
Setting the tone in the fields of automatic testing strategies and CI/CD for AI components, prompt management, and more.
Define and enforce best practices for model governance, security, and compliance.

As a Machine Learning Engineer, youll work on cutting-edge
code-focused LLMs and AI agent systems
that power our companys next-generation developer platform. Youll be at the center of research, model training, and productionization of intelligent systems that understand software deeply, collaborate with developers, and help automate engineering workflows end-to-end. Your work will immediately impact millions of engineers worldwide.
Responsibilities:
Push LLM Innovation: Research, design, and fine-tune domain-specific LLMs for code generation, refactoring, debugging, and multi-turn reasoning.
Agent-Oriented Development: Build multi-agent coding systems that integrate retrieval-augmented generation (RAG), code execution, testing, and tool use to create autonomous, context-aware coding workflows.
Production-Grade AI: Own the training-to-inference pipeline for large code modelsoptimize inference with quantization, distillation, and caching techniques.
Rapid Experimentation: Prototype and validate ideas quickly; leverage reinforcement learning, human feedback, and synthetic data generation to push accuracy and reasoning.
Cross-Functional Collaboration: Partner with product, engineering, and design teams to ship AI-powered features that help developers focus on high-impact work.
Scale the Platform: Contribute to distributed training, scalable serving systems, and GPU/TPU-efficient architectures for ultra-low-latency developer tools.