דרושים » הנדסה » AI Framework software engineer בחברת הייטק

We are looking for outstanding candidates with hands-on experience in development and optimization of AI frameworks. If you are a team player with excellent communication skills and motivation to revolutionize application performance, youre welcome on board!
What will you be doing?
Work as part of an innovative research team to analyze, develop, test and deploy improvements that enhance Huaweis distributed AI framework.
Develop optimizations that leverage hardware accelerator capabilities, minimize communication overhead and improve training/inference throughput
Push the boundaries of the state of the art in LLM performance and efficiency, including model compression and quantization
Analyze, profile and optimize the latest LLM AI algorithms, and implement as production-quality software libraries for latency-critical use-cases on next-generation hardware.
Work in a distributed computing environment to optimize for both scale-up (multi-device) and scale-out (multi-node) systems
Utilize advanced concepts such as Uncertainty Quantification, Mixed Precision Computing and Model Sparsity to improve performance and enable training of very large AI models
Collaborate with partners from top universities, and open-source communities to conduct state-of-the-art research

Our AI Solutions team in Israel is looking for an AI / machine learning / data engineer to join the LLM-based solutions engineering group. The team develops and sustains large language model (LLM)-powered tools that drive root cause analysis (RCA) and intelligent debugging for our current and next-generation hardware platforms. Our work accelerates issue resolution, improves product reliability, and powers the worlds most advanced GPU and data center technologies.

Our Hardware Networking division is a global leader in delivering end-to-end accelerated computing and connectivity solutions for high-performance data centers. We design innovative GPUs, networking platforms, and AI software that power modern workloads: from large language models and deep learning to cloud, enterprise, and hyperscale environments. Our products optimize performance and reliability at scale, supporting industries such as AI/ML, cloud, HPC, autonomous vehicles, and media & entertainment. We continually reinvent our platforms to stay ahead of the market and deliver breakthrough solutions that transform how computing and hardware engineering are done.

What youll be doing:

Build and maintain data pipelines and ETL flows for logs, telemetry, and hardware test data supporting AI/ML workflows.

Prepare, clean, and structure large, complex datasets (structured & unstructured) to train and fine-tune LLMs.

Assist in developing and deploying LLM-based applications for root cause analysis and hardware debugging.

Experiment with prompt engineering, retrieval-augmented generation (RAG), and vector search to integrate knowledge into models.

Collaborate with hardware, reliability, and AI platform teams to embed intelligent debugging tools into our engineering ecosystem.

Monitor and evaluate model performance, ensuring accuracy, scalability, and reliability in production environments.

Today, were tapping into the unlimited potential of AI to define the next era of computing. An era in which our GPU acts as the brains of computers, robots, and self-driving cars that can understand the world. Doing whats never been done before takes vision, innovation, and the worlds best talent. Youll be immersed in a diverse, supportive environment where everyone is inspired to do their best work. Come join the team that is building AI platform for operating AI factories to make a lasting impact on resilient operations of AI clusters.

What will you be doing:

You will bring together and understand internal and external customer requirements to improve AI cluster resiliency and design AIOps-based solutions that address these needs.

Develop automated workflows for issue detection and root cause analysis and closely collaborate with operators to debug sophisticated, full-stack AI cluster problems. We will bring to bear the findings for product improvements!

Deliver compelling technical presentations and lead hands-on demos or training. You'll also handle evaluation deployments (POC/POV) and ensure smooth, reliable installations by staying engaged and encouraging throughout the customer journey.

We are looking for an AI Developer with hands-on technical skills to join our team. This role combines development skills with product leadership and expertise in AI technologies. You will be responsible for the full lifecycle of AI agents, from vision and strategy through design, development and deployment. You will be deeply involved in building intelligent AI agents, engineering guidelines and designing impactful products that are at the intersection of technology and User Experience.
* Define and communicate the product vision and roadmap for AI-driven solutions, aligning business goals with technical feasibility.
* Take an active role in designing, coding and delivering AI agents, working as a full member of the development team.
* Research, create and optimize guidelines to improve Large Language Model (LLM) outputs in terms of accuracy, relevance and user satisfaction.
* Manage the full lifecycle of AI agents - from concept to launch and beyond, including monitoring and improving them over time.
* Analyze product performance using key performance indicators (KPIs) and drive continuous improvement based on data and user feedback.
* Ensure that AI solutions are designed and deployed in accordance with the principles of responsible AI, with a focus on transparency, fairness, and trust.

A leading medical company based in Caesarea is seeking an AI Developer with 2+ years of software development experience to join its growing team.
Key Responsibilities:
Define and lead the vision and roadmap for AI-driven solutions.
Design, implement, and deploy AI agents as part of the development team.
Conduct research and optimize LLM outputs to improve accuracy and relevance.
Manage the full development lifecycle of AI agents, from concept to deployment and continuous improvement.
Analyze product performance based on KPIs and introduce enhancements accordingly.
Ensure adherence to responsible AI principles, including transparency, fairness, and trust.

We are recruiting an MLOps / AI-Ops Engineer to join our data & AI Division in Haifa.
This role is responsible for managing, optimizing, and scaling the organizations AI/ML infrastructure across both cloud and on-prem environments, ensuring high availability, performance, and cost efficiency.
Role Overview:
* Manage day-to-day AI infrastructure operations, ensuring reliability, performance, and scalability.
* Deploy, configure, maintain, and troubleshoot AI platforms and tools, including GPU orchestration, Kubernetes, MLflow/Kubeflow, and vector databases.
* Monitor resource utilization (CPU, GPU, memory, Storage, network) and implement performance optimizations.
* Support CI/CD pipelines and infrastructure automation using Infrastructure as Code (Terraform, Ansible).
* Implement security best practices, manage access control, and ensure compliance with AI governance policies.
* Troubleshoot operational incidents and collaborate with AI Platform and AI Security Engineers.
* Contribute to documentation, runbooks, and knowledge sharing.
* Identify opportunities to improve AI infrastructure processes and tooling.