דרושים » תוכנה » Big Data Engineer

משרות על המפה
 
בדיקת קורות חיים
VIP
הפוך ללקוח VIP
רגע, משהו חסר!
נשאר לך להשלים רק עוד פרט אחד:
 
שירות זה פתוח ללקוחות VIP בלבד
AllJObs VIP
כל החברות >
משרה זו סומנה ע"י המעסיק כלא אקטואלית יותר
מיקום המשרה: הרצליה
סוג משרה: משרה מלאה
משרות דומות שיכולות לעניין אותך
סגור
דיווח על תוכן לא הולם או מפלה
מה השם שלך?
תיאור
שליחה
סגור
v נשלח
תודה על שיתוף הפעולה
מודים לך שלקחת חלק בשיפור התוכן שלנו :)
חברה חסויה
Location: Herzliya
Job Type: Full Time
We are seeking an experienced Data Platform Engineer to join our Storage Analytics team. You will design and build data solutions that provide critical insights into storage performance and usage across Apple's entire device ecosystem.
Description:
Working with large-scale telemetry data from millions of Apple devices worldwide, you'll support multiple CoreOS Storage teams, including Software Update, Backup/Restore/Migration, Storage Attribution, and other storage domains.
Responsibilities
Design, build, and maintain scalable data processing infrastructure to handle large-scale telemetry from Apple's global device fleet
Develop highly scalable data pipelines to ingest and process storage performance metrics, usage patterns, and system telemetry with actionable alerting and anomaly detection
Build and maintain robust data platforms and ETL frameworks that enable CoreOS Storage teams to access, process, and derive insights from storage telemetry data
Engineer automated data delivery systems and APIs that serve processed storage metrics to various engineering teams across different storage domains
Requirements:
Bachelor's degree in Computer Science or related technical field
4+ years of professional experience in data modeling, pipeline development, and software
engineering
Programming Languages: excellent programming skills in Python with strong computer science foundations (data structures, low-level parallelization.
Database Management: Strong SQL skills and hands-on experience with relational databases and query engines (PostgreSQL, Impala, Trino)
Experience with data analysis tools and libraries (Pandas/Polars, NumPy, dbt)
Experience with big data technologies (Kafka, Spark, Databricks, S3)
Experience with Apache Airflow, Dagster, or similar data orchestration frameworks for workflow orchestration, scheduling, and monitoring
Experience with containerization and orchestration (Docker, Kubernetes /visualization & Reporting:
Strong proficiency with creating and maintaining Tableau/Grafana dashboards and workflows
Preferred Qualifications:
Master's or PhD in Computer Science or related field
Deep expertise in data principles, data architecture, and data modeling
Strong problem-solving skills and meticulous attention to detail, with the ability to tackle loosely
defined problem
This position is open to all candidates.
 
Show more...
הגשת מועמדותהגש מועמדות
עדכון קורות החיים לפני שליחה
עדכון קורות החיים לפני שליחה
8407471
סגור
שירות זה פתוח ללקוחות VIP בלבד
סגור
דיווח על תוכן לא הולם או מפלה
מה השם שלך?
תיאור
שליחה
סגור
v נשלח
תודה על שיתוף הפעולה
מודים לך שלקחת חלק בשיפור התוכן שלנו :)
חברה חסויה
Location: Herzliya
Job Type: Full Time
You will join the R&D team building the next generation of our AI-powered metadata and context management. This system is the backbone that enables instant, actionable answers via our MCP and agentic use cases by translating complex business questions into secure, cost-aware data queries.

This is a high-impact, data-intensive role requiring production-grade backend development expertise, focused on quality, governance, and low-latency retrieval across complex data sources.

What youll do:
This role focuses on the end-to-end backend development and engineering quality for our core AI retrieval plane:
Design and Scale Context Retrieval: Develop and deploy services for our hybrid RAG/GraphRAG systems, combining lexical and vector search on data from various sources.
Implement Governance Gates: Build mission-critical backend logic to enforce data security policies, ensuring customer data and internal business data are filtered, masked, or isolated based on policy tags before context is ever generated.
Own the Quality Lifecycle: Design and implement automated evaluation to continuously measure the precision, recall, and faithfulness of the retrieved context against golden metrics.
Optimize Performance and Cost: Architect backend solutions for performance, including designing semantic caching strategies, memory, and context compression.
Data Modeling & APIs: Contribute to the graph model and APIs for retrieving metadata (glossary terms, lineage, schemas), enabling sophisticated context assembly for the agent.
Full Observability: Implement comprehensive tracing and monitoring for every agent component and tool call, ensuring high service reliability and quick root-cause analysis.
Requirements:
What you have
Primary Language: 4+ years of hands-on experience developing and deploying production-grade services at scale.
Data & Backend Excellence: Proven experience with large-scale distributed systems, and familiarity with large-scale production databases and data flow principles.
Search & Information Retrieval Expertise: Strong hands-on experience with search engines, vector indexing, and designing a hybrid retrieval mechanism.
Cloud Data Fluency: Experience with BigQuery and familiarity with general cloud platforms (AWS/GCP) for deploying data-intensive applications.
Quality Mindset: A strong commitment to quality engineering, test automation, and an ability to drive product excellence through data-driven decisions.
Bonus points.
Familiarity with metadata frameworks (DataHub, OpenMetadata, DataPlex, etc).
Passionate about building or integrating LLM-based systems (LangChain, RAG, vector DBs, etc.).
Python experience .
Recommended by our employee.
This position is open to all candidates.
 
Show more...
הגשת מועמדותהגש מועמדות
עדכון קורות החיים לפני שליחה
עדכון קורות החיים לפני שליחה
8437046
סגור
שירות זה פתוח ללקוחות VIP בלבד
סגור
דיווח על תוכן לא הולם או מפלה
מה השם שלך?
תיאור
שליחה
סגור
v נשלח
תודה על שיתוף הפעולה
מודים לך שלקחת חלק בשיפור התוכן שלנו :)
לפני 8 שעות
Location: Herzliya
Job Type: Full Time
We are looking for a Senior Live Streaming Software Engineer.
As a Senior Software Engineer in our Edge AI group, you will design, develop, and maintain media encoding pipelines and live streaming workflows for both cloud and on-premises environments.
You will build infrastructure, tools, and real-time monitoring systems that ensure reliable live video delivery and operational visibility.
Your work will involve writing code that integrates with Azure resources and extensions, leveraging modern technology stacks and methodologies.
You will be expected to break down complex problems, create clear execution plans, and take full ownership of your code from development through production. Collaboration within a multi-disciplinary team will be key, requiring strong communication skills and alignment with values.
In addition, you will automate quality control and alerting mechanisms to rapidly detect and resolve streaming issues, ensuring a seamless experience for customers streaming camera feeds and viewing live video alongside AI-driven insights.
Requirements:
5+ years of experience with SW development using C#, Java, Python or similar language.
Practical experience with AI-based or agentic development tools (e.g., GitHub CopilotAgent, Cursor, Claude Code, Cline).
Highly Familiar with distribution formats such as MPEG-TS, HLS, MPEG-DASH, and CMAF, including segmenting and packaging for live and on-demand delivery.
Solid understanding of end-to-end streaming systems design: ingest (e.g., RTSP), processing/analytics pipelines, packaging/origin, CDN delivery, player behavior, and operational observability (metrics, logging, alerting)
Other-
B.Sc. in Computer Science or equivalent
Ability to automate quality control and alerting for streaming workflows to detect and resolve streaming issues rapidly.
Familiarity with video transport protocols such as RTSP, RTP, RTMP, SRT and related streaming technologies.
WebRTC experience for interactive streaming scenarios.
Proven experience with real-time or streaming data processing (e.g. Kafka or similar).
Proven ability to lead complex tasks in unfamiliar domains and deliver them to production.
Experience developing and operating code in cloud environments (Azure / AWS / GCP).
Experience with Docker, Kubernetes, and modern CI/CD practices.
Team player with proven communication skills
A proactive, ownership-driven approach with the ability to lead complex projects end-to-end.
Proven problem-solving and coding skills with a passion for elegant architecture.
Demonstrated ability to think creatively and being resilient to change
Hands-on experience with DeepStream (by NVIDIA) for building and operating real-time video analytics and streaming pipelines
This position is open to all candidates.
 
Show more...
הגשת מועמדותהגש מועמדות
עדכון קורות החיים לפני שליחה
עדכון קורות החיים לפני שליחה
8446729
סגור
שירות זה פתוח ללקוחות VIP בלבד
סגור
דיווח על תוכן לא הולם או מפלה
מה השם שלך?
תיאור
שליחה
סגור
v נשלח
תודה על שיתוף הפעולה
מודים לך שלקחת חלק בשיפור התוכן שלנו :)
28/11/2025
Location: Herzliya
Job Type: Full Time
At Infinidat, we help enterprises and service providers empower their data-driven competitive advantage at scale. We are a leading provider of enterprise-class storage solutions. The company’s software-focused architecture delivers sub-millisecond latency, full availability, and scalability with a significantly lower total cost of ownership than competing storage technologies. We’re looking for passionate and bright individual who wish to take part in the design, development and all technical-related aspects of INFINIDAT’s S3 Protocol Development team. As a Software Engineer in the S3 Protocol Development team, you will design and implement core features of an S3-compatible object storage system. You will work on high-performance data paths, distributed systems logic, and protocol compliance to ensure seamless integration with high performance applications and data protection applications. Your work will directly.

Responsibilities:


* Design, develop, and optimize core S3 protocol components in a large-scale distributed storage system.
* Ensure compliance with AWS S3 API standards and extend functionality with advanced features.
* Collaborate with cross-functional teams on scalability and performance optimizations.
* Troubleshoot and resolve complex issues in development and test environments.
* Participate in code reviews, design discussions, and architectural decision-making.
* Continuously explore and evaluate new technologies and approaches to enhance protocol efficiency and system reliability.
Requirements:
* 2-5 years of development experience in Backend C++/GoLang Software Developer over Linux.
* BSc./B.A. in Computer Science/Computer Engineering/equivalent degree graduate.
* Strong problem-solving skills along with the ability to work independently.
* Highly motivated, confident, a quick learner and a team player.
* Strive to learn new things and gain experience.
* Ability to read and understand a large and complex existing code-base, as well as analyze and debug complex multi-threaded code. Preferred Qualifications
* Development experience in storage protocols NFS/SMB/S3.
* Development in network servers/backend
* Experience in distributed systems and performance-oriented development.
* Experience in developing enterprise class software.
About Infinidat Infinidat’s enterprise storage portfolio provides global Fortune 500 enterprises and service providers with best-in-class solutions for primary storage, next-generation data protection, disaster recovery, business continuity, and cyber resilience. Infinidat’s acclaimed InfuzeOS is the one of the most flexible and complete enterprise software-defined storage architectures in the industry. We recently announced powerful enhancements, an extensive expansion, and the dynamic evolution of our award-winning G4 enterprise cyber and AI storage solutions! Not only has Infinidat won 22 awards in the first half of 2025 , but has also been a 7-time winner of the Gartner® Peer Insights™ Voice of the Customer Award for Primary Storage and we can go on, and on, and on!?
This position is open to all candidates.
 
Show more...
הגשת מועמדותהגש מועמדות
עדכון קורות החיים לפני שליחה
עדכון קורות החיים לפני שליחה
8322693
סגור
שירות זה פתוח ללקוחות VIP בלבד
סגור
דיווח על תוכן לא הולם או מפלה
מה השם שלך?
תיאור
שליחה
סגור
v נשלח
תודה על שיתוף הפעולה
מודים לך שלקחת חלק בשיפור התוכן שלנו :)
30/11/2025
Location: Herzliya
Job Type: Full Time
At Infinidat, we help enterprises and service providers empower their data-driven competitive advantage at scale. We are a leading provider of enterprise-class storage solutions. The company’s software-focused architecture delivers sub-millisecond latency, full availability, and scalability with a significantly lower total cost of ownership than competing storage technologies. We are looking for a Python Developer to join our growing Hardware Infra team , part of the RnD group You will play a crucial role in architecting and developing the core of the infrastructure and tools that power our innovative solutions and ensure all our products are tested, shipped, and maintained with the highest quality standards. If you are innovative and passionate and looking for creative ways to improve product testing architecture and infrastructure - come and join us!

Responsibilities:

* Enhance and maintain appliance tools that monitor our products in a customer environment.
* Design and develop robust and scalable testing infrastructure and complex test scenarios ensuring high-performance and reliable products.
* Full ownership over the design and implementation of constantly improving web applications, API backends, and appliance tools.
* Collaborate with cross-functional teams including DevOps, Software Engineering, Hardware, and Validation to design and implement efficient, reusable, and reliable applications.
* Investigate and solve hard-to-find problems such as race conditions, hardware failures, delicate timing issues, and problems happening only at large scale.
Requirements:
* At least 4 years of working experience with Python.
* Proven experience in linux/unix environments.
* Problem-solver along with the ability to work independently and as a team.
* Organized, pays attention to small details. Able to manage multiple tasks simultaneously.
* Fluent English speaking and writing skills.
* Experience in Git and GitLab pipeline.
* Proven experience with complex large-scale systems - an advantage.
* Experience with Relational Database Management Systems - an advantage.
* Experience in debugging hardware problems (i.e server, SSD, JBOD, spinning drives, Infiniband, firmware, PDU, BBU, etc) - an advantage.
* Experience with storage hardware elements and protocols (i.e. SAS, SATA, NVMe, NAS, SAN and similar) - an advantage.
* A Bachelor’s degree in Computer Science/Electrical Engineering or equivalent education - an advantage. ?About Infinidat Infinidat’s enterprise storage portfolio provides global Fortune 500 enterprises and service providers with best-in-class solutions for primary storage, next-generation data protection, disaster recovery, business continuity, and cyber resilience. Infinidat’s acclaimed InfuzeOS is the one of the most flexible and complete enterprise software-defined storage architectures in the industry. We recently announced powerful enhancements, an extensive expansion, and the dynamic evolution of our award-winning G4 enterprise cyber and AI storage solutions! Not only has Infinidat won 22 awards in the first half of 2025 , but has also been a 7-time winner of the Gartner® Peer Insights™ Voice of the Customer Award for Primary Storage and we can go on, and on, and on!?
This position is open to all candidates.
 
Show more...
הגשת מועמדותהגש מועמדות
עדכון קורות החיים לפני שליחה
עדכון קורות החיים לפני שליחה
8276030
סגור
שירות זה פתוח ללקוחות VIP בלבד
סגור
דיווח על תוכן לא הולם או מפלה
מה השם שלך?
תיאור
שליחה
סגור
v נשלח
תודה על שיתוף הפעולה
מודים לך שלקחת חלק בשיפור התוכן שלנו :)
חברה חסויה
Location: Herzliya
Job Type: Full Time
Were looking for a Big Data Engineer who loves turning massive, messy datasets into scalable, reliable systems. Youll design and maintain data pipelines, ensure data quality, and collaborate with data scientists and product managers to bring new insights to life.

What youll do:
Design, build, and optimize scalable data pipelines and ETL processes
Own data products from design to production.
Ensure data accuracy, integrity, and performance across large datasets.
Collaborate with data scientists and engineers to deliver production-grade experiment.
Requirements:
What you have:
B.Sc. in computer science or an equivalent.
3+ years in Big Data engineering.
Strong programming skills (Scala, Python, Java).
Hands-on experience with Spark or similar distributed frameworks.
Skilled in SQL and data modeling.
Experience with cloud platforms (AWS / GCP).
A pragmatic, ownership-driven mindset.

Bonus points:
Experience with data warehousing (BigQuery, Redshift, Snowflake).
Exposure to A/B testing or marketing measurement.
Recommended by our employee.
This position is open to all candidates.
 
Show more...
הגשת מועמדותהגש מועמדות
עדכון קורות החיים לפני שליחה
עדכון קורות החיים לפני שליחה
8435997
סגור
שירות זה פתוח ללקוחות VIP בלבד
סגור
דיווח על תוכן לא הולם או מפלה
מה השם שלך?
תיאור
שליחה
סגור
v נשלח
תודה על שיתוף הפעולה
מודים לך שלקחת חלק בשיפור התוכן שלנו :)
לפני 7 שעות
Location: Herzliya
Job Type: Full Time
We are looking for AI Engineer to join the Data Science team.
As an AI Engineer in the Data Science team, you will be working closely with applied researchers on model optimizations, GPU and hardware, language-model optimizations in the Video and Language domains and more. 
Your code will reach Azure resources and extensions, and you will use various technology stacks with the latest tools and methodologies.
You will be expected to break down problems, learn and develop, have an open mind, and have ownership all the way to production. Working in a multi-disciplinary team will require excellent communication skills and at the heart of it all, alignment with values and endless curiousness.
Requirements:
B.Sc. in Computer Science or equivalent 
4+ years of experience with SW development using Python, C# or Java.
Experience with AI models and Kubernetes
Experience with developing and operating code in the cloud on Azure / AWS / GCP 
Preferred: 
Master's degree in computer science or equivalent
Experience in GPU programming and GPU-accelerated ML workflows, including model optimization and debugging on GPU hardware
Other
Ability to build tools and infrastructure to improve shipping and ensure software quality
Strong ability in code and solution design, creating modular and reusable solutions in both code and AI infrastructures
Able to lead complex tasks in unknown territories independently and bring them to production
Skills to leverage AI in coding, testing, and building automations using tools like GitHub Copilot Agent, Cursor, Claude Code, Cline etc. 
Demonstrated ability to think creatively and out of the box
This position is open to all candidates.
 
Show more...
הגשת מועמדותהגש מועמדות
עדכון קורות החיים לפני שליחה
עדכון קורות החיים לפני שליחה
8446786
סגור
שירות זה פתוח ללקוחות VIP בלבד
סגור
דיווח על תוכן לא הולם או מפלה
מה השם שלך?
תיאור
שליחה
סגור
v נשלח
תודה על שיתוף הפעולה
מודים לך שלקחת חלק בשיפור התוכן שלנו :)
חברה חסויה
Location: Herzliya
Job Type: Full Time
Were looking for an experienced Team Leader to join our growing R&D.
We use Java to develop our backend and use the latest AWS services for development and production environments.
You will:
Hire, mentor, and grow a full-stack agile engineering team, fostering a culture of technical excellence and innovation
Take a hands-on approach in developing the tools and infrastructure for our data processes
Work closely with product team to understand and define requirements
Manage your team tasks and ensure quality and timely execution using agile methodologies
Keep up-to-date on the latest techniques in management, development, and testing
Requirements:
5+ years as a team leader
10+ years of experience in server-side development (Java)
Experience in designing and developing scalable, high-performance systems within a microservice-oriented architecture
Experience in agile development, including continuous integration (CI), continuous deployment (CD), and coding for automated testing
Experience with DevOps methodologies and best practices (or at the very least, full-service ownership - creating and deploying services in a microservice environment)
Experience with SQL and NoSQL databases (e.g., MariaDB, Aurora, PostgreSQL, MongoDB)
Experience with in-memory data stores (e.g., Redis) and messaging/queuing systems (e.g., Kafka, RabbitMQ, SQS)
Experience with AWS services (e.g., Lambda, S3, CloudWatch)
Experience with containerization and orchestration technologies (e.g., Docker, Kubernetes)
Experience with Ai code assistant tools - cursor/claude code
Strong problem-solving skills with a get-things-done mentality
A team player with excellent collaboration skills
This position is open to all candidates.
 
Show more...
הגשת מועמדותהגש מועמדות
עדכון קורות החיים לפני שליחה
עדכון קורות החיים לפני שליחה
8423227
סגור
שירות זה פתוח ללקוחות VIP בלבד
סגור
דיווח על תוכן לא הולם או מפלה
מה השם שלך?
תיאור
שליחה
סגור
v נשלח
תודה על שיתוף הפעולה
מודים לך שלקחת חלק בשיפור התוכן שלנו :)
03/11/2025
חברה חסויה
Location: Herzliya
Job Type: Full Time
We are looking for an experienced DevOps Engineer to be a part of our team!

We are located in Herzliya and work in a hybrid work mode.

Manage and optimize Kubernetes clusters on OCI to ensure high availability and scalability of applications.
Collaborate closely with R&D and Data teams to align infrastructure solutions with business objectives.
Develop and maintain infrastructure as code using tools like Terraform, АrgoCD.
Design, implement, and maintain CI/CD pipelines using Gitlab CI for various projects.
Fix and resolve issues in development, test, and production environments.
Take part in on-call support during off-hours.
Requirements:
Bachelor's Degree in Software Engineering, Computer Science, Information Technology, Information Systems, or similar.
4+ years as a DevOps engineer in production environments 24x7.
Proficiency in the cloud (OCI - preferred).
Deep understanding of Kubernetes, container orchestration, and the broader cloud-native ecosystem.
Hands-on experience deploying and managing complex Kubernetes environments, including services, ingresses, load balancers, and Helm charts.
Proven experience with Infrastructure as code (Ansible and Terraform/Tofu).
Strong experience in implementing CI/CD pipelines using tools like GitLab CI
Deep understating of the software development lifecycle and strong scripting and coding skills in Bash and Python.
GitOps: Experience with tools like ArgoCD and Rancher.
Experience in managing monitoring and logging systems (Prometheus, Grafana, Splunk, Datadog, Site24)
Familiarity with queues (RabbitMQ, ActiveMQ, Kafka)
Familiarity with databases ( Oracle, Mysql)
Experience with Linux-based systems like (RedHat/Oracle Linux/Fedora/Debian) at an administrative level.
English at a high level.
This position is open to all candidates.
 
Show more...
הגשת מועמדותהגש מועמדות
עדכון קורות החיים לפני שליחה
עדכון קורות החיים לפני שליחה
8398091
סגור
שירות זה פתוח ללקוחות VIP בלבד
סגור
דיווח על תוכן לא הולם או מפלה
מה השם שלך?
תיאור
שליחה
סגור
v נשלח
תודה על שיתוף הפעולה
מודים לך שלקחת חלק בשיפור התוכן שלנו :)
לפני 7 שעות
Location: Herzliya
Job Type: Full Time
Are you a passionate Applied Scientist ready to make a global impact? Join our elite AI and data science team.
If you are a talented Applied Scientist with strong technical skills, a passion for turning data and research into real-world impact, and the ambition to design, experiment, and ship innovative ML and AI solutions, we would love to talk to you!
In our team, you will:
Develop ML models to detect and disrupt cyberattacks.
Collaborate with security experts to incorporate domain knowledge into ML solutions.
Work with truly large-scale data to create and refine high-quality training datasets.
Deploy ML models into production, monitor their performance, and continuously improve them.
Stay up to date with the latest advancements in ML/AI and apply them to complex cybersecurity challenges.
Requirements:
M.Sc. in Computer Science (or equivalent).
You have at least 2+ years of hands-on experience in Machine Learning using frameworks such as scikit-learn, PyTorch, or similar.
You have Hands-on experience in software development.
Preferred Qualifications:
Background or strong interest in cybersecurity.
Publications in AI-related research.
Experience with large-scale data systems (e.g., Spark).
Software development experience in C, Java, or C++.
Ability to drive challenging projects from ideation to production.
Ability to quickly learn new technologies independently.
Strong interpersonal skills, teamwork, and collaboration.
This position is open to all candidates.
 
Show more...
הגשת מועמדותהגש מועמדות
עדכון קורות החיים לפני שליחה
עדכון קורות החיים לפני שליחה
8446772
סגור
שירות זה פתוח ללקוחות VIP בלבד