דרושים » דאטה » Big Data Infrastructure Engineer

Were looking for a Big Data Engineer to develop and integrate systems that retrieve, process and analyze data from around the digital world, generating customer-facing data. This role will report to our Team Manager, R&D.
Why is this role so important?
A data-focused company, and data is the heart of our business.
As a big data engineer developer, you will work at the very core of the company, designing and implementing complex high scale systems to retrieve and analyze data from millions of digital users.
Your role as a big data engineer will give you the opportunity to use the most cutting-edge technologies and best practices to solve complex technical problems while demonstrating technical leadership.
So, what will you be doing all day?
Your role as part of the R&D team means your daily responsibilities may include:
Design and implement complex high scale systems using a large variety of technologies.
You will work in a data research team alongside other data engineers, data scientists and data analysts. Together you will tackle complex data challenges and bring new solutions and algorithms to production.
Contribute and improve the existing infrastructure of code and data pipelines, constantly exploring new technologies and eliminating bottlenecks.
You will experiment with various technologies in the domain of Machine Learning and big data processing.
You will work on a monitoring infrastructure for our data pipelines to ensure smooth and reliable data ingestion and calculation.

We are seeking an experienced Solutions Data Engineer who possess both technical depth and strong interpersonal skills to partner with internal and external teams to develop scalable, flexible, and cutting-edge solutions. Solutions Engineers collaborate with operations and business development to help craft solutions to meet customer business problems.
A Solutions Engineer works to balance various aspects of the project, from safety to design. Additionally, a Solutions Engineer researches advanced technology regarding best practices in the field and seek to find cost-effective solutions.
Job Description:
Were looking for a Solutions Engineer with deep experience in Big Data technologies, real-time data pipelines, and scalable infrastructure-someone whos been delivering critical systems under pressure, and knows what it takes to bring complex data architectures to life. This isnt just about checking boxes on tech stacks-its about solving real-world data problems, collaborating with smart people, and building robust, future-proof solutions.
In this role, youll partner closely with engineering, product, and customers to design and deliver high-impact systems that move, transform, and serve data at scale. Youll help customers architect pipelines that are not only performant and cost-efficient but also easy to operate and evolve.
We want someone whos comfortable switching hats between low-level debugging, high-level architecture, and communicating clearly with stakeholders of all technical levels.
Key Responsibilities:
Build distributed data pipelines using technologies like Kafka, Spark (batch & streaming), Python, Trino, Airflow, and S3-compatible data lakes-designed for scale, modularity, and seamless integration across real-time and batch workloads.
Design, deploy, and troubleshoot hybrid cloud/on-prem environments using Terraform, Docker, Kubernetes, and CI/CD automation tools.
Implement event-driven and serverless workflows with precise control over latency, throughput, and fault tolerance trade-offs.
Create technical guides, architecture docs, and demo pipelines to support onboarding, evangelize best practices, and accelerate adoption across engineering, product, and customer-facing teams.
Integrate data validation, observability tools, and governance directly into the pipeline lifecycle.
Own end-to-end platform lifecycle: ingestion → transformation → storage (Parquet/ORC on S3) → compute layer (Trino/Spark).
Benchmark and tune storage backends (S3/NFS/SMB) and compute layers for throughput, latency, and scalability using production datasets.
Work cross-functionally with R&D to push performance limits across interactive, streaming, and ML-ready analytics workloads.
Operate and debug object store-backed data lake infrastructure, enabling schema-on-read access, high-throughput ingestion, advanced searching strategies, and performance tuning for large-scale workloads.

Were looking for a Senior Data Engineer in the Data Collection Ingest team to contribute to the design and coding of our data ingestion services & pipelines. This role involves working as part of a team that handles millions of requests per minute across multiple servers, and is responsible for a wide-range of data pipelines, processing billions of events each day.
Why is this role so important?
As the most trusted platform for measuring online behavior, millions of people rely on our insights daily as the ground truth for their knowledge of the digital world. Producing these insights requires large scale raw data to be ingested reliably in high scale to provide stable signals for analysis. As a Data Engineer you will have the opportunity to perform hands-on work and own our raw data ingestion pipeline end-to-end. Your work will have a direct impact on the quality and reliability of our data and the insights that our products are delivering to our customers.
So, what will you be doing all day?
Your role as Data Engineer of the Ingest Data Collection team means your daily responsibilities may include:
Design, code and manage end-to-end our data ingestion pipelines, both online and offline.
Take charge of developing & maintaining modern data infrastructure, while implementing best practices for building data pipelines.
Be responsible for high-scale ingestion services, solving challenges of availability, reliability, and scalability.
Run the production environment by monitoring availability and taking a holistic view of system health and data quality.
Own data infrastructure features from design to production using industry best practices with focus on quality and delivery.
Lead design & decision-making processes of the team.
Solve diverse complex problems of scale, performance and business logic.
Collaborate with product managers and other team leaders to plan, nurture, and implement an efficient and effective development process.
Continuously learn and evaluate new technologies in the everlasting effort to perfect our products
Perform code reviews, evaluate implementations, and provide feedback about potential improvements.
Improve your skills, learn from and mentor top-notch engineers and enrich other team members.
Have lots of fun!

We are looking for a Data Engineer to join our team and play a key role in designing, building, and maintaining scalable, cloud-based data pipelines. You will work with AWS services , Airflow and databricks to integrate, process, and analyze large datasets, ensuring data reliability and efficiency.
Your work will directly impact business intelligence, analytics, and data-driven decision-making across the company.
What Youll Do:
ETL & Data Processing: Develop and maintain ETL processes, integrating data from various sources (APIs, databases, external platforms) using Python, SQL, and cloud technologies.
Utilize LangGraph and other frameworks to create state of the art AI agents that integrate various tools and data sources.
Implement integrations that allow agents to take automated actions on behalf of users, streamlining workflows and reducing overhead.
Data Modeling: Design and maintain logical and physical data models to support business needs.
Optimization & Scalability: Improve process efficiency and optimize runtime performance to handle large-scale data workloads.
Collaboration: Work closely with BI analysts and business stakeholders to define data requirements and functional specifications.
Monitoring & Troubleshooting: Ensure data integrity and reliability by proactively monitoring pipelines and resolving issues.

We are looking for an experienced Senior Data Engineer to join our Data team. In this role, you will lead and strengthen our Data Team, drive innovation, and ensure the robustness of our data/analytics platforms.
A day in the life and how youll make an impact:
Design and develop high-performance Data Pipelines and ETL processes to support diverse business needs.
Work closely with Product, Business Intelligence, Sales and other teams to integrate data solutions, ensuring seamless alignment and collaboration across functions.
Continuously improve our data analytics platforms, optimizing system performance and ensuring robust, reliable data infrastructure.
Oversee the entire data lifecycle, from infrastructure setup and data acquisition to detailed analysis and automated reporting, driving business growth through data-driven insights.
Implement robust data quality checks, monitoring mechanisms, and data governance policies to maintain data integrity and security, troubleshooting and resolving any data-related issues efficiently.

Were looking for an Infrastructure Data Engineer to join our Data Labs (DL) department, which specializes in professional services for our super-premium customers. This role will report to our DL (Datalabs) Infrastructure Team Manager in the R&D.
Why is this role so important?
A data-focused company, and our unique AI and machine learning capabilities are the center of our business.
As a Data Infrastructure Engineer in the Datalabs group, you will be the technical backbone supporting our data production, analyst, and data science teams. You will own and maintain our AWS cloud accounts and Databricks workspaces, optimize pipeline executions, and proactively modernize our tech stack to reduce tech debt - ensuring our platform remains scalable, reliable, fast, and cost-effective.
Given the business-oriented nature of Datalabs, you will work closely with cross-functional stakeholders and internal teams who interface directly with strategic customers. By unblocking operational bottlenecks and building robust tooling, you will empower our analysts and data scientists to deliver custom, high-value data products to our customers seamlessly.
So, what will you be doing all day?
Environment & Workspace Management: Administering and optimizing our groups AWS cloud accounts, IAM policies, and Databricks workspaces to ensure peak performance, rock-solid security, and cost efficiency.
Execution & Pipeline Infrastructure: Owning the health, reliability, and scaling of our core data execution environments (Airflow, Docker, EKS/ECS, distributed queues, and database engines).
Tech Debt Modernization: Proactively researching, benchmarking, and replacing legacy debt with modern technologies to keep our platform fast and cutting-edge.
Developer & Production Support: Serving as the technical focal point for internal analysts and data science teams-providing the tooling, standards, and infra support they need to build custom client reports smoothly.
Cross-Group & Client Alignment: Partnering with external engineering teams and internal stakeholders to support custom data delivery pipelines and uphold high-priority customer SLAs.

As a Data Scientist, you will apply your expertise in software engineering, LLM agents, and cybersecurity to build new defense techniques against cyber-villains. You will be a driving force in designing and developing groundbreaking, Agentic LLM-based security solutions that block attacks before they begin. Join our innovative team to shape the future of cybersecurity and impact millions of customers.
Important: this role requires a unique combination of hands-on software engineering skills as well as previous experience with designing and delivering LLM-driven products.
Key Responsibilities
Contribute to a diverse and highly skilled research group that pioneers state-of-the-art technologies to protect our customers.
Utilize analytical rigor, statistical methods, programming, and data modeling to analyze vast amounts of data, applying your cybersecurity knowledge to guide our focus and approach.
Design and implement agentic LLM solutions to face modern cybersecurity challenges.
Decompose complex problems scientifically and provide actionable insights and recommendations to both technical and non-technical stakeholders.
Lead and collaborate on end-to-end projects within the team and across engineering and product teams, from initial ideation to final deployment.

Required Senior Data Engineer
21679 ID
Role Description:
As a Senior Data Engineer, youll collaborate with top-notch engineers and data scientists to elevate our platform to the next level and deliver exceptional user experiences. Your primary focus will be on the data engineering aspects-ensuring the seamless flow of high-quality, relevant data to train and optimize content models, including GenAI foundation models, supervised fine-tuning, and more.
Youll work closely with teams across the company to ensure the availability of high-quality data from ML platforms, powering decisions across all departments. With access to petabytes of data through MySQL, Snowflake, Cassandra, S3, and other platforms, your challenge will be to ensure that this data is applied even more effectively to support business decisions, train and monitor ML models and improve our products.
Key Job Responsibilities and Duties:
Rapidly developing next-generation scalable, flexible, and high-performance data pipelines.
Dealing with massive textual sources to train GenAI foundation models.
Solving issues with data and data pipelines, prioritizing based on customer impact.
End-to-end ownership of data quality in our core datasets and data pipelines.
Experimenting with new tools and technologies to meet business requirements regarding performance, scaling, and data quality.
Providing tools that improve Data Quality company-wide, specifically for ML scientists.
Providing self-organizing tools that help the analytics community discover data, assess quality, explore usage, and find peers with relevant expertise.
Acting as an intermediary for problems, with both technical and non-technical audiences.
Promote and drive impactful and innovative engineering solutions
Technical, behavioral and interpersonal competence advancement via on-the-job opportunities, experimental projects, hackathons, conferences, and active community participation
Collaborate with multidisciplinary teams: Collaborate with product managers, data scientists, and analysts to understand business requirements and translate them into machine learning solutions. Provide technical guidance and mentorship to junior team members.

Required Principal/ Senior Data Scientist - LLM Agents
Job Summary
As a Data Scientist, you will apply your expertise in software engineering, LLM agents, and cybersecurity to build new defense techniques against cyber-villains. You will be a driving force in designing and developing groundbreaking, Agentic LLM-based security solutions that block attacks before they begin. Join our innovative team to shape the future of cybersecurity and impact millions of customers.
Important: this role requires a unique combination of hands-on software engineering skills as well as previous experience with designing and delivering LLM-driven products.
Key Responsibilities:
Contribute to a diverse and highly skilled research group that pioneers state-of-the-art technologies to protect our customers.
Utilize analytical rigor, statistical methods, programming, and data modeling to analyze vast amounts of data, applying your cybersecurity knowledge to guide our focus and approach.
Design and implement agentic LLM solutions to face modern cybersecurity challenges.
Decompose complex problems scientifically and provide actionable insights and recommendations to both technical and non-technical stakeholders.
Lead and collaborate on end-to-end projects within the team and across engineering and product teams, from initial ideation to final deployment.

Are you a talented Data Scientist with expertise in image analysis and text reading? Are you passionate about leveraging cutting-edge technologies to drive innovation in the field of electronic component inspection? Look no further!
an industry-leading technology company based in Tel Aviv, we are seeking a skilled Data Scientist to join our dynamic team. As a Data Scientist specializing in image analysis and text reading, you will play a pivotal role in developing and enhancing our AI-driven solutions for quick and accurate component inspection in electronic manufacturing.
Responsibilities
Develop and implement advanced algorithms for image analysis and text reading in the context of component inspection.
Collaborate closely with cross-functional teams to enhance existing models and drive continuous improvement.
Work with large-scale datasets, applying statistical and machine learning techniques to extract meaningful insights.
Stay updated with the latest advancements in the field of image analysis and text reading and apply them to enhance our solutions.