לוח משרות דרושים מהנדס/ת דאטה/DATA ENGINEER, לחיפוש זה נמצאו 125 משרות

We are looking for an experienced DevOps Data Infra Engineer to join our growing team. As a Data Infra Engineer, you will play a critical role in setting up, optimizing, and maintaining our data & analytics infrastructure. You will work closely with the development and Security teams to ensure the reliability, scalability, redundancy, and security of our data infrastructure platform.

The ideal candidate is passionate about big data, loves working with cutting-edge technologies, and thrives in a collaborative environment.

What you will do:

Design, implement, and manage scalable, highly available databases for both transactional, real-time use as well as backend analytics and big data.

Build, design, and maintain data processing pipeline infrastructure used by our various applications

Develop and maintain CI/CD processes for automating seamless changes to data infrastructure, including data migrations and database upgrades

Work closely with developers to make sure our data infrastructure meets existing and new feature requirements

Work alongside our Security Team to ensure our infrastructure meets rigorous security standards

Ensure the data infrastructure processes adhere to best practices in security and compliance.

We are seeking talented and passionate Senior Data Engineer to join our Data team. In this pivotal role, you will be instrumental in designing, building, and optimizing the critical data infrastructure that underpins innovative creative intelligence platform. You will tackle complex data challenges, ensuring our systems are robust, scalable, and capable of delivering high-quality data to power our advanced AI models, customer-facing analytics, and internal business intelligence. This is an opportunity to make a significant impact on our product, contribute to a data-driven culture, and help solve fascinating problems at the intersection of data, AI, and marketing technology.
Key Responsibilities:
Architect & Develop Data Pipelines: Design, implement, and maintain sophisticated, end-to-end data pipelines for ingesting, processing, validating, and transforming large-scale, diverse datasets.
Manage Data Orchestration: Implement and manage robust workflow orchestration for complex, multi-step data processes, ensuring reliability and visibility.
Advanced Data Transformation & Modeling: Develop and optimize complex data transformations using advanced SQL and other data manipulation techniques. Contribute to the design and implementation of effective data models for analytical and operational use.
Ensure Data Quality & Platform Reliability: Establish and improve processes for data quality assurance, monitoring, alerting, and performance optimization across the data platform. Proactively identify and resolve data integrity and pipeline issues.
Cross-Functional Collaboration: Partner closely with AI engineers, product managers, developers, customer success and other stakeholders to understand data needs, integrate data solutions, and deliver features that provide exceptional value.
Drive Data Platform Excellence: Contribute to the evolution of our data architecture, champion best practices in data engineering (e.g., DataOps principles), and evaluate emerging technologies to enhance platform capabilities, stability, and cost-effectiveness.
Foster a Culture of Learning & Impact: Actively share knowledge, contribute to team growth, and maintain a strong focus on how data engineering efforts translate into tangible product and business outcomes.

Were hiring a hands-on Senior Data Engineer who wants to build data products that move the needle in the physical world. Your work will help construction professionals make better, data-backed decisions every day.
Responsibilities:
Lead the design and development of scalable data pipelines.
Collaborate with Product, Data Science, and Analytics teams.
Build and optimize workflows using Databricks, Spark, Kafka, and AWS.
Implement real-time and batch processing architectures.
Develop and maintain ingestion pipelines from multiple sources.
Manage deployment and performance of data infrastructure.
Use Terraform to manage infrastructure-as-code.
Prepare data for analytics and product-facing use cases.

Required DevOps and Data Engineer
Job Location:
Israel, Hod HaSharon (Hybrid)
Job Brief:
Design, develop, and maintain internal data services, automation flows, CI/CD infrastructure, and database-related tooling.
Job Description:
Design, develop and maintain data pipelines, ETL/ELT flows, and integrations between internal engineering systems
Design and own the DevOps framework for the company and enable the automation infrastructure used by engineering teams
Build automation tools to improve data processing, tooling, and development workflows
Develop and help optimizing the in-house database-related services, including SQL queries, indexing, stored procedures, performance tuning, and monitoring
Ensure data security, permissions, access control, and data integrity across internal systems
Collaborate with cross-functional teams to understand requirements, solve technical issues, and improve internal developer and customer-facing platforms.

Required Senior Data Engineer
21679 ID
Role Description:
As a Senior Data Engineer, youll collaborate with top-notch engineers and data scientists to elevate our platform to the next level and deliver exceptional user experiences. Your primary focus will be on the data engineering aspects-ensuring the seamless flow of high-quality, relevant data to train and optimize content models, including GenAI foundation models, supervised fine-tuning, and more.
Youll work closely with teams across the company to ensure the availability of high-quality data from ML platforms, powering decisions across all departments. With access to petabytes of data through MySQL, Snowflake, Cassandra, S3, and other platforms, your challenge will be to ensure that this data is applied even more effectively to support business decisions, train and monitor ML models and improve our products.
Key Job Responsibilities and Duties:
Rapidly developing next-generation scalable, flexible, and high-performance data pipelines.
Dealing with massive textual sources to train GenAI foundation models.
Solving issues with data and data pipelines, prioritizing based on customer impact.
End-to-end ownership of data quality in our core datasets and data pipelines.
Experimenting with new tools and technologies to meet business requirements regarding performance, scaling, and data quality.
Providing tools that improve Data Quality company-wide, specifically for ML scientists.
Providing self-organizing tools that help the analytics community discover data, assess quality, explore usage, and find peers with relevant expertise.
Acting as an intermediary for problems, with both technical and non-technical audiences.
Promote and drive impactful and innovative engineering solutions
Technical, behavioral and interpersonal competence advancement via on-the-job opportunities, experimental projects, hackathons, conferences, and active community participation
Collaborate with multidisciplinary teams: Collaborate with product managers, data scientists, and analysts to understand business requirements and translate them into machine learning solutions. Provide technical guidance and mentorship to junior team members.

As a AI-Data Engineer, youll take a leading role in building the foundation of our companys Agentic Exposure Management platform: the source of truth that tells a security team what they have, whats actually risky and why, how to fix it, and who is responsible.
Enterprises run their security across a sprawl of cloud and on-prem tools. Making sense of that sprawl is the heart of what we do. Were building a complex data fabric that reconciles data from a hundred different sources, applies sophisticated transformation and enrichment, and turns partial, uncertain signal into one trustworthy model of an organizations real exposure.
Key Responsibilities:
Model the security graph. Design an ontology that spans both the modern cloud and the classical on-prem world, abstract enough to absorb 100+ different integrations under one model, yet rich enough to carry everything needed for decision making. Decide whats an entity, whats an edge, and whats a denormalized attribute, across millions of assets and finding rows.
Own asset identity engineering and reconciliation. Upstream identifiers are uncertain and volatile. Engineer deterministic identity resolution for assets and findings arriving from different vendors.
Build LLM-based and agentic pipelines for data classification, entity extraction, and enrichment, optimizing for cost, latency, and precision in production.
Build the integration factory. Stand up a scalable integration platform that drives down time-to-integration.
Build and maintain complex ETL pipelines handling millions of records: incremental sync, complex correlation, and data quality observability and monitoring.

We are seeking a skilled and motivated Data Engineer with expertise in Elasticsearch, cloud technologies, and Kafka. As a data engineer, you will be responsible for designing, building and maintaining scalable and efficient data pipelines that will support our organization's data processing needs.
The role will entail:
Design and develop data platforms based on Elasticsearch, Databricks, and Kafka
Build and maintain data pipelines that are efficient, reliable and scalable
Collaborate with cross-functional teams to identify data requirements and design solutions that meet those requirements
Write efficient and optimized code that can handle large volumes of data
Implement data quality checks to ensure accuracy and completeness of the data
Troubleshoot and resolve data pipeline issues in a timely manner.

As a Senior Research Scientist, AI & Data Systems at Eon Research, you will conduct applied research at the intersection of AI, data systems, and large-scale storage. you will explore challenging technical problems, publish research in leading peer-reviewed venues, file patents, and translate research breakthroughs into production-ready product capabilities.

This role is ideal for a researcher with a strong publication record, deep expertise in a relevant research area, and experience bringing research into real-world products.

Research Areas
Query Processing and Query Engines: Query optimization and execution over columnar and lakehouse formats, including Apache Iceberg and Parquet, as well as approximate query processing using sketches and synopses.

Storage Systems: Deduplication, compression, and data layout optimization for large-scale storage.

Data Integration and Discovery: Entity resolution, schema matching, table joinability, and data discovery, including the use of LLMs as judges.

Information Retrieval and RAG: Retrieval-augmented generation over enterprise data, including emails, documents, and databases.

LLM Evaluation and Benchmarking: Evaluation frameworks and benchmarks for LLM agents working with enterprise data.

LLMs for Software Engineering: CI failure diagnosis, automated debugging, and program repair.

We are looking for a mid-level Data Engineer, experienced with building data pipelines using Python and Airflow for structured data and relational databases. The ideal candidate is a self-directed learner, takes ownership of the pipelines they build, and cares about data quality as much as feature delivery.





Key Responsibilities:

Own our data pipelines, including maintenance and adding new features.
Take charge of data integrity and completeness, including writing and maintaining tests.
Improve process efficiency and optimize runtime performance.
Own schema design and evolution across our data pipelines.

About The Position
Design, build, and maintain scalable data pipelines and infrastructure entirely within GCP
Own data solutions end-to-end, from architecture and design through to production delivery
Build and maintain custom connectors to advertising platforms including Google Ads, Meta (Facebook) Marketing API, and other ad platforms
Design and implement data warehouse structures with a deep focus on performance, scalability and usability
Continuously investigate and evaluate new GCP native tools and services, assessing their fit, building proof of concepts, and driving adoption where it makes sense
Set up and configure orchestration and transformation frameworks (such as Airflow and dbt) within the GCP environment
Collaborate closely with backend engineers to ensure data infrastructure aligns with product and system needs
Contribute to data science initiatives and bring genuine curiosity to analytical use cases
Monitor, troubleshoot, and continuously improve the reliability and performance of existing data systems
Define technical standards and best practices for the data platform
Build and maintain data dashboards and reports to surface insights for stakeholders, primarily using Looker Studio.

We are looking for an experienced Senior Data Engineer to join our Data team. In this role, you will lead and strengthen our Data Team, drive innovation, and ensure the robustness of our data/analytics platforms.
A day in the life and how youll make an impact:
Design and develop high-performance Data Pipelines and ETL processes to support diverse business needs.
Work closely with Product, Business Intelligence, Sales and other teams to integrate data solutions, ensuring seamless alignment and collaboration across functions.
Continuously improve our data analytics platforms, optimizing system performance and ensuring robust, reliable data infrastructure.
Oversee the entire data lifecycle, from infrastructure setup and data acquisition to detailed analysis and automated reporting, driving business growth through data-driven insights.
Implement robust data quality checks, monitoring mechanisms, and data governance policies to maintain data integrity and security, troubleshooting and resolving any data-related issues efficiently.