לוח משרות דרושים מהנדס/ת דאטה/DATA ENGINEER משרה מלאה, לחיפוש זה נמצאו 120 משרות

Required Senior ML Data Engineer
About the team:
The AI Engineering group builds modern infrastructure and solutions that improve how algorithms are developed.
We are a small, independent team of experienced engineers with a mix of skills in algorithms, software, and infrastructure. We work in a DevOps style and build cross-team solutions that support research and development of advanced perception algorithms.
Our flagship project is a unified AV dataset used to train and evaluate next-generation models. We take large volumes of multi-camera video, object labels, HD maps, and sensor data from across the organization, and turn it into a curated, high-quality training set - at scale.
We are looking for someone who brings ML and computer-vision depth to the team - someone who can help shape the intelligence layer that decides what data is worth training on.
What will your job look like:
Work collaboratively with shared ownership. Your focus area will be the curation and ML side of our data pipeline, but you will contribute across the full stack alongside the rest of the team.
Build and improve the curation pipeline - from vision-model embeddings and scene detection, through VLM-based scene analysis, to scoring, deduplication, and sampling that produces a balanced and diverse dataset.
Run and optimize GPU inference at scale (embedding extraction, VLM inference) across thousands of driving sessions using workflow orchestration.
Develop scoring and sampling strategies that ensure rare but important scenarios (night driving, adverse weather, hazardous situations) are well-represented in the final dataset.
Work with algorithm teams to understand what data gaps hurt model performance and translate those into curation criteria.
Build validation and diagnostics that measure dataset quality - not just pipeline health, but whether the data is actually good for training.
Contribute to the core dataset SDK, converter, and 3D-geometry tooling (camera projection, calibration, coordinate transforms).

Required Senior Computer Vision Data Engineer
About the team:
The AI Engineering group builds modern infrastructure and solutions that improve how algorithms are developed.
We are a small, independent team of experienced engineers with a mix of skills in algorithms, software, and infrastructure. We work in a DevOps style and build cross-team solutions that support research and development of advanced perception algorithms.
Our flagship project is a unified AV dataset used to train and evaluate next-generation models. We take large volumes of multi-camera video, object labels, HD maps, and sensor data from across the organization, and turn it into a curated, high-quality training set - at scale.
We are looking for someone who brings ML and computer-vision depth to the team - someone who can help shape the intelligence layer that decides what data is worth training on.
What will your job look like:
Work collaboratively with shared ownership. Your focus area will be the curation and ML side of our data pipeline, but you will contribute across the full stack alongside the rest of the team.
Build and improve the curation pipeline - from vision-model embeddings and scene detection, through VLM-based scene analysis, to scoring, deduplication, and sampling that produces a balanced and diverse dataset.
Run and optimize GPU inference at scale (embedding extraction, VLM inference) across thousands of driving sessions using workflow orchestration.
Develop scoring and sampling strategies that ensure rare but important scenarios (night driving, adverse weather, hazardous situations) are well-represented in the final dataset.
Work with algorithm teams to understand what data gaps hurt model performance and translate those into curation criteria.
Build validation and diagnostics that measure dataset quality - not just pipeline health, but whether the data is actually good for training.
Contribute to the core dataset SDK, converter, and 3D-geometry tooling (camera projection, calibration, coordinate transforms).

We are seeking talented and passionate Senior Data Engineer to join our Data team. In this pivotal role, you will be instrumental in designing, building, and optimizing the critical data infrastructure that underpins innovative creative intelligence platform. You will tackle complex data challenges, ensuring our systems are robust, scalable, and capable of delivering high-quality data to power our advanced AI models, customer-facing analytics, and internal business intelligence. This is an opportunity to make a significant impact on our product, contribute to a data-driven culture, and help solve fascinating problems at the intersection of data, AI, and marketing technology.

Key Responsibilities
Architect & Develop Data Pipelines: Design, implement, and maintain sophisticated, end-to-end data pipelines for ingesting, processing, validating, and transforming large-scale, diverse datasets.
Manage Data Orchestration: Implement and manage robust workflow orchestration for complex, multi-step data processes, ensuring reliability and visibility.
Advanced Data Transformation & Modeling: Develop and optimize complex data transformations using advanced SQL and other data manipulation techniques. Contribute to the design and implementation of effective data models for analytical and operational use.
Ensure Data Quality & Platform Reliability: Establish and improve processes for data quality assurance, monitoring, alerting, and performance optimization across the data platform. Proactively identify and resolve data integrity and pipeline issues.
Cross-Functional Collaboration: Partner closely with AI engineers, product managers, developers, customer success and other stakeholders to understand data needs, integrate data solutions, and deliver features that provide exceptional value.
Drive Data Platform Excellence: Contribute to the evolution of our data architecture, champion best practices in data engineering (e.g., DataOps principles), and evaluate emerging technologies to enhance platform capabilities, stability, and cost-effectiveness.
Foster a Culture of Learning & Impact: Actively share knowledge, contribute to team growth, and maintain a strong focus on how data engineering efforts translate into tangible product and business outcomes.

We're looking for an experienced Software Engineer to join our Data Platform Group. In this key role, you will build the company data platform: cloud-based microservices and data pipelines that process on the order of 1M records/sec at low latency. Because the platform is the foundation other groups build on, your work has a direct impact on our customers and enables engineering, product, and research teams across the organization.
The Lakehouse team owns the data itself - how it is stored, organized, retained, and served. We own our analytical storage layer, the batch processing built on top of it, and the APIs through which customers and the rest of the company consume data. If you enjoy the problems that only appear at petabyte scale - physical data layout, query performance, storage cost, and retention - this is the role.

Responsibilities:
End-to-end ownership of our large-scale analytical storage layer: data modeling, schema and table design, partitioning, retention, and query performance.
Design and develop the batch processing layer over our data lake using Spark on EMR (Java and PySpark).
Build and evolve Java/Spring Boot services that expose our data through well-defined APIs to customers and to consumers across the company.
Own performance and cost: query optimization, file layout and compaction, cluster sizing, and storage efficiency at scale.
Research new technologies in the lakehouse and analytical-storage space and adapt them for use in our product.
Work closely with product, DevOps, and security teams.

We are looking for a Data Engineer to help build and scale the data platform behind our search quality, ML pipelines, product analytics, and business operations.
In this role, you will contribute across the full data lifecycle: ingesting data from production systems, designing and evolving our data warehouse, building batch and streaming pipelines, and making high-quality datasets available to researchers, engineers, analysts, and product teams across the company.
The platform spans tens of terabytes and ingests data from tens of proprietary and third-party sources - including our search engine and its components, CRM, billing, identity, and product analytics across multi-region production environments. Around 100 internal users rely on it daily.
You will work closely with engineers and stakeholders across the company, contribute to architectural and modeling decisions, and help improve the reliability, usability, and scalability of the data platform as it grows.

In this position, your responsibility will be to:
Contribute to the design, development, and operation of Tavily's data platform - from real-time ingestion through data warehouse medallion layers to consumer-facing datasets and dashboards.
Build and maintain reliable batch and streaming pipelines that ingest data from production services and external systems.
Design and evolve scalable, analytics-ready data models in the data warehouse.
Work closely with engineers across the company to ensure data produced by production systems is reliable, well-structured, and usable downstream.
Improve observability across the data platform, including data quality checks, freshness monitoring, lineage, schema evolution, and cost controls.
Partner with researchers, engineers, analysts, finance, and product managers to deliver trustworthy datasets for product, search quality, ML, and GTM analytics.
Contribute to defining the objects, entities, and relationships that represent Tavily's search domain - including agent inputs, URLs, chunks, agent sessions, crawls, and the connections between them - and translate them into clean, queryable data models.
Improve engineering practices around testing, documentation, deployment, and incident response.
Investigate and resolve production data issues, including broken pipelines, corrupted datasets, schema changes, and large-scale backfills.
Contribute to technical standards and best practices for data engineering across the company.
Help maintain high standards of data quality, integrity, security, and governance across environments.

We are looking for a Senior Data Engineer to own substantial parts of our data platform and deliver complex data products end to end. You will turn ambiguous business needs into pragmatic technical solutions, make architecture and implementation trade-offs, and improve the reliability, scalability, and usability of our data ecosystem.

You will work closely with product, platform, and business teams, helping them use data effectively while ensuring that our systems remain maintainable and trustworthy grows.

Your responsibilities:


Own the design, delivery, and operation of complex data pipelines, datasets, and platform components.
Translate business and analytical requirements into scalable data models, reliable data products, and clear technical plans.
Design and evolve data architecture, storage, processing, and orchestration patterns for large-scale workloads.
Improve data quality, observability, lineage, and incident response for critical datasets and pipelines.
Investigate and resolve challenging performance, reliability, and data-correctness issues in production.
Establish reusable tools, conventions, and automation that improve engineering productivity and reduce operational risk.
Work with product teams and business stakeholders to define data contracts, priorities, and success criteria.
Contribute to technical direction through design reviews, thoughtful trade-offs, and documentation.
Support and mentor other engineers through reviews, pairing, and knowledge sharing.
Participate in the on-call rotation and take ownership of improving the operational health of the systems you support.

We are looking for a Senior Data Engineer to build and scale the data foundation behind platform and products. You will own complex data end-to-end - from ingestion and transformation through modeling, quality, observability, and production delivery.
This is a hands-on senior IC role for a strong builder who can solve difficult data problems independently, set a high technical bar, and collaborate closely with engineering, DS, and product. You will turn large, fragmented datasets into reliable, reusable capabilities that power every product.
Responsibilities
Build and own scalable data pipelines- Design, implement, and operate robust pipelines for high-volume structured and unstructured data, with validation, monitoring, lineage, and recovery built in.
Scale the platform for growth- A key near-term initiative is re-architecting the system to support a significantly larger customer base. You will own performance and cost-efficiency across pipelines and services, keeping reliability and operating costs under control as the platform scales.
Build across the stack- This is not a pipelines-only role. You will also write backend services and some frontend, including the internal backoffice the team runs on. We hire builders, not narrow specialists.
Own the core data tables- Own schema design and evolution, data contracts, and the modeling standards the team follows - naming, shared dimensions, normalization, documentation. Be accountable when a table is wrong, late, or drifting.
Level up the teams data work- Pair with and advise software engineers and data scientists on Spark, SQL, and modeling, and help turn notebook-grade code into production-grade pipelines.
Partner cross-functionally- Translate product, client, compliance, and business requirements into clear technical designs and dependable production systems.

As our Senior Data Engineer you will handle Big Data in real time, and become the owner and gatekeeper of all data and data flows within the company. You will bring data ingenuity and technological excellence while gaining a deep business understanding.

This is an amazing opportunity to join a multi-disciplinary A-team while working in a fast-paced, modern-cloud, data-oriented environment.

Implement robust, reliable, and scalable data pipelines and data architecture.
Own and develop DWH (petabytes of data!).
Own the entire data development process, including business knowledge, methodology, quality assurance, and monitoring.
Collaborate with cross-functional teams to define, design, and ship new features.
Continuously discover, evaluate, and implement new technologies to maximize development efficiency.
Develop tailor-made solutions as part of our data pipelines.
Lead complex Big Data projects and build data platforms from scratch.
Work on high-scale, real-time, real-world, business-critical data stores and data endpoints.
Implement data profiling to identify anomalies and maintain data integrity.
Work in a results-driven, high-paced, rewarding environment.

Required Data Engineer
About The Position
Design, build, and maintain scalable data pipelines and infrastructure entirely within GCP
Own data solutions end-to-end, from architecture and design through to production delivery
Build and maintain custom connectors to advertising platforms including Google Ads, Meta (Facebook) Marketing API, and other ad platforms
Design and implement data warehouse structures with a deep focus on performance, scalability and usability
Continuously investigate and evaluate new GCP native tools and services, assessing their fit, building proof of concepts, and driving adoption where it makes sense
Set up and configure orchestration and transformation frameworks (such as Airflow and dbt) within the GCP environment
Collaborate closely with backend engineers to ensure data infrastructure aligns with product and system needs
Contribute to data science initiatives and bring genuine curiosity to analytical use cases
Monitor, troubleshoot, and continuously improve the reliability and performance of existing data systems
Define technical standards and best practices for the data platform
Build and maintain data dashboards and reports to surface insights for stakeholders, primarily using Looker Studio.

As a AI-Data Engineer, youll take a leading role in building the foundation of our companys Agentic Exposure Management platform: the source of truth that tells a security team what they have, whats actually risky and why, how to fix it, and who is responsible.
Enterprises run their security across a sprawl of cloud and on-prem tools. Making sense of that sprawl is the heart of what we do. Were building a complex data fabric that reconciles data from a hundred different sources, applies sophisticated transformation and enrichment, and turns partial, uncertain signal into one trustworthy model of an organizations real exposure.
Key Responsibilities:
Model the security graph. Design an ontology that spans both the modern cloud and the classical on-prem world, abstract enough to absorb 100+ different integrations under one model, yet rich enough to carry everything needed for decision making. Decide whats an entity, whats an edge, and whats a denormalized attribute, across millions of assets and finding rows.
Own asset identity engineering and reconciliation. Upstream identifiers are uncertain and volatile. Engineer deterministic identity resolution for assets and findings arriving from different vendors.
Build LLM-based and agentic pipelines for data classification, entity extraction, and enrichment, optimizing for cost, latency, and precision in production.
Build the integration factory. Stand up a scalable integration platform that drives down time-to-integration.
Build and maintain complex ETL pipelines handling millions of records: incremental sync, complex correlation, and data quality observability and monitoring.

We are seeking a highly skilled and analytical Senior Data Engineer to join our Data team. In this role, you will design and implement robust data pipelines, while uniquely bridging the gap between engineering and analytics by actively analyzing data to extract actionable insights. You will play a crucial part in architecting our data foundations to support everything from business intelligence to advanced machine learning and agentic AI pipelines.
As a Senior Data Engineer, you will collaborate closely with engineering teams, product managers, and stakeholders across the organization. You will not only build the infrastructure utilizing modern data stack tools but also act as a data analyst when needed, ensuring our systems are fully equipped to operate within and support a cutting-edge agentic AI environment.
Responsibilities
Design, build, and maintain highly scalable ELT/ETL data pipelines.
Architect and manage modern cloud data warehousing solutions.
Develop, maintain, and monitor Python services responsible for robust data collection and ingestion.
Perform hands-on data analysis to interpret complex datasets, identify trends, and deliver business insights, acting in a dual capacity as a Data Analyst.
Develop and optimize data infrastructure specifically designed to support autonomous agentic workflows and LLM integrations.
Collaborate with engineers and analysts to troubleshoot data issues, enforce quality SLAs, and define data requirements.
Document data architecture, flow, and analytics standards for internal team alignment.
Build and maintain dashboards and reports to communicate analytical findings and data health to the organization.
Maintain Kafka consumer applications that process high-volume event streams in real-time, ensuring reliable ingestion into cloud databases.

We built a platform that builds businesses. From launching and managing to growing a business, we are the all-in-one solution that empowers any business owner. Our platform services over 40 million small businesses. Our "Guidance Engine" assesses each new business introduced to our platform and devises a tailored plan that allows you to manage all your business needs from a single dashboard. Through our business-building platform, were turning the process of starting, managing, and growing a business into a better experience; were simplifying the business journey. At Tailor Brands, we believe in more than just handing you another tool; we are dedicated to teaching you the art of building a business.
About the Role:
As a data Engineer, you'll design and maintain the data pipelines that power decision-making across product, marketing, and finance. Working with Apache Airflow, Python, and SQL, you'll build trusted, well-documented datasets that enable self-service analytics for the entire organization. You'll champion data quality through validation and monitoring, optimize infrastructure for scale, and be part of a forward-thinking team that actively leverages AI tools like Claude to push the boundaries of modern data engineering. If you thrive on turning messy data into reliable, actionable foundations - and want to do it for a platform serving over 40 million small businesses - this role is for you. What were looking for:
* Design, implement and maintain pipelines that deliver data with measurable quality and SLAs for our product, marketing, finance, and other departments
* Partner with business domain experts, data analysts, and engineering teams to build foundational datasets that are trusted, well-understood, aligned with business strategy and enable a self-service analysis
* Focus on data quality, detect data /analytics quality issues, implement bug fixes and data validations for prevention
* Identify, design, and implement internal process improvements such as automating manual processes, optimizing data delivery, re-designing infrastructure for greater scalability, etc
* Be part of a team that actively integrates AI tools like Claude into day-to-day workflows, pushing the boundaries of how data engineering gets done