דרושים » דאטה » Senior data platform engineer

We're looking for an experienced Software Engineer to join our Data Platform Group. In this key role, you will build the company data platform: cloud-based microservices and data pipelines that process on the order of 1M records/sec at low latency. Because the platform is the foundation other groups build on, your work has a direct impact on our customers and enables engineering, product, and research teams across the organization.
The Lakehouse team owns the data itself - how it is stored, organized, retained, and served. We own our analytical storage layer, the batch processing built on top of it, and the APIs through which customers and the rest of the company consume data. If you enjoy the problems that only appear at petabyte scale - physical data layout, query performance, storage cost, and retention - this is the role.

Responsibilities:
End-to-end ownership of our large-scale analytical storage layer: data modeling, schema and table design, partitioning, retention, and query performance.
Design and develop the batch processing layer over our data lake using Spark on EMR (Java and PySpark).
Build and evolve Java/Spring Boot services that expose our data through well-defined APIs to customers and to consumers across the company.
Own performance and cost: query optimization, file layout and compaction, cluster sizing, and storage efficiency at scale.
Research new technologies in the lakehouse and analytical-storage space and adapt them for use in our product.
Work closely with product, DevOps, and security teams.

We are looking for a highly skilled Senior Data Platform Engineer to join our Data Platform team and play a key role in designing, building, and evolving the companys data infrastructure.

This is a hands-on engineering position focused on developing scalable data platforms, high-volume ingestion pipelines, and the foundational data systems that power analytics, product applications, AI workloads, and large-scale model execution. You will help architect our data lake, build reliable ingestion capabilities at scale, and shape the core infrastructure that supports the companys future growth.

This is an exciting opportunity to work with cutting-edge technologies and have a defining impact on the architecture and evolution of our data platform.

What Youll Do
Build complex, high-volume batch and near-real-time ingestion services while helping evolve the platforms streaming capabilities.
Design and implement data solutions for all application requirements in a distributed microservices environment
Develop and optimize large-scale data pipelines for batch and streaming use cases.
Ensure data quality, compliance, and governance.
Manage and optimize Kubernetes infrastructure, utilizing KEDA to dynamically scale resources for large-scale data processing workloads.
Own the full lifecycle of our data stack using Terraform and Kubernetes, from provisioning to application-level frameworks.
Provide technical guidance for the team, drive best practices around infrastructure, CI/CD, testing, and system design.
Deep-dive into memory management and performance tuning to ensure our large-scale distributed systems are both cost-effective and lightning-fast.

We are looking for a Senior Data Engineer to build and scale the data foundation behind platform and products. You will own complex data end-to-end - from ingestion and transformation through modeling, quality, observability, and production delivery.
This is a hands-on senior IC role for a strong builder who can solve difficult data problems independently, set a high technical bar, and collaborate closely with engineering, DS, and product. You will turn large, fragmented datasets into reliable, reusable capabilities that power every product.
Responsibilities
Build and own scalable data pipelines- Design, implement, and operate robust pipelines for high-volume structured and unstructured data, with validation, monitoring, lineage, and recovery built in.
Scale the platform for growth- A key near-term initiative is re-architecting the system to support a significantly larger customer base. You will own performance and cost-efficiency across pipelines and services, keeping reliability and operating costs under control as the platform scales.
Build across the stack- This is not a pipelines-only role. You will also write backend services and some frontend, including the internal backoffice the team runs on. We hire builders, not narrow specialists.
Own the core data tables- Own schema design and evolution, data contracts, and the modeling standards the team follows - naming, shared dimensions, normalization, documentation. Be accountable when a table is wrong, late, or drifting.
Level up the teams data work- Pair with and advise software engineers and data scientists on Spark, SQL, and modeling, and help turn notebook-grade code into production-grade pipelines.
Partner cross-functionally- Translate product, client, compliance, and business requirements into clear technical designs and dependable production systems.

We are looking for an experienced and visionary Data Engineer to help design, build, and scale our BI platform.
In this role, you will be responsible for developing our data analytics platform - enabling scalable data pipelines and robust data modeling to support real-time and batch analytics to provide insights that serve both business intelligence and product needs.
You will be part of the R&D team, collaborating closely with engineers, analysts, and product managers to deliver a modern data architecture that supports internal dashboards and future-facing operational analytics.
If you enjoy turning raw data into powerful insights and owning the full data lifecycle, this role is for you!
Responsibilities:
Take full ownership of the design and implementation of a scalable and efficient BI data infrastructure, ensuring high performance, reliability, and security.
Design and architect data products, from ingestion to transformation, modeling, storage, and access.
Build and maintain ETL/ELT pipelines, batch and real-time, to support analytics, reporting, and product integrations.
Establish and enforce best practices for data quality, lineage, observability, and governance to ensure accuracy and consistency.
Integrate modern tools and frameworks such as Airflow, Databricks, Power BI, and streaming platforms.
Collaborate cross-functional with product, engineering, and analytics teams to translate business needs into data infrastructure.
Promote a data-driven culture - be an advocate for data-driven decision-making across the company by empowering stakeholders with reliable and self-service data access.

We are looking for a Data Engineer to help build and scale the data platform behind our search quality, ML pipelines, product analytics, and business operations.
In this role, you will contribute across the full data lifecycle: ingesting data from production systems, designing and evolving our data warehouse, building batch and streaming pipelines, and making high-quality datasets available to researchers, engineers, analysts, and product teams across the company.
The platform spans tens of terabytes and ingests data from tens of proprietary and third-party sources - including our search engine and its components, CRM, billing, identity, and product analytics across multi-region production environments. Around 100 internal users rely on it daily.
You will work closely with engineers and stakeholders across the company, contribute to architectural and modeling decisions, and help improve the reliability, usability, and scalability of the data platform as it grows.

In this position, your responsibility will be to:
Contribute to the design, development, and operation of Tavily's data platform - from real-time ingestion through data warehouse medallion layers to consumer-facing datasets and dashboards.
Build and maintain reliable batch and streaming pipelines that ingest data from production services and external systems.
Design and evolve scalable, analytics-ready data models in the data warehouse.
Work closely with engineers across the company to ensure data produced by production systems is reliable, well-structured, and usable downstream.
Improve observability across the data platform, including data quality checks, freshness monitoring, lineage, schema evolution, and cost controls.
Partner with researchers, engineers, analysts, finance, and product managers to deliver trustworthy datasets for product, search quality, ML, and GTM analytics.
Contribute to defining the objects, entities, and relationships that represent Tavily's search domain - including agent inputs, URLs, chunks, agent sessions, crawls, and the connections between them - and translate them into clean, queryable data models.
Improve engineering practices around testing, documentation, deployment, and incident response.
Investigate and resolve production data issues, including broken pipelines, corrupted datasets, schema changes, and large-scale backfills.
Contribute to technical standards and best practices for data engineering across the company.
Help maintain high standards of data quality, integrity, security, and governance across environments.

Were looking for an experienced and passionate Data Group Tech Lead, Staff Engineer to join our Data Platform group in TLV. As the Groups Tech Lead, youll shape and implement the technical vision and architecture while staying hands-on across three specialized teams: Data Engineering Infra, Machine Learning Platform, and Data Warehouse Engineering, forming the backbone of our companys data ecosystem.
The groups mission is to build a state-of-the-art Data Platform that drives our company toward becoming the most precise and efficient insurance company on the planet. By embracing Data Mesh principles, we create tools that empower teams to own their data while leveraging a robust, self-serve data infrastructure. This approach enables Data Scientists, Analysts, Backend Engineers, and other stakeholders to seamlessly access, analyze, and innovate with reliable, well-modeled, and queryable data, at scale.
We believe three things matter for every role at our company: drive to push through challenges, efficiency that keeps standards high while moving fast, and adaptability that lets you pivot with data and AI insights. These aren't buzzwords, they're how we actually work.
Our AI-first approach isn't just a tagline either. We're building the future of insurance with AI at the center, and we need people who are genuinely excited to learn and grow alongside these tools.
In this role youll :
Technically lead the group by shaping the architecture, guiding design decisions, and ensuring the technical excellence of the Data Platforms three teams
Design and implement data solutions that address both applicative needs and data analysis requirements, creating scalable and efficient access to actionable insights
Drive initiatives in Data Engineering Infra, including building robust ingestion layers, managing streaming ETLs, and guaranteeing data quality, compliance, and platform performance
Develop and maintain the Data Warehouse, integrating data from various sources for optimized querying, analysis, and persistence, supporting informed decision-makingLeverage data modeling and transformations to structure, cleanse, and integrate data, enabling efficient retrieval and strategic insights
Build and enhance the Machine Learning Platform, delivering infrastructure and tools that streamline the work of Data Scientists, enabling them to focus on developing models while benefiting from automation for production deployment, maintenance, and improvements. Support cutting-edge use cases like feature stores, real-time models, point-in-time (PIT) data retrieval, and telematics-based solutions
Collaborate closely with other Staff Engineers across our company to align on cross-organizational initiatives and technical strategies
Work seamlessly with Data Engineers, Data Scientists, Analysts, Backend Engineers, and Product Managers to deliver impactful solutions
Share knowledge, mentor team members, and champion engineering standards and technical excellence across the organization.

a central part of the R&D department is seeking a versatile Senior Data Engineer to take part in leading data vision using a lake-house architecture, and building high-scale solutions for handling and consuming the different data assets of the company.
In this role youll go beyond traditional boundaries, taking on full product responsibilities - from conceptualization and architecture to design, maintenance, and continuous development. You will collaborate closely with stakeholders across the company to ensure our solutions effectively meet their needs.
The ideal candidate will have strong data engineering capabilities, along with software development skills including understanding of designing and managing AWS cloud infrastructure and strong knowledge of different data architectures, methods and tools.
Responsibilities:
Design and development of scalable, reliable, and secure data infrastructure and build ETL pipelines that handle diverse clinical data for research. Write production SQL, Spark jobs and craft schemas that evolve gracefully as research and production questions change.
Automate releases with CI/CD and Infrastructure as Code.
Optimise throughput, latency and cloud cost to meet research timelines at large scale.
Develop and maintain high-quality, scalable, and efficient code while fostering a culture of continuous improvement through regular retrospectives and knowledge sharing.
Take ownership of the full development lifecycle, including requirement gathering, design, implementation, testing, deployment, and ongoing maintenance.
Collaborate with cross-functional teams, including data scientists, data analysts, product managers, regulatory teams, and other developers, to drive the development of new tools and features that support mission.
Explore and adopt new technologies and frameworks that can enhance the capabilities of the Data-Nexus team and the overall data projects .

Design, build, and maintain robust pipelines feeding both DWH and production processes
Own pipeline orchestration in Apache Airflow end to end, including DAG design, monitoring, alerting, and production reliability
Design the data models behind our core domains and the contracts that downstream consumers depend on
Partner with business analysts, PMs, and business stakeholders to translate product and business questions into stable, qualified, and well-modeled data
Work with a variety of data sources including product events, application data, APIs, operational databases, logs, and third-party systems
Debug and solve data quality, pipeline, performance, and reliability issues
Use and create AI agents and LLM-based tooling to improve development, testing, documentation, and root cause analysis
Be part of the team and adopt effective ways of using AI tools in the engineering workflow.

we are on a mission to create public transportation systems that provide far greater access to jobs, healthcare, and education. Our platform serves as the technology backbone for modern transit networks, transforming antiquated and siloed public transportation systems into smart, data-driven, and efficient digital networks. With hundreds of agency partners around the world, we are recognized as the leading transportation technology and service provider globally.
As a Software & Data Engineer at our company, you will play a central role in building and evolving the data infrastructure that powers one of the world's leading transportation platforms. You'll work with rich, complex transportation data - from ride bookings and payments to real-time operational signals - designing the pipelines and systems that turn raw data into clean, reliable, and actionable insight across the business. This is a high-ownership role on a talented and deeply motivated engineering team in Tel Aviv, where your work will directly shape how our company understands and improves its service for cities and riders around the world.
About the Role:
Design and build highly scalable, reliable data pipelines that serve clean, structured data across our company's engineering, product, and business teams - ensuring the entire organisation can trust the data it works with
Own the architecture of complex data models that translate messy, real-world transportation data - bookings, payments, driver activity, and more - into systems that are fast, efficient, and built to scale
Lead end-to-end development across the full data lifecycle: from architecture and design through to deployment, monitoring, and continuous improvement
Proactively monitor data quality and reliability, identifying and resolving discrepancies before they reach stakeholders - building the kind of data infrastructure people can depend on
Collaborate with a broad forum of engineers, analysts, and business stakeholders to identify data needs, design POCs, and ship scalable solutions that make a real difference to how our company operates
Contribute to the adoption and evolution of our modern data stack, including DBT, Airflow, Iceberg storage, and AWS big data tooling such as Glue, EMR, and Athena.

Were looking for a Senior Data Engineer to own high-impact data products from architecture through production deployment, monitoring, and continuous improvement. This isnt a pure infrastructure role - youll combine strong engineering with product thinking, operational excellence, and awareness of data quality, cost, and business impact.

You will design, implement, test, deploy, and maintain production-grade data products - pipelines, transformation layers, data quality and reliability systems - using tools like DBT (on Spark) and Databricks. Youll apply best practices in Python and SQL to build scalable and maintainable data transformations, and leverage technologies like LLMs and GenAI to create innovative solutions for real business problems.

This role is ideal for someone who wants technical leadership responsibilities in an AI-first engineering culture - we use LLMs, GenAI, and AI-native development tools as core parts of our daily workflow.

Key Responsibilities

Act as a technical leader within the team - raise engineering standards, drive strong architectural choices, and improve how we build
Own data products end-to-end: design, development, deployment, monitoring, and iteration
Work closely with senior leadership to translate strategic goals into scalable data solutions
Develop and maintain production ETL/ELT pipelines using DBT (on Spark) and orchestrated workflows in Databricks
Build monitoring, alerting, and testing pipelines to ensure reliability and performance in production
Evaluate and introduce new technologies - including AI-native development tools - and integrate the ones that create real impact
Collaborate with customers and external data providers - gathering requirements and making product decisions.
Mentor team members through code reviews, pairing, and knowledge sharing