דרושים » דאטה » Senior Data Engineer

We are looking for a Data Engineer to join our team and play a key role in designing, building, and maintaining scalable, cloud-based data pipelines. You will work with AWS services , Airflow and databricks to integrate, process, and analyze large datasets, ensuring data reliability and efficiency.
Your work will directly impact business intelligence, analytics, and data-driven decision-making across the company.
What Youll Do:
ETL & Data Processing: Develop and maintain ETL processes, integrating data from various sources (APIs, databases, external platforms) using Python, SQL, and cloud technologies.
Utilize LangGraph and other frameworks to create state of the art AI agents that integrate various tools and data sources.
Implement integrations that allow agents to take automated actions on behalf of users, streamlining workflows and reducing overhead.
Data Modeling: Design and maintain logical and physical data models to support business needs.
Optimization & Scalability: Improve process efficiency and optimize runtime performance to handle large-scale data workloads.
Collaboration: Work closely with BI analysts and business stakeholders to define data requirements and functional specifications.
Monitoring & Troubleshooting: Ensure data integrity and reliability by proactively monitoring pipelines and resolving issues.

We are seeking talented and passionate Senior Data Engineer to join our Data team. In this pivotal role, you will be instrumental in designing, building, and optimizing the critical data infrastructure that underpins innovative creative intelligence platform. You will tackle complex data challenges, ensuring our systems are robust, scalable, and capable of delivering high-quality data to power our advanced AI models, customer-facing analytics, and internal business intelligence. This is an opportunity to make a significant impact on our product, contribute to a data-driven culture, and help solve fascinating problems at the intersection of data, AI, and marketing technology.

Key Responsibilities
Architect & Develop Data Pipelines: Design, implement, and maintain sophisticated, end-to-end data pipelines for ingesting, processing, validating, and transforming large-scale, diverse datasets.
Manage Data Orchestration: Implement and manage robust workflow orchestration for complex, multi-step data processes, ensuring reliability and visibility.
Advanced Data Transformation & Modeling: Develop and optimize complex data transformations using advanced SQL and other data manipulation techniques. Contribute to the design and implementation of effective data models for analytical and operational use.
Ensure Data Quality & Platform Reliability: Establish and improve processes for data quality assurance, monitoring, alerting, and performance optimization across the data platform. Proactively identify and resolve data integrity and pipeline issues.
Cross-Functional Collaboration: Partner closely with AI engineers, product managers, developers, customer success and other stakeholders to understand data needs, integrate data solutions, and deliver features that provide exceptional value.
Drive Data Platform Excellence: Contribute to the evolution of our data architecture, champion best practices in data engineering (e.g., DataOps principles), and evaluate emerging technologies to enhance platform capabilities, stability, and cost-effectiveness.
Foster a Culture of Learning & Impact: Actively share knowledge, contribute to team growth, and maintain a strong focus on how data engineering efforts translate into tangible product and business outcomes.

We are looking for a Data Engineer to help build and scale the data platform behind our search quality, ML pipelines, product analytics, and business operations.
In this role, you will contribute across the full data lifecycle: ingesting data from production systems, designing and evolving our data warehouse, building batch and streaming pipelines, and making high-quality datasets available to researchers, engineers, analysts, and product teams across the company.
The platform spans tens of terabytes and ingests data from tens of proprietary and third-party sources - including our search engine and its components, CRM, billing, identity, and product analytics across multi-region production environments. Around 100 internal users rely on it daily.
You will work closely with engineers and stakeholders across the company, contribute to architectural and modeling decisions, and help improve the reliability, usability, and scalability of the data platform as it grows.

In this position, your responsibility will be to:
Contribute to the design, development, and operation of Tavily's data platform - from real-time ingestion through data warehouse medallion layers to consumer-facing datasets and dashboards.
Build and maintain reliable batch and streaming pipelines that ingest data from production services and external systems.
Design and evolve scalable, analytics-ready data models in the data warehouse.
Work closely with engineers across the company to ensure data produced by production systems is reliable, well-structured, and usable downstream.
Improve observability across the data platform, including data quality checks, freshness monitoring, lineage, schema evolution, and cost controls.
Partner with researchers, engineers, analysts, finance, and product managers to deliver trustworthy datasets for product, search quality, ML, and GTM analytics.
Contribute to defining the objects, entities, and relationships that represent Tavily's search domain - including agent inputs, URLs, chunks, agent sessions, crawls, and the connections between them - and translate them into clean, queryable data models.
Improve engineering practices around testing, documentation, deployment, and incident response.
Investigate and resolve production data issues, including broken pipelines, corrupted datasets, schema changes, and large-scale backfills.
Contribute to technical standards and best practices for data engineering across the company.
Help maintain high standards of data quality, integrity, security, and governance across environments.

As our Founding Data Engineer, you will be the first dedicated Data Engineer at the company, with the opportunity to build our data engineering function from the ground up. You'll own the architecture and foundations of our internal data platform - the central warehouse, pipelines, and models every team relies on to understand how our product is performing, and provide tools for day to day operations. You'll define how data from across the company is collected, modeled, transformed, and governed, and establish the standards and best practices that will scale with us as we grow. Working closely with Engineering, Data Science, Delivery, Product, and Analytics teams, you'll turn data into reliable, structured assets that power product and business decisions.

What Youll Do
Build our Data Engineering Function: Be the first dedicated Data Engineer and will be required to be opinionated about the warehouse architecture, tooling, standards, and best practices for how we work with data across the company.
Develop Data Pipelines: Design, build, and maintain data pipelines that transform company data into structured, queryable assets.
Enable Data-Driven Decisions: Partner with Engineering, Data Science, Product and Analytics teams to deliver trusted data foundations and actionable insights.
Create BI Dashboards: Build and maintain dashboards and reporting layers that support product, and operational decision-making.
Ensure Data Quality and Accessibility: Implement best practices for data modeling, governance, monitoring, and reliability.

Required Senior Data Engineer
Description
We are making the future of Mobility come to life starting today.
We support the worlds largest vehicle fleet operators and transportation providers to optimize existing operations and seamlessly launch new, dynamic business models - driving efficient operations and maximizing utilization.
At the heart of our platform lies the data infrastructure, driving advanced machine learning models and optimization algorithms. As the owner of data pipelines, you'll tackle diverse challenges spanning optimization, prediction, modeling, inference, transportation, and mapping.
As a Senior Data Engineer, you will play a key role in owning and scaling the backend data infrastructure that powers our platform-supporting real-time optimization, advanced analytics, and machine learning applications.
What You'll Do:
Design, implement, and maintain robust, scalable data pipelines for batch and real-time processing using Spark, and other modern tools.
Own the backend data infrastructure, including ingestion, transformation, validation, and orchestration of large-scale datasets.
Leverage Google Cloud Platform (GCP) services to architect and operate scalable, secure, and cost-effective data solutions across the pipeline lifecycle.
Develop and optimize ETL/ELT workflows across multiple environments to support internal applications, analytics, and machine learning workflows.
Build and maintain data marts and data models with a focus on performance, data quality, and long-term maintainability.
Collaborate with cross-functional teams including development teams, product managers, and external stakeholders to understand and translate data requirements into scalable solutions.
Help drive architectural decisions around distributed data processing, pipeline reliability, and scalability.

We are looking for an experienced Data Engineer to own and evolve data infrastructure and analytics platform.

You will design and build scalable data pipelines and data models, working with large and diverse datasets generated across Trigos global retail deployments. You will own the data lifecycle from ingestion and transformation through orchestration, reliability, and analytics-ready datasets.

As a key technical owner of data platform, you will also work closely with analysts, Product, R&D, Operations, and Customer Success to build trusted data products, evolve our BI semantic layer, and turn complex data into scalable solutions

A day in the life
Design, build, and maintain scalable ETL/ELT pipelines processing large and diverse datasets.
Own and evolve data architecture, from ingestion and transformation through analytics-ready data models and consumption.
Build reliable data workflows and orchestration processes, with a focus on scalability, performance, and maintainability.
Design and maintain curated data models that power analytics, operational workflows, and data-driven products.
Ensure data quality, observability, monitoring, and reliability across datasets and pipelines.
Develop and evolve the BI semantic layer, enabling trusted metrics and self-service analytics across the company.
Work closely with R&D and Product on data integrations and new data-driven capabilities, including use cases that bridge offline analytics and production systems.
Partner with analysts and business stakeholders to translate complex requirements into scalable data solutions.

We're looking for a Data Warehouse Tech Lead to drive the technical vision and execution of our data infrastructure that powers decision-making across.
You'll lead both the technology and the business coordination for our data warehouse - architecting scalable solutions while working closely with stakeholders and data providers to ensure our platform serves the entire organization's needs. This role combines deep technical leadership with strategic business partnership as we build our next-generation data stack.
We believe three things matter for every role: drive to push through challenges, efficiency that keeps standards high while moving fast, and adaptability that lets you pivot with data and AI insights. These aren't buzzwords, they're how we actually work.
Our AI-first approach isn't just a tagline either. We're building the future of insurance with AI at the center, and we need people who are genuinely excited to learn and grow alongside these tools.
In this role you'll:
Lead technical architecture - design and develop scalable data warehouse solutions that support multiple products and serve the entire organization's analytics needs
Manage the technical roadmap - set strategy and guide execution for the Data Warehouse team, ensuring our platform evolves with business requirements
Drive business process coordination - translate business needs into technical requirements while establishing clear data contracts with R&D, Analytics, and external data providers
Establish and implement best practices - set technical standards for data warehouse architecture, performance tuning, and development methodologies that guide the entire team's approach to building scalable data solutions
Create and maintain sustainable data pipelines - build resilient systems capable of handling unstructured data and managing an evolving schema registry across diverse data sources
Implement advanced data modeling - create robust data structures using methodologies like dimensional modeling, and optimize ETL/ELT processes for our semantic layer
Establish data quality standards - build processes for schema evaluation, anomaly detection, and monitoring data completeness and freshness across all sources
Lead cross-team collaboration - work directly with Data Engineers, ML Platform Engineers, Data Scientists, Analysts, and Product Managers to align technical solutions with business goals

We are looking for a brilliant Data Engineer- an independent, logical thinker who enjoys solving complex problems and building scalable data solutions. You will own and evolve the data foundations that power Product, Finance, Operations, and Business teams. Working closely with diverse stakeholders, Analysts, and R&D teams, you will serve as a technical partner, translating complex business challenges into robust data models, pipelines, and infrastructure. You should be able to translate business and data requirements into scalable data pipelines and data models, integrating multiple internal and external data sources using the most appropriate technologies. Beyond building pipelines, you will improve data quality, modernize existing data assets, automate manual workflows, and help create a clean, reliable, and scalable data ecosystem that supports the company's growth.
Roles and Responsibilities:
Design and build end-to-end data pipelines - From defining source structures and integrating APIs to delivering clean, trusted datasets that enable analytics, reporting, and operational workflows.
Translate business needs into scalable data solutions based on business priorities and the product roadmap, understand technical requirements, and deliver purpose-built pipelines and tools.
Act as the technical partner for Product, Finance, Operations, and R&D teams, translating business needs into scalable data models, pipelines, and internal tools while ensuring reliable, trusted data across the organization.
Write high-quality, maintainable code, while following best practices and leveraging modern data tooling and CI/CD principles.
Drive data quality and reliability - Monitor, validate, troubleshoot, and continuously improve data quality and pipeline reliability across the data platform.

As our Senior Data Engineer you will handle Big Data in real time, and become the owner and gatekeeper of all data and data flows within the company. You will bring data ingenuity and technological excellence while gaining a deep business understanding.

This is an amazing opportunity to join a multi-disciplinary A-team while working in a fast-paced, modern-cloud, data-oriented environment.

Implement robust, reliable, and scalable data pipelines and data architecture.
Own and develop DWH (petabytes of data!).
Own the entire data development process, including business knowledge, methodology, quality assurance, and monitoring.
Collaborate with cross-functional teams to define, design, and ship new features.
Continuously discover, evaluate, and implement new technologies to maximize development efficiency.
Develop tailor-made solutions as part of our data pipelines.
Lead complex Big Data projects and build data platforms from scratch.
Work on high-scale, real-time, real-world, business-critical data stores and data endpoints.
Implement data profiling to identify anomalies and maintain data integrity.
Work in a results-driven, high-paced, rewarding environment.

Were looking for a talented Data Engineer to join our AI team and build the data foundations that power our AI systems at scale. As a key member of the AI team, youll be responsible for designing, building, and operating the data layer that enables our AI models and agents to perform in production. This includes data ingestion, storage, transformation, monitoring, and defining the data strategy that ensures our AI applications receive high-quality, reliable, and timely data.

Were seeking an ambitious Data Engineer who is passionate about building robust data infrastructure, working with large-scale and complex datasets, and partnering closely with AI engineers and researchers to translate model needs into production-grade data systems.


WHAT YOU WILL DO
Design, build, and operate scalable data pipelines (batch + streaming) that power our AI systems in production.
Own the end-to-end data lifecycle: ingestion, storage, transformation, serving, and continuous improvement.
Build and maintain the data layer from raw data to semantically accessible data that enables AI models and agents to perform reliably at scale.
Ensure high data quality and high-standard operation through monitoring, alerting, and validation checks.
Work with modern storage systems (data lakes, warehouses, relational, graph, and vector databases) to support diverse AI workloads.
Partner closely with AI engineers and researchers to translate model requirements into production-grade data infrastructure.
Define and evolve the data strategy to for AI applications.