דרושים » דאטה » Data Engineer REF27Y

We are looking for an experienced and visionary Data Engineer to help design, build, and scale our BI platform.
In this role, you will be responsible for developing our data analytics platform - enabling scalable data pipelines and robust data modeling to support real-time and batch analytics to provide insights that serve both business intelligence and product needs.
You will be part of the R&D team, collaborating closely with engineers, analysts, and product managers to deliver a modern data architecture that supports internal dashboards and future-facing operational analytics.
If you enjoy turning raw data into powerful insights and owning the full data lifecycle, this role is for you!
Responsibilities:
Take full ownership of the design and implementation of a scalable and efficient BI data infrastructure, ensuring high performance, reliability, and security.
Design and architect data products, from ingestion to transformation, modeling, storage, and access.
Build and maintain ETL/ELT pipelines, batch and real-time, to support analytics, reporting, and product integrations.
Establish and enforce best practices for data quality, lineage, observability, and governance to ensure accuracy and consistency.
Integrate modern tools and frameworks such as Airflow, Databricks, Power BI, and streaming platforms.
Collaborate cross-functional with product, engineering, and analytics teams to translate business needs into data infrastructure.
Promote a data-driven culture - be an advocate for data-driven decision-making across the company by empowering stakeholders with reliable and self-service data access.

We're seeking a Mid to Senior Data Engineer to join our Cloud Identity & Perimeter, a critical component of CrowdStrike's security infrastructure. Our team develops and maintains complex data pipelines that process billions of records daily, analyzing identity-related security patterns, effective permissions, internet exposure, and attack paths. We're at the forefront of securing enterprise identities and delivering actionable security insights at scale.

What You'll Do:

Design and implement high-performance, distributed data processing pipelines handling petabytes of security data.

Architect complex data transformations using Apache Spark for large-scale batch and stream processing.

Be part of shaping new products while collaborating with product teams, customers, and sales.

Build and optimize real-time data streaming solutions using Kafka for identity analytics.

Develop and maintain scalable ETL processes that handle billions of daily events.

Create efficient data models for complex security analytics queries.

Collaborate with cross-functional teams to deliver high-impact security features.

Optimize query performance and data storage patterns for large-scale distributed systems.

Participate in system design discussions and architectural decisions.


This position is based in our Tel Aviv, Israel office and requires strong leadership presence and ability to work closely with cross-functional teams.

we are on a mission to create public transportation systems that provide far greater access to jobs, healthcare, and education. Our platform serves as the technology backbone for modern transit networks, transforming antiquated and siloed public transportation systems into smart, data-driven, and efficient digital networks. With hundreds of agency partners around the world, we are recognized as the leading transportation technology and service provider globally.
As a Software & Data Engineer at our company, you will play a central role in building and evolving the data infrastructure that powers one of the world's leading transportation platforms. You'll work with rich, complex transportation data - from ride bookings and payments to real-time operational signals - designing the pipelines and systems that turn raw data into clean, reliable, and actionable insight across the business. This is a high-ownership role on a talented and deeply motivated engineering team in Tel Aviv, where your work will directly shape how our company understands and improves its service for cities and riders around the world.
About the Role:
Design and build highly scalable, reliable data pipelines that serve clean, structured data across our company's engineering, product, and business teams - ensuring the entire organisation can trust the data it works with
Own the architecture of complex data models that translate messy, real-world transportation data - bookings, payments, driver activity, and more - into systems that are fast, efficient, and built to scale
Lead end-to-end development across the full data lifecycle: from architecture and design through to deployment, monitoring, and continuous improvement
Proactively monitor data quality and reliability, identifying and resolving discrepancies before they reach stakeholders - building the kind of data infrastructure people can depend on
Collaborate with a broad forum of engineers, analysts, and business stakeholders to identify data needs, design POCs, and ship scalable solutions that make a real difference to how our company operates
Contribute to the adoption and evolution of our modern data stack, including DBT, Airflow, Iceberg storage, and AWS big data tooling such as Glue, EMR, and Athena.

We are looking for a brilliant Data Engineer- an independent, logical thinker who enjoys solving complex problems and building scalable data solutions. You will own and evolve the data foundations that power Product, Finance, Operations, and Business teams. Working closely with diverse stakeholders, Analysts, and R&D teams, you will serve as a technical partner, translating complex business challenges into robust data models, pipelines, and infrastructure. You should be able to translate business and data requirements into scalable data pipelines and data models, integrating multiple internal and external data sources using the most appropriate technologies. Beyond building pipelines, you will improve data quality, modernize existing data assets, automate manual workflows, and help create a clean, reliable, and scalable data ecosystem that supports the company's growth.

Roles and Responsibilities:
Design and build end-to-end data pipelines - From defining source structures and integrating APIs to delivering clean, trusted datasets that enable analytics, reporting, and operational workflows.
Translate business needs into scalable data solutions based on business priorities and the product roadmap, understand technical requirements, and deliver purpose-built pipelines and tools.
Act as the technical partner for Product, Finance, Operations, and R&D teams, translating business needs into scalable data models, pipelines, and internal tools while ensuring reliable, trusted data across the organization.
Write high-quality, maintainable code, while following best practices and leveraging modern data tooling and CI/CD principles.
Drive data quality and reliability - Monitor, validate, troubleshoot, and continuously improve data quality and pipeline reliability across the data platform.

Were looking for a Senior Data Engineer to own high-impact data products from architecture through production deployment, monitoring, and continuous improvement. This isnt a pure infrastructure role - youll combine strong engineering with product thinking, operational excellence, and awareness of data quality, cost, and business impact.

You will design, implement, test, deploy, and maintain production-grade data products - pipelines, transformation layers, data quality and reliability systems - using tools like DBT (on Spark) and Databricks. Youll apply best practices in Python and SQL to build scalable and maintainable data transformations, and leverage technologies like LLMs and GenAI to create innovative solutions for real business problems.

This role is ideal for someone who wants technical leadership responsibilities in an AI-first engineering culture - we use LLMs, GenAI, and AI-native development tools as core parts of our daily workflow.

Key Responsibilities

Act as a technical leader within the team - raise engineering standards, drive strong architectural choices, and improve how we build
Own data products end-to-end: design, development, deployment, monitoring, and iteration
Work closely with senior leadership to translate strategic goals into scalable data solutions
Develop and maintain production ETL/ELT pipelines using DBT (on Spark) and orchestrated workflows in Databricks
Build monitoring, alerting, and testing pipelines to ensure reliability and performance in production
Evaluate and introduce new technologies - including AI-native development tools - and integrate the ones that create real impact
Collaborate with customers and external data providers - gathering requirements and making product decisions.
Mentor team members through code reviews, pairing, and knowledge sharing

We are looking for a brilliant Data Engineer- an independent, logical thinker who enjoys solving complex problems and building scalable data solutions. You will own and evolve the data foundations that power Product, Finance, Operations, and Business teams. Working closely with diverse stakeholders, Analysts, and R&D teams, you will serve as a technical partner, translating complex business challenges into robust data models, pipelines, and infrastructure. You should be able to translate business and data requirements into scalable data pipelines and data models, integrating multiple internal and external data sources using the most appropriate technologies. Beyond building pipelines, you will improve data quality, modernize existing data assets, automate manual workflows, and help create a clean, reliable, and scalable data ecosystem that supports the company's growth.
Roles and Responsibilities:
Design and build end-to-end data pipelines - From defining source structures and integrating APIs to delivering clean, trusted datasets that enable analytics, reporting, and operational workflows.
Translate business needs into scalable data solutions based on business priorities and the product roadmap, understand technical requirements, and deliver purpose-built pipelines and tools.
Act as the technical partner for Product, Finance, Operations, and R&D teams, translating business needs into scalable data models, pipelines, and internal tools while ensuring reliable, trusted data across the organization.
Write high-quality, maintainable code, while following best practices and leveraging modern data tooling and CI/CD principles.
Drive data quality and reliability - Monitor, validate, troubleshoot, and continuously improve data quality and pipeline reliability across the data platform.

As a Senior Data Engineer in our R&D team, you aren't just moving bytes; you are the architect of the world's most comprehensive food-intelligence engine. You will take full ownership of our ingestion pipelines, transforming massive volumes of unstructured web data into the actionable insights our customers rely on. This role requires a builder who can navigate complex anti-bot measures, design resilient distributed systems, and ensure our data remains flawless as we scale.

Key responsibilities:

Own end-to-end architecture and delivery of our web-scale data ingestion pipelines, from resilient scraping through transformation and storage.
Design and maintain scrapers that reliably bypass anti-bot measures and handle dynamic content at scale, adapting quickly as sources change.
Leverage AI coding assistants (Claude Code, Codex) to accelerate development, optimize pipeline logic, and ship faster within titling R&D cycles.
Build and manage distributed, cloud-based data pipelines that support real-time analytics and AI model deployment.
Proactively identify and resolve data quality issues before they reach production, ensuring accuracy and consistency across all sources.
Architect scalable API and system designs that connect pipeline decisions directly to business value and consumer-trend accuracy.
Monitor, troubleshoot, and continuously improve data workflows to keep the engine reliable as we scale.

Required Data Engineer
About The Position
Design, build, and maintain scalable data pipelines and infrastructure entirely within GCP
Own data solutions end-to-end, from architecture and design through to production delivery
Build and maintain custom connectors to advertising platforms including Google Ads, Meta (Facebook) Marketing API, and other ad platforms
Design and implement data warehouse structures with a deep focus on performance, scalability and usability
Continuously investigate and evaluate new GCP native tools and services, assessing their fit, building proof of concepts, and driving adoption where it makes sense
Set up and configure orchestration and transformation frameworks (such as Airflow and dbt) within the GCP environment
Collaborate closely with backend engineers to ensure data infrastructure aligns with product and system needs
Contribute to data science initiatives and bring genuine curiosity to analytical use cases
Monitor, troubleshoot, and continuously improve the reliability and performance of existing data systems
Define technical standards and best practices for the data platform
Build and maintain data dashboards and reports to surface insights for stakeholders, primarily using Looker Studio.

As a Principal Data Engineer, you will be integral to the security research group, designing, building, and maintaining the data pipelines and data frameworks that are the backbone of our cyber attack detection capabilities. You will work closely with top security and AI researchers, enabling their work and seeing the direct impact of your contributions on our services and the day-to-day effectiveness of the research team.
Key Responsibilities
Lead the design and implementation of end-to-end, complex data pipelines and data platforms in cloud environment.
Collect, analyze, and translate complex data requirements from various stakeholders including data analysts, developers, and Cyber security researchers.
Develop robust, scalable Cloud based data solutions using Python and distributed processing frameworks such as Apache Beam (Dataflow) , GKE , Spark , etc.
Utilize AI as part of the development cycle, including generating, reviewing, and testing code via prompts.
Model and manage data within cloud MPP databases and data lakes such as BigQuery, Redshift, or Snowflake.

Were looking for a Senior Data Engineer in the Data Collection Ingest team to contribute to the design and coding of data ingestion services & pipelines. This role involves working as part of a team that handles millions of requests per minute across multiple servers, and is responsible for a wide-range of data pipelines, processing billions of events each day.

So, what will you be doing all day?

Your role as Data Engineer of the Ingest Data Collection team means your daily responsibilities may include:

Design, code and manage end-to-end data ingestion pipelines, both online and offline.
Take charge of developing & maintaining modern data infrastructure, while implementing best practices for building data pipelines.
Be responsible for high-scale ingestion services, solving challenges of availability, reliability, and scalability.
Run the production environment by monitoring availability and taking a holistic view of system health and data quality.
Own data infrastructure features from design to production using industry best practices with focus on quality and delivery.
Lead design & decision-making processes of the team.
Solve diverse complex problems of scale, performance and business logic.
Collaborate with product managers and other team leaders to plan, nurture, and implement an efficient and effective development process.
Continuously learn and evaluate new technologies in the everlasting effort to perfect our products
Perform code reviews, evaluate implementations, and provide feedback about potential improvements.
Improve your skills, learn from and mentor top-notch engineers and enrich other team members.
Have lots of fun!