דרושים » תוכנה » Senior Data Engineer

We are looking for a Senior Data Architect to help define and evolve the data architecture of our SaaS platform and core products. You will work closely with product, delivery, and engineering squads to design scalable, reliable data systems, set technical direction for how data is ingested, modeled, stored, and served, and guide teams in making high-quality architectural decisions that balance delivery speed with long-term sustainability.
This is a hands-on, senior technical leadership role: you will spend most of your time shaping data architectures with teams, reviewing data models, pipelines and critical code, and driving shared standards and patterns across the organization, all in an advanced agentic environment.
Responsibilities:
Define and evolve the data architecture for key domains (ingestion, ELT/ETL, data modeling, storage, APIs, integration, observability, governance, and security), including owning the lakehouse/medallion architecture (bronze/silver/gold) and the data flows that move data across layers at scale.
Translate business and product requirements into pragmatic data designs, data contracts, and architecture roadmaps; create and maintain architecture artefacts (data flow/lineage diagrams, ADRs, reference implementations, modeling guidelines).
Evaluate design options and technology choices, articulate trade-offs, and lead decision-making with stakeholders; push forward the agentic mindset and implementation across the data platform.
Partner with squad leads and senior engineers to design data solutions, break down complex problems, and keep implementations aligned with the target architecture; participate in design/tech reviews to ensure NFRs (performance, scalability, data quality, resilience, security, operability) are addressed early.
Provide hands-on support where it matters most: spike and prototype critical data flows, review complex PRs, and help debug tricky production data and pipeline issues.

We are looking for an experienced and visionary Data Engineer to help design, build, and scale our BI platform.
In this role, you will be responsible for developing our data analytics platform - enabling scalable data pipelines and robust data modeling to support real-time and batch analytics to provide insights that serve both business intelligence and product needs.
You will be part of the R&D team, collaborating closely with engineers, analysts, and product managers to deliver a modern data architecture that supports internal dashboards and future-facing operational analytics.
If you enjoy turning raw data into powerful insights and owning the full data lifecycle, this role is for you!
Responsibilities
Take full ownership of the design and implementation of a scalable and efficient BI data infrastructure, ensuring high performance, reliability, and security.
Design and architect data products, from ingestion to transformation, modeling, storage, and access.
Build and maintain ETL/ELT pipelines, batch and real-time, to support analytics, reporting, and product integrations.
Establish and enforce best practices for data quality, lineage, observability, and governance to ensure accuracy and consistency.
Integrate modern tools and frameworks such as Airflow, Databricks, Power BI, and streaming platforms.
Collaborate cross-functional with product, engineering, and analytics teams to translate business needs into data infrastructure.
Promote a data-driven culture - be an advocate for data-driven decision-making across the company by empowering stakeholders with reliable and self-service data access.

We are looking for a Senior Data Platform Engineer to join our growing Platform team and help build the foundation that powers our products, analytics, and data-driven decision making.

In this role, you will design, build, and operate the core data infrastructure that enables engineering teams to move fast while maintaining reliability, scalability, and operational excellence. You will work across databases, streaming systems, data lakes, cloud infrastructure, and platform services, solving complex challenges around scale, performance, and resilience.

As a senior engineer, you will play a key role in shaping our data architecture, driving technical decisions, and mentoring other engineers.

Responsibilities
Design, build, and operate scalable data platform services and infrastructure.
Develop high-quality software for distributed systems and data-intensive applications.
Design and optimize data storage solutions across operational databases, data lakes, and analytical systems.
Drive database performance improvements through query optimization, indexing strategies, schema design, and capacity planning.
Build and maintain event-driven architectures and streaming data pipelines.
Develop and improve data ingestion, transformation, orchestration, and processing frameworks.
Partner with product, engineering, analytics, and AI teams to deliver scalable and reliable data solutions.
Improve platform reliability, observability, and operational excellence through automation and engineering best practices.
Build and enhance CI/CD pipelines, deployment processes, and developer tooling.
Lead architecture discussions and contribute to long-term platform strategy.
Troubleshoot complex production issues and drive root-cause analysis and preventative improvements.
Mentor engineers through code reviews, technical guidance, and knowledge sharing.

We are looking for an experienced Data Engineering Team Leader.

In this role, you will lead and strengthen our Data Team, drive innovation, and ensure the robustness of our data and analytics platforms.

A day in the life and how youll make an impact:

Drive the technical strategy and roadmap for the data engineering function, ensuring alignment with overall business objectives.
Own the design, development, and evolution of scalable, high-performance data pipelines to enable diverse and growing business needs.
Establish and enforce a strong data governance framework, including comprehensive data quality standards, monitoring, and security protocols, taking full accountability for data integrity and reliability.
Lead the continuous enhancement and optimization of the data analytics platform and infrastructure, focusing on performance, scalability, and cost efficiency.
Champion the complete data lifecycle, from robust infrastructure and data ingestion to detailed analysis and automated reporting, to maximize the strategic value of data and drive business growth.

we are looking for a Senior Data Engineer.
As a Senior Data Engineer, you will play a key role in owning and scaling the backend data infrastructure that powers our platform-supporting real-time optimization, advanced analytics, and machine learning applications.
What You'll Do:
Design, implement, and maintain robust, scalable data pipelines for batch and real-time processing using Spark, and other modern tools.
Own the backend data infrastructure, including ingestion, transformation, validation, and orchestration of large-scale datasets.
Leverage Google Cloud Platform (GCP) services to architect and operate scalable, secure, and cost-effective data solutions across the pipeline lifecycle.
Develop and optimize ETL/ELT workflows across multiple environments to support internal applications, analytics, and machine learning workflows.
Build and maintain data marts and data models with a focus on performance, data quality, and long-term maintainability.
Collaborate with cross-functional teams including development teams, product managers, and external stakeholders to understand and translate data requirements into scalable solutions.
Help drive architectural decisions around distributed data processing, pipeline reliability, and scalability.

Req ID: 21679

As a Senior Data Engineer, youll collaborate with top-notch engineers and data scientists to elevate our platform to the next level and deliver exceptional user experiences. Your primary focus will be on the data engineering aspects-ensuring the seamless flow of high-quality, relevant data to train and optimize content models, including GenAI foundation models, supervised fine-tuning, and more.

Youll work closely with teams across the company to ensure the availability of high-quality data from ML platforms, powering decisions across all departments. With access to petabytes of data through MySQL, Snowflake, Cassandra, S3, and other platforms, your challenge will be to ensure that this data is applied even more effectively to support business decisions, train and monitor ML models and improve our products.


Key Job Responsibilities and Duties:

Rapidly developing next-generation scalable, flexible, and high-performance data pipelines.

Dealing with massive textual sources to train GenAI foundation models.

Solving issues with data and data pipelines, prioritizing based on customer impact.

End-to-end ownership of data quality in our core datasets and data pipelines.

Experimenting with new tools and technologies to meet business requirements regarding performance, scaling, and data quality.

Providing tools that improve Data Quality company-wide, specifically for ML scientists.

Providing self-organizing tools that help the analytics community discover data, assess quality, explore usage, and find peers with relevant expertise.

Acting as an intermediary for problems, with both technical and non-technical audiences.

Promote and drive impactful and innovative engineering solutions

Technical, behavioral and interpersonal competence advancement via on-the-job opportunities, experimental projects, hackathons, conferences, and active community participation

Collaborate with multidisciplinary teams: Collaborate with product managers, data scientists, and analysts to understand business requirements and translate them into machine learning solutions. Provide technical guidance and mentorship to junior team members.

The Data-Nexus team, a central part of the R&D department , is seeking a versatile Senior Data Engineer to take part in leading data vision using a lake-house architecture, and building high-scale solutions for handling and consuming the different data assets of the company.
In this role youll go beyond traditional boundaries, taking on full product responsibilities - from conceptualization and architecture to design, maintenance, and continuous development. You will collaborate closely with stakeholders across the company to ensure our solutions effectively meet their needs.
The ideal candidate will have strong data engineering capabilities, along with software development skills including understanding of designing and managing AWS cloud infrastructure and strong knowledge of different data architectures, methods and tools.
Responsibilities:
Design and development of scalable, reliable, and secure data infrastructure and build ETL pipelines that handle diverse clinical data for research. Write production SQL, Spark jobs and craft schemas that evolve gracefully as research and production questions change.
Automate releases with CI/CD and Infrastructure as Code.
Optimise throughput, latency and cloud cost to meet research timelines at large scale.
Develop and maintain high-quality, scalable, and efficient code while fostering a culture of continuous improvement through regular retrospectives and knowledge sharing.
Take ownership of the full development lifecycle, including requirement gathering, design, implementation, testing, deployment, and ongoing maintenance.
Collaborate with cross-functional teams, including data scientists, data analysts, product managers, regulatory teams, and other developers, to drive the development of new tools and features that support mission.
Explore and adopt new technologies and frameworks that can enhance the capabilities of the Data-Nexus team and the overall data projects.

We're seeking a Mid to Senior Data Engineer to join our Cloud Identity & Perimeter, a critical component of CrowdStrike's security infrastructure. Our team develops and maintains complex data pipelines that process billions of records daily, analyzing identity-related security patterns, effective permissions, internet exposure, and attack paths. We're at the forefront of securing enterprise identities and delivering actionable security insights at scale.

What You'll Do:

Design and implement high-performance, distributed data processing pipelines handling petabytes of security data.

Architect complex data transformations using Apache Spark for large-scale batch and stream processing.

Be part of shaping new products while collaborating with product teams, customers, and sales.

Build and optimize real-time data streaming solutions using Kafka for identity analytics.

Develop and maintain scalable ETL processes that handle billions of daily events.

Create efficient data models for complex security analytics queries.

Collaborate with cross-functional teams to deliver high-impact security features.

Optimize query performance and data storage patterns for large-scale distributed systems.

Participate in system design discussions and architectural decisions.


This position is based in our Tel Aviv, Israel office and requires strong leadership presence and ability to work closely with cross-functional teams.

Were looking for a Senior Data Engineer in the Data Collection Ingest team to contribute to the design and coding of data ingestion services & pipelines. This role involves working as part of a team that handles millions of requests per minute across multiple servers, and is responsible for a wide-range of data pipelines, processing billions of events each day.

So, what will you be doing all day?

Your role as Data Engineer of the Ingest Data Collection team means your daily responsibilities may include:

Design, code and manage end-to-end data ingestion pipelines, both online and offline.
Take charge of developing & maintaining modern data infrastructure, while implementing best practices for building data pipelines.
Be responsible for high-scale ingestion services, solving challenges of availability, reliability, and scalability.
Run the production environment by monitoring availability and taking a holistic view of system health and data quality.
Own data infrastructure features from design to production using industry best practices with focus on quality and delivery.
Lead design & decision-making processes of the team.
Solve diverse complex problems of scale, performance and business logic.
Collaborate with product managers and other team leaders to plan, nurture, and implement an efficient and effective development process.
Continuously learn and evaluate new technologies in the everlasting effort to perfect our products
Perform code reviews, evaluate implementations, and provide feedback about potential improvements.
Improve your skills, learn from and mentor top-notch engineers and enrich other team members.
Have lots of fun!

Required Data Engineer
Working in data is about finding what nobody else knew they lost. We want investigators, people who adapt, think flexibly, and know how to bring leadership onboard. From scientists to engineers to visualization experts, our data team is made for those who find the missing piece and act on it. So if curiosity is your default setting and making it useful your priority, the Data team might be what you're looking for.
Join our dynamic Data department as a Senior Data Engineer, where you'll play a pivotal role in launching a critical new data product. This is an opportunity to elevate our engineering rigor and deliver innovative solutions for the world's most popular freelance marketplace, tackling complex challenges with advanced data warehousing and full-stack development expertise.
What am I going to do?
Architect and design robust schemas for our new data product backend, ensuring scalability and performance.
Drive full-stack feature development for production-ready features, contributing to both data pipelines and user-facing elements.
Orchestrate and optimize data pipelines, guaranteeing reliable and timely data delivery.
Provide technical leadership to enhance software engineering standards across the team, mentoring other developers.
Integrate complex systems and manage schema design with a keen eye on cost optimization.
Collaborate closely with cross-functional teams in daily stand-ups and development cycles.