דרושים » דאטה » Senior Data Engineer

Required Data Engineer
Description
Join our core platform engineering team, developing our AI-powered automotive data management platform.
We are developing the next generation data-driven products for the Automotive industry, focusing on cybersecurity (XDR) and vehicle quality. our products monitor and secure millions of vehicles worldwide and help automakers leverage connected vehicle data to deliver cyber resilience, safety, customer satisfaction and increase brand loyalty.
Our Data Engineering & Data Science Group leads the development of our Iceberg-based data platform, including data lake, query engine, and ML-Ops tools, serving as a solid AI-ready foundation for all our products.
At the core of our Engineering Team, you will build and operate scalable, production-grade customer-facing data and ML platform components, focusing on reliability and performance.
Technological background and focus: Iceberg, Trino, Prefect, GitHub Actions, Kubernetes, JupyterHub, MLflow, dbt
This role is full-time and is Herzliya, Israel based.
Responsibilities
Design, build, and maintain scalable data pipelines to ingest and transform batch data on our data lake, enabling analytics and ML with strong data quality, governance, observability, and CI/CD.
Build and expand our foundational data infrastructure, including our data lake, analytics engine, and batch processing frameworks.
Create robust infrastructure to enable automated pipelines that will ingest and process data into our analytical platforms, leveraging open-source, cloud-agnostic frameworks and toolsets.
Develop and maintain our data lake layouts and architectures for efficient data access and advanced analytics.
Develop and manage orchestration tools, governance tools, data discovery tools, and more.
Work with other team members of the engineering group, including data architects, data analysts, and data scientists, to provide solutions using a use case-based approach that drives the construction of technical data flows.
End-to-end ownership mindset with a proactive, production-first approach.

were looking for skilled professionals to help shape our data platform and drive the next generation of trading technology.

In this role you will:
Design, implement, and maintain scalable data pipelines using Python and orchestration tools like Apache Airflow.

Take a leading role in evaluating and selecting foundational components of our data stack (e.g., Databricks vs. Snowflake).

Architect and optimize data workflows across AWS and on-premise environments.

Work with modern file formats (Iceberg, Parquet, ORC) and understand their trade-offs for performance, cost, and scalability.

Collaborate with analysts, engineers, and stakeholders to provide accessible and reliable datasets.

Help assess and implement frameworks such as DBT for data transformation and modeling.

Develop best practices and internal standards for data engineering, monitoring, and testing.

Contribute to the long-term vision and roadmap of Fin-on-exs data infrastructure.

We are looking for a motivated Data Engineer to join our growing Data team. This is an exciting opportunity to be part of a core group responsible for building, maintaining, and scaling our data platform, while working closely with Product, Engineering, and business teams.

You will play a key role in developing reliable data pipelines, ensuring data quality and consistency, and enabling data-driven decision-making across the organization.

Responsibilities:
Design, build, and maintain data pipelines and data models to support analytics and reporting needs.
Work with structured data across databases, data lakes, and data warehouses.
Write efficient and maintainable SQL and Python code for data transformation and validation.
Ensure data quality, consistency, and basic data lineage across systems.
Collaborate with Product, Engineering, and business stakeholders to understand data requirements.
Support dashboards and reporting tools by providing clean, well-modeled data.
Contribute to improving data standards, documentation, and best practices.

We are seeking an experienced Data Engineer with a strong background in BI and Data Engineering, excellent problem-solving skills, and the ability to work independently and learn quickly.
Role Overview
You will join a dynamic team responsible for designing and implementing end-to-end data solutions on the Microsoft Fabric platform. This role involves:
Building and maintaining robust data processes.
Driving adoption of new technology within the organization.
Ensuring scalability, performance, and reliability of data solutions.

Responsibilities:
Collaborate with leaders, stakeholders, and product managers to understand data requirements and deliver effective BI solutions.
Design, develop and maintain robust data pipelines for efficient data ingestion, processing, and storage.
Optimize data storage and retrieval processes for optimal performance.
Monitor data pipelines and systems consistently to identify performance issues, ensuring timely maintenance and troubleshooting.
Create and maintain documentation of data processes and systems.

We are searching for an innovative and experienced Data Engineer that will join us and be part of our reference and alternative data team in our data group.
As a Data Engineer, you will:
Be a part of a cross functional team of data and backend engineers.
Be responsible for ingesting financial data and providing it over numerous APIs in close collaboration with algorithmic teams and other partners.
Lead the architecture, planning, design and development of mission-critical and diverse data pipelines over both public and on-prem cloud solutions.

Experienced Data Engineer? Excellent team player?
Come join a great team to overcome meaningful cyber challenges!
Our Data Solutions Group is looking for an exceptional Python developer with Data Engineering experience.

Design, build, and maintain scalable ETL/ELT pipelines to integrate data from diverse sources, optimizing for performance and cost efficiency.
Leverage Databricks and other modern data platforms to manage, transform, and process data
Collaborate with software teams to understand data needs and ensure data solutions meet business requirements.
Optimize data processing workflows for performance and scalability.

As a Mobile App Software Developer, you will join our team at the forefront of creating a cutting-edge solution that connects the physical world with the digital one. Your work will directly impact our ability to scale and grow, developing new mobile capabilities and driving innovation. You will tackle interdisciplinary challenges alongside a dedicated team, leveraging sharp problem-solving skills to bring these advanced solutions to production.

You will be responsible for developing world class multi-drone mission software running on mobile devices, flying drones autonomously and connects them with the cloud
You will work end-to-end, writing code for both the mobile app and the server side
Collaborate with an interdisciplinary team for the development of cutting edge software features from inception to release
Work in an Agile team, manage tasks and complete them through TDD, continuous integration as well as modern development processes
Make an impact on the innovation that vHive brings to drone field operations