דרושים » דאטה » Data Engineer

We are seeking an experienced Data Engineer with a strong background in BI and Data Engineering, excellent problem-solving skills, and the ability to work independently and learn quickly.
Role Overview
You will join a dynamic team responsible for designing and implementing end-to-end data solutions on the Microsoft Fabric platform. This role involves:
Building and maintaining robust data processes.
Driving adoption of new technology within the organization.
Ensuring scalability, performance, and reliability of data solutions.
Responsibilities:
Collaborate with leaders, stakeholders, and product managers to understand data requirements and deliver effective BI solutions.
Design, develop and maintain robust data pipelines for efficient data ingestion, processing, and storage.
Optimize data storage and retrieval processes for optimal performance.
Monitor data pipelines and systems consistently to identify performance issues, ensuring timely maintenance and troubleshooting.
Create and maintain documentation of data processes and systems.

We are seeking a seasoned and strategic Head of BI to lead our Business Intelligence group.
In this pivotal role, you will be responsible for overseeing the full BI stackfrom data infrastructure and pipelines to analytics and reportingwhile managing a team of data engineers and analysts.
You will drive the design and execution of our data strategy, ensure delivery of trusted insights across the organization, and lead the team responsible for building and maintaining our data platform and analytics capabilities. This is a hands-on leadership role requiring a balance of technical depth, managerial experience, and strategic thinking.Responsibilities
What Youll Be Doing:
Lead, mentor, and scale a cross-functional team of BI Analysts and Data Engineers.
Own and evolve our data warehouse architecture, ensuring integrity, scalability, and performance (Snowflake preferred).
Oversee the design and development of ETL/ELT pipelines and semantic data models using tools such as dbt, Python, and Airflow.
Collaborate with senior stakeholders to align business goals with data priorities, translating requirements into scalable solutions.
Define and implement best practices across the entire BI lifecycle: data ingestion, transformation, modeling, visualization, and governance.
Deliver robust, actionable dashboards and insights that drive key business decisions and KPIs.

We are looking for a talented and experienced big data engineer to join our cyber defence group to take over a cutting-edge data solution.

The successful candidate should have hands-on experience with big data processing technologies and architectures.

The candidate will join our growing team of analysts, developers, data scientists, and architects who design and develop innovative solutions to the most critical needs of our customers.

Responsibilities:
Designing, architecting, implementing, and supporting our data pipelines and processing flows.
Collaborate with analytics department to analyze and understand data sources.+
Provide insights and guidance on database technology and data modelling best practices.
Insure the maintenance of data integrity, managing data and analysis flows with attention to detail and high responsibility.
Implementing algorithms with our data scientists.

We are now looking for a Data Engineer to join our team and play a key role in building and optimizing large-scale Big Data systems in production environments.

Key Responsibilities:
Design, implement, and maintain Big Data pipelines in production.
Work extensively with Apache Spark (2.x and above), focusing on complex joins, shuffle optimization, and performance improvements at scale.
Integrate Spark with relational databases, NoSQL systems, cloud storage, and streaming platforms.
Contribute to system architecture and ensure scalability, reliability, and efficiency in data processing workflows.

Required Senior Data Engineer
Description
Join our core platform engineering team, developing our AI-powered automotive data management platform.
We are developing the next generation data-driven products for the Automotive industry, focusing on cybersecurity (XDR) and vehicle quality. our products monitor and secure millions of vehicles worldwide and help automakers leverage connected vehicle data to deliver cyber resilience, safety, customer satisfaction and increase brand loyalty.
Our Data Engineering & Data Science Group leads the development of our Iceberg-based data platform, including data lake, query engine, and ML-Ops tools, serving as a solid AI-ready foundation for all our products.
At the core of our Engineering Team, you will build and operate scalable, production-grade customer-facing data and ML platform components, focusing on reliability and performance.
Technological background and focus: Iceberg, Trino, Prefect, GitHub Actions, Kubernetes, JupyterHub, MLflow, dbt
This role is full-time and is Herzliya, Israel based.
Responsibilities
Design, build, and maintain scalable data pipelines to ingest and transform batch data on our data lake, enabling analytics and ML with strong data quality, governance, observability, and CI/CD.
Build and expand our foundational data infrastructure, including our data lake, analytics engine, and batch processing frameworks.
Create robust infrastructure to enable automated pipelines that will ingest and process data into our analytical platforms, leveraging open-source, cloud-agnostic frameworks and toolsets.
Develop and maintain our data lake layouts and architectures for efficient data access and advanced analytics.
Build our ML platform and automate the ML lifecycle.
Drive business-wide ML projects from an engineering perspective.
Develop and manage orchestration tools, governance tools, data discovery tools, and more.
Work with other team members of the engineering group, including data architects, data analysts, and data scientists, to provide solutions using a use case-based approach that drives the construction of technical data flows.

As part of the Audiences team, youll work on highly scalable systems, tackle real-time challenges, and contribute to a platform that directly impacts the success of our customers campaigns.

Our team mixes disciplines from back-end, data, AI and front-end engineers and were looking for a great back-end data oriented developer that is passionate about what they do, who want to dive into the worlds of big data, microservices and production management at our scale, to help us reach our vision and goals.

What youll do:
Solve diverse, complex problems at a large scale.
Collaborate with Product Managers, data scientists and Software Engineers to deliver innovative, user-facing products.
Independent - cradle to grave, own a feature from scratch to production.
Analyze and improve performance, scalability and stability of our products, environments and tools.
Continuously learn and evaluate new technologies in the everlasting effort to perfect our products and adapt to the ever-growing scale.

At Infinidat, we help enterprises and service providers empower their data-driven competitive advantage at scale. We are a leading provider of enterprise-class storage solutions. The company’s software-focused architecture delivers sub-millisecond latency, full availability, and scalability with a significantly lower total cost of ownership than competing storage technologies. We are looking for a Python Developer to join our growing Hardware Infra team , part of the RnD group You will play a crucial role in architecting and developing the core of the infrastructure and tools that power our innovative solutions and ensure all our products are tested, shipped, and maintained with the highest quality standards. If you are innovative and passionate and looking for creative ways to improve product testing architecture and infrastructure - come and join us!

Responsibilities:

* Enhance and maintain appliance tools that monitor our products in a customer environment.
* Design and develop robust and scalable testing infrastructure and complex test scenarios ensuring high-performance and reliable products.
* Full ownership over the design and implementation of constantly improving web applications, API backends, and appliance tools.
* Collaborate with cross-functional teams including DevOps, Software Engineering, Hardware, and Validation to design and implement efficient, reusable, and reliable applications.
* Investigate and solve hard-to-find problems such as race conditions, hardware failures, delicate timing issues, and problems happening only at large scale.

At Infinidat, we help enterprises and service providers empower their data-driven competitive advantage at scale. We are a leading provider of enterprise-class storage solutions. The company’s software-focused architecture delivers sub-millisecond latency, 100% availability, and scalability with a significantly lower total cost of ownership than competing storage technologies. We’re looking for passionate and bright individuals who wish to take part in the design, development, and all technical aspects of INFINIDAT’s Big Data team. The selected candidate will be part of a professional team that develops various applications - from massive infrastructure, through complicated distributed systems, to plug-ins for 3rd-party enterprise applications. Most development is in Python and some other languages as well, while using a wide range of operating systems, technologies, and architectures. Our big data solutions are cloud-based with secure access allowing predictive analytics (trends, anomaly detection, planning, etc.), early issues detection while analyzing a massive stream of events, and much more. You can be part of it!



Responsibilities:

* Design and develop using Python in a Big Data environment.
* Integrate solutions with existing systems and technologies.
* Troubleshoot and debug existing solutions.
* Write and maintain documentation for solutions.
* Participate in code reviews, providing feedback and suggestions for improvement.

As part of the Audiences team, youll work on highly scalable systems, tackle real-time challenges, and contribute to a platform that directly impacts the success of our customers campaigns.

Our team mixes disciplines from back-end, data, AI and front-end engineers and were looking for a great back-end data oriented developer that is passionate about what they do, who want to dive into the worlds of big data, microservices and production management at our scale, to help us reach our vision and goals

What youll do:
Solve diverse, complex problems at a large scale.
Collaborate with Product Managers, data scientists and Software Engineers to deliver innovative, user-facing products.
Independent - cradle to grave, own a feature from scratch to production.
Analyze and improve performance, scalability and stability of our products, environments and tools.
Continuously learn and evaluate new technologies in the everlasting effort to perfect our products and adapt to the ever-growing scale.

Our Data Solutions Group is looking for an exceptional Python developer with Data Engineering experience.