דרושים » דאטה » ארגון רפואי במרכז הארץ מגייס data Engineer

We are seeking a Senior Data Engineer to join our dynamic data team. In this role, you will design, build, and maintain robust data systems and infrastructure that support data collection, processing, and analysis. Your expertise will be crucial in developing scalable data pipelines, ensuring data quality, and collaborating with cross-functional teams to deliver actionable insights.

Key Responsibilities:

Design, develop, and maintain scalable ETL processes for data transformation and integration.
Build and manage data pipelines to support analytics and operational needs.
Ensure data accuracy, integrity, and consistency across various sources and systems.
Collaborate with data scientists and analysts to support AI model deployment and data-driven decision-making.
Optimize data storage solutions, including data lakehouses and databases, to enhance performance and scalability..
Monitor and troubleshoot data workflows to maintain system reliability.
Stay updated with emerging technologies and best practices in data engineering.

In this role, you will work closely with data scientists, analysts, and other cross-functional teams to understand their data needs and requirements. You will also be responsible for ensuring that data is easily accessible and can be used to support data-driven decision making.

Location: Ramat Gan, Hybrid Model

What will you do?

Design, build, and maintain data pipelines to extract, transform, and load data from various sources, including databases, APIs, and flat files
Enhance our data warehouse system to dynamically support multiple analytics use cases
Reimplement and productize scientific computational methods
Implement data governance policies and procedures to ensure data quality, security, and privacy
Collaborate with data scientists and other cross-functional teams to understand their data needs and requirements
Develop and maintain documentation for data pipelines, processes, and systems

We are looking for a hands-on data Architect to design, build, and optimize a cutting-edge data Lakehouse solution from the ground up. This role requires deep technical expertise in Big Data architectures, data modeling, ETL /ELT pipelines, cloud & on-prem solutions, and Real-Time analytics. As part of a fast-paced startup, youll be directly involved in coding, implementing, and scaling the platform not just designing, but building alongside the team. Youll take ownership of data strategies, governance, and architecture to enable high-performance analytics, AI, and business intelligence
Key Responsibilities Hands-On Architecture & Development: Build and deploy a scalable, open-source data Lakehouse integrating structured, semi-structured, and unstructured data.
* Design Real-Time and batch data processing pipelines using open-source frameworks (Apache Spark, Flink, Trino, Iceberg, Delta Lake, etc.).
* Develop cost-effective, high-performance data Storage strategies (columnar formats: Parquet, ORC).
* Implement best practices for data security, governance, access control, and compliance (GDPR, CCPA, etc.).
* Ensure seamless data integration across cloud and on-prem environments. data Engineering & ETL Pipelines:
* Develop high-performance ETL /ELT pipelines to ingest data from diverse sources (APIs, databases, IoT, logs).
* Optimize query performance using indexing, caching, materialized views, and distributed computing
* Implement metadata-driven, schema evolution-friendly data ingestion strategies.
* Ensure data quality, lineage, and observability across the entire pipeline. Collaboration & Execution: Work hands-on with data Engineers, BI Analysts, and ML Engineers to build an integrated platform.
* Define data cataloging and self-service analytics capabilities for internal users.
* Drive technical decision-making while balancing speed and scalability.
* Stay ahead of emerging trends in data architecture, ensuring best practices are implemented.