דרושים » דאטה » data Engineer

we are looking for a Big Data Engineer.
As a Senior Big Data Engineer, working within Mobility Group, you will play a pivotal role in designing, developing, and maintaining the data infrastructure that powers our location analytics platform.
RESPONSIBILITIES:
Data Pipeline Architecture and Development: Design, build, and optimize robust and scalable data pipelines to process, transform, and integrate large volumes of data from various sources into our analytics platform.
Data Quality Assurance: Implement data validation, cleansing, and enrichment techniques to ensure high-quality and consistent data across the platform.
Performance Optimization: Identify performance bottlenecks and optimize data processing and storage mechanisms to enhance overall system performance and reduce latency.
Cloud Infrastructure: Work extensively with cloud-based technologies (GCP and AWS), to design and manage scalable data infrastructure.
Collaboration: Collaborate with cross-functional teams including Data Analysts, Data Scientists, Product Managers, and Software Engineers to understand requirements and deliver solutions that meet business needs.
Data Governance: Implement and enforce data governance practices, ensuring compliance with relevant regulations and best practices related to data privacy and security.
Monitoring and Maintenance: Monitor the health and performance of data pipelines, troubleshoot issues, and ensure high availability of data infrastructure.
Mentorship: Provide technical guidance and mentorship to junior data engineers, fostering a culture of learning and growth within the team.

Required Senior Data Engineer
About the role:
You will specialize in designing and building world class, scalable data architectures, ensuring reliable data flow and integration for groundbreaking biotechnological research. Your expertise in big data tools and pipelines will accelerate our ability to derive actionable insights from complex datasets, driving innovations in improving patients outcome and in delivering life savings treatment solutions.
In this role, you will work closely with data scientists, AI/ML engineers, architect and other cross-functional teams to understand their data needs and requirements. You will also be responsible for ensuring that data is easily accessible and can be used to support data-driven decision making.
Location: Ramat Gan, (Hybrid model)
What will you do?
Design, build, and maintain data pipelines that ingest, transform, and load noisy, heterogeneous biological data at scale - from single-cell sequencing, genomic, and clinical sources - across databases, APIs, and flat files
Enhance our data warehouse system to dynamically support multiple analytics use cases
Implement and productize complex scientific and computational algorithms as scalable, production-grade pipeline components
Drive our data infrastructure toward becoming AI-native, enabling AI/ML systems and agents to reliably query, reason over, and act on our data
Implement data governance policies and procedures to ensure data quality, security, and privacy
Collaborate with ML and AI scientists and other cross-functional teams to understand their data needs and requirements
Drive team capability growth by championing an AI-first SDLC, mentoring data engineers on AI-assisted development practices and tooling
Develop and maintain documentation for data pipelines, processes, and systems
Requirements
We will only consider senior data engineers that have demonstrated strong system design skills combined with an extensive background working with data orchestration, data warehousing and ETL tools.