לוח משרות דרושים איש ביג דאטה Big Data במרכז

Requirements:
MUST HAVE Requirements: 5+ years of hands-on experience as a Big Data Engineer
* Proven ability to design and deploy Big Data & AI solutions using frameworks and tools such as:
* Apache NiFi
* Kafka
* Spark
* Graph DB
* NoSQL databases Strong coding proficiency in Python and Bash
* Experience building large-scale data pipelines for data processing, transformation, and analytics
* Ability to define and manage metadata schemas
* Experience developing data workflows (e.g., metadata generation, auto-extraction, validation, format conversion)
* Experience developing tools for data observability and compliance analytics
* Ability to analyze and report on complex datasets and results
* Experience working with big data lakehouse architectures
* Ability to explore, enhance, and manage data fusion from multiple data sources
* Experience developing analytics tools, algorithms, and programs
* Technical leadership of data structure design for contextual pipelines
* Collaboration experience with Data Scientists and Architects
* Strong ability to work independently, learn new technologies, and apply innovative solutions
* Excellent interpersonal skills and ability to work as part of a team MSc in Computer Science or Data Science Advantages:
* Experience with managing metadata and taxonomy concepts alongside big data objects
* Experience working with public cloud Big Data & AI services
* Familiarity with machine learning concepts
* Strong technical skills
* Independent, hands-on developer
* Curious, open-minded, fast learner, and a strong team player

Requirements:
5+ years experience as a Data Engineer.
Good working knowledge of Google Cloud Platform (GCP).
Experience using AI-assisted tools or automation to improve data development, monitoring, or debugging workflows.
Strong experience in SQL and Python.
Experience with high volume ETL/ELTs tools and methodologies - both batch and real-time processing.
Understanding of how to build robust and reliable solutions.
The ability to understand the business impact of the data engineering tasks.
Hands-on experience in writing complex queries and optimizing them for performance.
Able to understand complex data and data flows.
Have a strong analytical mind with proven problem-solving abilities.
Ability to manage multiple tasks and drive them to completion.
Independent and proactive.