לוח משרות דרושים איש ביג דאטה Big Data

Requirements:
Has 5+ years of experience in developing code for big data infrastructure. Proficiency in technologies such as: Databricks, Spark, Airflow, Firehose, SQS, or other similar tools.
Proven experience working with high scale on AWS or any other cloud provider. Experience in architecture and design of large-scale and high performance production systems.
Comfortable taking challenges and learning new technologies.
Excellent communication skills with the ability to provide constant dialog between teams.
Ability to take business requirements and translate them to technical alternatives by performing risk management and evaluating tradeoffs.

Requirements:
Passionate about data.
Holds a BSc degree in Computer Science\Engineering or a related technical field of study.
Has at least 5 years of software or data engineering development experience in one or more of the following programming languages: Python, Java, or Scala.
Has strong programming skills and knowledge of Data Structures, Design Patterns and Object Oriented Programming.
Has good understanding and experience of CI/CD practices and Git.
Excellent communication skills with the ability to provide constant dialog between and within data teams.
Can easily prioritize tasks and work independently and with others.
Conveys a strong sense of ownership over the products of the team.
Is comfortable working in a fast-paced dynamic environment.
Advantage:
Has experience with containerization technologies like Docker and Kubernetes.
Experience in designing and productization of complex big data pipelines.
Familiar with a cloud provider (AWS / Azure / GCP).

Requirements:
At least 2 years of work experience in a Tech Company - Must
At least 2 years experience in Python scripting - Must
Experience with SQL for data analysis -Must
Knowledge and understanding of the statistical principles, concepts, methods, and standards- Must
Hadoop/Spark/AWS Infrastructure experience - Big Advantage
Ability to visualize data and experience with a visualization tool and modules (mlplot, matplolib, sns)- Big Advantage
Excellent verbal and communication skills (in English) - Must
Team player, autodidact, fast learner with excellent analytical, research and business skills.

Requirements:
5 years of backend-focused engineering experience, with a proven track record of building and scaling complex systems.
Success across 2-3 fast-paced startup environments, demonstrating adaptability and impact.
Strong proficiency in Python for backend development.
Deep understanding of data systems, including SQL/NoSQL databases and data warehouses.
Hands-on experience with cloud platforms (AWS/GCP), Kubernetes, and CI/CD pipelines.
Curiosity and eagerness to learn; background in cybersecurity, blockchain, or data analysis is a strong plus.
Experience designing and building scalable data pipelines and real-time processing systems.
Skilled with- ETL/ELT tools (Apache Airflow/dbt/Dagster) and streaming platforms (Kafka/Kinesis/RabbitMQ/..).
Familiar with real-time analytics frameworks such as Flink, Spark Streaming, or similar.

Requirements:
MUST HAVE Requirements: 5+ years of hands-on experience as a Big Data Engineer
* Proven ability to design and deploy Big Data & AI solutions using frameworks and tools such as:
* Apache NiFi
* Kafka
* Spark
* Graph DB
* NoSQL databases Strong coding proficiency in Python and Bash
* Experience building large-scale data pipelines for data processing, transformation, and analytics
* Ability to define and manage metadata schemas
* Experience developing data workflows (e.g., metadata generation, auto-extraction, validation, format conversion)
* Experience developing tools for data observability and compliance analytics
* Ability to analyze and report on complex datasets and results
* Experience working with big data lakehouse architectures
* Ability to explore, enhance, and manage data fusion from multiple data sources
* Experience developing analytics tools, algorithms, and programs
* Technical leadership of data structure design for contextual pipelines
* Collaboration experience with Data Scientists and Architects
* Strong ability to work independently, learn new technologies, and apply innovative solutions
* Excellent interpersonal skills and ability to work as part of a team MSc in Computer Science or Data Science Advantages:
* Experience with managing metadata and taxonomy concepts alongside big data objects
* Experience working with public cloud Big Data & AI services
* Familiarity with machine learning concepts
* Strong technical skills
* Independent, hands-on developer
* Curious, open-minded, fast learner, and a strong team player