דרושים » ניהול ביניים » Senior Data Engineer

משרות על המפה
 
בדיקת קורות חיים
אבחון און ליין
VIP
הפוך ללקוח VIP
רגע, משהו חסר!
נשאר לך להשלים רק עוד פרט אחד:
 
שירות זה פתוח ללקוחות VIP בלבד
AllJObs VIP
סגור
דיווח על תוכן לא הולם או מפלה
מה השם שלך?
תיאור
שליחה
סגור
v נשלח
תודה על שיתוף הפעולה
מודים לך שלקחת חלק בשיפור התוכן שלנו :)
 
נאספה מאתר אינטרנט
13/05/2024
חברה חסויה
Location: Tel Aviv-Yafo
Job Type: Full Time
We are looking for a Senior Data Engineer.
In your role as a Data Engineer, you'll be actively engaged in the most fascinating and demanding projects for our clients. Handling high-scale operations, heavy traffic, stringent SLAs, and massive data volumes is just the starting point. Our leadership in the realms of Big Data, Streaming Data, and Complex Event Processing (CEP) stems from our adept use of cutting-edge, optimal technologies.
Responsibilities:
Apply software-engineering methods and best practices (Medallion Architecture) in Data Lake management.
Develop Data pipelines to provide ingest and transformation of data.
Manage and enhance orchestrated pipelines across company
Data Modeling: Developing data models to ensure efficient storage, retrieval, and processing of data, often involving schema design for NoSQL databases, data lakes, and data warehouses.
Scalability: Ensuring that the big data architecture can scale horizontally to handle large volumes of data and high traffic loads.
Data Security: Implementing security measures to protect sensitive data, including encryption, access controls, and data masking.
Data Governance: Establishing data governance policies to ensure data quality, compliance with regulations, and data lineage.
Requirements:
5 years of experience in Python (+Java / Scala)
Experience in NoSQL and data storage (e.g. Elasticm, Redis, MongoDB, CouchBase, BigQuery, Snowflake, Databricks)
Experience in data formats (Parquet, Avro, ORC)
Experience in Big Data Technologies (Spark, MapReduce )
Experience in streaming (Spark Streaming, Flink, Kafka Streams, Beam, etc.)
Experience in messaging (Kafka, RabbitMQ, etc.)
Experience with Machine Learning (Spark ML, TensorFlow, etc.) - Plus
Experience in cloud platforms (AWS, GCP)
This position is open to all candidates.
 
Hide
הגשת מועמדותהגש מועמדות
עדכון קורות החיים לפני שליחה
עדכון קורות החיים לפני שליחה
7719953
סגור
שירות זה פתוח ללקוחות VIP בלבד
משרות דומות שיכולות לעניין אותך
סגור
דיווח על תוכן לא הולם או מפלה
מה השם שלך?
תיאור
שליחה
סגור
v נשלח
תודה על שיתוף הפעולה
מודים לך שלקחת חלק בשיפור התוכן שלנו :)
 
נאספה מאתר אינטרנט
09/06/2024
Location: Tel Aviv-Yafo
Job Type: Full Time and Hybrid work
We are looking for an experienced Senior Data Engineer to join our 'Data & AI' group. As a key member of our team, you will play a crucial role in designing and building data models, developing infrastructure, and optimizing data processes to support our data analysis, data science and engineering teams. You will collaborate with various stakeholders to ensure efficient data ingestion, processing, and analysis, contributing to the overall success of our data-driven initiatives.
Key Responsibilities:
Design and build robust data models and infrastructure to support data science and engineering teams.
Develop and optimize data processes, including ETL/ELT pipelines, for efficient data ingestion and processing.
Identify and understand business processes to derive actionable insights from the data.
Collaborate with BI analysts to create comprehensive reports and dashboards.
Implement and maintain scalable data solutions in a high-volume production environment.
Utilize modern technologies such as M3DB, Open-Search, Grafana, etc., for data processing and analysis.
Lead design initiatives for new products and contribute to best practices.
Work closely with cloud providers like AWS for data storage, computation, and orchestration.
Stay updated with advancements in data engineering, big data, and cloud technologies.
Requirements:
Bachelor's degree in computer science, engineering, or a related field.
5+ years of hands-on experience in data engineering and BI development.
Proficiency in SQL and Python for data manipulation and pipeline development.
Experience with complex ETL/ELT processes and big data technologies
Experience with Airflow.
Strong analytical skills and attention to detail
Excellent communication and collaboration abilities.
Preferred Qualifications:
Experience with machine learning algorithms and AI implementation.
Previous work with distributed systems, real-time analytics, and data visualization tools.
Familiarity with the AWS cloud platform and big data technologies.
Experience with Spark, Kafka, Elasticsearch, DynamoDB, and K8s.
This position is open to all candidates.
 
Show more...
הגשת מועמדותהגש מועמדות
עדכון קורות החיים לפני שליחה
עדכון קורות החיים לפני שליחה
7752621
סגור
שירות זה פתוח ללקוחות VIP בלבד
סגור
דיווח על תוכן לא הולם או מפלה
מה השם שלך?
תיאור
שליחה
סגור
v נשלח
תודה על שיתוף הפעולה
מודים לך שלקחת חלק בשיפור התוכן שלנו :)
 
נאספה מאתר אינטרנט
7 ימים
חברה חסויה
Location: Tel Aviv-Yafo
Job Type: Full Time
We are seeking a Big Data Engineer to join our team.
In this role, you will play a crucial role in designing, building, and maintaining our query engine. You will play a crucial role in managing large volumes of data, optimizing data pipelines, optimizing data query, developing complex analytics capabilities on top of the data, and ensuring the reliability and scalability of our data infrastructure.
Responsibilities:
Develop our ETL and query engines using Java / Spring Boot / Scala / Zio
Deliver high quality features for our high-scale web environment
Participate in design from scratch to production
Monitor the performance and cost of the services in production
Stay up-to-date with industry trends and best practices to continuously improve our technology stack and development processes
Integrate with other team members (backend/frontend/product/UX).
Requirements:
5+ years of proven backend development experience using Scala, Java, and Spring Boot
5+ years of experience working in a microservices environment, including AWS, Kubernetes, RabbitMQ, SQS, Terraform, Helm, and Tilt
High proficiency in various data stores such as MongoDB, Elasticsearch, PostgreSQL, Snowflake, and Redshift
An enthusiastic self-learner who can confidently embrace new technologies, conduct research to discover innovative solutions, and successfully deliver results
Demonstrated excellent problem-solving skills and meticulous attention to detail.
Strong communication and collaboration skills
Ability to adapt quickly and effectively manage context switches.
This position is open to all candidates.
 
Show more...
הגשת מועמדותהגש מועמדות
עדכון קורות החיים לפני שליחה
עדכון קורות החיים לפני שליחה
7757074
סגור
שירות זה פתוח ללקוחות VIP בלבד
סגור
דיווח על תוכן לא הולם או מפלה
מה השם שלך?
תיאור
שליחה
סגור
v נשלח
תודה על שיתוף הפעולה
מודים לך שלקחת חלק בשיפור התוכן שלנו :)
 
נאספה מאתר אינטרנט
20/05/2024
חברה חסויה
Location: Tel Aviv-Yafo
Job Type: Full Time
Were looking for brilliant data engineers to join our rapidly growing team.
You will join a team consisting of senior software and data engineers that drive our data platform from data acquisition, to processing and enrichment and all the way to business insights.
You will join an early stage team and company and will have a major impact on the decisions and architecture of our various products.
Responsibilities:
Design and build data acquisition pipelines that acquire, clean, and structure large datasets to form the basis of our data platform and IP
Design and build data pipelines integrating many different data sources and forms
Define architecture, evaluate tools and open source projects to use within our environment
Develop and maintain features in production to serve our customers
Collaborate with product managers, data scientists, data analysts and full-stack engineers to deliver our product to top tier retail customers
Take a leading part in the development of our enterprise-grade technology platform and ecosystem
Harmonize and clean large datasets from different sources.
Requirements:
At least 6 years of experience in software engineering in Python or an equivalent language
At least 3 years of experience with data engineering products from early-stage concept to production rollouts
Experience with cloud platforms (GCP, AWS, Azure), working on production payloads at large scale and complexity
Hands-on experience with data pipeline building and tools (Luigi, Airflow etc), specifically on cloud infrastructure
Advantage: Hands-on experience with relevant data analysis tools (Jupyter notebooks, Anaconda etc)
Advantage: Hands-on experience with data science tools, packages, and frameworks
Advantage: Hands-on experience with ETL Flows
Advantage: Hands-on experience with Docker / Kubernetes.
This position is open to all candidates.
 
Show more...
הגשת מועמדותהגש מועמדות
עדכון קורות החיים לפני שליחה
עדכון קורות החיים לפני שליחה
7728201
סגור
שירות זה פתוח ללקוחות VIP בלבד
סגור
דיווח על תוכן לא הולם או מפלה
מה השם שלך?
תיאור
שליחה
סגור
v נשלח
תודה על שיתוף הפעולה
מודים לך שלקחת חלק בשיפור התוכן שלנו :)
 
נאספה מאתר אינטרנט
09/06/2024
Location: Tel Aviv-Yafo
Job Type: Full Time
We are looking for a Senior Java Software Engineer to become an integral member of our EP GW Core team. we are actively seeking passionate and motivated Senior Java Software Engineer to become an integral member of our EP GW Core team. This dynamic team plays a pivotal role in developing and sustaining multi-tenant platform, responsible for efficiently streaming data from millions of agents to our backend detection servers.

In This Position You Will

Join an esteemed autonomous, cross-functional agile team where you will assume complete responsibility for features and/or services through the entire lifecycle from design to deployment.
Leverage cloud-native technologies within a GCP environment to deliver resilient and scalable solutions.
Specialize in designing, developing, and deploying Java services with a strong emphasis on high availability, low latency, and scalability.
Establish and sustain a cost-effective infrastructure capable of real-time processing for millions of events per second.
Engage in close collaboration with fellow engineers, product owners, and designers to tackle complex challenges in the field of cybersecurity.
Thrive in an environment that actively supports your individual growth.
Requirements:
Minimum of 6 years of Java coding experience (mandatory)
Collaborative team player with a strong sense of accountability, dedication, and passion
Proficient in working within a cloud environment
Hands-on experience with SpringBoot
Proven expertise in designing and implementing microservices using the Spring framework
Demonstrated experience in crafting distributed, scalable, and multithreading systems (mandatory)
In-depth knowledge of system design, data structures and algorithms
Experience in constructing deployment pipelines using Jenkins and Kubernetes
Familiarity with queues and messaging systems such as PubSub, SQS, Kafka, etc.
Proficiency in both relational databases (e.g., MySQL, Postgres) and NoSQL databases (e.g., MongoDB, AeroSpike)
Possession of a B.Sc. in Computer Science/Engineering or equivalent knowledge
This position is open to all candidates.
 
Show more...
הגשת מועמדותהגש מועמדות
עדכון קורות החיים לפני שליחה
עדכון קורות החיים לפני שליחה
7752529
סגור
שירות זה פתוח ללקוחות VIP בלבד
סגור
דיווח על תוכן לא הולם או מפלה
מה השם שלך?
תיאור
שליחה
סגור
v נשלח
תודה על שיתוף הפעולה
מודים לך שלקחת חלק בשיפור התוכן שלנו :)
 
נאספה מאתר אינטרנט
09/06/2024
חברה חסויה
Location: Tel Aviv-Yafo
Job Type: Full Time
Were seeking a Data Specialist with strong analytics skills to join our Tel Aviv-based team and help shape our Large Language Model (LLM) capabilities. In this unique role, you'll own and architect the data tagging landscape . You'll go beyond performing tagging tasks to design and implement the processes and systems that will govern future data labeling efforts. You will leverage your expertise alongside Prompt Engineers and Product Managers. As you grow, you'll build and lead a team of part-time Data Taggers, ensuring consistency and quality in tagging processes.

Sound like your perfect fit? We want to hear from you!

As a Data Specialist, you will be responsible for owning data tagging foundation and ensuring top-quality data through hands-on tagging, system design, and collaboration. In this role, you will:

Perform hands-on data tagging to ensure accuracy and completeness, develop and implement tagging standards and guidelines, and work across various data sources to maintain consistent and high-quality tagging.
Design and establish foundational processes for data tagging, monitoring, and evaluation, develop a comprehensive tagging framework and best practices. Implement systems for continuous monitoring of data quality and tagging accuracy, create and maintain documentation, evaluate and improve tagging processes, and generate regular reports on tagging performance and metrics.
Inspire and lead a dynamic team of data tagging professionals, empowering their performance, and driving a culture of excellence amidst a fast-paced, ever-evolving environment.
Work closely with other departments to understand their data needs and ensure tagging processes align with goals. Communicate regularly with stakeholders on tagging initiatives and performance, and act as the primary point of contact for tagging-related issues and all monitoring and evaluation tasks, ensuring remains top in class.
Requirements:
Bachelors Degree in a technical field
1+ years of experience as an analyst/ in an analyst position
Deep interest and foundational knowledge in Large Language Models (LLMs)
Excellent written communication and problem-solving skills
Ability to learn quickly and maintain attention to detail
Fluent in English, including both written and verbal communication
Ability to work from our Tel Aviv office
Authorization to work in Israel
This position is open to all candidates.
 
Show more...
הגשת מועמדותהגש מועמדות
עדכון קורות החיים לפני שליחה
עדכון קורות החיים לפני שליחה
7751936
סגור
שירות זה פתוח ללקוחות VIP בלבד
סגור
דיווח על תוכן לא הולם או מפלה
מה השם שלך?
תיאור
שליחה
סגור
v נשלח
תודה על שיתוף הפעולה
מודים לך שלקחת חלק בשיפור התוכן שלנו :)
 
נאספה מאתר אינטרנט
13/05/2024
חברה חסויה
Location: Tel Aviv-Yafo
Job Type: Full Time
Joining us means entering a career journey for seniors, building your tailored development roadmap. Here, you are the one to choose the technologies you want to practice, and steer your tech career to becoming a Backend Tech Lead.
While seniority doesn't signify the end of learning, it can often be difficult to find the time and hands-on experience to focus on your professional development.
you can choose what you want and need to learn, have a mentor to take you there, and the hands-on practice to "walk the talk".
Responsibilities:
Architect, design, and develop highly scalable and performant backend systems
Advanced algorithms, data structures, and distributed computing techniques
Develop and implement robust APIs
Leveraging industry best practices and standards, while ensuring flexibility, extensibility, and maintainability.
Implement data persistence solutions using both SQL and NoSQL databases,data modeling, query optimization, and indexing strategies.
Cloud-based infrastructures
Requirements:
5+ years of experience in Backend engineering
Proficient with Python (+Java / Scala / Rust / Go / NodeJS )
Experience in Distributed Techniques (Microservices, Reactive Programming, Distributed Processing, Messaging)
Experience in Cloud Services (AWS, OpenStack, GCP or Azure)
Experience in one of NoSQL Technologies (e.g. MongoDB, ElasticSearch, Druid, Redis)
Independent & Autodidact you know when to take action and when to raise flags
Passionate about technology and doing things the right way
This position is open to all candidates.
 
Show more...
הגשת מועמדותהגש מועמדות
עדכון קורות החיים לפני שליחה
עדכון קורות החיים לפני שליחה
7719970
סגור
שירות זה פתוח ללקוחות VIP בלבד
סגור
דיווח על תוכן לא הולם או מפלה
מה השם שלך?
תיאור
שליחה
סגור
v נשלח
תודה על שיתוף הפעולה
מודים לך שלקחת חלק בשיפור התוכן שלנו :)
 
נאספה מאתר אינטרנט
לפני 15 שעות
Location: Tel Aviv-Yafo
Job Type: Full Time
As a Senior Java Developer, you will research, design, and implement cloud security products using the most up-to-date and cutting-edge technologies and frameworks, across all cloud providers (AWS, GCP, Azure, etc). You will build and be responsible for high-performance, massively scalable, always-available cloud-based systems.
Your Impact :
Drive innovation by addressing client needs with impactful solutions, contributing significantly to feature development from design to deployment
Acquire experience by taking ownership of specific feature segments, showcasing responsibility and dedication to maintaining high quality
Engage in cross-functional collaboration to ensure smooth integration of product features and infrastructure
Generate ideas and actively participate in brainstorming sessions to foster innovation within the product
Engage actively in discussions, exchange knowledge, and leverage expertise from other teams
Requirements:
At least 5 years of experience in Java / Kotlin using Spring Boot
Experience with design and architecting large and scalable cloud-based applications
Experience working with Relational and No-SQL databases (e.g. MySQL, PostgreSQL, MongoDB, etc) and ORMs (e.g JPA and Hibernate)
Experience working in an agile and dynamic environment
Outstanding drive and communication skills
Nice to have:
Experience working with Python, Go, and Node.js
BSc in Computer Science and/or elite software army unit graduate
Experience with Microservices architecture (Kubernetes, GKE, EKS, AKS, Docker, Serverless, etc)
Familiarity with CI/CD pipelines and cloud infra
Have the ability to make stuff work" on top of writing high-quality code
Experience with big-data architectures (using Kafka, Splunk, Flink, etc)
Familiarity with Cyber Technologies, Information Security, and Software Security
This position is open to all candidates.
 
Show more...
הגשת מועמדותהגש מועמדות
עדכון קורות החיים לפני שליחה
עדכון קורות החיים לפני שליחה
7766430
סגור
שירות זה פתוח ללקוחות VIP בלבד
סגור
דיווח על תוכן לא הולם או מפלה
מה השם שלך?
תיאור
שליחה
סגור
v נשלח
תודה על שיתוף הפעולה
מודים לך שלקחת חלק בשיפור התוכן שלנו :)
 
נאספה מאתר אינטרנט
4 ימים
חברה חסויה
Location: Tel Aviv-Yafo
Job Type: Full Time and Hybrid work
We are looking for an experienced Python Backend Developer with a passion for startups and a genuine interest in cyber to join our dynamic Research Group.
The ideal candidate will have a strong background in software development, a passion for problem-solving, and the ability to work independently to develop and implement robust solutions.
What you'll do:
Design & Develop our products using Python.
Maintain, and optimize our Infra Python package.
Design and implement efficient data models for Spark datalake.
Collaborate with cross-functional teams to define, design, and ship new features.
Lead the Python development and best practices.
Some More Details and Perks:
Location: Tel Aviv, IL
Hybrid work Environment
Competitive compensation package with stock options
Top of the line equipment
Requirements:
Who you are:
You have a Bachelor's degree in Computer Science or equivalent experience.
You possess 5+ years of software development experience.
Proficient in Python.
Experienced with relational and schema-less databases and efficient data modeling.
A strong problem-solver with exceptional analytical skills.
Knowledgeable in software engineering best practices, including unit testing, code reviews and design documentation.
It would also be nice if you had:
Experience with cloud providers such as AWS, GCP, or Azure.
Familiarity with big data tools and libraries such as Spark or Pandas.
Previous experience in the cybersecurity realm.
This position is open to all candidates.
 
Show more...
הגשת מועמדותהגש מועמדות
עדכון קורות החיים לפני שליחה
עדכון קורות החיים לפני שליחה
7759520
סגור
שירות זה פתוח ללקוחות VIP בלבד
סגור
דיווח על תוכן לא הולם או מפלה
מה השם שלך?
תיאור
שליחה
סגור
v נשלח
תודה על שיתוף הפעולה
מודים לך שלקחת חלק בשיפור התוכן שלנו :)
 
נאספה מאתר אינטרנט
13/05/2024
Location: Tel Aviv-Yafo
Job Type: Full Time
We are looking for a Machine Learning Engineer to join our team as a Technical Lead. The Technical Lead will be integral to the data science feature development process, working with data engineering.
You will design machine learning pipelines, apply algorithms to generate predictions, tackle data set challenges, and develop the first-ever, real-time corporate credit score platform.
This isn't just another job; you'll be a key part of an exciting, experienced team in a fast-paced environment. This position does not involve managerial duties but rather entails leading technically.
You will:
Architect and engineer prompts for various AI models, including LLMs, to generate accurate and actionable outputs for security automation tasks.
Build forecasting/prediction models from scratch (POC) to production-ready
Work closely in aligning the product, research, and development teams in crafting the product, increasing product effectiveness
Collaborative mindset to improve the AI team, communicate with stakeholders, and shape research vision.
Take a critical role in the research process for finding the best market solutions for defined business problems
Guide the R&D team and product teams
Requirements:
5+ years of hands-on experience in engineering with Python
Strong analytical and problem-solving skills to navigate the complexities of AI and LLM integration - A must.
Degree in Computer Science, Physics, Mathematics, or equivalent experience
Profound analytical skills and true love for data
PhD/MSc in exact sciences - an advantage
This position is open to all candidates.
 
Show more...
הגשת מועמדותהגש מועמדות
עדכון קורות החיים לפני שליחה
עדכון קורות החיים לפני שליחה
7719914
סגור
שירות זה פתוח ללקוחות VIP בלבד
סגור
דיווח על תוכן לא הולם או מפלה
מה השם שלך?
תיאור
שליחה
סגור
v נשלח
תודה על שיתוף הפעולה
מודים לך שלקחת חלק בשיפור התוכן שלנו :)
 
נאספה מאתר אינטרנט
20/05/2024
חברה חסויה
Location: Tel Aviv-Yafo
Job Type: Full Time
We are looking for a Senior BackEnd Engineer to join our in-house research infrastructure team and play a pivotal role in contributing to the companys ongoing success, Come join us.
What you will do Its all about the data:
The teams mission is to build the ultimate platform for quantitative finance research. Our pipelines process huge amounts of data from various sources, and you will provide the tools to extract, translate and compute it to gain insights and optimize workflows across all products.
Your Impact:
Conceiving innovative and novel ideas in various areas ranging from API management to high throughput computing on dedicated clusters.
Working with quantitative researchers to deliver high-quality features for machine learning models.
End-to-end ownership POC, design, development cycles, deployment, and scaling.
Creative thinking using state-of-the-art tech stack.
Requirements:
BSc in Computer Science or equivalent software engineering fundamentals (Autodidact, Military experience)
Can-do mentality, intellectual curiosity, self-motivation, and ability to communicate within and across teams.
At least 5 years of industry experience.
Strong programming skills in Python, C# and JS
Experience working with CI/CD pipelines and servers (preference for GitLab)
Experience with Large-scale databases
Preferred Qualifications:
A passion for capital markets.
Prior experience in quantitative finance.
This position is open to all candidates.
 
Show more...
הגשת מועמדותהגש מועמדות
עדכון קורות החיים לפני שליחה
עדכון קורות החיים לפני שליחה
7727427
סגור
שירות זה פתוח ללקוחות VIP בלבד