דרושים » תוכנה » Senior Data Engineer

משרות על המפה
 
בדיקת קורות חיים
אבחון און ליין
VIP
הפוך ללקוח VIP
רגע, משהו חסר!
נשאר לך להשלים רק עוד פרט אחד:
 
שירות זה פתוח ללקוחות VIP בלבד
AllJObs VIP
משרה זו סומנה ע"י המעסיק כלא אקטואלית יותר
מיקום המשרה: תל אביב יפו
סוג משרה: משרה מלאה
משרות דומות שיכולות לעניין אותך
סגור
דיווח על תוכן לא הולם או מפלה
מה השם שלך?
תיאור
שליחה
סגור
v נשלח
תודה על שיתוף הפעולה
מודים לך שלקחת חלק בשיפור התוכן שלנו :)
 
נאספה מאתר אינטרנט
01/05/2024
חברה חסויה
Location: Tel Aviv-Yafo
Job Type: Full Time
We are looking for a brilliant, quick-learner Data Engineer for our data engineering team - an independent logical thinker who understands the importance of data structuring for macro-business decisions.
The position combines high technical skills with business orientation, working closely with the analysts and the R&D team, and affecting the company's cross-departments decisions directly. Our Data Engineer should have the ability to speak in technical and practical terms, and more importantly, lead from one to the other, while dealing with challenges and creating them - to make our team even better than it is.
Roles and Responsibilities:
Creating and structuring end-to-end data pipelines & ETLs: from the source all the way to the analysts hands, enabling them the ideal conditions to make smart and data driven business decisions.
Cracking top industry data challenges while initiating and building creative technical solutions - in house Device Graph, Server-to-Server to multiple systems, Privacy challenges, Online-to-Offline and more.
Deep understanding of the business needs, technical requirements and the companys roadmap - and translating it into custom made data solutions and scalable products.
Craft code following best practices to ensure efficiency, while integrating CI/CD principles.
Writing multi-step scalable processes from more than 50 data sources - Marketing. Operations, CS, Product, CRM and more... tying them up to a valuable & useful source of insights for the analysts.
Understanding data challenges and weaknesses, and managing high standards monitoring and reliability processes.
Requirements:
B.A / B.Sc degree in a highly quantitative field - a must.
4-5 years hands on experience as a Data Engineer querying data warehouses (SQL), structuring data processes using quantitative techniques - a must.
Fast learner with high attention to details, and proven ability to multitask on several projects at a time. - a must.
Practical experience in Python and Infrastructure in data context. a must.
High analytical skills and the ability to deep dive into details. a must.
Google Cloud Data tools (BigQuery, Cloud Composer/Airflow) - a must.
AutoML, DataFlow, Neo4J - a plus.
Practical experience with distributed data processing like Spark - a plus.
Experienced in analyzing data, and gaining insights - a plus.
Experience working for a data driven company on a large scale - a plus.
This position is open to all candidates.
 
Show more...
הגשת מועמדותהגש מועמדות
עדכון קורות החיים לפני שליחה
עדכון קורות החיים לפני שליחה
7706607
סגור
שירות זה פתוח ללקוחות VIP בלבד
סגור
דיווח על תוכן לא הולם או מפלה
מה השם שלך?
תיאור
שליחה
סגור
v נשלח
תודה על שיתוף הפעולה
מודים לך שלקחת חלק בשיפור התוכן שלנו :)
 
נאספה מאתר אינטרנט
06/05/2024
חברה חסויה
Location: Tel Aviv-Yafo
Job Type: Full Time
We are looking for a Data Engineer.
Main responsibilities:
Provide the direction of our data architecture. Determine the right tools for the right jobs. We collaborate on the requirements and then you call the shots on what gets built.
Manage end-to-end execution of high-performance, large-scale data-driven projects, including design, implementation, and ongoing maintenance.
Monitor and optimize our (teams) cloud costs.
Design and construct monitoring tools to ensure the efficiency and reliability of data processes.
Requirements:
3+ Years of Experience in data engineering and big data. - Must
Experience in working with different databases (SQL, Snowflake, Impala, PostgreSQL)  Must
Experience in programming languages (Python, OOP Languages) Must
Experience with Data modeling, ETL development, data warehousing  Must
Experience with building both batch and streaming data pipelines using PySpark  Big Advantage
Experience in Messaging systems (Kafka, RabbitMQ etc) Big Advantage
Experience working with any of the major cloud providers: Azure, Google Cloud , AWS)  Big Advantage
Creating and Maintaining Microservices data processes - Big Advantage
Basic knowledge in DevOps concepts (Docker, Kubernetes, Terraform) Advantage
Experience in Design Patterns concepts Advantage
This position is open to all candidates.
 
Show more...
הגשת מועמדותהגש מועמדות
עדכון קורות החיים לפני שליחה
עדכון קורות החיים לפני שליחה
7711729
סגור
שירות זה פתוח ללקוחות VIP בלבד
סגור
דיווח על תוכן לא הולם או מפלה
מה השם שלך?
תיאור
שליחה
סגור
v נשלח
תודה על שיתוף הפעולה
מודים לך שלקחת חלק בשיפור התוכן שלנו :)
 
נאספה מאתר אינטרנט
06/05/2024
חברה חסויה
Location: Tel Aviv-Yafo
Job Type: Full Time and Hybrid work
We're looking for a Senior Big Data Developer to join our Data Engineering team in Tel Aviv.

You will be a part of our Data Management platform, that is responsible for processing, storing, and serving data for all our core systems.

As a Senior Big Data Developer, we will encourage you to take a proactive & autonomous approach in research & development while working collaboratively with the team. Our ideal candidate is a fast but thorough problem solver, and a fun person to work with!

What Youll Do:

End-to-end feature development and ownership, from design to production, with a strong emphasis on innovation and efficiency.
Take part in building & designing the next generation of company Identity solutions.
Implement high scale Big-Data solutions and contribute to our platform infrastructure and architecture.
Research core technologies and integrations with external APIs and services.
Working with various stakeholders: Product, Engineering, Data providers etc.
Lead and mentor other developers through complex projects that will affect our core business.
Requirements:
Bachelor's Degree in Computer Science/Computer Engineering or equivalent degrees.
6+ years of data engineering experience.
Experience in building and optimizing data pipelines, ETLs, and streaming systems using technologies like Hadoop, Spark, and Kafka.
3+ years of experience in Java or Scala.
Experience with SQL & NOSQL DBs.
Experience in dealing with performance and high scale systems.
Experience with Kubernetes - advantage.
Experience with Gitlab, Grafana, InfluxDb, Kibana advantage.
Team player, ego less, strong communication skills.
This position is open to all candidates.
 
Show more...
הגשת מועמדותהגש מועמדות
עדכון קורות החיים לפני שליחה
עדכון קורות החיים לפני שליחה
7711812
סגור
שירות זה פתוח ללקוחות VIP בלבד
סגור
דיווח על תוכן לא הולם או מפלה
מה השם שלך?
תיאור
שליחה
סגור
v נשלח
תודה על שיתוף הפעולה
מודים לך שלקחת חלק בשיפור התוכן שלנו :)
 
נאספה מאתר אינטרנט
06/05/2024
חברה חסויה
Location: Tel Aviv-Yafo
Job Type: Full Time and Hybrid work
We are looking for a Data Engineer Team Lead to join our Data Engineering team in Tel Aviv.

You will be leading one of our data platform teams, that is responsible for processing, storing, and serving data for all our core systems.

What Youll Do:

Lead and mentor a data lake team within our data organization.
Drive high-level projects with company-wide visibility.
Manage the team roadmap, team building, and SW project execution.
Collaborate with stakeholders, including developers, product managers, and business operations.
Take full ownership of end-to-end feature development, from design to production. Contribute to building and designing innovative big data solutions.
Research core technologies and integrate with external APIs and services.
Requirements:
BSc in Computer Science or related degree.
2+ years of experience in leading an engineering team.
6+ years of data engineering experience as a developer, tech lead, or architect.
4+ years of experience in Java.
Strong system architecture knowledge.
Experience in building high-volume and scalable applications.
Proficiency with cluster technologies, distributed systems, or streaming applications.
Familiarity with SQL and NoSQL databases.
Experience with pipelines/ Spark/ Kafka.
Experience with Vertica/ Redis/ Elasticsearch/ Hadoop.
Familiarity with Scrum methodologies.
AWS Service Experience.
Working knowledge of Linux, Docker, Kubernetes, CI/CD, and rollout plans.
Excellent spoken and written English communication skills.
Proactive team player with a desire to impact our engineering team, product, and customers.
This position is open to all candidates.
 
Show more...
הגשת מועמדותהגש מועמדות
עדכון קורות החיים לפני שליחה
עדכון קורות החיים לפני שליחה
7711826
סגור
שירות זה פתוח ללקוחות VIP בלבד
סגור
דיווח על תוכן לא הולם או מפלה
מה השם שלך?
תיאור
שליחה
סגור
v נשלח
תודה על שיתוף הפעולה
מודים לך שלקחת חלק בשיפור התוכן שלנו :)
 
נאספה מאתר אינטרנט
08/05/2024
חברה חסויה
Location: Tel Aviv-Yafo
Job Type: Full Time
Were looking for an exceptional data engineer to join our journey to create a data-based platform that will transform the shipping industry.
As a senior data engineer, you will take an instrumental part in laying the foundations and building the data infrastructure in the company, plan and implement the relevant data infrastructure and tools, be in charge of pipelining the companys data and be responsible for the integrity of the data as we scale up.
Responsibilities:
Contribute to the ongoing management of the data team platform including platform enhancements, capacity management, performance monitoring, troubleshooting and resolution of technical issues
Designing and optimizing data storage solutions, including data warehouses and data lakes.
Identify, design, and implement process improvements: automating manual processes, optimizing data delivery, re-designing infrastructure for greater scalability.
Developing and maintaining data pipelines for efficient extraction, transformation, and loading (ETL) processes.
Participate in proofs-of-concept on platform innovation, and effectively transition and scale those concepts into production at scale through, engineering, deployment and commercialization.
Part of a cross-disciplinary team, working closely with other data engineers, software engineers, data scientists, data managers and business partners.
Requirements:
BSc or MSc degree in Computer Engineering, Computer Science or a related discipline
8+ years of experience in data/ software engineering within a production environment
Strong programming skills (e.g., Python,, SQL).
Familiarity with Docker, Kubernetes, and cloud services (AWS, GCP)
Experience with SQL/NoSQL databases (e.g., Redshift, Postgres, MongoDB, Spark)
Proficiency in data modeling and database management.
This position is open to all candidates.
 
Show more...
הגשת מועמדותהגש מועמדות
עדכון קורות החיים לפני שליחה
עדכון קורות החיים לפני שליחה
7715298
סגור
שירות זה פתוח ללקוחות VIP בלבד
סגור
דיווח על תוכן לא הולם או מפלה
מה השם שלך?
תיאור
שליחה
סגור
v נשלח
תודה על שיתוף הפעולה
מודים לך שלקחת חלק בשיפור התוכן שלנו :)
 
נאספה מאתר אינטרנט
15/04/2024
חברה חסויה
Location: Tel Aviv-Yafo
Job Type: Full Time
Required Data Infrastructure Engineer
Job Description:
Design, build, and maintain scalable data solutions and infrastructure to support data processing, data quality and data tools for different data professionals and consumers in the organization
Develop and maintain generic processes to ingest data automatically from various sources into our data lake/data warehouse
Lead end to end projects in the data infrastructure group, working closely with users and leaders from the Data Engineering Guild
Collaborate with cross-functional infrastructure teams to integrate data engineering solutions into our products and services to create high-quality deliverables
Stay up-to-date with the latest trends and technologies in data engineering and recommend best practices to improve our data infrastructure.
Requirements:
3+ years of experience as a Data Engineer or Backend Developer with a focus on Python, Spark/Flink/Kafka, and experience cloud architecture (AWS services, k8s and more)
You are experienced in writing complex SQL queries and data pipelines for big data processing
You are an independent, self-learner who is passionate about data and can translate business and technical needs into data models or services
You have strong problem-solving skills and the ability to work independently
Youre a team player with excellent communication skills
Experience with Airflow, Great Expectations, Open Metadata, data governance practices or any data solutions would be an advantage
Experience building microservices in Python using FastAPI, Flask or similar would also be an advantage.
This position is open to all candidates.
 
Show more...
הגשת מועמדותהגש מועמדות
עדכון קורות החיים לפני שליחה
עדכון קורות החיים לפני שליחה
7693927
סגור
שירות זה פתוח ללקוחות VIP בלבד
סגור
דיווח על תוכן לא הולם או מפלה
מה השם שלך?
תיאור
שליחה
סגור
v נשלח
תודה על שיתוף הפעולה
מודים לך שלקחת חלק בשיפור התוכן שלנו :)
 
נאספה מאתר אינטרנט
13/05/2024
חברה חסויה
Location: Tel Aviv-Yafo
Job Type: Full Time
We are looking for a Senior Data Engineer.
In your role as a Data Engineer, you'll be actively engaged in the most fascinating and demanding projects for our clients. Handling high-scale operations, heavy traffic, stringent SLAs, and massive data volumes is just the starting point. Our leadership in the realms of Big Data, Streaming Data, and Complex Event Processing (CEP) stems from our adept use of cutting-edge, optimal technologies.
Responsibilities:
Apply software-engineering methods and best practices (Medallion Architecture) in Data Lake management.
Develop Data pipelines to provide ingest and transformation of data.
Manage and enhance orchestrated pipelines across company
Data Modeling: Developing data models to ensure efficient storage, retrieval, and processing of data, often involving schema design for NoSQL databases, data lakes, and data warehouses.
Scalability: Ensuring that the big data architecture can scale horizontally to handle large volumes of data and high traffic loads.
Data Security: Implementing security measures to protect sensitive data, including encryption, access controls, and data masking.
Data Governance: Establishing data governance policies to ensure data quality, compliance with regulations, and data lineage.
Requirements:
5 years of experience in Python (+Java / Scala)
Experience in NoSQL and data storage (e.g. Elasticm, Redis, MongoDB, CouchBase, BigQuery, Snowflake, Databricks)
Experience in data formats (Parquet, Avro, ORC)
Experience in Big Data Technologies (Spark, MapReduce )
Experience in streaming (Spark Streaming, Flink, Kafka Streams, Beam, etc.)
Experience in messaging (Kafka, RabbitMQ, etc.)
Experience with Machine Learning (Spark ML, TensorFlow, etc.) - Plus
Experience in cloud platforms (AWS, GCP)
This position is open to all candidates.
 
Show more...
הגשת מועמדותהגש מועמדות
עדכון קורות החיים לפני שליחה
עדכון קורות החיים לפני שליחה
7719953
סגור
שירות זה פתוח ללקוחות VIP בלבד
סגור
דיווח על תוכן לא הולם או מפלה
מה השם שלך?
תיאור
שליחה
סגור
v נשלח
תודה על שיתוף הפעולה
מודים לך שלקחת חלק בשיפור התוכן שלנו :)
 
נאספה מאתר אינטרנט
08/05/2024
חברה חסויה
Location: Tel Aviv-Yafo
Job Type: Full Time
We are looking for a talented and experienced BI Engineer to join our dynamic team. As a BI Engineer, you will take a major part in defining and building the core business models, playing a key role in transforming raw data into valuable insights, and enabling informed business decisions.
WHY YOU SHOULD JOIN OUR TEAM:
Our team's mission is to be the source of actionable strategic intelligence for us. The team partners with business leaders and users to add value through data, make data-informed decisions, discover insights, and share knowledge. Our company and product are focused on serving you. Being on the data team means you get early access to cutting-edge technology & are a north star for the data teams.
Responsibilities:
Data Modeling:
Develop and maintain scalable and efficient data models using dbt (data build tool) and other ETL tools.
Design and implement logical and physical data models that align with business requirements and industry best practices.
SQL Expertise:
Write and optimize complex SQL queries to extract, transform, and load (ETL) data.
To support business objectives, perform data analysis to identify trends, patterns, and anomalies.
dbt and Snowflake Implementation:
Utilize dbt to build, test, and deploy data transformations in a version-controlled environment.
Work extensively with Snowflake, leveraging its features for efficient data storage, processing, and querying.
Data Governance:
Establish and enforce data governance policies, ensuring data accuracy, consistency, and security.
Document data models, transformations, and processes for knowledge sharing and team collaboration.
Collaboration:
Work closely with business stakeholders to understand their data needs and provide actionable insights.
Collaborate with data engineers, analysts, and other team members to ensure seamless integration of data solutions.
Requirements:
At least 4 years of proven experience as a BI Engineer, Data Engineer, or Data Analyst.
In-depth knowledge of data modeling principles and practices.
Proficiency in writing complex SQL queries and optimizing database performance.
Strong analytical and problem-solving skills.
Experience with Snowflake, including data warehousing, optimization, and query performance tuning.
Excellent communication and collaboration abilities, with a demonstrated ability to work in a dynamic and fast-changing environment.
Preferred Skills:

Hands-on experience with dbt and version control systems.
This position is open to all candidates.
 
Show more...
הגשת מועמדותהגש מועמדות
עדכון קורות החיים לפני שליחה
עדכון קורות החיים לפני שליחה
7715697
סגור
שירות זה פתוח ללקוחות VIP בלבד
סגור
דיווח על תוכן לא הולם או מפלה
מה השם שלך?
תיאור
שליחה
סגור
v נשלח
תודה על שיתוף הפעולה
מודים לך שלקחת חלק בשיפור התוכן שלנו :)
 
נאספה מאתר אינטרנט
1 ימים
חברה חסויה
Location: Tel Aviv-Yafo
Job Type: Full Time
We are seeking an experienced Senior Backend Engineer with a passion for tackling complex challenges across a diverse range of technologies.
Your role will involve a deep commitment to software design, code quality, and performance optimization.
As part of our Engineering team , your mission will be to empower critical infrastructure by enabling the detection, investigation, and response to complex attacks and data breaches on their networks.
As a Senior Backend Engineer, you will take a lead role in developing the backend infrastructure to efficiently handle, process, and store massive volumes of data.
Your expertise will play a crucial part in building a scalable, high-performance backend system that serves as the foundation for other services within the platform. Additionally, you will be responsible for translating intricate requirements into meticulous and actionable backend designs.
Responsibilities:
Be a significant part of the development of backend infrastructure to efficiently handle, process, and store vast volumes of data.
Architect and build a scalable, high-performance backend system that supports various services within the platform.
Translate intricate requirements into meticulous backend design plans, maintaining a focus on software design, code quality, and performance.
Collaborate with cross-functional teams to implement backend and data-handling techniques.
Apply your expertise in Core Linux, SQL, and scripting languages to create robust backend solutions. Leverage your proficiency in cloud platforms such as AWS, GCP, or Azure to drive strong backend engineering practices.
Demonstrate strong debugging skills, identifying issues such as race conditions and memory leaks within the backend system. Solve complex backend problems with an analytical mindset and contribute to a positive team dynamic.
Bring your excellent interpersonal skills to foster collaboration and maintain a positive attitude within the team.
Requirements:
5+ years of experience with server-side coding in Java, Python, Go, or .NET.
Experience with microservices architecture and tools (docker, k8s, etc.).
Experience with large-scale applications with large data volumes and intensive traffic.
Experience with NoSQL databases.
Experience with bootstrapping projects and building systems from scratch.
Proven ownership and leadership skills.
Advantages:
Experience with Go development.
Good knowledge of networking protocols, flows, etc.
Experience working in a startup or small company environment.
This position is open to all candidates.
 
Show more...
הגשת מועמדותהגש מועמדות
עדכון קורות החיים לפני שליחה
עדכון קורות החיים לפני שליחה
7727757
סגור
שירות זה פתוח ללקוחות VIP בלבד
סגור
דיווח על תוכן לא הולם או מפלה
מה השם שלך?
תיאור
שליחה
סגור
v נשלח
תודה על שיתוף הפעולה
מודים לך שלקחת חלק בשיפור התוכן שלנו :)
 
נאספה מאתר אינטרנט
2 ימים
חברה חסויה
Location: Tel Aviv-Yafo
Job Type: Full Time
You will design, develop, and optimize ML model pipelines, and scale our models from research to production.

RESPONSIBILITIES
Building and improving our engineering infrastructure to enable and scale our applied algorithmic research and development. On a day to day, some of your responsibilities will include:

Design, Develop, Test and Maintain ETLs and services for integrating with our customers various data systems.
Design, Develop, Test and Maintain ETLs and services for building our own data processes to accommodate applied research needs as well as production needs.
Finding performance bottlenecks in our data pipelines and our machine learning pipelines and resolving them
Develop end-to-end algorithmic solutions for complex ML problems from research and training models, through design, development, evaluation and optimization.
Develop train and inference engine pipelines in a large scale distributed system.
Transform NLP and data related ML/DL algorithmic approaches into efficient and optimized production-ready solutions.
Design, Implement and Optimize ML/DL and research pipelines to improve algorithms performance.
Transform high-level product requirements into technical requirements
Brainstorm and prototype algorithmic improvements.
Work in an ambiguous environment and collect requirements from different personas in the company (Product, FE, Research, etc.)
Advise and collaborate with researchers on DL software engineering aspects (such as tools and practices).
Requirements:
M.Sc. (Phd preferred) in Computer Science, Engineer, or equivalent, ideally with a thesis in deep learning
Proven track record in MLOps, ML/DL engineering
High proficiency in Python and its data science stack (Pandas, sklearn, etc.).
Deep understanding of artificial deep neural networks architectures, algorithms, infrastructure, tooling and practices, ideally in NLP/NLU/NLG.
Hands-on experience with design, implementation and optimization of deep learning models using common frameworks (TensorFlow, PyTorch, HuggingFace, etc.)
Model optimization techniques familiarity with testing and hyperparameter optimization tools and frameworks.
3+ years of hands-on experience in engineering in production environments
2+ years of experience in ML
Experience in the following technologies: Dockers, Kubernetes, Aws, MongoDB
End to end experience owning feature from an idea stage, through design, architecture, coding, integration, deployment, and monitoring stages


ADVANTAGES
NLP/NLU/NLG experience in document classification, text generation, summarization, NER
Proven ability of conducting reproducible applied research in ML
Working with medical data on healthcare data projects
Experience in the following technologies: Spark/Hadoop, Airflow, Redis, Kafka
Go programming language proficiency
This position is open to all candidates.
 
Show more...
הגשת מועמדותהגש מועמדות
עדכון קורות החיים לפני שליחה
עדכון קורות החיים לפני שליחה
7725835
סגור
שירות זה פתוח ללקוחות VIP בלבד