דרושים » תוכנה » Senior Data Engineer

משרות על המפה
 
בדיקת קורות חיים
אבחון און ליין
VIP
הפוך ללקוח VIP
רגע, משהו חסר!
נשאר לך להשלים רק עוד פרט אחד:
 
שירות זה פתוח ללקוחות VIP בלבד
AllJObs VIP
סגור
דיווח על תוכן לא הולם או מפלה
מה השם שלך?
תיאור
שליחה
סגור
v נשלח
תודה על שיתוף הפעולה
מודים לך שלקחת חלק בשיפור התוכן שלנו :)
 
פורסם ע"י המעסיק
21/03/2024
חברה חסויה
Location: Herzliya
Job Type: Full Time
As a Senior Data Engineer at CodeValue, you'll play a crucial role in our data team, contributing to the development and maintenance of scalable data pipelines and systems. You'll be at the forefront of designing, implementing, and optimizing data solutions that drive our business objectives and empower data-driven decision-making processes. Collaboration with data analysts, data scientists, and other stakeholders will be essential to ensure data integrity, reliability, and accessibility. Responsibilities:
* Design, develop, and optimize data pipelines and architectures using a variety of technologies and tools including Python, SQL, Spark, Kafka, and Airflow.
* Develop efficient data models to facilitate storage, retrieval, and processing, with a focus on schema design for NoSQL databases, data lakes, and data warehouses.
* Ensure scalability of big data architecture to handle large data volumes and high traffic loads.
* Implement data quality checks, validation processes, and data governance measures to ensure accuracy and consistency of data.
* Monitor, troubleshoot, and debug data issues and performance bottlenecks.
* Implement security measures such as encryption, access controls, and data masking to protect sensitive data.
* Research and evaluate new data technologies and best practices to enhance data engineering processes and solutions.

Top Profiles:
Top Profiles
Requirements:
* 4+ years of experience in data engineering or related roles.
* Proficiency in Python and SQL, with familiarity in other programming languages such as Java, Scala, etc.
* Experience with big data technologies and frameworks like Spark, Hadoop, Hive, etc.
* Familiarity with data streaming and messaging platforms such as Kafka, RabbitMQ, etc.
* Expertise in high-performance, near real-time ETL/ELT processes incorporating current and emerging data stack tools like Airflow, AWS, Kubernetes, Databricks, dbt, Spark, and Kafka.
* Experience with cloud platforms and services like AWS, GCP, Azure, etc.
* Ability to work independently and as part of a team in a fast-paced and dynamic environment.
* Bachelor's degree in Computer Science, Engineering, or related field, or equivalent work experience.
This position is open to all candidates.
 
Hide
הגשת מועמדותהגש מועמדות
עדכון קורות החיים לפני שליחה
עדכון קורות החיים לפני שליחה
7531492
סגור
שירות זה פתוח ללקוחות VIP בלבד
משרות דומות שיכולות לעניין אותך
סגור
דיווח על תוכן לא הולם או מפלה
מה השם שלך?
תיאור
שליחה
סגור
v נשלח
תודה על שיתוף הפעולה
מודים לך שלקחת חלק בשיפור התוכן שלנו :)
 
נאספה מאתר אינטרנט
21/04/2024
חברה חסויה
Location: Herzliya
Job Type: Full Time
We are searching for an innovative and experienced Senior Big Data Engineer that will join us and be part of our big data group.
As a Senior Big Data Engineer, you will:
Lead the architecture and development of mission-critical, diverse and large-scale data pipelines over both public and on-prem cloud solutions.
Derive policies for data storage and versioning over peta-bytes scale complex storage solutions of multiple data lakes.
Design and develop smart ML infrastructure in order to build Agile ML processes (MLOps).
Work with Data Scientists to understand needs and design ML infrastructure solutions
Be a part of a collaborative heterogeneous data team which includes developers, data scientists, data engineers, MLOps and data scouts.
Requirements:
BSc / MSc degree in Computer Science/ Engineering / Mathematics or Statistics
At least 5 years of experience working as a Data Engineer or Data Architect or ML Engineer
At least 3 years of experience working in high level software development, preferably in Python
Proven hands-on experience in designing, developing and optimizing complex solutions that move and/or manipulate large volumes of data
Sound understanding of different big data file formats such as Parquet, Arrow, HDF5, etc.
Experience with Docker, Linux, CI/CD tools and concepts, Kubernetes.
Experience with data pipelining tools such as Airflow, Kubeflow, MLFlow and similar technologies.
Hands-on experience with large-scale distributed computing systems and related technologies (e.g., Spark, Hive)
Understanding of ML concepts and processes.
Result oriented, self-motivated, fast learner, can do attitude and a great team player
Advantage:
Experience and understanding of various storage solutions (NFS, S3, software defined distributed storage, etc.)
Experience working with data versioning tools such as DVC, LakeFS, GitLFS or similar technologies.
Experience working with AWS data processing tools and concepts.
Experience with large, offline on-premises production deployments.
Experience with Pandas, Numpy, Jupyter notebook.
Hands-on experience in lower-level programming languages such as C++ or RUST.
This position is open to all candidates.
 
Show more...
הגשת מועמדותהגש מועמדות
עדכון קורות החיים לפני שליחה
עדכון קורות החיים לפני שליחה
7700757
סגור
שירות זה פתוח ללקוחות VIP בלבד
סגור
דיווח על תוכן לא הולם או מפלה
מה השם שלך?
תיאור
שליחה
סגור
v נשלח
תודה על שיתוף הפעולה
מודים לך שלקחת חלק בשיפור התוכן שלנו :)
 
נאספה מאתר אינטרנט
21/04/2024
חברה חסויה
Location: Herzliya
Job Type: Full Time
We are searching for an innovative and experienced Data Engineer that will join us and be part of our new data initiatives team in our data group.
As a Data Engineer, you will:
Be a part of a cross functional team of data, backend and DevOps engineers.
Be responsible for ingesting large volumes of new data, followed by deep understanding and inspection of the data in close collaboration with data scientists.
Lead the architecture, planning, design and development of mission-critical, diverse and large-scale data pipelines over both public and on-prem cloud solutions.
Requirements:
At least 3 years of experience working as a Data Engineer
At least 3 years of experience working in python development with emphasis on data analysis tools such as numpy, pandas, polars, Jupyter notebook.
Hands-on experience with Spark for large-scale batch processing.
Hands-on experience working with AWS data processing tools and concepts.
Proven understanding in designing, developing and optimizing complex solutions that move and/or manipulate large volumes of data.
Sound understanding of partitioning and optimization techniques of different big data file formats (such as Parquet, DeltaLake, AVRO, HDF5)
Experience with Docker, Linux, CI/CD tools and concepts, Kubernetes.
Experience with data pipelining tools such as Airflow, Kubeflow or similar.
BSc / MSc degree in Computer Science/Engineering / Mathematics or Statistics.
Understanding of ML concepts and processes.
Advantage:
Hands-on experience with DataBricks platform.
Experience working on large scale and complex on-premises systems.
Hands-on experience in ML frameworks and models training and implementation.
Hands-on experience in lower-level programming languages such as C++ or RUST
This position is open to all candidates.
 
Show more...
הגשת מועמדותהגש מועמדות
עדכון קורות החיים לפני שליחה
עדכון קורות החיים לפני שליחה
7700766
סגור
שירות זה פתוח ללקוחות VIP בלבד
סגור
דיווח על תוכן לא הולם או מפלה
מה השם שלך?
תיאור
שליחה
סגור
v נשלח
תודה על שיתוף הפעולה
מודים לך שלקחת חלק בשיפור התוכן שלנו :)
 
נאספה מאתר אינטרנט
28/03/2024
חברה חסויה
Location: Herzliya
Job Type: More than one
We are looking for strong and motivated Senior SRE to help us continue driving the Azure Data Explorer / Synapse Real Time Analytics revolution and make it THE technology for log search and text analytics across as well as providing value to our external customers.
Responsibilities:
As a Senior SRE in Kusto your primary responsibilities will be:
Live Site Management  Almost all the company come to rely on Azure Data Explorer (Kusto) for keeping their business running. This fuels a lot of passion in our team to keep the systems working at high availability and performance.  
As a Senior Service Engineer, you will be part of a global team driving huge scale live sites 24X7 (with follow the Sun model) and is passionate to deliver the best service within as well as to external customers 
Customer Focus our core value is Customer First. We in Kusto take pride in that and bring unwavering customer focus and support to help our customers utilize, embedded and build deep solutions on top of Kusto tailored to their needs. 
Automation As Kusto scale is huge and is expected to keep growing rapidly, we are committed to delivering automation and tooling to improve our live site management and adhere to scale without scale methodology.   
Design - Evaluate and contribute to product, service design and architecture, help shape Site Reliability Engineering strategies, review specifications, design and improve upon core processes.  
Observability - Identify system problems and recommend monitoring solutions & automation to improve processing efficiency and stability.  
Continuous integration/deployment - Implement/maintain and operate the build and release pipelines allowing our developers to safely code/test and deploy our products in very large scale.
Provide engineering design across different workloads including incident & problem management, change management, security and compliance.  
Community Building - Help us build and contribute to an exciting Azure Data explorer community.
Requirements:
Required Qualifications: 
Bachelor's degree in computer science, Information Technology, or related field AND 5+ years technical experience in software engineering, network engineering, service engineering, or systems engineering
OR equivalent experience.
3+ years of scripting and programming experience, including any of the following: NET, PowerShell, Python, C#
Preferred qualifications:
Deep understanding of cloud services  
Knowledge of Kubernetes concepts and implementation in Azure (AKS) and/or in other cloud provider platforms.
Working knowledge of Database as well as Big Data systems is a plus 
Understanding of BCDR  
Understanding and working knowledge of CI/CD pipelines is a big plus
3+ years of troubleshooting experience in wide cloud-based systems  
Out of the box, agile thinking to adapt to changing environment  
Deep knowledge of system design & architecture, and running of complex, large scale online services 
Working knowledge of Virtual Network and Private Endpoint concepts is plus
Ability to monitor and act on telemetry data and perform analyses to identify patterns that reveal errors and unexpected problems that are affecting the system availability, reliability, performance, and/or efficiency, with minimal guidance.
Ability to work as part an On-Call rotation is a must 
Ability to contribute to multiple projects/demands simultaneously. 
Ability to work effectively with customers both internal and external is a must.
This position is open to all candidates.
 
Show more...
הגשת מועמדותהגש מועמדות
עדכון קורות החיים לפני שליחה
עדכון קורות החיים לפני שליחה
7671675
סגור
שירות זה פתוח ללקוחות VIP בלבד
סגור
דיווח על תוכן לא הולם או מפלה
מה השם שלך?
תיאור
שליחה
סגור
v נשלח
תודה על שיתוף הפעולה
מודים לך שלקחת חלק בשיפור התוכן שלנו :)
 
פורסם ע"י המעסיק
1 ימים
חברה חסויה
Location: Herzliya
Job Type: Full Time
XM Cyber is a global leader in hybrid cloud security. XM Cyber brings a new approach that uses the attacker’s perspective to find and remediate critical attack paths across on-premises and multi-cloud networks. The XM Cyber platform enables companies to rapidly prioritize and respond to cyber risks affecting their business-sensitive systems. As a Senior Backend engineer with Spark experience at XM Cyber, you'll be responsible for implementing core features, building infrastructure, and finding innovative solutions while getting into the language internals. We're looking for top talents who are ready to level up their skills in an exciting and fast-paced environment. You will be responsible for leading features and products end to end, from design to production; build and develop modules, data pipelines, and services.
Requirements:
* 4+ years of experience in backend development and design
* 2+ years of experience server-side development with Node.js, TypeScript/JavaScript
* Experience in distributed computing such as Spark- MUST
* Experience with highscale production environment
* Experience with Docker/ Kubernetes
* Experience in designing and developing large distributed system and microservices architecture
* B.Sc. degree in Computer Science or equivalent practical experience
This position is open to all candidates.
 
Show more...
הגשת מועמדותהגש מועמדות
עדכון קורות החיים לפני שליחה
עדכון קורות החיים לפני שליחה
7419511
סגור
שירות זה פתוח ללקוחות VIP בלבד
סגור
דיווח על תוכן לא הולם או מפלה
מה השם שלך?
תיאור
שליחה
סגור
v נשלח
תודה על שיתוף הפעולה
מודים לך שלקחת חלק בשיפור התוכן שלנו :)
 
נאספה מאתר אינטרנט
22/04/2024
חברה חסויה
Location: Tel Aviv-Yafo and Herzliya
Job Type: Full Time
As a Senior Backend engineer with Spark experience you'll be responsible for implementing core features, building infrastructure, and finding innovative solutions while getting into the language internals. We're looking for top talents who are ready to level up their skills in an exciting and fast-paced environment. You will be responsible for leading features and products end to end, from design to production; build and develop modules, data pipelines, and services.
Requirements:
4+ years of experience in backend development and design
2+ years of experience server-side development with Node.js, TypeScript/JavaScript
Experience in distributed computing such as Spark- MUST
Experience with highscale production environment
Experience with Docker/ Kubernetes
Experience in designing and developing large distributed system and microservices architecture
B.Sc. degree in Computer Science or equivalent practical experience
This position is open to all candidates.
 
Show more...
הגשת מועמדותהגש מועמדות
עדכון קורות החיים לפני שליחה
עדכון קורות החיים לפני שליחה
7701080
סגור
שירות זה פתוח ללקוחות VIP בלבד
סגור
דיווח על תוכן לא הולם או מפלה
מה השם שלך?
תיאור
שליחה
סגור
v נשלח
תודה על שיתוף הפעולה
מודים לך שלקחת חלק בשיפור התוכן שלנו :)
 
נאספה מאתר אינטרנט
28/03/2024
חברה חסויה
Location: Herzliya
Job Type: Full Time
We are looking for strong and motivated SRE to help us continue driving the Azure Data Explorer / Synapse Real Time Analytics revolution and make it THE technology for log search and text analytics across The company as well as providing value to our external customers.
Responsibilities:
As a SRE in Kusto your primary responsibilities will be:
Live Site Management  Almost all the company come to rely on Azure Data Explorer (Kusto) for keeping their business running. This fuels a lot of passion in our team to keep the systems working at high availability and performance.
As a Service Engineer, you will be part of a global team driving huge scale live sites 24X7 (with follow the Sun model) and is passionate to deliver the best service within as well as to external customers. 
Customer Focus our core value is Customer First. We in Kusto take pride in that and bring unwavering customer focus and support to help our customers utilize, embedded and build deep solutions on top of Kusto tailored to their needs. 
Automation As Kusto scale is huge and is expected to keep growing rapidly, we are committed to delivering automation and tooling to improve our live site management and adhere to scale without scale methodology.   
Design - Evaluate and contribute to product, service design and architecture, help shape Site Reliability Engineering strategies, review specifications, design and improve upon core processes.  
Observability - Identify system problems and recommend monitoring solutions & automation to improve processing efficiency and stability.  
Continuous integration/deployment - Implement/maintain and operate the build and release pipelines allowing our developers to safely code/test and deploy our products in very large scale.
Provide engineering design across different workloads including incident & problem management, change management, security and compliance.  
Community Building - Help us build and contribute to an exciting Azure Data explorer community.
Requirements:
Required Qualifications: 
Bachelor's degree in computer science, Information Technology, or related field AND 2+ years technical experience in software engineering, network engineering, service engineering, or systems engineering
OR equivalent experience.
2+ years of scripting and programming experience, including any of the following: NET, PowerShell, Python, C#
Preferred qualifications:
Understanding of cloud services  
Knowledge of Kubernetes concepts..
Working knowledge of Database as well as Big Data systems is a plus 
Understanding of BCDR  
Understanding and working knowledge of CI\CD pipelines is a big plus
1+ years of troubleshooting experience in wide cloud-based systems  
Out of the box, agile thinking to adapt to changing environment  
Knowledge of system design & architecture, and running of complex, large scale online services 
Working knowledge of Virtual Network and Private Endpoint concepts is plus
Ability to monitor and act on telemetry data and perform analyses to identify patterns that reveal errors and unexpected problems that are affecting the system availability, reliability, performance, and/or efficiency, with minimal guidance.
Ability to work as part an On-Call rotation is a must 
Ability to contribute to multiple projects/demands simultaneously. 
Ability to work effectively with customers both internal and external to Microsoft is a must
This position is open to all candidates.
 
Show more...
הגשת מועמדותהגש מועמדות
עדכון קורות החיים לפני שליחה
עדכון קורות החיים לפני שליחה
7671679
סגור
שירות זה פתוח ללקוחות VIP בלבד
סגור
דיווח על תוכן לא הולם או מפלה
מה השם שלך?
תיאור
שליחה
סגור
v נשלח
תודה על שיתוף הפעולה
מודים לך שלקחת חלק בשיפור התוכן שלנו :)
 
נאספה מאתר אינטרנט
21/04/2024
חברה חסויה
Location: Herzliya
Job Type: Full Time
We are looking for an Algo-Dev Engineer to join one of our research teams. You will be working closely with our researchers, assisting them in achieving their research objective while developing tools and optimizing models in both offline and online environments.
Areas of responsibility include data-handling, deep dive into algo code, design, implementation, and deployment of technologies designed to enable innovative algo-trading projects and support existing and ongoing initiatives.
In this role you will :
Be involved in the execution of a significant new project, with high-end performance requirements and a deep understanding of the low-level implementation.
Participate end-to-end in research support, system architecture, implementation, simulation, testing and production.
Be responsible for designing and implementing research environments, offline and online data sources, coding machine learning algorithms, testing and deployment of solutions.
Collaborate with algorithmic and SW teams across the group to overcome our unique challenges.
Requirements:
7 years+ of SW development in variety of programming languages
5 years experience of SW development in the industry.
Research capabilities, machine learning experience
Have the resilience to solve complex difficult problems.
Independent, focused, well organized, and capable of prioritizing and multitasking
Be proactive and detail-oriented, yet comfortable working in a dynamic environment with fast paced deliveries and changing requirements
B.SC from a leading University
Advantages:
Experienced with BigData and Machine learning / AI technologies stack
Experienced with languages Python / C / C++
Proven experience with Deep Learning models optimizations on top of GPU
This position is open to all candidates.
 
Show more...
הגשת מועמדותהגש מועמדות
עדכון קורות החיים לפני שליחה
עדכון קורות החיים לפני שליחה
7700769
סגור
שירות זה פתוח ללקוחות VIP בלבד
סגור
דיווח על תוכן לא הולם או מפלה
מה השם שלך?
תיאור
שליחה
סגור
v נשלח
תודה על שיתוף הפעולה
מודים לך שלקחת חלק בשיפור התוכן שלנו :)
 
פורסם ע"י המעסיק
12/04/2024
חברה חסויה
Location: Herzliya
Job Type: Full Time
data Product Manager
Dynamic and innovative ad-tech company is looking for talented people who love data and want to
join us in our exciting journey as we leverage cutting-edge technology and a collaborative team
environment to deliver exceptional data -driven solutions.
We are seeking a talented and experienced data Product Manager to join our team. As a data
Product Manager, you will play a crucial role in shaping and delivering our data products, ensuring
they meet the needs of our clients and contribute to the overall success of our business. This role
requires a strategic thinker with a deep understanding of data, excellent communication skills, and
a passion for driving innovation.
Requirements:
3+ years of proven experience as a data Product Manager or similar position, with a focus
on creating comprehensive and technical PRDs and managing product development
roadmaps. Analytics and data products - an advantage.
? Strong technical background with a deep understanding of software development and
engineering principles.
? Strong understanding of data technologies, analytics, and Machine Learning concepts.
? Fluent English and Excellent communication
? Strong analytical and problem-solving skills.
? Experience working with cross-functional teams and Agile methodologies.
? Familiarity with market research and competitive analysis.
? Detail-oriented with a focus on delivering high-quality products.
? Quick and independent learner with a proven ability to rapidly acquire new knowledge and
skills.
This position is open to all candidates.
 
Show more...
הגשת מועמדותהגש מועמדות
עדכון קורות החיים לפני שליחה
עדכון קורות החיים לפני שליחה
7689841
סגור
שירות זה פתוח ללקוחות VIP בלבד
סגור
דיווח על תוכן לא הולם או מפלה
מה השם שלך?
תיאור
שליחה
סגור
v נשלח
תודה על שיתוף הפעולה
מודים לך שלקחת חלק בשיפור התוכן שלנו :)
 
נאספה מאתר אינטרנט
21/04/2024
חברה חסויה
Location: Herzliya
Job Type: Full Time
We are searching for an innovative Backend Engineer that will join us and be part of a SW team responsible of the full life cycle development of several web key applications including technical and statistical research, design, coding and integration.
This role will require you to move fast and deliver great products, you will be part of a smart, motivated, creative team of people who are filled with positive energy targeting to bring the best solutions to the finish line.
In this role youll :
Deliver scalable features to support our vision in a timely and quality manner
Building cutting-edge technologies that make a powerful impact on data-driven systems
Tackle tough problems and find creative ways to solve them
Produce (a lot) of high-quality, functional code that is readable, testable and maintainable
Leverage our in-house autonomous tools to manage all development flow, from setting up our development environment to creating git branches and deploying services to production
Be the owner of your domain to ensure code quality, performance, and scalability of our products
Requirements:
4+ years working as a Backend engineer in a web environment
In Depth understanding of OOP, SOLID and know functional programming principles
Can understand and write multi-threaded code, specifically a web server's request lifecycle
Have an excellent understanding of database systems, relational and otherwise, including big data applications
Are able to conduct performance analysis for a system and find its bottlenecks
Familiar with Linux development
Broad knowledge of modern backend and frontend frameworks, tools, and architecture
Experience working on a high scale, production-grade projects
B.Sc. in Computer Science or Mathematics (or equivalent experience) is a big plus
Result oriented, self-motivated, fast learner, can do attitude and a great team player
Experience with Python + SQL - major advantage
Experience with Pandas/SQL-alchemy - advantage
This position is open to all candidates.
 
Show more...
הגשת מועמדותהגש מועמדות
עדכון קורות החיים לפני שליחה
עדכון קורות החיים לפני שליחה
7700767
סגור
שירות זה פתוח ללקוחות VIP בלבד
סגור
דיווח על תוכן לא הולם או מפלה
מה השם שלך?
תיאור
שליחה
סגור
v נשלח
תודה על שיתוף הפעולה
מודים לך שלקחת חלק בשיפור התוכן שלנו :)
 
נאספה מאתר אינטרנט
09/04/2024
חברה חסויה
Location: Herzliya
Job Type: More than one
We are seeking a highly skilled AI/NLP Research Engineer to join our specialized team of deep research efforts in natural language interaction with structured data.
The ideal candidate will have a strong academic background in AI and NLP, with a focus on deep learning methods and their theoretical underpinnings. This individual will play a crucial role in driving our research agenda forward with the goal to become a leader in this area focusing on results accuracy and real life use cases.
Our offices are located in Herzliya, and the employment can be flexible - either full time or part, company employee or external consultant.
Responsibilities:
Lead and conduct advanced research in natural language interaction with structured data, with a focus on choosing and applying NLP Algorithms and models as well as innovate and improve on them to suppress existing best of breed.
Collaborate closely with cross-functional teams to understand product requirements and translate them into research objectives and experiments.
Stay current with the latest advancements in AI and NLP research, and apply findings to enhance our technology and products.
Provide guidance on research methodologies, best practices, and technical skills development.
Requirements:
M.A/Ph.D. or equivalent in Mathematics, Computer Science, Artificial Intelligence, Machine Learning, or a related field.
2+ year proven track record of applying NLP techniques to real-world problems, with hands-on experience in developing and deploying AI solutions.
Extensive experience in NLP research, with a focus on natural language interaction with structured data.
Strong theoretical background in deep learning, particularly in the area of large language modeling (LLM).
Demonstrated expertise in Python and relevant machine learning tools.
Familiarity with statistical modeling/analysis techniques. Knowledge in R, Matlab, or similar tools for statistical analysis is an advantage.
Excellent communication skills, with the ability to convey complex technical concepts to both technical and non-technical stakeholders.
Creative thinker with a passion for pushing the boundaries of AI research and innovation.
This position is open to all candidates.
 
Show more...
הגשת מועמדותהגש מועמדות
עדכון קורות החיים לפני שליחה
עדכון קורות החיים לפני שליחה
7686378
סגור
שירות זה פתוח ללקוחות VIP בלבד