דרושים » תוכנה » Senior Big Data Developer

משרות על המפה
 
בדיקת קורות חיים
אבחון און ליין
VIP
הפוך ללקוח VIP
רגע, משהו חסר!
נשאר לך להשלים רק עוד פרט אחד:
 
שירות זה פתוח ללקוחות VIP בלבד
AllJObs VIP
06/05/2024
משרה זו סומנה ע"י המעסיק כלא אקטואלית יותר
שם חברה חסוי
מיקום המשרה: תל אביב יפו
משרות דומות שיכולות לעניין אותך
סגור
דיווח על תוכן לא הולם או מפלה
מה השם שלך?
תיאור
שליחה
סגור
v נשלח
תודה על שיתוף הפעולה
מודים לך שלקחת חלק בשיפור התוכן שלנו :)
 
נאספה מאתר אינטרנט
09/06/2024
Location: Tel Aviv-Yafo
Job Type: Full Time and Hybrid work
We are looking for an experienced Senior Data Engineer to join our 'Data & AI' group. As a key member of our team, you will play a crucial role in designing and building data models, developing infrastructure, and optimizing data processes to support our data analysis, data science and engineering teams. You will collaborate with various stakeholders to ensure efficient data ingestion, processing, and analysis, contributing to the overall success of our data-driven initiatives.
Key Responsibilities:
Design and build robust data models and infrastructure to support data science and engineering teams.
Develop and optimize data processes, including ETL/ELT pipelines, for efficient data ingestion and processing.
Identify and understand business processes to derive actionable insights from the data.
Collaborate with BI analysts to create comprehensive reports and dashboards.
Implement and maintain scalable data solutions in a high-volume production environment.
Utilize modern technologies such as M3DB, Open-Search, Grafana, etc., for data processing and analysis.
Lead design initiatives for new products and contribute to best practices.
Work closely with cloud providers like AWS for data storage, computation, and orchestration.
Stay updated with advancements in data engineering, big data, and cloud technologies.
Requirements:
Bachelor's degree in computer science, engineering, or a related field.
5+ years of hands-on experience in data engineering and BI development.
Proficiency in SQL and Python for data manipulation and pipeline development.
Experience with complex ETL/ELT processes and big data technologies
Experience with Airflow.
Strong analytical skills and attention to detail
Excellent communication and collaboration abilities.
Preferred Qualifications:
Experience with machine learning algorithms and AI implementation.
Previous work with distributed systems, real-time analytics, and data visualization tools.
Familiarity with the AWS cloud platform and big data technologies.
Experience with Spark, Kafka, Elasticsearch, DynamoDB, and K8s.
This position is open to all candidates.
 
Show more...
הגשת מועמדותהגש מועמדות
עדכון קורות החיים לפני שליחה
עדכון קורות החיים לפני שליחה
7752621
סגור
שירות זה פתוח ללקוחות VIP בלבד
סגור
דיווח על תוכן לא הולם או מפלה
מה השם שלך?
תיאור
שליחה
סגור
v נשלח
תודה על שיתוף הפעולה
מודים לך שלקחת חלק בשיפור התוכן שלנו :)
 
נאספה מאתר אינטרנט
20/05/2024
חברה חסויה
Location: Tel Aviv-Yafo
Job Type: Full Time
We are seeking an experienced Senior Backend Engineer with a passion for tackling complex challenges across a diverse range of technologies.
Your role will involve a deep commitment to software design, code quality, and performance optimization.
As part of our Engineering team , your mission will be to empower critical infrastructure by enabling the detection, investigation, and response to complex attacks and data breaches on their networks.
As a Senior Backend Engineer, you will take a lead role in developing the backend infrastructure to efficiently handle, process, and store massive volumes of data.
Your expertise will play a crucial part in building a scalable, high-performance backend system that serves as the foundation for other services within the platform. Additionally, you will be responsible for translating intricate requirements into meticulous and actionable backend designs.
Responsibilities:
Be a significant part of the development of backend infrastructure to efficiently handle, process, and store vast volumes of data.
Architect and build a scalable, high-performance backend system that supports various services within the platform.
Translate intricate requirements into meticulous backend design plans, maintaining a focus on software design, code quality, and performance.
Collaborate with cross-functional teams to implement backend and data-handling techniques.
Apply your expertise in Core Linux, SQL, and scripting languages to create robust backend solutions. Leverage your proficiency in cloud platforms such as AWS, GCP, or Azure to drive strong backend engineering practices.
Demonstrate strong debugging skills, identifying issues such as race conditions and memory leaks within the backend system. Solve complex backend problems with an analytical mindset and contribute to a positive team dynamic.
Bring your excellent interpersonal skills to foster collaboration and maintain a positive attitude within the team.
Requirements:
5+ years of experience with server-side coding in Java, Python, Go, or .NET.
Experience with microservices architecture and tools (docker, k8s, etc.).
Experience with large-scale applications with large data volumes and intensive traffic.
Experience with NoSQL databases.
Experience with bootstrapping projects and building systems from scratch.
Proven ownership and leadership skills.
Advantages:
Experience with Go development.
Good knowledge of networking protocols, flows, etc.
Experience working in a startup or small company environment.
This position is open to all candidates.
 
Show more...
הגשת מועמדותהגש מועמדות
עדכון קורות החיים לפני שליחה
עדכון קורות החיים לפני שליחה
7727757
סגור
שירות זה פתוח ללקוחות VIP בלבד
סגור
דיווח על תוכן לא הולם או מפלה
מה השם שלך?
תיאור
שליחה
סגור
v נשלח
תודה על שיתוף הפעולה
מודים לך שלקחת חלק בשיפור התוכן שלנו :)
 
נאספה מאתר אינטרנט
09/06/2024
Location: Tel Aviv-Yafo
Job Type: Full Time
We are looking for a Senior Java Software Engineer to become an integral member of our EP GW Core team. we are actively seeking passionate and motivated Senior Java Software Engineer to become an integral member of our EP GW Core team. This dynamic team plays a pivotal role in developing and sustaining multi-tenant platform, responsible for efficiently streaming data from millions of agents to our backend detection servers.

In This Position You Will

Join an esteemed autonomous, cross-functional agile team where you will assume complete responsibility for features and/or services through the entire lifecycle from design to deployment.
Leverage cloud-native technologies within a GCP environment to deliver resilient and scalable solutions.
Specialize in designing, developing, and deploying Java services with a strong emphasis on high availability, low latency, and scalability.
Establish and sustain a cost-effective infrastructure capable of real-time processing for millions of events per second.
Engage in close collaboration with fellow engineers, product owners, and designers to tackle complex challenges in the field of cybersecurity.
Thrive in an environment that actively supports your individual growth.
Requirements:
Minimum of 6 years of Java coding experience (mandatory)
Collaborative team player with a strong sense of accountability, dedication, and passion
Proficient in working within a cloud environment
Hands-on experience with SpringBoot
Proven expertise in designing and implementing microservices using the Spring framework
Demonstrated experience in crafting distributed, scalable, and multithreading systems (mandatory)
In-depth knowledge of system design, data structures and algorithms
Experience in constructing deployment pipelines using Jenkins and Kubernetes
Familiarity with queues and messaging systems such as PubSub, SQS, Kafka, etc.
Proficiency in both relational databases (e.g., MySQL, Postgres) and NoSQL databases (e.g., MongoDB, AeroSpike)
Possession of a B.Sc. in Computer Science/Engineering or equivalent knowledge
This position is open to all candidates.
 
Show more...
הגשת מועמדותהגש מועמדות
עדכון קורות החיים לפני שליחה
עדכון קורות החיים לפני שליחה
7752529
סגור
שירות זה פתוח ללקוחות VIP בלבד
סגור
דיווח על תוכן לא הולם או מפלה
מה השם שלך?
תיאור
שליחה
סגור
v נשלח
תודה על שיתוף הפעולה
מודים לך שלקחת חלק בשיפור התוכן שלנו :)
 
נאספה מאתר אינטרנט
13/05/2024
חברה חסויה
Location: Tel Aviv-Yafo
Job Type: Full Time
We are looking for a Senior Data Engineer.
In your role as a Data Engineer, you'll be actively engaged in the most fascinating and demanding projects for our clients. Handling high-scale operations, heavy traffic, stringent SLAs, and massive data volumes is just the starting point. Our leadership in the realms of Big Data, Streaming Data, and Complex Event Processing (CEP) stems from our adept use of cutting-edge, optimal technologies.
Responsibilities:
Apply software-engineering methods and best practices (Medallion Architecture) in Data Lake management.
Develop Data pipelines to provide ingest and transformation of data.
Manage and enhance orchestrated pipelines across company
Data Modeling: Developing data models to ensure efficient storage, retrieval, and processing of data, often involving schema design for NoSQL databases, data lakes, and data warehouses.
Scalability: Ensuring that the big data architecture can scale horizontally to handle large volumes of data and high traffic loads.
Data Security: Implementing security measures to protect sensitive data, including encryption, access controls, and data masking.
Data Governance: Establishing data governance policies to ensure data quality, compliance with regulations, and data lineage.
Requirements:
5 years of experience in Python (+Java / Scala)
Experience in NoSQL and data storage (e.g. Elasticm, Redis, MongoDB, CouchBase, BigQuery, Snowflake, Databricks)
Experience in data formats (Parquet, Avro, ORC)
Experience in Big Data Technologies (Spark, MapReduce )
Experience in streaming (Spark Streaming, Flink, Kafka Streams, Beam, etc.)
Experience in messaging (Kafka, RabbitMQ, etc.)
Experience with Machine Learning (Spark ML, TensorFlow, etc.) - Plus
Experience in cloud platforms (AWS, GCP)
This position is open to all candidates.
 
Show more...
הגשת מועמדותהגש מועמדות
עדכון קורות החיים לפני שליחה
עדכון קורות החיים לפני שליחה
7719953
סגור
שירות זה פתוח ללקוחות VIP בלבד
סגור
דיווח על תוכן לא הולם או מפלה
מה השם שלך?
תיאור
שליחה
סגור
v נשלח
תודה על שיתוף הפעולה
מודים לך שלקחת חלק בשיפור התוכן שלנו :)
 
פורסם ע"י המעסיק
09/06/2024
חברה חסויה
Location: Tel Aviv-Yafo
Job Type: Full Time
Globalbit is an award-winning Israeli IT company that specializes in delivering digital solutions to Enterprises, SMEs, and government agencies. Our extensive project portfolio comprises dozens of high-end software solutions that serve over 200 million people globally. We partnered with a technological product company from the SAAS - AI platform. We are looking to hire you as a R&D team leader It's time to join a stable, globally based company!

Responsibilites:
We are a group of technophiles who love big things that scale. As the leader in our group, you will need to: Lead - Take over a team of 6 that develops and maintains systems that process TBs of data. Execute - Make things happen and hone your leadership and mentorship skills. Think outside of the box - Own legacy systems and gradually re-write them. Innovate - Tackle advanced software engineering challenges, mainly in big data batch processing. Own - Take products from ideation and planning to production and monitoring together with your peers and stakeholders.


Company:
Optimove
Requirements:
* At least five years in backend development/data engineering.
* At least two years in team leadership.
* Managed at least 3 engineers.
* Processed at least 1 TB of data over a short period of time.
* End-to-end ideation, execution and deployment of at least one meaningful project. Leadership:
* Strong communication skills and ability to tear down projects to small deployable units.
* Patience to mentor with a focus on actionable milestones.
* Take ownership and know how to filter essence from noise. Hands-on Experience working with:
* Java/.NET.
* NodeJS/Python.
* SQL and NoSQL DBs.
* Data Engineer frameworks (Apache AirFlow, Apache Spark, Hadoop, Kafka, Snowflake, DataBricks). Knowledge:
* Deep Understanding of a complex open-source project.
* How to build solutions for the Cloud. Fluent in English and ability to work in a multi-language environment.
This position is open to all candidates.
 
Show more...
הגשת מועמדותהגש מועמדות
עדכון קורות החיים לפני שליחה
עדכון קורות החיים לפני שליחה
7747690
סגור
שירות זה פתוח ללקוחות VIP בלבד
סגור
דיווח על תוכן לא הולם או מפלה
מה השם שלך?
תיאור
שליחה
סגור
v נשלח
תודה על שיתוף הפעולה
מודים לך שלקחת חלק בשיפור התוכן שלנו :)
 
נאספה מאתר אינטרנט
7 ימים
חברה חסויה
Location: Tel Aviv-Yafo
Job Type: Full Time
We are seeking a Big Data Engineer to join our team.
In this role, you will play a crucial role in designing, building, and maintaining our query engine. You will play a crucial role in managing large volumes of data, optimizing data pipelines, optimizing data query, developing complex analytics capabilities on top of the data, and ensuring the reliability and scalability of our data infrastructure.
Responsibilities:
Develop our ETL and query engines using Java / Spring Boot / Scala / Zio
Deliver high quality features for our high-scale web environment
Participate in design from scratch to production
Monitor the performance and cost of the services in production
Stay up-to-date with industry trends and best practices to continuously improve our technology stack and development processes
Integrate with other team members (backend/frontend/product/UX).
Requirements:
5+ years of proven backend development experience using Scala, Java, and Spring Boot
5+ years of experience working in a microservices environment, including AWS, Kubernetes, RabbitMQ, SQS, Terraform, Helm, and Tilt
High proficiency in various data stores such as MongoDB, Elasticsearch, PostgreSQL, Snowflake, and Redshift
An enthusiastic self-learner who can confidently embrace new technologies, conduct research to discover innovative solutions, and successfully deliver results
Demonstrated excellent problem-solving skills and meticulous attention to detail.
Strong communication and collaboration skills
Ability to adapt quickly and effectively manage context switches.
This position is open to all candidates.
 
Show more...
הגשת מועמדותהגש מועמדות
עדכון קורות החיים לפני שליחה
עדכון קורות החיים לפני שליחה
7757074
סגור
שירות זה פתוח ללקוחות VIP בלבד
סגור
דיווח על תוכן לא הולם או מפלה
מה השם שלך?
תיאור
שליחה
סגור
v נשלח
תודה על שיתוף הפעולה
מודים לך שלקחת חלק בשיפור התוכן שלנו :)
 
נאספה מאתר אינטרנט
לפני 17 שעות
Location: Tel Aviv-Yafo
Job Type: Full Time
We are looking for a Principal Backend Engineer to join our Cortex XDR team and help us to prevent, detect and respond to all runs on an integrated endpoint, network and cloud data reduce the noise and focus on real threats.
More information about the Cortex XDR product can be found here.
Your Impact:
You will be a part of a group with the mentality and independence of a startup, supported by the power of a successful corporation - You will design and build an infrastructure that supports billions of events per second, storing, processing and making them accessible and visible to the user while collaborating with the industrys leading cyber products
You will be responsible for the complete software development life cycle including requirement analysis, design, development, deployment, and support - You will write clean, testable, readable, fast and maintainable code that is efficient and scalable
Requirements:
BSc in Computer Science or equivalent knowledge or equivalent military experience required
5+ years of software engineering experience - Must
Experience in distributed cloud products
Experienced with a variety of database technologies (Mysql / Cassandra / Google BigQuery Amazon Redshift / ElasticSearch)
Experience in designing, building and maintaining a scalable server-side application
Experience in Go / Python - an advantage
Experience with GCP - advantage
Experience with Kubernetes/Docker - advantage
Knowledge of the cyber field - advantage
This position is open to all candidates.
 
Show more...
הגשת מועמדותהגש מועמדות
עדכון קורות החיים לפני שליחה
עדכון קורות החיים לפני שליחה
7766005
סגור
שירות זה פתוח ללקוחות VIP בלבד
סגור
דיווח על תוכן לא הולם או מפלה
מה השם שלך?
תיאור
שליחה
סגור
v נשלח
תודה על שיתוף הפעולה
מודים לך שלקחת חלק בשיפור התוכן שלנו :)
 
נאספה מאתר אינטרנט
09/06/2024
חברה חסויה
Location: Tel Aviv-Yafo
Job Type: Full Time
We are looking for a Senior Java Software Engineer to become an integral member of our EP On-Prem Applicative team. This dynamic team plays a pivotal role in developing and sustaining On-Prem solution.

In This Position You Will:

Join an esteemed autonomous, cross-functional agile team where you will assume complete responsibility for features and/or services through the entire lifecycle from design to deployment.
Specialize in designing, developing, and deploying Java services with a strong emphasis on high availability, low latency, and scalability.
Establish and sustain a cost-effective infrastructure capable of real-time processing for millions of events per second.
Engage in close collaboration with fellow engineers, product owners, and designers to tackle complex challenges in the field of cybersecurity.
Thrive in an environment that actively supports your individual growth.
Requirements:
Minimum of 6 years of Java coding experience (mandatory)
Collaborative team player with a strong sense of accountability, dedication, and passion
Hands-on experience with SpringBoot
Proven expertise in designing and implementing microservices using the Spring framework
Demonstrated experience in crafting distributed, scalable, and multithreading systems (mandatory)
In-depth knowledge of system design, data structures and algorithms
Experience in constructing deployment pipelines using Jenkins and Kubernetes
Familiarity with queues and messaging systems such as PubSub, SQS, Kafka, etc.
Proficiency in both relational databases (e.g., MySQL, Postgres) and NoSQL databases (e.g., MongoDB, AeroSpike)
Possession of a B.Sc. in Computer Science/Engineering or equivalent knowledge
This position is open to all candidates.
 
Show more...
הגשת מועמדותהגש מועמדות
עדכון קורות החיים לפני שליחה
עדכון קורות החיים לפני שליחה
7752552
סגור
שירות זה פתוח ללקוחות VIP בלבד
סגור
דיווח על תוכן לא הולם או מפלה
מה השם שלך?
תיאור
שליחה
סגור
v נשלח
תודה על שיתוף הפעולה
מודים לך שלקחת חלק בשיפור התוכן שלנו :)
 
נאספה מאתר אינטרנט
09/06/2024
חברה חסויה
Location: Tel Aviv-Yafo
Job Type: Full Time
Were seeking a Data Specialist with strong analytics skills to join our Tel Aviv-based team and help shape our Large Language Model (LLM) capabilities. In this unique role, you'll own and architect the data tagging landscape . You'll go beyond performing tagging tasks to design and implement the processes and systems that will govern future data labeling efforts. You will leverage your expertise alongside Prompt Engineers and Product Managers. As you grow, you'll build and lead a team of part-time Data Taggers, ensuring consistency and quality in tagging processes.

Sound like your perfect fit? We want to hear from you!

As a Data Specialist, you will be responsible for owning data tagging foundation and ensuring top-quality data through hands-on tagging, system design, and collaboration. In this role, you will:

Perform hands-on data tagging to ensure accuracy and completeness, develop and implement tagging standards and guidelines, and work across various data sources to maintain consistent and high-quality tagging.
Design and establish foundational processes for data tagging, monitoring, and evaluation, develop a comprehensive tagging framework and best practices. Implement systems for continuous monitoring of data quality and tagging accuracy, create and maintain documentation, evaluate and improve tagging processes, and generate regular reports on tagging performance and metrics.
Inspire and lead a dynamic team of data tagging professionals, empowering their performance, and driving a culture of excellence amidst a fast-paced, ever-evolving environment.
Work closely with other departments to understand their data needs and ensure tagging processes align with goals. Communicate regularly with stakeholders on tagging initiatives and performance, and act as the primary point of contact for tagging-related issues and all monitoring and evaluation tasks, ensuring remains top in class.
Requirements:
Bachelors Degree in a technical field
1+ years of experience as an analyst/ in an analyst position
Deep interest and foundational knowledge in Large Language Models (LLMs)
Excellent written communication and problem-solving skills
Ability to learn quickly and maintain attention to detail
Fluent in English, including both written and verbal communication
Ability to work from our Tel Aviv office
Authorization to work in Israel
This position is open to all candidates.
 
Show more...
הגשת מועמדותהגש מועמדות
עדכון קורות החיים לפני שליחה
עדכון קורות החיים לפני שליחה
7751936
סגור
שירות זה פתוח ללקוחות VIP בלבד
סגור
דיווח על תוכן לא הולם או מפלה
מה השם שלך?
תיאור
שליחה
סגור
v נשלח
תודה על שיתוף הפעולה
מודים לך שלקחת חלק בשיפור התוכן שלנו :)
 
נאספה מאתר אינטרנט
05/06/2024
חברה חסויה
Location: Tel Aviv-Yafo
Job Type: Full Time and Hybrid work
We are looking for a top-notch Backend Engineer who will work on our next first-to-market products and tackle highly challenging problems by building innovative, scalable solutions. This position will be based in our R&D office in the heart of Tel-Aviv.

In this role, you'll be responsible for building scalable pipelines handling billions of events per day and building new customer-facing innovative products. We deeply encourage our engineers to develop a deep understanding of our industry and our customers and growth in their engineering skills. You will take part in our major projects and tackle complex problems in the realms of orchestrating a cost-effective and scalable architecture in our AWS stack. You will also have the chance to work in one of the most professional R&D teams in the startup community and grow professionally.
Requirements:
The ideal candidate is a backend engineer that brings a rare mix of big-picture thinking, responsibility and hands-on execution.

Independent, responsible, fast learner, and enjoys working in a fast-paced, growth environment.
Highly Experienced in building scalable, high-performance, tested and monitored systems.
At least 5 years of hands-on experience with Python / Go / Java and backend frameworks (Django, Flask, etc).
Experience with AWS and large-scale environments (e.g. Dynamo, EMR, Kafka, Kubernetes, Druid, Snowflake) a big plus
This position is open to all candidates.
 
Show more...
הגשת מועמדותהגש מועמדות
עדכון קורות החיים לפני שליחה
עדכון קורות החיים לפני שליחה
7748659
סגור
שירות זה פתוח ללקוחות VIP בלבד