דרושים » תוכנה » Data Engineer

משרות על המפה
 
בדיקת קורות חיים
אבחון און ליין
VIP
הפוך ללקוח VIP
רגע, משהו חסר!
נשאר לך להשלים רק עוד פרט אחד:
 
שירות זה פתוח ללקוחות VIP בלבד
AllJObs VIP
משרה זו סומנה ע"י המעסיק כלא אקטואלית יותר
שם חברה חסוי
מיקום המשרה: תל אביב יפו
סוג משרה: משרה מלאה
משרות דומות שיכולות לעניין אותך
סגור
דיווח על תוכן לא הולם או מפלה
מה השם שלך?
תיאור
שליחה
סגור
v נשלח
תודה על שיתוף הפעולה
מודים לך שלקחת חלק בשיפור התוכן שלנו :)
 
נאספה מאתר אינטרנט
6 ימים
Location: Tel Aviv-Yafo
Job Type: Full Time and Hybrid work
We are looking for an experienced Senior Data Engineer to join our 'Data & AI' group. As a key member of our team, you will play a crucial role in designing and building data models, developing infrastructure, and optimizing data processes to support our data analysis, data science and engineering teams. You will collaborate with various stakeholders to ensure efficient data ingestion, processing, and analysis, contributing to the overall success of our data-driven initiatives.
Key Responsibilities:
Design and build robust data models and infrastructure to support data science and engineering teams.
Develop and optimize data processes, including ETL/ELT pipelines, for efficient data ingestion and processing.
Identify and understand business processes to derive actionable insights from the data.
Collaborate with BI analysts to create comprehensive reports and dashboards.
Implement and maintain scalable data solutions in a high-volume production environment.
Utilize modern technologies such as M3DB, Open-Search, Grafana, etc., for data processing and analysis.
Lead design initiatives for new products and contribute to best practices.
Work closely with cloud providers like AWS for data storage, computation, and orchestration.
Stay updated with advancements in data engineering, big data, and cloud technologies.
Requirements:
Bachelor's degree in computer science, engineering, or a related field.
5+ years of hands-on experience in data engineering and BI development.
Proficiency in SQL and Python for data manipulation and pipeline development.
Experience with complex ETL/ELT processes and big data technologies
Experience with Airflow.
Strong analytical skills and attention to detail
Excellent communication and collaboration abilities.
Preferred Qualifications:
Experience with machine learning algorithms and AI implementation.
Previous work with distributed systems, real-time analytics, and data visualization tools.
Familiarity with the AWS cloud platform and big data technologies.
Experience with Spark, Kafka, Elasticsearch, DynamoDB, and K8s.
This position is open to all candidates.
 
Show more...
הגשת מועמדותהגש מועמדות
עדכון קורות החיים לפני שליחה
עדכון קורות החיים לפני שליחה
7752621
סגור
שירות זה פתוח ללקוחות VIP בלבד
סגור
דיווח על תוכן לא הולם או מפלה
מה השם שלך?
תיאור
שליחה
סגור
v נשלח
תודה על שיתוף הפעולה
מודים לך שלקחת חלק בשיפור התוכן שלנו :)
 
נאספה מאתר אינטרנט
13/05/2024
חברה חסויה
Location: Tel Aviv-Yafo
Job Type: Full Time
We are looking for a Senior Data Engineer.
In your role as a Data Engineer, you'll be actively engaged in the most fascinating and demanding projects for our clients. Handling high-scale operations, heavy traffic, stringent SLAs, and massive data volumes is just the starting point. Our leadership in the realms of Big Data, Streaming Data, and Complex Event Processing (CEP) stems from our adept use of cutting-edge, optimal technologies.
Responsibilities:
Apply software-engineering methods and best practices (Medallion Architecture) in Data Lake management.
Develop Data pipelines to provide ingest and transformation of data.
Manage and enhance orchestrated pipelines across company
Data Modeling: Developing data models to ensure efficient storage, retrieval, and processing of data, often involving schema design for NoSQL databases, data lakes, and data warehouses.
Scalability: Ensuring that the big data architecture can scale horizontally to handle large volumes of data and high traffic loads.
Data Security: Implementing security measures to protect sensitive data, including encryption, access controls, and data masking.
Data Governance: Establishing data governance policies to ensure data quality, compliance with regulations, and data lineage.
Requirements:
5 years of experience in Python (+Java / Scala)
Experience in NoSQL and data storage (e.g. Elasticm, Redis, MongoDB, CouchBase, BigQuery, Snowflake, Databricks)
Experience in data formats (Parquet, Avro, ORC)
Experience in Big Data Technologies (Spark, MapReduce )
Experience in streaming (Spark Streaming, Flink, Kafka Streams, Beam, etc.)
Experience in messaging (Kafka, RabbitMQ, etc.)
Experience with Machine Learning (Spark ML, TensorFlow, etc.) - Plus
Experience in cloud platforms (AWS, GCP)
This position is open to all candidates.
 
Show more...
הגשת מועמדותהגש מועמדות
עדכון קורות החיים לפני שליחה
עדכון קורות החיים לפני שליחה
7719953
סגור
שירות זה פתוח ללקוחות VIP בלבד
סגור
דיווח על תוכן לא הולם או מפלה
מה השם שלך?
תיאור
שליחה
סגור
v נשלח
תודה על שיתוף הפעולה
מודים לך שלקחת חלק בשיפור התוכן שלנו :)
 
נאספה מאתר אינטרנט
08/05/2024
חברה חסויה
Location: Tel Aviv-Yafo
Job Type: Full Time
Were looking for an exceptional data engineer to join our journey to create a data-based platform that will transform the shipping industry.
As a senior data engineer, you will take an instrumental part in laying the foundations and building the data infrastructure in the company, plan and implement the relevant data infrastructure and tools, be in charge of pipelining the companys data and be responsible for the integrity of the data as we scale up.
Responsibilities:
Contribute to the ongoing management of the data team platform including platform enhancements, capacity management, performance monitoring, troubleshooting and resolution of technical issues
Designing and optimizing data storage solutions, including data warehouses and data lakes.
Identify, design, and implement process improvements: automating manual processes, optimizing data delivery, re-designing infrastructure for greater scalability.
Developing and maintaining data pipelines for efficient extraction, transformation, and loading (ETL) processes.
Participate in proofs-of-concept on platform innovation, and effectively transition and scale those concepts into production at scale through, engineering, deployment and commercialization.
Part of a cross-disciplinary team, working closely with other data engineers, software engineers, data scientists, data managers and business partners.
Requirements:
BSc or MSc degree in Computer Engineering, Computer Science or a related discipline
8+ years of experience in data/ software engineering within a production environment
Strong programming skills (e.g., Python,, SQL).
Familiarity with Docker, Kubernetes, and cloud services (AWS, GCP)
Experience with SQL/NoSQL databases (e.g., Redshift, Postgres, MongoDB, Spark)
Proficiency in data modeling and database management.
This position is open to all candidates.
 
Show more...
הגשת מועמדותהגש מועמדות
עדכון קורות החיים לפני שליחה
עדכון קורות החיים לפני שליחה
7715298
סגור
שירות זה פתוח ללקוחות VIP בלבד
סגור
דיווח על תוכן לא הולם או מפלה
מה השם שלך?
תיאור
שליחה
סגור
v נשלח
תודה על שיתוף הפעולה
מודים לך שלקחת חלק בשיפור התוכן שלנו :)
 
נאספה מאתר אינטרנט
5 ימים
חברה חסויה
Location: Tel Aviv-Yafo
Job Type: Full Time
We are currently seeking a Backend Developer based out of Israel (hybrid).

We are seeking to hire a Backend Developer, ideally with some background in DevOps & Infrastructure fields, to support the companys tech side. Candidates will have the opportunity to code and develop in multiple programming languages, on a microservice oriented environment, using latest modern tech stack.

The position will work directly under our Head of Technology, but will also need to communicate well and be able to work with other peers and senior colleagues from different departments.

Well Count on You To:
Maintain existing code, solving bugs, implementing changes.
Developing new features, new tools, and working on new green-field projects for new product endeavors.
Help maintaining and keeping the stability of our infrastructure and availability of our services & products.
Building and Improving tech-related support systems such as monitoring, alerts, analytics, etc.
Supporting and helping the PoliSci team and the Sales team when working with internal (non-client facing) systems, usually due to clients demands.
Requirements:
What You Need to Have:

Academic :
BA or BsC in Computer Science, or Software Engineering, or similar degree in the field.

Technical & Professional Experience
At least 4+ years of experience as a backend developer. Significant time working at startups or in a startup-like environment advantage.
Fluent in Ruby On Rails or NodeJS (for Backend development). Experience with the other mentioned language and/or Python strong advantage
Strong data orientation - managing and understanding data pipelines, data storage & management, schema design, etc. Highly experienced working with SQL (PostgreSQL advantage). Some acquaintance with MongoDB, Redis, Elasticsearch advantage
Regularly working using standard collaborative work practices (i.e. Git, etc)
Good grasp of software engineering and coding best-practices.
Must be able to deliver code at highest quality.
At least basic familiarity with AWS Cloud Infrastructures and working with AWS management console.
Some knowledge and experience with DevOps & Infrastructure related worlds strong advantage. Specifically, with any of the following: Docker, Kubernetes, Helm, Terraform, GitOps, ArgoCD, ArgoWorkflows, Jenkins.
Developing or maintaining algorithms implementations advantage
Familiar with async work distributions, workers & jobs queues, consumer-producer concept advantage.

Languages:
Excellent verbal and written communication skills in English and Hebrew.

What Would Make You Stand Out:
Fast learner, eager to learn and expand knowledge horizontally, being a jack of many trades.
Independent, self-sufficient, and self-reliant personality, being able to tackle big tasks with little spec and a lot of uncertainty and see them end to end.
Can fill in gaps in knowledge and requirements with only little help (as opposed to being spoon-fed with all the nitty-gritty details)
Must be comfortable working in dynamic agile environment (not referring to agile methodologies such as scrum, lean, etc, but more like no defined methodology work environment), where tasks and focus can change frequently.
Display exceptional organizational and time/deadline management skills and ability to prioritize among various deliverables.
This position is open to all candidates.
 
Show more...
הגשת מועמדותהגש מועמדות
עדכון קורות החיים לפני שליחה
עדכון קורות החיים לפני שליחה
7754055
סגור
שירות זה פתוח ללקוחות VIP בלבד
סגור
דיווח על תוכן לא הולם או מפלה
מה השם שלך?
תיאור
שליחה
סגור
v נשלח
תודה על שיתוף הפעולה
מודים לך שלקחת חלק בשיפור התוכן שלנו :)
 
נאספה מאתר אינטרנט
2 ימים
חברה חסויה
Location: Tel Aviv-Yafo
Job Type: Full Time
We seek an experienced Software Engineer with a strong background to become an integral member of our Data-Core team, tasked with the mission of processing, digitizing, and analyzing hundreds of millions of data sources. Your role will be pivotal in creating a unified, up-to-date, and accurate utilities map, services, and tools for accelerating our mapping operations. Your contributions will directly impact our core product's success.

Your Mission

Collaborate with cross-functional teams to design, build, and maintain data processing pipelines, ensuring efficient data integration, transformation, and loading.
Implement geospatial data processing techniques and contribute to the visualization of data on our unified map, enhancing the product's geospatial features.
Drive the scalability and performance optimization of data systems, addressing infrastructure challenges as data volume and complexity grow.
Develop and optimize complex Python-based code for data cleansing, validation, and standardization, enhancing the quality and accuracy of datasets.
Create and manage data infrastructure components, including ETL workflows, data warehouses, and databases, supporting seamless data flow and accessibility.
Collaborate in designing and implementing data architecture, ensuring effective data storage, retrieval, and security.
Design and implement CI/CD processes for data processing, model training, releasing, and monitoring, ensuring robustness and consistency.
Requirements:
7+ years of proven experience as a backend/software engineer.
2+ years of proven experience as a Data Infrastructure Engineer or in a similar role in managing and processing large-scale datasets.
A proven experience in building scalable online services.
Experience with frameworks like Kafka, DataLake, Airflow, Docker, and K8S to build data processing and exploration pipelines along with ML infrastructure to power our intelligence.
Experience in AWS/Google cloud environments, writing in Python/Java/Scala/Go.
Experience in deploying a diverse range of cloud-based technologies to support mission-critical projects, including expertise in writing, testing, and deploying code within a Kubernetes environment.
Experience working with both SQL and NoSQL databases such as Postgres, MySQL, Redis, or DynamoDB.
This position is open to all candidates.
 
Show more...
הגשת מועמדותהגש מועמדות
עדכון קורות החיים לפני שליחה
עדכון קורות החיים לפני שליחה
7756241
סגור
שירות זה פתוח ללקוחות VIP בלבד
סגור
דיווח על תוכן לא הולם או מפלה
מה השם שלך?
תיאור
שליחה
סגור
v נשלח
תודה על שיתוף הפעולה
מודים לך שלקחת חלק בשיפור התוכן שלנו :)
 
נאספה מאתר אינטרנט
2 ימים
חברה חסויה
Location: Tel Aviv-Yafo
Job Type: Full Time
We are seeking a Big Data Engineer to join our team.
In this role, you will play a crucial role in designing, building, and maintaining our query engine. You will play a crucial role in managing large volumes of data, optimizing data pipelines, optimizing data query, developing complex analytics capabilities on top of the data, and ensuring the reliability and scalability of our data infrastructure.
Responsibilities:
Develop our ETL and query engines using Java / Spring Boot / Scala / Zio
Deliver high quality features for our high-scale web environment
Participate in design from scratch to production
Monitor the performance and cost of the services in production
Stay up-to-date with industry trends and best practices to continuously improve our technology stack and development processes
Integrate with other team members (backend/frontend/product/UX).
Requirements:
5+ years of proven backend development experience using Scala, Java, and Spring Boot
5+ years of experience working in a microservices environment, including AWS, Kubernetes, RabbitMQ, SQS, Terraform, Helm, and Tilt
High proficiency in various data stores such as MongoDB, Elasticsearch, PostgreSQL, Snowflake, and Redshift
An enthusiastic self-learner who can confidently embrace new technologies, conduct research to discover innovative solutions, and successfully deliver results
Demonstrated excellent problem-solving skills and meticulous attention to detail.
Strong communication and collaboration skills
Ability to adapt quickly and effectively manage context switches.
This position is open to all candidates.
 
Show more...
הגשת מועמדותהגש מועמדות
עדכון קורות החיים לפני שליחה
עדכון קורות החיים לפני שליחה
7757074
סגור
שירות זה פתוח ללקוחות VIP בלבד
סגור
דיווח על תוכן לא הולם או מפלה
מה השם שלך?
תיאור
שליחה
סגור
v נשלח
תודה על שיתוף הפעולה
מודים לך שלקחת חלק בשיפור התוכן שלנו :)
 
נאספה מאתר אינטרנט
20/05/2024
חברה חסויה
Location: Tel Aviv-Yafo
Job Type: Full Time
We are seeking an adept Senior Data Engineer with a passion for tackling complex challenges across a diverse range of technologies.
Your role will involve a deep commitment to software design, code quality, and performance optimization.
As part of our Engineering team, your mission will be to empower critical infrastructure by enabling the detection, investigation, and response to complex attacks and data breaches on their networks.
You will play a pivotal role in developing pipelines to efficiently extract, transform, and load massive volumes of data.
Your expertise will contribute to the creation of a scalable, high-performance data lake that serves as a foundation for other services within the platform. Additionally, you will be responsible for translating intricate requirements into meticulous and actionable designs.
Responsibilities:
Be a significant part of the development of data pipelines to efficiently extract, transform, and load vast volumes of data.
Architect and build a scalable, high-performance data lake that supports various services within the platform.
Translate intricate requirements into meticulous design plans, maintaining a focus on software design, code quality, and performance.
Collaborate with cross-functional teams to implement data-warehousing and data-modeling techniques.
Apply your expertise in Core Linux, SQL, and scripting languages to create robust solutions.
Leverage your proficiency in cloud platforms such as AWS, GCP, or Azure to drive strong data engineering practices.
Utilize your experience with streaming frameworks, such as Kafka, to handle real-time data processing.
Employ your familiarity with industry-standard visualization and analytics tools, like Tableau and R, to provide insightful data representations.
Demonstrate strong debugging skills, identifying issues such as race conditions and memory leaks.
Solve complex problems with an analytical mindset and contribute to a positive team dynamic.
Bring your excellent interpersonal skills to foster collaboration and maintain a positive attitude within the team.
Requirements:
5+ years of experience in developing large-scale cloud systems.
Proficiency in Core Linux, SQL, and at least one scripting language.
Strong data engineering skills with expertise in cloud platforms like AWS, GCP, or Azure.
Expertise in developing pipelines for ETL processes, handling extensive data loads.
Familiarity with streaming frameworks, such as Kafka, or similar technologies.
Knowledge of data-warehousing and data-modeling techniques.
Practical experience with industry-wide visualization and analytics tools such as Tableau, R, etc.
Strong understanding of operating system concepts.
Proven ability to diagnose and address issues like race conditions and memory leaks.
Adept problem solver with analytical thinking abilities.
Outstanding interpersonal skills and a positive attitude.
Demonstrated ability to collaborate effectively within a team.
Advantages:
Previous experience working on-premises solutions.
This position is open to all candidates.
 
Show more...
הגשת מועמדותהגש מועמדות
עדכון קורות החיים לפני שליחה
עדכון קורות החיים לפני שליחה
7727785
סגור
שירות זה פתוח ללקוחות VIP בלבד
סגור
דיווח על תוכן לא הולם או מפלה
מה השם שלך?
תיאור
שליחה
סגור
v נשלח
תודה על שיתוף הפעולה
מודים לך שלקחת חלק בשיפור התוכן שלנו :)
 
נאספה מאתר אינטרנט
08/05/2024
חברה חסויה
Location: Tel Aviv-Yafo
Job Type: Full Time and Hybrid work
As the Vice President of Data , you will hold a critical leadership position responsible for driving strategic decisions through advanced quantitative analysis and data Science. Your expertise will be instrumental in cross-departmental collaboration with product marketing, customer service, and operations teams to ensure alignment and synergy across all areas of the business.

Responsibilities:

Lead and mentor multiple teams of Analysts, Data Scientists and Data Engineers.
Initiate & manage cutting-edge projects from ideation to delivery, including developing automated solutions.
Evaluate and improve the companys KPIs through data.
Collaborate closely with Stakeholders from Product, Marketing, Operations, Customer support and Finance and initiate data driven decisions and solutions.
Lead the analysis of complex datasets to extract valuable insights, trends, patterns, and anomalies that drive strategic decisions.
Lead the building and upgrade of existing data infrastructure to cope with performance, scalability, and growth.
Requirements:
Master's degree (or higher) in Mathematics, Statistics, Engineering, Computer Science, or any other quantitative field.
5+ years of practical data experience in big data businesses.
2+ years of experience managing a multidisciplinary data department including Analytics, Data Science and Data engineering teams.
2+ years of experience in a B2C
Strong understanding of ML, statistics and hands-on experience with SQL, Python, and data visualization tools.
Excellent analytical skills with experience in querying large, complex data sets.
Strong familiarity with cloud based DWH like BigQuery / Snowflake / Redshift - an advantage.
2+ years of experience in managing team leads - an advantage.
Self-learner, multi-tasker, able to work independently, highly organized, proactive, and a problem-solver.
This position is open to all candidates.
 
Show more...
הגשת מועמדותהגש מועמדות
עדכון קורות החיים לפני שליחה
עדכון קורות החיים לפני שליחה
7715442
סגור
שירות זה פתוח ללקוחות VIP בלבד
סגור
דיווח על תוכן לא הולם או מפלה
מה השם שלך?
תיאור
שליחה
סגור
v נשלח
תודה על שיתוף הפעולה
מודים לך שלקחת חלק בשיפור התוכן שלנו :)
 
נאספה מאתר אינטרנט
19/05/2024
חברה חסויה
Location: Tel Aviv-Yafo
Job Type: Full Time
You will design, develop, and optimize ML model pipelines, and scale our models from research to production.

RESPONSIBILITIES
Building and improving our engineering infrastructure to enable and scale our applied algorithmic research and development. On a day to day, some of your responsibilities will include:

Design, Develop, Test and Maintain ETLs and services for integrating with our customers various data systems.
Design, Develop, Test and Maintain ETLs and services for building our own data processes to accommodate applied research needs as well as production needs.
Finding performance bottlenecks in our data pipelines and our machine learning pipelines and resolving them
Develop end-to-end algorithmic solutions for complex ML problems from research and training models, through design, development, evaluation and optimization.
Develop train and inference engine pipelines in a large scale distributed system.
Transform NLP and data related ML/DL algorithmic approaches into efficient and optimized production-ready solutions.
Design, Implement and Optimize ML/DL and research pipelines to improve algorithms performance.
Transform high-level product requirements into technical requirements
Brainstorm and prototype algorithmic improvements.
Work in an ambiguous environment and collect requirements from different personas in the company (Product, FE, Research, etc.)
Advise and collaborate with researchers on DL software engineering aspects (such as tools and practices).
Requirements:
M.Sc. (Phd preferred) in Computer Science, Engineer, or equivalent, ideally with a thesis in deep learning
Proven track record in MLOps, ML/DL engineering
High proficiency in Python and its data science stack (Pandas, sklearn, etc.).
Deep understanding of artificial deep neural networks architectures, algorithms, infrastructure, tooling and practices, ideally in NLP/NLU/NLG.
Hands-on experience with design, implementation and optimization of deep learning models using common frameworks (TensorFlow, PyTorch, HuggingFace, etc.)
Model optimization techniques familiarity with testing and hyperparameter optimization tools and frameworks.
3+ years of hands-on experience in engineering in production environments
2+ years of experience in ML
Experience in the following technologies: Dockers, Kubernetes, Aws, MongoDB
End to end experience owning feature from an idea stage, through design, architecture, coding, integration, deployment, and monitoring stages


ADVANTAGES
NLP/NLU/NLG experience in document classification, text generation, summarization, NER
Proven ability of conducting reproducible applied research in ML
Working with medical data on healthcare data projects
Experience in the following technologies: Spark/Hadoop, Airflow, Redis, Kafka
Go programming language proficiency
This position is open to all candidates.
 
Show more...
הגשת מועמדותהגש מועמדות
עדכון קורות החיים לפני שליחה
עדכון קורות החיים לפני שליחה
7725835
סגור
שירות זה פתוח ללקוחות VIP בלבד
סגור
דיווח על תוכן לא הולם או מפלה
מה השם שלך?
תיאור
שליחה
סגור
v נשלח
תודה על שיתוף הפעולה
מודים לך שלקחת חלק בשיפור התוכן שלנו :)
 
נאספה מאתר אינטרנט
03/06/2024
חברה חסויה
Location: Tel Aviv-Yafo
Job Type: Full Time
We are making the future of Mobility come to life starting today.

we support the worlds largest vehicle fleet operators and transportation providers to optimize existing operations and seamlessly launch new, dynamic business models - driving efficient operations and maximizing utilization.

seeking a talented and experienced Senior Data Engineer to join our dynamic team. As a Senior Data Engineer , you will play a crucial role in optimizing and expanding our data services, driving advanced machine learning models and optimization algorithms. You will have the opportunity to work on diverse challenges such as data pipelines, optimization, prediction, modeling, transportation, and mapping.
We are looking for someone who is passionate about data engineering, with a strong background in backend development and experience in architecting and implementing data pipelines. You will collaborate with business teams and customers to understand their unique needs and requirements, and translate them into efficient and scalable data solutions. If you are a fast learner, independent, and enjoy tackling complex problems, we would love to hear from you!

Key Responsibilities:

Design and maintain production-level machine learning and data pipelines
Take full data ownership of existing and new features, including data extraction, manipulation, validation, and testing
Create, support, and maintain data marts with a focus on data integrity, performance, and long-term maintainability
Collaborate with business teams and customers to understand unique needs and requirement
Requirements:
4+ years of backend experience in a data engineering/development role
Strong knowledge of Python
Proven experience working with SQL and NoSQL databases, data warehouses, and data lakes
Experience in architecting and implementing data pipelines
Experience with spark
Practical experience in MLOps - big advantage
BSc/BA in computer science or engineering
Fast learner, independent, and able to multitask on several projects
Ability to identify and improve inefficient processes
This position is open to all candidates.
 
Show more...
הגשת מועמדותהגש מועמדות
עדכון קורות החיים לפני שליחה
עדכון קורות החיים לפני שליחה
7745840
סגור
שירות זה פתוח ללקוחות VIP בלבד