דרושים » תוכנה » Senior Data Engineer

משרות על המפה
 
בדיקת קורות חיים
אבחון און ליין
VIP
הפוך ללקוח VIP
רגע, משהו חסר!
נשאר לך להשלים רק עוד פרט אחד:
 
שירות זה פתוח ללקוחות VIP בלבד
AllJObs VIP
סגור
דיווח על תוכן לא הולם או מפלה
מה השם שלך?
תיאור
שליחה
סגור
v נשלח
תודה על שיתוף הפעולה
מודים לך שלקחת חלק בשיפור התוכן שלנו :)
 
נאספה מאתר אינטרנט
08/05/2024
חברה חסויה
Location: Tel Aviv-Yafo
Job Type: Full Time
Were looking for an exceptional data engineer to join our journey to create a data-based platform that will transform the shipping industry.
As a senior data engineer, you will take an instrumental part in laying the foundations and building the data infrastructure in the company, plan and implement the relevant data infrastructure and tools, be in charge of pipelining the companys data and be responsible for the integrity of the data as we scale up.
Responsibilities:
Contribute to the ongoing management of the data team platform including platform enhancements, capacity management, performance monitoring, troubleshooting and resolution of technical issues
Designing and optimizing data storage solutions, including data warehouses and data lakes.
Identify, design, and implement process improvements: automating manual processes, optimizing data delivery, re-designing infrastructure for greater scalability.
Developing and maintaining data pipelines for efficient extraction, transformation, and loading (ETL) processes.
Participate in proofs-of-concept on platform innovation, and effectively transition and scale those concepts into production at scale through, engineering, deployment and commercialization.
Part of a cross-disciplinary team, working closely with other data engineers, software engineers, data scientists, data managers and business partners.
Requirements:
BSc or MSc degree in Computer Engineering, Computer Science or a related discipline
8+ years of experience in data/ software engineering within a production environment
Strong programming skills (e.g., Python,, SQL).
Familiarity with Docker, Kubernetes, and cloud services (AWS, GCP)
Experience with SQL/NoSQL databases (e.g., Redshift, Postgres, MongoDB, Spark)
Proficiency in data modeling and database management.
This position is open to all candidates.
 
Hide
הגשת מועמדותהגש מועמדות
עדכון קורות החיים לפני שליחה
עדכון קורות החיים לפני שליחה
7715298
סגור
שירות זה פתוח ללקוחות VIP בלבד
משרות דומות שיכולות לעניין אותך
סגור
דיווח על תוכן לא הולם או מפלה
מה השם שלך?
תיאור
שליחה
סגור
v נשלח
תודה על שיתוף הפעולה
מודים לך שלקחת חלק בשיפור התוכן שלנו :)
 
נאספה מאתר אינטרנט
16/05/2024
חברה חסויה
Location: Tel Aviv-Yafo
Job Type: Full Time
Required Senior Data Engineering
We are looking for a talented and experienced Data Engineer to join our data engineering team. In this role, you will be responsible for designing, implementing, and maintaining our data pipelines and infrastructure. You will collaborate closely with cross-functional teams, including data scientists, analysts, and software engineers, to ensure the availability, accessibility, and quality of our data assets. Your expertise in data processing, database technologies, and ETL processes will be essential in enabling effective data utilization and analysis.
Responsibilities:
Design, develop, and maintain efficient and scalable data pipelines that extract, transform, and load data from various sources into target systems.
Monitor and optimize data pipelines for performance, reliability, and data quality.
Implement and manage data storage solutions, including relational databases, data warehouses, and NoSQL databases.
Implement data partitioning, indexing, and compression strategies for improved performance and scalability.
Identify and resolve data quality issues, including data cleansing, standardization, and validation.
Identify and implement performance optimization techniques to enhance data processing speed, query performance, and system scalability.
Monitor and analyze data infrastructure and pipeline performance, identifying bottlenecks and implementing optimizations.
Stay updated on emerging technologies and trends in data engineering, proactively identifying opportunities for innovation and improvement.
Requirements:
Relevant Bachelor's degree preferably CS, Engineering/ Information Systems, or other equivalent Software Engineering background.
5+ years of experience as a Data engineer.
Strong SQL abilities and hands-on experience with SQL and no-SQL DBs, performing analysis and performance optimizations.
Hands-on experience in Python or equivalent programming language
Experience with data warehouse solutions (like Bigquery/ Redshift/ Snowflake or others)
Experience with data modeling, data catalog concepts, data formats, data pipelines/ETL design, implementation, and maintenance.
Experience with AWS/GCP cloud services such as GCS/S3, Lambda/Cloud Function, EMR/Dataproc, Glue/Dataflow, and Athena.
Experience with Airflow and DBT (advantage).
Experience with MLOps (advantage).
Experience with development practices Agile, CI/CD, TDD - Advantage.
This position is open to all candidates.
 
Show more...
הגשת מועמדותהגש מועמדות
עדכון קורות החיים לפני שליחה
עדכון קורות החיים לפני שליחה
7723424
סגור
שירות זה פתוח ללקוחות VIP בלבד
סגור
דיווח על תוכן לא הולם או מפלה
מה השם שלך?
תיאור
שליחה
סגור
v נשלח
תודה על שיתוף הפעולה
מודים לך שלקחת חלק בשיפור התוכן שלנו :)
 
נאספה מאתר אינטרנט
06/05/2024
חברה חסויה
Location: Tel Aviv-Yafo
Job Type: Full Time and Hybrid work
We're looking for a Senior Big Data Developer to join our Data Engineering team in Tel Aviv.

You will be a part of our Data Management platform, that is responsible for processing, storing, and serving data for all our core systems.

As a Senior Big Data Developer, we will encourage you to take a proactive & autonomous approach in research & development while working collaboratively with the team. Our ideal candidate is a fast but thorough problem solver, and a fun person to work with!

What Youll Do:

End-to-end feature development and ownership, from design to production, with a strong emphasis on innovation and efficiency.
Take part in building & designing the next generation of company Identity solutions.
Implement high scale Big-Data solutions and contribute to our platform infrastructure and architecture.
Research core technologies and integrations with external APIs and services.
Working with various stakeholders: Product, Engineering, Data providers etc.
Lead and mentor other developers through complex projects that will affect our core business.
Requirements:
Bachelor's Degree in Computer Science/Computer Engineering or equivalent degrees.
6+ years of data engineering experience.
Experience in building and optimizing data pipelines, ETLs, and streaming systems using technologies like Hadoop, Spark, and Kafka.
3+ years of experience in Java or Scala.
Experience with SQL & NOSQL DBs.
Experience in dealing with performance and high scale systems.
Experience with Kubernetes - advantage.
Experience with Gitlab, Grafana, InfluxDb, Kibana advantage.
Team player, ego less, strong communication skills.
This position is open to all candidates.
 
Show more...
הגשת מועמדותהגש מועמדות
עדכון קורות החיים לפני שליחה
עדכון קורות החיים לפני שליחה
7711812
סגור
שירות זה פתוח ללקוחות VIP בלבד
סגור
דיווח על תוכן לא הולם או מפלה
מה השם שלך?
תיאור
שליחה
סגור
v נשלח
תודה על שיתוף הפעולה
מודים לך שלקחת חלק בשיפור התוכן שלנו :)
 
נאספה מאתר אינטרנט
13/05/2024
חברה חסויה
Location: Tel Aviv-Yafo
Job Type: Full Time
We are looking for a Senior Data Engineer.
In your role as a Data Engineer, you'll be actively engaged in the most fascinating and demanding projects for our clients. Handling high-scale operations, heavy traffic, stringent SLAs, and massive data volumes is just the starting point. Our leadership in the realms of Big Data, Streaming Data, and Complex Event Processing (CEP) stems from our adept use of cutting-edge, optimal technologies.
Responsibilities:
Apply software-engineering methods and best practices (Medallion Architecture) in Data Lake management.
Develop Data pipelines to provide ingest and transformation of data.
Manage and enhance orchestrated pipelines across company
Data Modeling: Developing data models to ensure efficient storage, retrieval, and processing of data, often involving schema design for NoSQL databases, data lakes, and data warehouses.
Scalability: Ensuring that the big data architecture can scale horizontally to handle large volumes of data and high traffic loads.
Data Security: Implementing security measures to protect sensitive data, including encryption, access controls, and data masking.
Data Governance: Establishing data governance policies to ensure data quality, compliance with regulations, and data lineage.
Requirements:
5 years of experience in Python (+Java / Scala)
Experience in NoSQL and data storage (e.g. Elasticm, Redis, MongoDB, CouchBase, BigQuery, Snowflake, Databricks)
Experience in data formats (Parquet, Avro, ORC)
Experience in Big Data Technologies (Spark, MapReduce )
Experience in streaming (Spark Streaming, Flink, Kafka Streams, Beam, etc.)
Experience in messaging (Kafka, RabbitMQ, etc.)
Experience with Machine Learning (Spark ML, TensorFlow, etc.) - Plus
Experience in cloud platforms (AWS, GCP)
This position is open to all candidates.
 
Show more...
הגשת מועמדותהגש מועמדות
עדכון קורות החיים לפני שליחה
עדכון קורות החיים לפני שליחה
7719953
סגור
שירות זה פתוח ללקוחות VIP בלבד
סגור
דיווח על תוכן לא הולם או מפלה
מה השם שלך?
תיאור
שליחה
סגור
v נשלח
תודה על שיתוף הפעולה
מודים לך שלקחת חלק בשיפור התוכן שלנו :)
 
נאספה מאתר אינטרנט
20/05/2024
חברה חסויה
Location: Tel Aviv-Yafo
Job Type: Full Time
Were looking for brilliant data engineers to join our rapidly growing team.
You will join a team consisting of senior software and data engineers that drive our data platform from data acquisition, to processing and enrichment and all the way to business insights.
You will join an early stage team and company and will have a major impact on the decisions and architecture of our various products.
Responsibilities:
Design and build data acquisition pipelines that acquire, clean, and structure large datasets to form the basis of our data platform and IP
Design and build data pipelines integrating many different data sources and forms
Define architecture, evaluate tools and open source projects to use within our environment
Develop and maintain features in production to serve our customers
Collaborate with product managers, data scientists, data analysts and full-stack engineers to deliver our product to top tier retail customers
Take a leading part in the development of our enterprise-grade technology platform and ecosystem
Harmonize and clean large datasets from different sources.
Requirements:
At least 6 years of experience in software engineering in Python or an equivalent language
At least 3 years of experience with data engineering products from early-stage concept to production rollouts
Experience with cloud platforms (GCP, AWS, Azure), working on production payloads at large scale and complexity
Hands-on experience with data pipeline building and tools (Luigi, Airflow etc), specifically on cloud infrastructure
Advantage: Hands-on experience with relevant data analysis tools (Jupyter notebooks, Anaconda etc)
Advantage: Hands-on experience with data science tools, packages, and frameworks
Advantage: Hands-on experience with ETL Flows
Advantage: Hands-on experience with Docker / Kubernetes.
This position is open to all candidates.
 
Show more...
הגשת מועמדותהגש מועמדות
עדכון קורות החיים לפני שליחה
עדכון קורות החיים לפני שליחה
7728201
סגור
שירות זה פתוח ללקוחות VIP בלבד
סגור
דיווח על תוכן לא הולם או מפלה
מה השם שלך?
תיאור
שליחה
סגור
v נשלח
תודה על שיתוף הפעולה
מודים לך שלקחת חלק בשיפור התוכן שלנו :)
 
נאספה מאתר אינטרנט
06/05/2024
חברה חסויה
Location: Tel Aviv-Yafo
Job Type: Full Time and Hybrid work
We are looking for a Data Engineer Team Lead to join our Data Engineering team in Tel Aviv.

You will be leading one of our data platform teams, that is responsible for processing, storing, and serving data for all our core systems.

What Youll Do:

Lead and mentor a data lake team within our data organization.
Drive high-level projects with company-wide visibility.
Manage the team roadmap, team building, and SW project execution.
Collaborate with stakeholders, including developers, product managers, and business operations.
Take full ownership of end-to-end feature development, from design to production. Contribute to building and designing innovative big data solutions.
Research core technologies and integrate with external APIs and services.
Requirements:
BSc in Computer Science or related degree.
2+ years of experience in leading an engineering team.
6+ years of data engineering experience as a developer, tech lead, or architect.
4+ years of experience in Java.
Strong system architecture knowledge.
Experience in building high-volume and scalable applications.
Proficiency with cluster technologies, distributed systems, or streaming applications.
Familiarity with SQL and NoSQL databases.
Experience with pipelines/ Spark/ Kafka.
Experience with Vertica/ Redis/ Elasticsearch/ Hadoop.
Familiarity with Scrum methodologies.
AWS Service Experience.
Working knowledge of Linux, Docker, Kubernetes, CI/CD, and rollout plans.
Excellent spoken and written English communication skills.
Proactive team player with a desire to impact our engineering team, product, and customers.
This position is open to all candidates.
 
Show more...
הגשת מועמדותהגש מועמדות
עדכון קורות החיים לפני שליחה
עדכון קורות החיים לפני שליחה
7711826
סגור
שירות זה פתוח ללקוחות VIP בלבד
סגור
דיווח על תוכן לא הולם או מפלה
מה השם שלך?
תיאור
שליחה
סגור
v נשלח
תודה על שיתוף הפעולה
מודים לך שלקחת חלק בשיפור התוכן שלנו :)
 
נאספה מאתר אינטרנט
28/04/2024
חברה חסויה
Location: Tel Aviv-Yafo
Job Type: More than one
We are looking for a passionate Senior Software Engineer (Data & ML) to join our team. You will have a key part in developing the core detection capabilities and data pipeline at scale of the company and bringing it to the next level.
As a Software Engineer at EverC youll be expected to:
Be fully hands-on, lead your parts from A-Z (why, what, how), continuously raise the bar.
Drive the engineering efforts in a cross-functional squad.
Responsabilities
Design, develop and influence how we process data at scale, together with amazing people.
Work closely with Data Scientists & Product Managers to deploy and serve ML models & LLMs to production.
Solve diverse complex problems of scale, performance and business logic.
Work in an agile development methodology.
Review code, architecture and data to identify and troubleshoot problems and areas for improvement and optimization.
Share knowledge and mentor other engineers.
Requirements:
Baseline qualifications:
Expertise in Java or Python with at least 4+ years of experience in backend development of streaming application at scale.
Experience with large scale distributed systems in production.
Experience with microservices-based architecture.
Proficiency in Kubernetes & Kafka (or equivalent streaming enabler).
Hands on experience with cloud platforms, preferably AWS.
Team player, hard worker, quick learner, independent and loves challenges.
Fluent in English.
Preferred qualifications:
Experience with Spark & Scala
Strong advantage for experienced engineers working with deployment and serving of ML models.
Experience with CI/CD systems (Git Actions, ArgoCD).
Experience with infrastructure tools such as Cloud Formation and Terraform.
This position is open to all candidates.
 
Show more...
הגשת מועמדותהגש מועמדות
עדכון קורות החיים לפני שליחה
עדכון קורות החיים לפני שליחה
7703234
סגור
שירות זה פתוח ללקוחות VIP בלבד
סגור
דיווח על תוכן לא הולם או מפלה
מה השם שלך?
תיאור
שליחה
סגור
v נשלח
תודה על שיתוף הפעולה
מודים לך שלקחת חלק בשיפור התוכן שלנו :)
 
נאספה מאתר אינטרנט
06/05/2024
Location: Tel Aviv-Yafo
Job Type: Full Time
We are looking for a strong software engineer to join our MLOps team, and assist in building and driving forward our MLOps domain in a fast-paced startup working environment.
As a senior software engineer, you will be an integral part of a growing team, facing interesting and meaningful challenges.
We deeply value creative fast learners and independent thinkers with a proactive mindset who are able to handle tasks from ideation to Production.
Responsibilities:
Be a part of a highly skilled team, all aiming to build the best MLOPs platform in the industry.
Take a significant part in shaping our cross-company engineering culture.
Utilize the various tools used by the team and the methodologies we work by.
Conduct high-quality design reviews.
Improve the efficiency, scalability, and stability of various system components.
Put an emphasis on testing and code design.
The tools you know are less important than who you are and your problem solving skills!
Requirements:
Required skills:
5+ years of proven experience in software development.
Working experience in Java (or equivalent).
Experienced in designing, developing, and debugging complex, distributed systems (microservices, event-driven).
Proven hands-on experience in containerized environments, microservices and Kubernetes.
Experienced with at least one of the main cloud provider platforms (e.g. AWS, GCP)
Desired skills:
Experience with designing, structuring, and maintaining Python SDKs.
Experienced in building Data Science / Data Engineering tools using Python.
Working experience in Go.
This position is open to all candidates.
 
Show more...
הגשת מועמדותהגש מועמדות
עדכון קורות החיים לפני שליחה
עדכון קורות החיים לפני שליחה
7711448
סגור
שירות זה פתוח ללקוחות VIP בלבד
סגור
דיווח על תוכן לא הולם או מפלה
מה השם שלך?
תיאור
שליחה
סגור
v נשלח
תודה על שיתוף הפעולה
מודים לך שלקחת חלק בשיפור התוכן שלנו :)
 
נאספה מאתר אינטרנט
06/05/2024
חברה חסויה
Location: Tel Aviv-Yafo
Job Type: Full Time
we are looking for a Performance Solution Architect to work with our globally distributed engineering team on internet-scale data lake analytics platform. This is our flagship product and offers incredible value-add on the already stellar performance of the open-source Trino software. This role provides you with the opportunity to directly contribute to the enhancement of performance. The role entails conducting performance analysis and comparing existing in-market solutions, formulating a comprehensive strategy for performance testing, analyzing the results, and offering appropriate recommendations for enhancing.

As a Data Performance Engineer
Be an expert in architecture and performance approaches
Partner closely with sales engineers, solutions, support, and engineering teams to deliver guidance on performance issues at any phase in the product life cycle.
Maintain a profound understanding of current market solutions and devise instrumentation and approaches for comparing them with the solution, paving the way for future enhancements to .
Collaborate with Product Management and Solution architects to continuously improve performance and eco-system roadmaps.
Requirements:
Minimum 5 years experience with performance testing and design best practices.
Hands-on experience in performance analyzing and comparing complex SAAS products
Hands-on experience in performance tools and approaches
Strong communication skills, able to effectively communicate ideas and technical concepts to both technical and executive audiences.
Basic understanding of databases, data warehouses, and data processing
Basic knowledge and experience in software development in Python or Java
Proficient knowledge of SQL, especially for analytics and data warehousing use cases
Bonus points:
University degree in computer science, engineering, mathematics, or related fields.
Knowledge of distributed systems
Experience and understanding of large-scale infrastructure-as-a-service platforms (e.g. Amazon AWS, Microsoft Azure, OpenStack).
Experience with product management software like Jira
This position is open to all candidates.
 
Show more...
הגשת מועמדותהגש מועמדות
עדכון קורות החיים לפני שליחה
עדכון קורות החיים לפני שליחה
7711606
סגור
שירות זה פתוח ללקוחות VIP בלבד
סגור
דיווח על תוכן לא הולם או מפלה
מה השם שלך?
תיאור
שליחה
סגור
v נשלח
תודה על שיתוף הפעולה
מודים לך שלקחת חלק בשיפור התוכן שלנו :)
 
נאספה מאתר אינטרנט
01/05/2024
חברה חסויה
Location: Tel Aviv-Yafo
Job Type: Full Time
We are looking for a brilliant, quick-learner Data Engineer for our data engineering team - an independent logical thinker who understands the importance of data structuring for macro-business decisions.
The position combines high technical skills with business orientation, working closely with the analysts and the R&D team, and affecting the company's cross-departments decisions directly. Our Data Engineer should have the ability to speak in technical and practical terms, and more importantly, lead from one to the other, while dealing with challenges and creating them - to make our team even better than it is.
Roles and Responsibilities:
Creating and structuring end-to-end data pipelines & ETLs: from the source all the way to the analysts hands, enabling them the ideal conditions to make smart and data driven business decisions.
Cracking top industry data challenges while initiating and building creative technical solutions - in house Device Graph, Server-to-Server to multiple systems, Privacy challenges, Online-to-Offline and more.
Deep understanding of the business needs, technical requirements and the companys roadmap - and translating it into custom made data solutions and scalable products.
Craft code following best practices to ensure efficiency, while integrating CI/CD principles.
Writing multi-step scalable processes from more than 50 data sources - Marketing. Operations, CS, Product, CRM and more... tying them up to a valuable & useful source of insights for the analysts.
Understanding data challenges and weaknesses, and managing high standards monitoring and reliability processes.
Requirements:
B.A / B.Sc degree in a highly quantitative field - a must.
4-5 years hands on experience as a Data Engineer querying data warehouses (SQL), structuring data processes using quantitative techniques - a must.
Fast learner with high attention to details, and proven ability to multitask on several projects at a time. - a must.
Practical experience in Python and Infrastructure in data context. a must.
High analytical skills and the ability to deep dive into details. a must.
Google Cloud Data tools (BigQuery, Cloud Composer/Airflow) - a must.
AutoML, DataFlow, Neo4J - a plus.
Practical experience with distributed data processing like Spark - a plus.
Experienced in analyzing data, and gaining insights - a plus.
Experience working for a data driven company on a large scale - a plus.
This position is open to all candidates.
 
Show more...
הגשת מועמדותהגש מועמדות
עדכון קורות החיים לפני שליחה
עדכון קורות החיים לפני שליחה
7706607
סגור
שירות זה פתוח ללקוחות VIP בלבד
סגור
דיווח על תוכן לא הולם או מפלה
מה השם שלך?
תיאור
שליחה
סגור
v נשלח
תודה על שיתוף הפעולה
מודים לך שלקחת חלק בשיפור התוכן שלנו :)
 
פורסם ע"י המעסיק
09/05/2024
חברה חסויה
Location: Tel Aviv-Yafo
Job Type: Full Time and Hybrid work
We are Tailor Brands . We built a platform that builds businesses. From launching and managing to growing a business, Tailor Brands is the all-in-one solution that empowers any business owner. Our platform services over 40 million small businesses Our "Guidance Engine" assesses each new business introduced to our platform and devises a tailored plan that allows you to manage all your business needs from a single dashboard. Through our business-building platform, we’re turning the process of starting, managing, and growing a business into a better experience; we’re simplifying the business journey. At Tailor Brands, we believe in more than just handing you another tool; we are dedicated to teaching you the art of building a business About the Role As a Senior Platform Engineer, your work will have a direct impact on development processes across the entire R&D organization. You will help lead our Infrastructure, SRE, CI/CD, Security, and Scale/Performance efforts. You will take a leading role in defining and designing these systems, all to enable our Fullstack and Data teams to be as independent and successful as possible. At Tailor Brands, the Platform team doesn't manage all of our services on their own – they build the tools and guidance so our Development teams can own them end-to-end.
* Take an active role in the senior platform engineer engineering team that focuses on all aspects of CI/CD infrastructure, GitOps full automation, and operational metrics to ensure the highest productivity for our Cloud engineering infrastructure
* Lead the design and delivery of software and infrastructure to improve the reliability, scalability, and efficiency of our services.
* Design, develop, and maintain our core platform and CI/CD infrastructure and our development environments
* Manage cloud security principles and define best practices
* Build, configure, and tune highly available and fault-tolerant Container Clusters and K8s infrastructures
* Take an active role in defining the team’s roadmap
* Develop automation to support our orchestration and application deployment
Requirements:
* 4+ years of work experience as a senior platform engineer hands-on Engineer in a production environment
* Understanding of Development and build processes, CI & CD concepts, and tools
* Experience with any of the major cloud providers: Azure, AWS, Google Cloud
* Experience with Kubernetes or other container orchestration tooling Nice to have
* IaC experience
* Experience in a fully CD environment
* Programming experience Nice to know
* We are located in Rothschild, Tel Aviv
* Our hybrid model includes four days in the office and one day at home
This position is open to all candidates.
 
Show more...
הגשת מועמדותהגש מועמדות
עדכון קורות החיים לפני שליחה
עדכון קורות החיים לפני שליחה
7635268
סגור
שירות זה פתוח ללקוחות VIP בלבד