דרושים » דאטה » Data Engineer 2628

משרות על המפה
 
בדיקת קורות חיים
VIP
הפוך ללקוח VIP
רגע, משהו חסר!
נשאר לך להשלים רק עוד פרט אחד:
 
שירות זה פתוח ללקוחות VIP בלבד
AllJObs VIP
כל החברות >
סגור
דיווח על תוכן לא הולם או מפלה
מה השם שלך?
תיאור
שליחה
סגור
v נשלח
תודה על שיתוף הפעולה
מודים לך שלקחת חלק בשיפור התוכן שלנו :)
חברה חסויה
Location: Merkaz
We are seeking an experienced and professional Data Engineer to join our technology team.
The role involves designing, developing, and implementing data engineering solutions, working with big data systems, integrating systems, managing cloud-based data infrastructure, and leveraging AI tools to enhance data processing and analytics.
the ideal candidate will have proven experience with advanced technologies, including AI-driven tools, and the ability to work in a dynamic and challenging environment.
Requirements:
At least 3 years of experience in Data Engineering or data systems development roles
Proficiency in python and java
Experience with kafka for real-time data streaming and processing
Experience with kubernetes and OpenShift (OCP) for container management
Familiarity with Big Data systems such as Hadoop and Vertica
Experience with Elasticsearch for log and data analytics
Experience with Oracle and Redis
Experience with cloud platforms such as AWS and GCP, including services like S3, EC2, BigQuery, and cloud Functions, experience with AI-driven tools such as kero, Claude code, and MCP
Ability to integrate AI models into data pipelines for predictive analytics and automation.
This position is open to all candidates.
 
Hide
הגשת מועמדותהגש מועמדות
עדכון קורות החיים לפני שליחה
עדכון קורות החיים לפני שליחה
8763642
סגור
שירות זה פתוח ללקוחות VIP בלבד
משרות דומות שיכולות לעניין אותך
סגור
דיווח על תוכן לא הולם או מפלה
מה השם שלך?
תיאור
שליחה
סגור
v נשלח
תודה על שיתוף הפעולה
מודים לך שלקחת חלק בשיפור התוכן שלנו :)
19/07/2026
חברה חסויה
Location: Lod and Tel Aviv-Yafo
Job Type: Full Time and Hybrid work
abra professional services is seeking a Data Analytics Architect / Principal Data Engineer We are looking for a skilled Data Analytics Architect / Principal Data Engineer to lead the organization’s analytics data domain, design large-scale data architecture, build advanced analytical models, define organizational data modeling standards, and implement innovative AI and LLM-based technologies. This role requires deep expertise in data engineering, analytics, BI, SQL, PostgreSQL, data modeling, performance optimization, data governance, and the integration of AI tools into data engineering processes. A full-time hybrid position based in Central Israel. The first 4–6 months will be based in Tel Aviv, followed by a transition to the Lod area. The position includes 1 day a week remote. Key Responsibilities:
* Design and develop data architecture that supports large-scale analytics and business intelligence.
* Lead the design and implementation of complex data models and enterprise data modeling solutions.
* Define organizational standards, methodologies, and best practices in the data domain.
* Optimize database performance, analytical queries, and reporting processes.
* Lead LLM-based development and implement AI tools within data engineering processes.
* Mentor data engineers, conduct code reviews and architecture reviews.
* Collaborate with management and business stakeholders to build a technological roadmap.
* Establish frameworks for data quality and data governance.
* Lead initiatives to improve the reliability and stability of BI and analytics systems.
* Evaluate new technologies and lead the adoption of innovative solutions across the organization.
* Lead the design and implementation of end-to-end analytics platforms.
Requirements:
Requirements: must have requirements: • Bachelor’s degree in Computer Science, Data Science, Statistics, or another relevant field, or equivalent professional experience. • At least 5 years of experience in Data Engineering, with a focus on Analytics and BI. • Expert-level SQL skills. • Deep experience with PostgreSQL, including performance tuning and optimization. • At least 3 years of experience with Python for data processing, automation, and testing. • At least 3 years of experience designing and implementing large-scale data models. • Experience leading performance optimization in complex data systems. • Experience establishing and implementing Data Governance and Data Quality processes. • Proven ability to translate business requirements into data architecture and technological solutions. • Experience providing technical leadership, mentoring, and leading technological initiatives. • Experience building Data and Analytics platforms from scratch. • Proven experience integrating AI and LLM tools into development and data engineering processes. Advantages: • Experience in FinTech or financial organizations. • Deep familiarity with regulation, information security, and compliance requirements. • Experience working with Data Lakes and Data Warehouses. • Experience with orchestration tools and ELT / ETL processes. • Experience working in cloud environments such as AWS, GCP, or Azure. • Familiarity with streaming technologies and real-time data processing. • Experience leading technology teams or professional excellence groups. Personality requirements: • Fast learning ability and curiosity for new technologies and methodologies. • Strategic thinking and broad system-wide perspective. • Ability to lead and influence without formal authority. • Ability to work independently and manage multiple tasks simultaneously. • High personal responsibility and ability to receive professional feedback. • Initiative, creativity, and ability to solve complex problems. • High motivation and constant drive for excellence. • Excellent interpersonal communication skills and ability to work with multiple stakeholders. • Ability to driv
This position is open to all candidates.
 
Show more...
הגשת מועמדותהגש מועמדות
עדכון קורות החיים לפני שליחה
עדכון קורות החיים לפני שליחה
8742948
סגור
שירות זה פתוח ללקוחות VIP בלבד
סגור
דיווח על תוכן לא הולם או מפלה
מה השם שלך?
תיאור
שליחה
סגור
v נשלח
תודה על שיתוף הפעולה
מודים לך שלקחת חלק בשיפור התוכן שלנו :)
חברה חסויה
Location: Petah Tikva
Job Type: Full Time
We are looking for a strong, hands-on Data Engineer to join our team and play a key role in building our data infrastructure from the ground up. In this role, you will design and implement scalable data pipelines and platforms, supporting both batch and real-time use cases. You will work closely with analysts and stakeholders to deliver reliable, high-quality data solutions, and take full ownership of data flows - from ingestion to consumption. This is a great opportunity for an executor who enjoys building, moving fast, and making an impact.
What will your job look like?
Design, build, and maintain robust and scalable data pipelines (batch and real-time) end-to-end.
Design and implement scalable, flexible data architectures to support evolving business needs.
Build and manage data platforms, including data lakes and data warehouses.
Integrate multiple data sources (structured and unstructured) into a unified data platform using batch (ETL) and real-time streaming solutions.
Design and implement efficient data models, schemas, and database structures (SQL / NoSQL).
Develop and implement data quality processes to ensure accuracy, consistency, and reliability.
Monitor, optimize, and troubleshoot data infrastructure to meet performance and SLA requirements.
Requirements:
5+ years of hands-on experience as a Data Engineer, building data systems from scratch in dynamic environments.
Bachelors degree in Computer Science, Engineering, or a related field (or equivalent practical experience).
Strong proficiency in Python and advanced SQL, with solid experience in data modeling.
Proven experience designing and building scalable data pipelines (batch and real-time), including streaming technologies such as Kafka.
Strong experience working with AWS, including services such as S3, Athena and DynamoDB.
Experience working with big data processing frameworks such as Spark, and columnar data formats (e.g., Parquet).
Hands-on experience with workflow orchestration tools such as Airflow.
Strong ownership and execution mindset, with excellent problem-solving skills and high attention to detail, and the ability to collaborate effectively and deliver in ambiguous, fast-paced environments.
Experience with data platform technologies such as Databricks, Snowflake - Advantage.
Experience building data platforms using modern lakehouse technologies (e.g., Iceberg) - Advantage.
Fluent in English.
This position is open to all candidates.
 
Show more...
הגשת מועמדותהגש מועמדות
עדכון קורות החיים לפני שליחה
עדכון קורות החיים לפני שליחה
8763644
סגור
שירות זה פתוח ללקוחות VIP בלבד
סגור
דיווח על תוכן לא הולם או מפלה
מה השם שלך?
תיאור
שליחה
סגור
v נשלח
תודה על שיתוף הפעולה
מודים לך שלקחת חלק בשיפור התוכן שלנו :)
Location: Herzliya
Job Type: Full Time
We are looking for a Data Engineer to join our usage metering & billing platform team! with a strong background in writing ETLs and complicated data processing pipelines. Youre deeply familiar with modern data processing stack (especially Spark, Hadoop and Airflow), have a strong problem-solving attitude and, most importantly, youre passionate about understanding the business side of the platform. Our platform engineers have an end-to-end understanding of the data our products generate and the commercial models and data structures in which they fit.
Working with this enormous volume of data begins with massive ETL pipelines built using cutting-edge technologies such as Kafka, BigQuery, Airflow, S3, PostgreSQL, Athena, SQS, Redis, and especially Spark. We are big believers in working with the right tool for the right job, including programming languages. We run a truly polyglot shot with Scala, Python, Go and Node being especially common here . The extreme growth rate of our data and client base means that solutions need to be designed to handle 10X growth or more.
What youll do:
Develop end-to-end ETLs and data infrastructure features from data processing logic to database choice and implementation through to API development
Improve the scalability and performance of existing data pipelines
Delve into existing pipelines and business logic, target weaknesses and add functionality
Mentor, advise, and work collaboratively within the Biz Data & Dev group, with other development teams, and with all other business teams of the company
Continuously learn and follow new technologies both for personal growth and to ensure we are making the most informed technology choices possible
Requirements:
3-5 years of experience in data engineering in Big Data environments
2+ years of experience with Spark and its ecosystem.
Experience using JVM stack, build tools, and environment (We mostly use Scala)
Experience with public cloud environments (AWS will be a bonus), Hadoop ecosystem, SQL and NoSQL databases
High proficiency with Python and at least one JVM-based language (Scala, Java, or Kotlin)
Proficiency with SQL and experience with ETL and data modeling and development
Positive attitude and willingness to take ownership
A mindset of continuous learning and the desire to try new things
Ability to see the "big picture" and to understand the business side of things
This position is open to all candidates.
 
Show more...
הגשת מועמדותהגש מועמדות
עדכון קורות החיים לפני שליחה
עדכון קורות החיים לפני שליחה
8723959
סגור
שירות זה פתוח ללקוחות VIP בלבד
סגור
דיווח על תוכן לא הולם או מפלה
מה השם שלך?
תיאור
שליחה
סגור
v נשלח
תודה על שיתוף הפעולה
מודים לך שלקחת חלק בשיפור התוכן שלנו :)
Location: Herzliya
Job Type: Full Time
We are looking for a Data Engineer to join our usage metering & billing platform team! with a strong background in writing ETLs and complicated data processing pipelines. Youre deeply familiar with modern data processing stack (especially Spark, Hadoop and Airflow), have a strong problem-solving attitude and, most importantly, youre passionate about understanding the business side of the platform. Our platform engineers have an end-to-end understanding of the data our products generate and the commercial models and data structures in which they fit.
Working with this enormous volume of data begins with massive ETL pipelines built using cutting-edge technologies such as Kafka, BigQuery, Airflow, S3, PostgreSQL, Athena, SQS, Redis, and especially Spark. We are big believers in working with the right tool for the right job, including programming languages. We run a truly polyglot shot with Scala, Python, Go and Node being especially common here . The extreme growth rate of our data and client base means that solutions need to be designed to handle 10X growth or more.
What youll do:
Develop end-to-end ETLs and data infrastructure features from data processing logic to database choice and implementation through to API development
Improve the scalability and performance of existing data pipelines
Delve into existing pipelines and business logic, target weaknesses and add functionality
Mentor, advise, and work collaboratively within the Biz Data & Dev group, with other development teams, and with all other business teams of the company
Continuously learn and follow new technologies both for personal growth and to ensure we are making the most informed technology choices possible
Requirements:
3-5 years of experience in data engineering in Big Data environments
2+ years of experience with Spark and its ecosystem.
Experience using JVM stack, build tools, and environment (We mostly use Scala)
Experience with public cloud environments (AWS will be a bonus), Hadoop ecosystem, SQL and NoSQL databases
High proficiency with Python and at least one JVM-based language (Scala, Java, or Kotlin)
Proficiency with SQL and experience with ETL and data modeling and development
Positive attitude and willingness to take ownership
A mindset of continuous learning and the desire to try new things
Ability to see the "big picture" and to understand the business side of things
This position is open to all candidates.
 
Show more...
הגשת מועמדותהגש מועמדות
עדכון קורות החיים לפני שליחה
עדכון קורות החיים לפני שליחה
8725187
סגור
שירות זה פתוח ללקוחות VIP בלבד
סגור
דיווח על תוכן לא הולם או מפלה
מה השם שלך?
תיאור
שליחה
סגור
v נשלח
תודה על שיתוף הפעולה
מודים לך שלקחת חלק בשיפור התוכן שלנו :)
חברה חסויה
Location: Tel Aviv-Yafo
Job Type: Full Time
We are looking for a Senior Data Architect to help define and evolve the data architecture of our SaaS platform and core products. You will work closely with product, delivery, and engineering squads to design scalable, reliable data systems, set technical direction for how data is ingested, modeled, stored, and served, and guide teams in making high-quality architectural decisions that balance delivery speed with long-term sustainability.
This is a hands-on, senior technical leadership role: you will spend most of your time shaping data architectures with teams, reviewing data models, pipelines and critical code, and driving shared standards and patterns across the organization, all in an advanced agentic environment.
Responsibilities:
Define and evolve the data architecture for key domains (ingestion, ELT/ETL, data modeling, storage, APIs, integration, observability, governance, and security), including owning the lakehouse/medallion architecture (bronze/silver/gold) and the data flows that move data across layers at scale.
Translate business and product requirements into pragmatic data designs, data contracts, and architecture roadmaps; create and maintain architecture artefacts (data flow/lineage diagrams, ADRs, reference implementations, modeling guidelines).
Evaluate design options and technology choices, articulate trade-offs, and lead decision-making with stakeholders; push forward the agentic mindset and implementation across the data platform.
Partner with squad leads and senior engineers to design data solutions, break down complex problems, and keep implementations aligned with the target architecture; participate in design/tech reviews to ensure NFRs (performance, scalability, data quality, resilience, security, operability) are addressed early.
Provide hands-on support where it matters most: spike and prototype critical data flows, review complex PRs, and help debug tricky production data and pipeline issues.
Requirements:
8+ years of experience in software / data engineering, including several years in a senior / staff / architect role designing complex data systems.
Strong experience designing modern data platforms and distributed data architectures (lakehouse/warehouse, batch and streaming/event-driven patterns, robust data APIs).
Experience working with columnar/serialization data formats such as AVRO and Parquet, including schema evolution and storage trade-offs.
Experience with DBT and ELT management tools for building, testing, and maintaining transformation pipelines.
Experience with Apache Airflow (or comparable orchestration tooling) for scheduling and managing data workflows.
Experience working with Databricks (or Snowflake) and medallion architecture (bronze/silver/gold).
Experience building SaaS data infrastructure, including CI/CD, ETL/data pipeline observability, and data quality monitoring.
Proven ability to design for scale, performance, security, and reliability in production SaaS environments.
Hands-on experience with at least one major language and ecosystem used in our stack (e.g., Python, SQL, Java, or similar).
Proven agentic experience - as hands-on experience and as architecting GenAI systems.
Comfortable reading and reviewing code, guiding implementation, and occasionally building prototypes or reference implementations.
Nice to have:
Experience with financial services, B2B SaaS, or integrations with large enterprise customers (e.g., banks).
Background in analytics, BI, or ML-adjacent systems and feature/data pipelines for ML.
Familiarity with data governance, lineage, cataloging, and master data management.
Familiarity with domain-driven design, event sourcing, or CQRS patterns.
Solid understanding of cloud-native architecture (e.g., AWS/Azure/GCP), containers, and infrastructure-as-code practices.
This position is open to all candidates.
 
Show more...
הגשת מועמדותהגש מועמדות
עדכון קורות החיים לפני שליחה
עדכון קורות החיים לפני שליחה
8739901
סגור
שירות זה פתוח ללקוחות VIP בלבד
סגור
דיווח על תוכן לא הולם או מפלה
מה השם שלך?
תיאור
שליחה
סגור
v נשלח
תודה על שיתוף הפעולה
מודים לך שלקחת חלק בשיפור התוכן שלנו :)
חברה חסויה
Location: Tel Aviv-Yafo
Job Type: Full Time
We are looking for an experienced and visionary Data Engineer to help design, build, and scale our BI platform.
In this role, you will be responsible for developing our data analytics platform - enabling scalable data pipelines and robust data modeling to support real-time and batch analytics to provide insights that serve both business intelligence and product needs.
You will be part of the R&D team, collaborating closely with engineers, analysts, and product managers to deliver a modern data architecture that supports internal dashboards and future-facing operational analytics.
If you enjoy turning raw data into powerful insights and owning the full data lifecycle, this role is for you!
Responsibilities
Take full ownership of the design and implementation of a scalable and efficient BI data infrastructure, ensuring high performance, reliability, and security.
Design and architect data products, from ingestion to transformation, modeling, storage, and access.
Build and maintain ETL/ELT pipelines, batch and real-time, to support analytics, reporting, and product integrations.
Establish and enforce best practices for data quality, lineage, observability, and governance to ensure accuracy and consistency.
Integrate modern tools and frameworks such as Airflow, Databricks, Power BI, and streaming platforms.
Collaborate cross-functional with product, engineering, and analytics teams to translate business needs into data infrastructure.
Promote a data-driven culture - be an advocate for data-driven decision-making across the company by empowering stakeholders with reliable and self-service data access.
Requirements:
Requirements
5+ years of hands-on experience in data engineering and in building data products for analytics and business intelligence.
Experience working on data developments using AI tools and agentic workflows.
Strong hands-on experience with ETL orchestration tools (Apache Airflow), and data lake houses (Databricks is an advantage)
Vast knowledge in both batch processing and streaming processing (e.g., Kafka, Spark Streaming).
Proficiency in Python, SQL, and cloud data engineering environments (AWS, Azure, or GCP).
Familiarity with data visualization tools (Power BI, Looker, or similar).
BSc in Computer Science or a related field from a leading university
Nice to have:
Experience working on early-stage projects, building data systems from scratch.
Background in building operational analytics pipelines, in which analytical data feeds real-time product business logic.
Experience in cost optimization in modern cloud environments.
Knowledge of data governance principles, compliance, and security best practices.
This position is open to all candidates.
 
Show more...
הגשת מועמדותהגש מועמדות
עדכון קורות החיים לפני שליחה
עדכון קורות החיים לפני שליחה
8739902
סגור
שירות זה פתוח ללקוחות VIP בלבד
סגור
דיווח על תוכן לא הולם או מפלה
מה השם שלך?
תיאור
שליחה
סגור
v נשלח
תודה על שיתוף הפעולה
מודים לך שלקחת חלק בשיפור התוכן שלנו :)
30/06/2026
חברה חסויה
Location:
Job Type: Full Time
our companys data & AI Division is looking for a data Engineer to join a leading project! We are looking for a talented data Engineer with a passion for building modern cloud-based data platforms. In this role, you will design and develop scalable data pipelines, build and optimize data warehouse solutions, and ensure the delivery of high-quality, reliable data for analytics and business intelligence. You will work closely with BI developers and business stakeholders to transform complex data into trusted, analytics-ready assets while leveraging modern AWS technologies and AI-powered development tools. Key Responsibilities
* Design and build data warehouse tables and data models, including source-to-target (S2T) mappings based on a layered architecture.
* Develop ETL /ELT processes to extract, transform, cleanse, and migrate data from Oracle source systems into Amazon Redshift.
* Build and maintain automated data pipelines for scheduled data ingestion, validation, reconciliation, and ongoing refresh processes.
* Analyze and re-implement existing procedures and business logic, including complex calculations, as part of cloud migration initiatives.
* Develop outbound data interfaces to support integrations with external systems and public data platforms.
* Implement automated data quality and reconciliation processes while optimizing pipeline performance and cost efficiency.
* Leverage AI tools to accelerate SQL development, technical documentation, and data pipeline implementation.
Requirements:
* 3+ years of experience in data Engineering.
* Hands-on experience with AWS data services, including Amazon Redshift and AWS Glue.
* Strong SQL skills with proven experience designing, developing, and maintaining ETL /ELT pipelines.
* Experience in data modeling and data Warehouse design, including layered architectures and source-to-target (S2T) mapping.
* Proficiency in using AI tools to support software development and technical documentation.
This position is open to all candidates.
 
Show more...
הגשת מועמדותהגש מועמדות
עדכון קורות החיים לפני שליחה
עדכון קורות החיים לפני שליחה
8716091
סגור
שירות זה פתוח ללקוחות VIP בלבד
סגור
דיווח על תוכן לא הולם או מפלה
מה השם שלך?
תיאור
שליחה
סגור
v נשלח
תודה על שיתוף הפעולה
מודים לך שלקחת חלק בשיפור התוכן שלנו :)
חברה חסויה
Location: Petah Tikva
Job Type: Full Time
We are looking for a strong, hands-on Data Platform Engineer to join our team and play a key role in building our data infrastructure from the ground up.
In this role, you will design and implement scalable data pipelines and platforms, supporting both batch and real-time use cases.
You will work closely with analysts and stakeholders to deliver reliable, high-quality data solutions, and take full ownership of data flows - from ingestion to consumption.
This is a great opportunity for an executor who enjoys building, moving fast, and making an impact.
What will your job look like?
Design, build, and maintain the underlying infrastructure for a modern cloud-based data platform.
Implement and manage CI/CD processes for data pipelines and platform deployments across development and production environments.
Design and manage secure, scalable AWS-based data infrastructure, including IAM roles, permissions, policies, networking, and environment isolation.
Build and maintain orchestration, monitoring, alerting, and observability capabilities for data pipelines and platform services.
Support deployment, reliability, and operational excellence of data workloads running on technologies such as Spark, DBT, Airflow, Athena, and AWS services.
Collaborate closely with Data Engineers, Analysts, BI teams, and IT/Cyber teams to ensure secure and scalable data operations.
Monitor, troubleshoot, and optimize platform performance, availability, and cost efficiency.
Establish best practices for infrastructure-as-code, deployment standards, security, and production readiness.
Requirements:
5+ years of hands-on experience in Data Engineering, Platform Engineering, DevOps, or Cloud Infrastructure roles.
Bachelors degree in Computer Science, Engineering, or a related field (or equivalent practical experience).
Strong hands-on experience with AWS, including services such as IAM, S3, Athena, CloudWatch, networking, permissions, and security policies.
Experience managing development and production environments, deployment processes, and CI/CD pipelines.
Experience supporting and operating data platforms and pipelines in production environments.
Strong understanding of data engineering concepts and modern data architectures (batch and real-time).
Experience working with Spark, Airflow, and cloud-based data processing frameworks.
Strong Python and SQL skills.
Experience with monitoring, logging, alerting, and operational troubleshooting of data systems.
Experience with Infrastructure as Code tools (Terraform / CloudFormation) - Advantage
Experience with Kubernetes, containerized environments - Advantage
Experience with Kafka, Iceberg, Databricks, Snowflake - Advantage
Strong ownership and execution mindset, with the ability to work in fast-paced and ambiguous environments.
Fluent in English.
This position is open to all candidates.
 
Show more...
הגשת מועמדותהגש מועמדות
עדכון קורות החיים לפני שליחה
עדכון קורות החיים לפני שליחה
8763636
סגור
שירות זה פתוח ללקוחות VIP בלבד
סגור
דיווח על תוכן לא הולם או מפלה
מה השם שלך?
תיאור
שליחה
סגור
v נשלח
תודה על שיתוף הפעולה
מודים לך שלקחת חלק בשיפור התוכן שלנו :)
חברה חסויה
Location: Netanya
Job Type: Full Time and Hybrid work
Required Senior Data Engineer - Big Data
Our Core Data Platform team:
We're a leading force in the ad tech industry, revolutionizing how brands connect with their audiences.
Our platform processes billions of ad impressions daily, generating massive datasets that drive our core business.
We thrive on innovation and seek a Data Engineer to help us build and scale the data infrastructure that powers our insights and analytics.
This is a unique opportunity to work with cutting-edge technologies and make a direct impact on our products.
What will you do?
As a Big Data Engineer, you'll be a key part of our data platform team, responsible for designing, building, and maintaining robust and scalable data pipelines. You'll work closely with data scientists, analysts, and server side engineers to ensure our data is reliable, accessible, and ready for analysis. Your expertise will be crucial in expanding our data warehouse and data lake capabilities, enabling us to deliver next-generation ad tech solutions.
Your mission will be to:
Develop and Optimize Data Pipelines: Design, build, and maintain ETL/ELT pipelines using Apache Spark to ingest, process, and transform large-scale datasets from various sources.
Manage Cloud Infrastructure: Architect and manage our data infrastructure primarily on Google Cloud Platform (GCP) or Amazon Web Services (AWS). This includes services like BigQuery, S3, GCS, EMR, and AirFlow.
Enhance Data Storage: Improve and manage our data warehouse and data lake solutions, ensuring data quality, consistency, and accessibility for business intelligence and machine learning applications.
Collaborate and Innovate: Partner with cross-functional teams to understand data needs and implement solutions that support new product features and business initiatives.
Ensure Data Integrity: Implement monitoring, alerting, and logging systems to maintain data pipeline health and ensure data accuracy.
Requirements:
5+ years of data engineering experience, building and operating production data pipelines at scale (TB+ datasets, hourly/daily batch or streaming workloads).
Hands-on production experience with Apache Spark and distributed data processing frameworks such as Flink, Hive, or Trino. Strong understanding of large-scale batch and streaming pipelines, including performance tuning and troubleshooting. Language is not a filter: Scala, Python, or Java are all fine. What matters is that you can debug and ship production Spark code, not which language you write it in
Production experience building and operating data solutions on GCP or AWS, including cloud-native services such as BigQuery, Dataproc, GCS, S3, EMR, or Redshift. Experience across the full project lifecycle is preferred.
Production experience with Kafka or Kafka-compatible streaming platforms, including the development, operation, and troubleshooting of real-time data pipelines, as well as debugging production incidents involving consumer lag, partition rebalancing, or data loss.
Strong understanding of data warehouse and data lake concepts, including Medallion Architecture (Bronze, Silver, Gold) and data platform best practices.
Nice to have
Production experience with a lakehouse table format (Apache Iceberg or Delta Lake). The specific format matters less than the underlying concepts: you understand how the lake stores data on object storage, how a table format adds transactional semantics on top and how a data warehouse can read that data. You have dealt with schema evolution and table maintenance.
Please submit your CV in English.
This position is open to all candidates.
 
Show more...
הגשת מועמדותהגש מועמדות
עדכון קורות החיים לפני שליחה
עדכון קורות החיים לפני שליחה
8715554
סגור
שירות זה פתוח ללקוחות VIP בלבד
סגור
דיווח על תוכן לא הולם או מפלה
מה השם שלך?
תיאור
שליחה
סגור
v נשלח
תודה על שיתוף הפעולה
מודים לך שלקחת חלק בשיפור התוכן שלנו :)
חברה חסויה
Location: Ramat Gan
Job Type: Full Time
we are looking for a Big Data Engineer.
As a Senior Big Data Engineer, working within Mobility Group, you will play a pivotal role in designing, developing, and maintaining the data infrastructure that powers our location analytics platform.
RESPONSIBILITIES:
Data Pipeline Architecture and Development: Design, build, and optimize robust and scalable data pipelines to process, transform, and integrate large volumes of data from various sources into our analytics platform.
Data Quality Assurance: Implement data validation, cleansing, and enrichment techniques to ensure high-quality and consistent data across the platform.
Performance Optimization: Identify performance bottlenecks and optimize data processing and storage mechanisms to enhance overall system performance and reduce latency.
Cloud Infrastructure: Work extensively with cloud-based technologies (GCP and AWS), to design and manage scalable data infrastructure.
Collaboration: Collaborate with cross-functional teams including Data Analysts, Data Scientists, Product Managers, and Software Engineers to understand requirements and deliver solutions that meet business needs.
Data Governance: Implement and enforce data governance practices, ensuring compliance with relevant regulations and best practices related to data privacy and security.
Monitoring and Maintenance: Monitor the health and performance of data pipelines, troubleshoot issues, and ensure high availability of data infrastructure.
Mentorship: Provide technical guidance and mentorship to junior data engineers, fostering a culture of learning and growth within the team.
Requirements:
Strong hands-on Apache Spark experience - building and operating pipelines in production, not just familiarity
Proficiency in PySpark or Scala for Spark development
Proven track record delivering ETL pipelines and data integration at scale
Solid SQL skills and command of data modeling concepts
Cloud platform experience (AWS, GCP, or Azure) in a production data context
Comfortable working with distributed systems and big data formats (Parquet, Delta Lake)
Nice to have:
Experience with pipeline orchestration tools, particularly Apache Airflow
Exposure to the geospatial or location analytics domain
Familiarity with Hadoop ecosystem components
Background in both Python and Scala (beyond Spark context)
This position is open to all candidates.
 
Show more...
הגשת מועמדותהגש מועמדות
עדכון קורות החיים לפני שליחה
עדכון קורות החיים לפני שליחה
8715025
סגור
שירות זה פתוח ללקוחות VIP בלבד