לוח משרות דרושים איש ביג דאטה Big Data, לחיפוש זה נמצאו 27 משרות

As a Senior Software Engineer specializing in JVM-based frameworks, you'll serve as a core contributor, owning and maintaining critical parts of Data engineering ecosystem. This role sits at the intersection of high-performance database engineering and developer experience, where you'll craft tools that enable Data Engineers to harness incredible speed and scale.

we are looking for a Drools / DMN Expert to join a large-scale Enterprise project in the banking and financial services domain. The role focuses on business rules, decision management, and the design of complex decision logic that supports critical banking processes. What You'll Do
* Design and implement business rules using Drools.
* Model business decisions using DMN.
* Design and maintain Decision Tables.
* Translate complex business logic into maintainable rules.
* Separate business rules from application logic.
* Collaborate with analysts, architects, developers, and business stakeholders.
* Support the evolution and optimization of decision management solutions.
Location: Rishon LeZion Work Model: Hybrid - 1 day per week on-site

As a Senior Big Data Engineer, working within Mobility Group, you will play a pivotal role in designing, developing, and maintaining the data infrastructure that powers our location analytics platform.
RESPONSIBILITIES:

Data Pipeline Architecture and Development: Design, build, and optimize robust and scalable data pipelines to process, transform, and integrate large volumes of data from various sources into our analytics platform.
Data Quality Assurance: Implement data validation, cleansing, and enrichment techniques to ensure high-quality and consistent data across the platform.
Performance Optimization: Identify performance bottlenecks and optimize data processing and storage mechanisms to enhance overall system performance and reduce latency.
Cloud Infrastructure: Work extensively with cloud-based technologies (GCP and AWS), to design and manage scalable data infrastructure.
Collaboration: Collaborate with cross-functional teams including Data Analysts, Data Scientists, Product Managers, and Software Engineers to understand requirements and deliver solutions that meet business needs.
Data Governance: Implement and enforce data governance practices, ensuring compliance with relevant regulations and best practices related to data privacy and security.
Monitoring and Maintenance: Monitor the health and performance of data pipelines, troubleshoot issues, and ensure high availability of data infrastructure.
Mentorship: Provide technical guidance and mentorship to junior data engineers, fostering a culture of learning and growth within the team.

We're a leading force in the ad tech industry, revolutionizing how brands connect with their audiences. Our platform processes billions of ad impressions daily, generating massive datasets that drive our core business.

We thrive on innovation and seek a Senior Data Infra Engineer to help us build and scale the data infrastructure that powers our insights and analytics.
This is a unique opportunity to work with cutting-edge technologies and make a direct impact on our products.

What will you do?
As a Senior Data Infra Engineer, you'll be a key part of our data platform team, responsible for designing, building, and maintaining robust and scalable data pipelines. You'll work closely with data scientists, analysts, and server side engineers to ensure our data is reliable, accessible, and ready for analysis. Your expertise will be crucial in expanding our data warehouse and data lake capabilities, enabling us to deliver next-generation ad tech solutions.

Your mission will be to:

Develop and Optimize Data Pipelines: Design, build, and maintain ETL/ELT pipelines using Apache Spark to ingest, process, and transform large-scale datasets from various sources.
Manage Cloud Infrastructure: Architect and manage our data infrastructure primarily on Google Cloud Platform (GCP) or Amazon Web Services (AWS). This includes services like BigQuery, S3, GCS, EMR, and AirFlow.
Enhance Data Storage: Improve and manage our data warehouse and data lake solutions, ensuring data quality, consistency, and accessibility for business intelligence and machine learning applications.
Collaborate and Innovate: Partner with cross-functional teams to understand data needs and implement solutions that support new product features and business initiatives.
Ensure Data Integrity: Implement monitoring, alerting, and logging systems to maintain data pipeline health and ensure data accuracy.

Were looking for a Big Data Engineer to develop and integrate systems that retrieve, process and analyze data from around the digital world, generating customer-facing data. This role will report to our Team Manager, R&D.

So, what will you be doing all day?

Your role as part of the R&D team means your daily responsibilities may include:

Design and implement complex high scale systems using a large variety of technologies.
You will work in a data research team alongside other data engineers, data scientists and data analysts. Together you will tackle complex data challenges and bring new solutions and algorithms to production.
Contribute and improve the existing infrastructure of code and data pipelines, constantly exploring new technologies and eliminating bottlenecks.
You will experiment with various technologies in the domain of Machine Learning and big data processing.
You will work on a monitoring infrastructure for our data pipelines to ensure smooth and reliable data ingestion and calculation.

Were looking for a Senior Data Engineer in the Data Collection Ingest team to contribute to the design and coding of data ingestion services & pipelines. This role involves working as part of a team that handles millions of requests per minute across multiple servers, and is responsible for a wide-range of data pipelines, processing billions of events each day.

So, what will you be doing all day?

Your role as Data Engineer of the Ingest Data Collection team means your daily responsibilities may include:

Design, code and manage end-to-end data ingestion pipelines, both online and offline.
Take charge of developing & maintaining modern data infrastructure, while implementing best practices for building data pipelines.
Be responsible for high-scale ingestion services, solving challenges of availability, reliability, and scalability.
Run the production environment by monitoring availability and taking a holistic view of system health and data quality.
Own data infrastructure features from design to production using industry best practices with focus on quality and delivery.
Lead design & decision-making processes of the team.
Solve diverse complex problems of scale, performance and business logic.
Collaborate with product managers and other team leaders to plan, nurture, and implement an efficient and effective development process.
Continuously learn and evaluate new technologies in the everlasting effort to perfect our products
Perform code reviews, evaluate implementations, and provide feedback about potential improvements.
Improve your skills, learn from and mentor top-notch engineers and enrich other team members.
Have lots of fun!

Were looking for a sharp and driven Data Analyst to join our fast - paced Data Labs team. As part of a high-performing group of analysts, youll handle complex, custom requests from some of the biggest names in the market, turning raw data into strategic, ad hoc insights. The work is intense and constantly evolving - it requires strong analytical skills and the ability to work independently under pressure. Youll need to be curious, adaptable, and willing to dive deep to find answers where others might stop. If you thrive in a demanding environment and are excited by the opportunity to make a real impact, we want you on our team.

What does the day to day of a Big Data Analyst Customer Facing (Data Labs) look like:

Building custom-made reports end to end - from meeting with the client and understanding their needs, to writing the code and setting up the report for ongoing delivery.
Apply your expertise in quantitative analysis and data mining to turn data into insights.
Conduct research and develop tools which will help answer client's business. questions by using raw data sets and algorithms.
Partner with Engineering teams to establish an infrastructure to scale solutions.
Partner with Advisory Services team of Consultants to answer strategic business questions and deliver custom data products seamlessly

Were looking for a Senior Data Engineer to join our Research Engineering Team and play a pivotal role in shaping the data infrastructure that powers innovative solutions. In this role, youll design, build, and scale data pipelines and data warehouses from the ground up, creating the backbone for the worlds leading data classification engine. Youll collaborate closely with researchers and machine learning experts to enable the development of advanced models, ensuring a seamless flow of high-quality, reliable, and well-structured data. Your contributions will directly impact the scalability, performance, and precision of our platform, advancing our mission to protect critical data.

What Youll Do

Design and build scalable batch and streaming data pipelines that process complex datasets from diverse sources, enabling reliable and high-performance model training and inference.

Collaborate closely with researchers and data scientists to deliver high-quality, structured datasets that accelerate experimentation and model iteration.

Lead large-scale historical backfills and migration initiatives to ensure data consistency and integrity across evolving storage and compute platforms.

Optimize data workflows through advanced query tuning, indexing, partitioning, and cost optimization strategies to support efficient large-scale analytics.

Architect and maintain high-performance cloud-based data platforms using modern data stack components across AWS, GCP, or Azure.

Operate distributed data processing engines to handle massive volumes of structured and unstructured data.

Design and implement event-driven architectures using large-scale queue systems such as Kafka or SQS to ensure reliable and efficient data movement.

Develop automated monitoring and validation systems that guarantee uptime, schema compatibility, and pipeline reliability.

Deploy and manage data infrastructure in containerized, Kubernetes-based environments to support scalable and resilient services.

We are looking for a highly motivated backend software engineer specializing in creating high-scale, distributed backend systems.

You must demonstrate strong software engineering skills, excellent interpersonal communication, extreme ownership, and the ability to accept and give meaningful technical feedback.

You will be responsible for designing architecture, writing correct, robust code, maintaining and improving existing functionality, and shipping new features.

You will work as part of a Scrum-Agile cross-functional team and collaborate with front-end engineers, quality engineers, product managers, and more.

The platform you help us build will scale novel functionality to millions of Plus users worldwide.

Our team strives to set the bar for real-time, high-scale, mission-critical trading systems. We want to work with people who are excited by this goal and have the talent to deliver on it.

What Youll Do - Responsibilities

Design and build scalable, high-availability mission-critical systems and APIs
Drive the migration of large-scale, distributed trading services towards cloud-native microservices
Solve problems using distributed, asynchronous messaging
Tackle technical challenges - performance, fault-tolerance, security, and live production issues
Work closely with product, DevOps\SRE, and infrastructure teams - we practice full-cycle development where developers own and operate what they build.
Mentor Jr engineers as a Senior member of the team

Join our team to innovate in data management by designing, implementing, and managing advanced data platforms.
Youll optimize relational/non-relational databases and big data systems, collaborate with cross-functional teams, and provide technical support.
Monitor performance, solve complex challenges, and stay updated on emerging technologies.

We are seeking a highly skilled and versatile Senior Data Infrastructure Engineer to join our team and participate in the design, implementation and maintainance of cutting-edge Data Platforms and Big Data solutions. This position allows you to have the unique opportunity to significantly impact intelligence processes, contribute to counter-terrorism efforts by leveraging advanced Big Data technologies.
This role combines expertise in Big Data Infrastructure, Big Data Engineering, architecture and support of critical operations and intelligence processes.
עוד על התפקיד
Design, install, maintain and upgrade Big Data technologies.
Monitor and optimize system performance, identifying areas for improvement and implementing solutions.
Provide technical support to internal teams and end-users, ensuring seamless operations.
Conduct POCs and recommend adoption of new technologies and tools in the Big Data domain.
Develop automation solutions for infrastructure management, empowering teams to operate efficiently.

We are looking for developers interested in joining exciting and innovative bigdata projects
This is a great opportunity for individuals seeking to develop solutions to the most challenging problems in the bigdata field, dealing with operational requirements while using cutting edge technologies.

We are looking for a Data Science Engineer to design and implement the decision-making logic of our Price Optimizer. You will focus on translating complex business rules into mathematical models and production-ready Python code.

Your primary mission is to build the "brain" of our system. You will work at the intersection of Data Science and Product, ensuring our simulation and optimization engines accurately reflect real-world pricing strategies and market dynamics. While you will write production code, you will rely on our Data Engineers for ETL pipelines orchestration and distributed compute scaling.

Responsibilities:

Implement Business Logic: Translate intricate pricing rules and commercial strategies into robust Python code and mathematical constraints.
Refine Optimization Models: Develop and tune the simulation and revenue management algorithms that drive our pricing recommendations.
Write Clean Code: Contribute high-quality, tested, and maintainable code to the core logic repositories.
Analyze & Improve: Use data to validate model behavior and identify edge cases where business rules clash with algorithmic outputs.
Collaborate: Partner with Solution Architects to define logic requirements and with Data Engineers to integrate your models into the Dagster pipelines.

We are seeking an experienced Data Science Team Lead to lead our data science and data engineering efforts and oversee a team of skilled data engineers. This role combines hands-on technical leadership and team management, with responsibilities that include building and scaling data infrastructure to power real-time pricing, large-scale data pipelines, and machine learning products.

You will lead the team through architecture decisions, development, and deployment of mission-critical systems-while growing and mentoring a high-performing team.

Responsibilities

Manage a team of data scientists and data engineers responsible for building robust, scalable, and high-performance data pipelines and infrastructure.
Design, build, and maintain distributed data processing workflows (batch & streaming).
Drive best practices for data quality, validation, testing, and observability.
Own and evolve data architecture in alignment with business and product goals.
Manage sprint planning, task breakdown, code reviews, and performance feedback for your team.
Contribute hands-on to key development tasks and architecture decisions.
Recruit, mentor, and grow the data science engineering team.

We are looking for a Data Science Engineer to design and implement the decision-making logic of our Price Optimizer. You will focus on translating complex business rules into mathematical models and production-ready Python code.

Your primary mission is to build the "brain" of our system. You will work at the intersection of Data Science and Product, ensuring our simulation and optimization engines accurately reflect real-world pricing strategies and market dynamics. While you will write production code, you will rely on our Data Engineers for ETL pipelines orchestration and distributed compute scaling.

Responsibilities:

Implement Business Logic: Translate intricate pricing rules and commercial strategies into robust Python code and mathematical constraints.
Refine Optimization Models: Develop and tune the simulation and revenue management algorithms that drive our pricing recommendations.
Write Clean Code: Contribute high-quality, tested, and maintainable code to the core logic repositories.
Analyze & Improve: Use data to validate model behavior and identify edge cases where business rules clash with algorithmic outputs.
Collaborate: Partner with Solution Architects to define logic requirements and with Data Engineers to integrate your models into the Dagster pipelines.