לוח משרות דרושים איש ביג דאטה Big Data

we are looking for a we are looking for a.
he Data Engineering (DE) team is a Team that plays a significant role in the ongoing cloud technologies. The ideal candidate is a data engineer with a strong technical background in data infrastructure, data architecture design and robust data pipes building. The candidate must also have collaborative abilities to interact effectively with Product managers, Data scientists, Onboarding engineers, and Support staff.
Responsibilities:
Deploy and maintain critical data pipelines in production.
Drive strategic technological initiatives and long-term plans from initial exploration and POC to going live in a hectic production environment.
Design infrastructural data services, and to build scalable data solutions.
Work in Agile process with Product Managers and other tech teams.
End-to-end responsibility for the development of data crunching and manipulation processes within the product.
Design and implement data pipelines and data marts.
Create data tools for various teams (e.g., onboarding teams) that assist them in building, testing, and optimizing the delivery of the product.
Explore and implement new data technologies to support data infrastructure.

Were looking for a sharp and driven Data Analyst to join our fast - paced Data Labs team. As part of a high-performing group of analysts, youll handle complex, custom requests from some of the biggest names in the market, turning raw data into strategic, ad hoc insights. The work is intense and constantly evolving - it requires strong analytical skills and the ability to work independently under pressure. Youll need to be curious, adaptable, and willing to dive deep to find answers where others might stop. If you thrive in a demanding environment and are excited by the opportunity to make a real impact, we want you on our team.
What does the day to day of a Big Data Analyst Customer Facing (Data Labs) look like:
Building custom-made reports end to end - from meeting with the client and understanding their needs, to writing the code and setting up the report for ongoing delivery.
Apply your expertise in quantitative analysis and data mining to turn data into insights.
Conduct research and develop tools which will help answer client's business. questions by using raw data sets and algorithms.
Partner with Engineering teams to establish an infrastructure to scale solutions.
Partner with Advisory Services team of Consultants to answer strategic business questions and deliver custom data products seamlessly

We are looking for an experienced DBA to join our team!

Responsibilities:

Acting as the focal point for all MongoDB-related issues, including reviewing any configuration or setup changes.
Maintain and support MongoDB databases in both Atlas & on-prem!
Maintain and support SQL Server & Postgres databases in both on-prem & AWS.
Monitor the systems health and performance.
Advising software engineers on SQL queries and schema design strategies!
Minimise database downtime and manage HA/DR.
Plan for long-term scalability and architecture planning.
Implement changes, apply patches, and versions when required.
Assist in applying extraction pipelines from MongoDB & SQL Server.
Be part of the On-Call cycle.

we are looking for a Applied AI Data Scientist.
What Youll Do:
Devise, initiate, manage and execute cutting-edge exploration and exploitation projects.
Apply your knowledge of Data Science, Machine Learning and AI-driven algorithms to create scalable data solutions.
Analyze extremely large (petabytes) and diverse datasets to solve complex problems, and develop automated, intelligent systems to address them.
Design, build and deploy AI/ML models (including predictive models, recommendation systems and generative AI solutions) to drive business impact.
Leverage modern AI tools and frameworks to accelerate research and production workflows.
Proactively seek growth opportunities aligned with core KPIs.
Enable real-time and near real-time data insights - instant data gratification guaranteed.

we are looking for a Big Data Software Engineer.
What you'll do:
You will join the Traffic Team, a core engineering team operating at the heart of the company's measurement system.
You will Build and maintain high-throughput streaming systems processing 100B+ daily events.
Tackle performance and optimization challenges that make interview questions actually relevant
Design and implement real-time data processing pipelines using Kafka, Databricks/Spark, and distributed computing
Lead projects end-to-end: design, development, integration, deployment, and production support

We are looking for developers interested in joining exciting and innovative bigdata projects
This is a great opportunity for individuals seeking to develop solutions to the most challenging problems in the bigdata field, dealing with operational requirements while using cutting edge technologies.

A fast-growing fintech AI start-up company, focused on eliminating fraud and chargebacks in online commerce, is looking for an experienced Senior Data Engineer.

In this Roll, you will build large-scale, cutting-edge data solutions for fraud prevention, with the potential to grow into a technical leadership role.

The company is located in Modi'in, central Israel. Hybrid work model.



Responsibilities

Build and maintain scalable data pipelines and ETL processes.
Design complex data models and optimize data architecture.
Collaborate with teams to deliver high-quality, compliant solutions.
Troubleshoot production issues and implement best practices.
Recommend new technologies to enhance the data infrastructure.

abra R&D is looking for a Data Scientist! abra R&D is looking for a Data Scientist who will take part in building the next?generation Database built from scratch for AI Agents agentic analytics platform that enables data?driven decision making on large?scale, real?time data. The product focuses on extracting insights, understanding patterns, and supporting decisions through advanced analytics, experimentation, and statistical modeling. The Data Scientist role focuses on analysis, modeling, experimentation, and insights , rather than low?level algorithm or infrastructure development. What you’ll do:
* Analyze large?scale structured and unstructured datasets to extract actionable insights
* Build and evaluate statistical and machine learning models to support analytics and decision systems
* Apply causal inference methodologies to understand relationships in data and measure impact
* Develop time?series models for forecasting, trend analysis, and anomaly detection
* Define statistical methodologies used across analytics and decision?making processes
* Design and analyze experiments (A/B tests, uplift modeling, evaluation frameworks)
* Create data?driven feedback loops to improve product decisions
* Collaborate with AI and engineering teams to translate analytical insights into product features
* Communicate findings clearly to technical and non?technical stakeholders

Own accuracy and coverage of detection capabilities such as: technology fingerprinting, SSO/login identification, vulnerability-to-technology mapping
Build AI-powered workflows (LLM classifiers, automated rule generation) to scale detection beyond manual rule-writing
Design eval frameworks and feedback loops - golden datasets, precision/recall tracking, regression testing - to keep quality high as automation grows
Tune IP/domain discovery logic: decision rules, blacklists, thresholds, unstructured data parsing
Extend BI pipelines and schemas to enrich asset data
Investigate customer-reported detection gaps; root-cause and fix systematically

We are looking for an Experienced Big Data Engineer who loves solving complex problems at an extreme scale. In this role, you arent just building "internal pipelines"-you are developing the actual product our clients interact with. You will write high-performance code, optimize your own Spark processes for client freshness, and own features end-to-end. We need a "problem solver by nature, optimizer in their soul" who brings both technical depth and a great personality to a high-speed, deep technical team.

What youll do:
Build Client-Facing Features: Design and implement high-scale product features for our premium clients - from architecture to production deployment.
Performance Engineering: Optimize scalable data pipelines and distributed processes to meet strict client SLAs. Every millisecond of freshness matters.
System Integrity: Ensure uncompromising data accuracy and performance across massive, complex datasets.
Strategic Collaboration: Partner with upstream data providers, client-side teams, and Product Managers to turn raw events into production-grade features.

We're looking for a Data Engineer with 4+ year experience to join our Data Engineering team and help us build and scale our production-grade data platform. You'll work on high-performance systems built on self-hosted ClickHouse, optimize complex data pipelines, and collaborate closely with Product, Analytics, and Infrastructure teams to deliver reliable, fast, and scalable data solutions.

This is a hands-on technical role where you'll have a significant impact on how we ingest, model, store, and serve data that powers our analytics and AI-driven products.
Youll play a key role in shaping the direction of our data platform and have meaningful ownership over critical components of our architecture.

What You'll Do:
Data Modeling & Architecture
Design and evolve data models that reflect business logic and support analytical use cases
Collaborate with the BI and Analytics teams to understand data requirements and translate them into efficient schemas
Performance Optimization
Optimize ClickHouse schemas, partitioning strategies, indexing, and compression
Profile and tune slow queries to improve performance and reduce costs
Implement systems that ensure data quality, consistency, and operational efficiency (e.g., deduplication, validation, anomaly detection)
Monitor pipeline health, data freshness, and query performance with appropriate alerting mechanisms
SQL Compiler Development
Develop and maintain the SQL Compiler layer that translates high-level queries into optimized ClickHouse execution plansImplement query optimization and rewriting strategies to improve performanceDebug and resolve compiler issues to ensure accurate and efficient query translation

Data Pipeline Development & Collaboration
Review and advise the Integration team on pipeline architecture, performance, and best practices.
Provide guidance on data modeling, schema design, and optimization for new data sources.
Troubleshoot and maintain existing pipelines when issues arise or optimization is needed
Ensure data freshness, reliability, and quality across all ingestion pipelines.
Collaboration & Support
Work closely with the Integration team to ensure smooth data ingestion from new sources.
Partner with Infrastructure to support high availability and disaster recovery
Support other teams across the company in accessing and using data effectively.

Our culture of proactiveness and a customer-centric mindset guides us to create a unified platform that makes data science and analytics accessible to everyone. We aim to inspire our customers to make informed decisions that push their business forward. We provide a user-friendly and intuitive platform that makes it easy to turn insights into action and fosters a culture of creativity, experimentation, and continuous improvement.
You will be an essential part of this mission, using your technical expertise to demonstrate how our Data and Intelligence Platform can help customers solve their complex data challenges.
You'll work with a collaborative, customer-focused team that values innovation and creativity. You'll use your skills to create customized solutions to help our customers achieve their goals and guide their businesses forward.
Join us in our quest to change how people work with data and make a better world!
The impact you will have:
Form successful relationships with clients throughout your assigned territory, providing technical and business value to our customers in collaboration with Account Executives.
Operate as an expert in big data analytics to excite customers about our company. You will develop into a champion and trusted advisor on multiple issues of architecture, design, and implementation to lead to the successful adoption of the company Data Intelligence Platform.
Scale best practices in your field and support customers by authoring reference architectures, how-tos, and demo applications, and help build the company community in your region by leading workshops, seminars, and meet-ups.
Grow your knowledge and expertise to the level of a technical and/or industry specialist.