לוח משרות דרושים איש ביג דאטה Big Data במרכז

abra professional services is seeking for an senior data engineer. We are seeking a Senior Data Engineer to lead the technical development of our Data Fabric within a military program. This role involves technical leadership in building contextual data pipelines, working with big data lakehouse architectures, and driving data pipeline automation.

As our Senior Data Engineer you will handle Big Data in real time, and become the owner and gatekeeper of all data and data flows within the company. You will bring data ingenuity and technological excellence while gaining a deep business understanding.

This is an amazing opportunity to join a multi-disciplinary A-team while working in a fast-paced, modern cloud, data-oriented environment.



What Youll Do:

Implement robust, reliable and scalable data pipelines and data architecture.
Own and develop DWH (Petabytes of data!).
Own the entire data development process, including business knowledge, methodology, quality assurance, and monitoring.
Collaborate with cross-functional teams to define, design, and ship new features.
Continuously discover, evaluate, and implement new technologies to maximize development efficiency.
Develop tailormade solutions as part of our data pipelines.
Lead complex Big Data projects and build data platforms from scratch.
Work on a high-scale, real-time, real-world business-critical data stores and data endpoints.
Implement data profiling to identify anomalies and maintain data integrity.
Work in a results-driven, high-paced, rewarding environment.

This is a great opportunity to be part of one of the fastest-growing infrastructure companies in history, an organization that is in the center of the hurricane being created by the revolution in artificial intelligence.
We are seeking an experienced Solutions Data Engineer who possess both technical depth and strong interpersonal skills to partner with internal and external teams to develop scalable, flexible, and cutting-edge solutions. Solutions Engineers collaborate with operations and business development to help craft solutions to meet customer business problems.
A Solutions Engineer works to balance various aspects of the project, from safety to design. Additionally, a Solutions Engineer researches advanced technology regarding best practices in the field and seek to find cost-effective solutions.
Job Description:
Were looking for a Solutions Engineer with deep experience in Big Data technologies, real-time data pipelines, and scalable infrastructure-someone whos been delivering critical systems under pressure, and knows what it takes to bring complex data architectures to life. This isnt just about checking boxes on tech stacks-its about solving real-world data problems, collaborating with smart people, and building robust, future-proof solutions.
In this role, youll partner closely with engineering, product, and customers to design and deliver high-impact systems that move, transform, and serve data at scale. Youll help customers architect pipelines that are not only performant and cost-efficient but also easy to operate and evolve.
We want someone whos comfortable switching hats between low-level debugging, high-level architecture, and communicating clearly with stakeholders of all technical levels.
Key Responsibilities:
Build distributed data pipelines using technologies like Kafka, Spark (batch & streaming), Python, Trino, Airflow, and S3-compatible data lakes-designed for scale, modularity, and seamless integration across real-time and batch workloads.
Design, deploy, and troubleshoot hybrid cloud/on-prem environments using Terraform, Docker, Kubernetes, and CI/CD automation tools.
Implement event-driven and serverless workflows with precise control over latency, throughput, and fault tolerance trade-offs.
Create technical guides, architecture docs, and demo pipelines to support onboarding, evangelize best practices, and accelerate adoption across engineering, product, and customer-facing teams.
Integrate data validation, observability tools, and governance directly into the pipeline lifecycle.
Own end-to-end platform lifecycle: ingestion → transformation → storage (Parquet/ORC on S3) → compute layer (Trino/Spark).
Benchmark and tune storage backends (S3/NFS/SMB) and compute layers for throughput, latency, and scalability using production datasets.
Work cross-functionally with R&D to push performance limits across interactive, streaming, and ML-ready analytics workloads.

Were looking for an experienced Data Engineer to join our DEX Platform and help drive the next stage of our growth. In this role, youll design, build, and scale data infrastructure and advanced processing pipelines that power real-time insights and intelligent automation across our platform.

As a senior data engineer, youll own the full service lifecycle-from architecture and development to deployment, monitoring, and scaling-while ensuring data quality, reliability, and compliance. Youll work closely with backend, AI, and data teams to deliver robust, production-ready systems that support our AI-first strategy and our mission to make the workplace run itself.

We are looking for a talented and experienced big data engineer to join our cyber defence group to take over a cutting-edge data solution.

The successful candidate should have hands-on experience with big data processing technologies and architectures.

The candidate will join our growing team of analysts, developers, data scientists, and architects who design and develop innovative solutions to the most critical needs of our customers.

Responsibilities:
Designing, architecting, implementing, and supporting our data pipelines and processing flows.
Collaborate with analytics department to analyze and understand data sources.+
Provide insights and guidance on database technology and data modelling best practices.
Insure the maintenance of data integrity, managing data and analysis flows with attention to detail and high responsibility.
Implementing algorithms with our data scientists.

We are looking for an Experienced Big Data Engineer who loves solving complex problems at an extreme scale. In this role, you arent just building "internal pipelines"-you are developing the actual product our clients interact with. You will write high-performance code, optimize your own Spark processes for client freshness, and own features end-to-end. We need a "problem solver by nature, optimizer in their soul" who brings both technical depth and a great personality to a high-speed, deep technical team.

What youll do
Build Client-Facing Features: Design and implement high-scale product features for premium clients - from architecture to production deployment.
Performance Engineering: Optimize scalable data pipelines and distributed processes to meet strict client SLAs. Every millisecond of freshness matters.
System Integrity: Ensure uncompromising data accuracy and performance across massive, complex datasets.
Strategic Collaboration: Partner with upstream data providers, client-side teams, and Product Managers to turn raw events into production-grade features.

As a Cloud Architect, you will serve as a technical focal point, driving strategic architectural decisions that shape the future of our globally distributed platform.
Platform & Scale Leadership: Lead the architectural efforts to modernize and significantly scale the companys infrastructure across multiple geographies and heterogeneous cloud providers.
Cross-Organizational Influence: Work with other groups in the organization to deeply understand their needs and translate them into concrete, production-ready capabilities and platform offerings.
Multi-Cloud Data Strategy: Define and champion a comprehensive, petabyte-scale multi-cloud data strategy, ensuring optimal data governance, security, and cost-efficient flow for streaming ingestion, data lakes, and advanced analytics workloads across environments.
Microservices Design & Resilience: Provide high-level architectural oversight for the multi-cloud design patterns of our microservices, focusing on cross-cloud resilience, global traffic management, data locality, and failure domain isolation.
AI Transformation Leadership: Lead the AI transformation initiatives aimed at radically enhancing the developer experience, introducing intelligent automation, and leveraging generative AI models to accelerate software delivery, testing, and operational efficiency.
Strategic Alignment: Foster cross-group alignment and build consensus among engineering leaders and business stakeholders for strategic platform projects, translating complex technical roadmap items into clear, measurable business outcomes.
Architecture Definition: Help define the technical vision, architecture, and long-term directions of the Cloud Platform group and the wider R&D organization.
Engineering Excellence: Be a champion for engineering excellence, setting high standards, mentoring engineers across the group to foster solid architectural principles, and supporting their professional growth.
Architect Forum Participation: Be a key member of the companys architect forum, participate in complex technical discussions, and facilitate effective, org-wide decision-making processes.

Join a core team of experts responsible for developing innovative cyber-attack techniques for Cloud-based environments (AWS, Azure, GCP, Kubernetes) that integrate into fully automated attack simulation.
This role provides the opportunity to lead end-to-end design & implementation of advanced server-side features using a wide range of technologies: Apache Spark, Apache Airflow, Scala, k8s, Node.js (JS/Typescript) with MongoDB, Redis, Kafka, Dockers and Flink (Big Data Stream Processing)
If you are up for the challenge and you have , come and join us!

We are seeking engineers with hands-on experience in developing and managing distributed systems and microservices in a production environment. The ideal candidate should have a solid background in infrastructure and operations.
The team builds high-throughput ingestion and processing pipelines, efficient storage on object stores, and systems for data governance, usage reporting, and routing data to multiple physical locations.
You will work on cloud-native, production systems written in Rust and Scala, operating at scale with Kafka, Postgres, Redis, and object storage, run on Kubernetes and operate in a multi-cloud environment.
Responsibilities:
Develop and operate distributed systems in production
Build Kafka-based ingestion and processing pipelines
Design systems for data governance, retention, deletion, and usage reporting
Work with Postgres and Redis, requiring solid database design and operational knowledge
Implement efficient persistence using column-oriented data formats and object storage

We are looking for an Algo-Dev Engineer to join one of our research teams. You will be working closely with our researchers, assisting them in achieving their research objective while developing tools and optimizing models in both offline and online environments.
Areas of responsibility include data-handling, deep dive into algo code, design, implementation, and deployment of technologies designed to enable innovative algo-trading projects and support existing and ongoing initiatives.
In this role you will :
Contribute to the continuous evolution and optimization of our internal deep algorithms, bridging the gap between theoretical research and production-ready implementations

We are looking for a Big Data Software Engineer to join our growing team. In this role, you will be responsible to design and development of our big data processing engine.

Responsibilities
Design and development of high-quality big data processing engineer

Identify and proactively address potential product risks and challenges and ensuring success

Work closely with stakeholders to transform requirements into technical specifications

Ensure that the code is consistent with industry coding standards and best practices

Take a deep dive into the technical details and provide expert advice and solutions

seeking a talented Site Reliability Engineer to join our team in Israel. Our SRE team is responsible for the design, creation, and maintenance of our healthcare data platform hosted on multiple cloud/on-prem environments. This is an amazing opportunity to work with a world-class technical team and to be responsible for designing, creating, and provisioning infrastructure as well as deploying and maintaining applications with a focus on infrastructure as code We aim to adopt the best solutions to fulfill our requirements. Join us in solving complex challenges in the healthcare data industry. So, if you want to grow with us and work for a world leader company, now is the right time to join.
What You'll Do
Ensure high uptime and reliability of Crossixs production environment, on-prem and cloud
Take responsibility for managing the production environment, security, change management, deployment, architecture, and tools
Perform root cause analysis for complex failures and offer modern solutions and tools
Lead technical discussions with our health data partners in the USA
Analyze performance and stability issues and create in-house automation tooling
Work closely with DevOps, R&D, product, and project managers to enable automated CI/CD methods
Design, develop, and drive troubleshooting & mitigation tools as part of driving self-healing agenda
Constantly improve the technology stack, supporting the data growth and the customers requirements
Working in a data-driven company with cutting-edge environments that combines multiple cloud technologies

We are looking for a talented and dedicated Data Analyst - ML & Big Data who will be a part of the Core Data group.
As part of this role, you will help us process and streamline rich and complicated datasets. Will explore and validate new data sources. Be part of the data science and data engineering force creating new features for our solution.
What does the day-to-day of a Data Analyst - ML & Big Data look like:
Apply your expertise in quantitative analysis and data mining to turn data into insights.
Conduct research and develop tools that will ensure the quality of data and algorithms.
Utilize your deep understanding of data in order to evaluate and improve novel algorithms produced by the data scientists in your team.
Partner with Big Data Engineers to establish an infrastructure to scale solutions.

Were looking for a Senior Data Engineer in the Data Collection Ingest team to contribute to the design and coding of data ingestion services & pipelines. This role involves working as part of a team that handles millions of requests per minute across multiple servers, and is responsible for a wide-range of data pipelines, processing billions of events each day.
Why is this role so important?
As the most trusted platform for measuring online behavior, millions of people rely on insights daily as the ground truth for their knowledge of the digital world. Producing these insights requires large scale raw data to be ingested reliably in high scale to provide stable signals for analysis. As a Data Engineer you will have the opportunity to perform hands-on work and own raw data ingestion pipeline end-to-end. Your work will have a direct impact on the quality and reliability of our data and the insights that our products are delivering to our customers.

Were looking for a Big Data Engineer to develop and integrate systems that retrieve, process and analyze data from around the digital world, generating customer-facing data. This role will report to our Team Manager, R&D.
Why is this role so important?
we are a data-focused company, and data is the heart of our business.
As a big data engineer developer, you will work at the very core of the company, designing and implementing complex high scale systems to retrieve and analyze data from millions of digital users.
Your role as a big data engineer will give you the opportunity to use the most cutting-edge technologies and best practices to solve complex technical problems while demonstrating technical leadership.