דרושים » תוכנה » Senior Software Engineer - Distributed Systems Quality Platform

Reqired Staff Software Engineer - Distributed Systems Quality Platform
About the role:
Were building the next-generation testing platform that will redefine how complex distributed systems are validated at scale. Our mission is to create an automated, intelligent testing environment that continuously validates the correctness, performance, and resilience of the Data Platform across every layer of the stack. This is an opportunity to reinvent how next-gen infrastructure is tested, leveraging both proven engineering techniques and the latest AI-driven approaches. Youll work on solving some of the hardest challenges in large-scale systems engineering: How do you validate correctness in deeply parallel I/O systems? How do you uncover reliability gaps that appear only under extreme concurrency? How can AI tools help us automatically generate test scenarios, analyze failures, and predict weak spots before they occur?
As a Staff Software Engineer, youll be at the center of these questions. Youll set the technical direction, design testing frameworks that scale with our product, and partner across engineering to raise the bar for quality.
What Youll Do:
Design and implement a next-generation testing and quality framework for distributed systems, enabling automated validation of functionality, performance, and resilience.
Leverage AI-driven tools to scale the testing environment, including automated test generation, intelligent workload synthesis, and anomaly detection.
Create end-to-end testing environments that simulate real-world scale, stress, and failure conditions.
Define and drive the technical strategy for testing across, setting the standard for quality engineering.
Mentor and influence engineers across teams, fostering a culture of technical rigor and reliability obsession.
Collaborate with product and infrastructure teams to ensure the testing platform is deeply integrated into our development lifecycle.

We are seeking an experienced Solutions Data Engineer who possess both technical depth and strong interpersonal skills to partner with internal and external teams to develop scalable, flexible, and cutting-edge solutions. Solutions Engineers collaborate with operations and business development to help craft solutions to meet customer business problems.
A Solutions Engineer works to balance various aspects of the project, from safety to design. Additionally, a Solutions Engineer researches advanced technology regarding best practices in the field and seek to find cost-effective solutions.
Job Description:
Were looking for a Solutions Engineer with deep experience in Big Data technologies, real-time data pipelines, and scalable infrastructuresomeone whos been delivering critical systems under pressure, and knows what it takes to bring complex data architectures to life. This isnt just about checking boxes on tech stacksits about solving real-world data problems, collaborating with smart people, and building robust, future-proof solutions.
In this role, youll partner closely with engineering, product, and customers to design and deliver high-impact systems that move, transform, and serve data at scale. Youll help customers architect pipelines that are not only performant and cost-efficient but also easy to operate and evolve.
We want someone whos comfortable switching hats between low-level debugging, high-level architecture, and communicating clearly with stakeholders of all technical levels.
Key Responsibilities:
Build distributed data pipelines using technologies like Kafka, Spark (batch & streaming), Python, Trino, Airflow, and S3-compatible data lakesdesigned for scale, modularity, and seamless integration across real-time and batch workloads.
Design, deploy, and troubleshoot hybrid cloud/on-prem environments using Terraform, Docker, Kubernetes, and CI/CD automation tools.
Implement event-driven and serverless workflows with precise control over latency, throughput, and fault tolerance trade-offs.
Create technical guides, architecture docs, and demo pipelines to support onboarding, evangelize best practices, and accelerate adoption across engineering, product, and customer-facing teams.
Integrate data validation, observability tools, and governance directly into the pipeline lifecycle.
Own end-to-end platform lifecycle: ingestion → transformation → storage (Parquet/ORC on S3) → compute layer (Trino/Spark).
Benchmark and tune storage backends (S3/NFS/SMB) and compute layers for throughput, latency, and scalability using production datasets.
Work cross-functionally with R&D to push performance limits across interactive, streaming, and ML-ready analytics workloads.
Operate and debug object storebacked data lake infrastructure, enabling schema-on-read access, high-throughput ingestion, advanced searching strategies, and performance tuning for large-scale workloads.

Required Senior Software Engineer
Tel Aviv
About the role:
As a Senior Software Engineer on the Data Platform, youll be part of one of our most strategic engineering groups, tasked with building the core data ingestion and processing infrastructure that powers our entire platform. The team is responsible for handling billions of cloud signals daily, ensuring scalability, reliability, and efficiency across our architecture.
Youll work on large-scale distributed systems, own critical components of the cloud security data pipeline, and drive architectural decisions that influence how data is ingested, normalized, and made available for product teams across. Were currently in the midst of a major architectural transformation, evolving our ingestion and processing layers to support real-time pipelines, improved observability, and greater horizontal scalability, and were looking for experienced engineers who are eager to make foundational impact!
Our Stack: Python, Go, Rust, SingleStore, Postgres, ElasticSearch, Redis, Kafka, AWS
On a typical day youll:
Write clean, concise code that is stable, extensible, and unit-tested appropriately
Write production-ready code that meets design specifications, anticipates edge cases, and accounts for scalability
Diagnose complex issues, evaluate, recommend and execute the best solution
Implement new requirements within our Agile delivery methodology while following our established architectural principles
Lead initiatives end to end from design and planning to implementation and deployment, while aligning cross-functional teams and ensuring technical excellence
Test software to ensure proper and efficient execution and adherence to business and technical requirements
Provides input into the architecture and design of the product; collaborating with the team in solving problems the right way
Develop expertise of AWS, Azure, and GCP products and technologies.

This role has been designed as Hybrid with an expectation that you will work on average 2 days per week from an HPE office.
Job Description:
We are looking for a highly skilled Senior Data Engineer with strong architectural expertise to design and evolve our next-generation data platform. You will define the technical vision, build scalable and reliable data systems, and guide the long-term architecture that powers analytics, operational decision-making, and data-driven products across the organization.
This role is both strategic and hands-on. You will evaluate modern data technologies, define engineering best practices, and lead the implementation of robust, high-performance data solutionsincluding the design, build, and lifecycle management of data pipelines that support batch, streaming, and near-real-time workloads.
What Youll Do
Architecture & Strategy
Own the architecture of our data platform, ensuring scalability, performance, reliability, and security.
Define standards and best practices for data modeling, transformation, orchestration, governance, and lifecycle management.
Evaluate and integrate modern data technologies and frameworks that align with our long-term platform strategy.
Collaborate with engineering and product leadership to shape the technical roadmap.
Engineering & Delivery
Design, build, and manage scalable, resilient data pipelines for batch, streaming, and event-driven workloads.
Develop clean, high-quality data models and schemas to support analytics, BI, operational systems, and ML workflows.
Implement data quality, lineage, observability, and automated testing frameworks.
Build ingestion patterns for APIs, event streams, files, and third-party data sources.
Optimize compute, storage, and transformation layers for performance and cost efficiency.
Leadership & Collaboration
Serve as a senior technical leader and mentor within the data engineering team.
Lead architecture reviews, design discussions, and cross-team engineering initiatives.
Work closely with analysts, data scientists, software engineers, and product owners to define and deliver data solutions.
Communicate architectural decisions and trade-offs to technical and non-technical stakeholders.

We are looking for a highly talented technical individual to join the Cortex XDR infrastructure team.
The team is responsible for developing automation infrastructure and various cloud based tools and platforms that are used across the research, development and QA departments to ensure the functionality, stability and quality of the XDR product, alongside the efficiency of the infrastructure and process used to build, test and deploy on various clouds and distributions. We believe that the platforms & infrastructure that the team provides are a critical & crucial part of our department's progress to the modern future and one of our key growth factors.
As a Platform engineer you will play a pivotal role in enhancing our development and automation experience by pushing forward modern automation approaches, eliminating manual efforts and introducing new development operations for continuous integration, scale & durability using advanced cloud services. Your expertise will be used in areas such as infrastructure development, cloud based automation, serverless infrastructure, automation as a service, providing technical guidance, and pushing infrastructure\configuration as a code and GitOps approach across the development departments.
To succeed in this role, you should have a strong foundation in modern cloud based automation methodologies and a comprehensive understanding of industry best practices, especially in redundancy and scalability of large systems and the ability to control them via SCM based declarative configs. You should be familiar with modern public clouds approaches and serverless based architectures, including virtualization containers and container based orchestration including multiple Kubernetes based deployments. You should be comfortable engaging in complex technical discussions and advocating for optimal solutions in a fast-paced growing environment as part of our quest for continuous improvement.
Your Impact
Utilize modern technologies including serverless cloud services, Kubernetes, Terraform, among others, and use them all in an infrastructure/configuration as a code GItOps approach to manage everything via source code and continuous integration processes
Design and implement (hands on) the next generation of platforms, automation frameworks, SDKs, and tools to be used across our entire R&D group, and be part of our infrastructure transition to the cloud
Develop and maintain a cloud based test execution system, that supports parallel executions on multiple operating systems and multiple cloud providers and at a very large scale, and by so helping reduce the amount of effort required to perform automatic testing and manual testing, and reduce time to market
Provide tools, systems and simulators for scaling up all lifecycle phases of our products and services including cross company and third party integrations and frameworks to be used in high scale
Introduce progress and help revolutionize our operations and lay the foundation for innovation and growth.

Required Senior Algo Data Engineer
Realize your potential by joining the leading performance-driven advertising company!
As a Senior Algo Data Engineer on the Infra group, youll play a vital role in develop, enhance and maintain highly scalable Machine-Learning infrastructures and tools.
About Algo platform:
The objective of the algo platform group is to own the existing algo platform (including health, stability, productivity and enablement), to facilitate and be involved in new platform experimentation within the algo craft and lead the platformization of the parts which should graduate into production scale. This includes support of ongoing ML projects while ensuring smooth operations and infrastructure reliability, owning a full set of capabilities, design and planning, implementation and production care.
The group has deep ties with both the algo craft as well as the infra group. The group reports to the infra department and has a dotted line reporting to the algo craft leadership.
The group serves as the professional authority when it comes to ML engineering and ML ops, serves as a focal point in a multidisciplinary team of algorithm researchers, product managers, and engineers and works with the most senior talent within the algo craft in order to achieve ML excellence.
How youll make an impact:
As a Senior Algo Data Engineer, youll bring value by:
Develop, enhance and maintain highly scalable Machine-Learning infrastructures and tools, including CI/CD, monitoring and alerting and more
Have end to end ownership: Design, develop, deploy, measure and maintain our machine learning platform, ensuring high availability, high scalability and efficient resource utilization
Identify and evaluate new technologies to improve performance, maintainability, and reliability of our machine learning systems
Work in tandem with the engineering-focused and algorithm-focused teams in order to improve our platform and optimize performance
Optimize machine learning systems to scale and utilize modern compute environments (e.g. distributed clusters, CPU and GPU) and continuously seek potential optimization opportunities.
Build and maintain tools for automation, deployment, monitoring, and operations.
Troubleshoot issues in our development, production and test environments
Influence directly on the way billions of people discover the internet
Our tech stack:
Java, Python, TensorFlow, Spark, Kafka, Cassandra, HDFS, vespa.ai, ElasticSearch, AirFlow, BigQuery, Google Cloud Platform, Kubernetes, Docker, git and Jenkins.

A leading large-scale ad network at the forefront of advertising technology. We are looking for a highly skilled and experienced Senior Software Engineer to join our backend team.
In this role, you will leverage your expertise in distributed systems, data engineering, and software development to design, build, and deploy high-performance solutions. You will take a leading role in developing and maintaining a cutting-edge online machine learning system powered by PyTorch/Tensorflow models and Triton inference server.
This is an opportunity to work on complex, large-scale systems that serve billions of requests, shaping the future of ad tech and ML-driven optimization.
What you'll be doing
Architect and Build: Design, develop, and deploy robust, scalable, and high-performance distributed systems that form the backbone of ironSource's next-generation ML ad network.
Real-Time Ad Serving: Engineer and optimize critical systems for real-time ad serving, enabling machine learning models to make intelligent, low-latency decisions for optimal ad selection.
ML Infrastructure Innovation: Drive the evolution of our ML capabilities by researching, evaluating, and implementing cutting-edge techniques for feature stores, data aggregation, and model serving infrastructure.
Data Pipeline Engineering: Collaborate closely with data scientists and product managers to design, build, and maintain efficient and reliable data lakes and data pipelines, ensuring high-quality data for ML training and analytics.
Operational Excellence: Take ownership of key system components, ensuring their reliability, performance, and scalability in a production environment through proactive monitoring and continuous improvement.

We have improved AI infrastructure by merging GPU virtualization with Kubernetes-native tech to power innovative AI factories. We aim to speed up enterprise AI projects with smart orchestration, and scalability for AI workloads. Seeking a skilled Senior Software Engineer for our Infrastructure Group to innovate AI technology. The Infrastructure Group is tasked with composing and evolving the core systems responsible for thousands of GPUs and nodes driving enterprise AI. We invent the foundation that facilitates elastic, secure, and observable AI operations at extensive scale. We are seeking engineers who are passionate about distributed systems, modern cloud-native infrastructure, and AI performance optimization.

What youll be doing:

Crafting and developing enterprise-grade systems with a strong focus on scalability, reliability, and performance.

Building and optimizing microservices-based architectures using Kubernetes and cloud-native technologies.

Collaborating closely with backend engineers, product managers, and other partners to deliver impactful solutions.

Writing clean, maintainable, and testable code in Go, contributing to our CI/CD pipelines.

Conducting code and build reviews to uphold high-quality standards and mentor team members.

Leading the development and implementation of advanced identity management systems that secure our innovative AI and GPU cloud.

Developing scalable multi-tenant solutions that allow our diverse clientele to harness the power of our platforms securely and efficiently.

Collaborating with multi-functional teams to integrate identity and access management features seamlessly into our products, from cloud services to edge computing devices.

Required Senior Software Engineer KSPM Team
About the role
As a Senior Software Engineer on the KSPM (Kubernetes Security Posture Management) team, youll be part of a mission-critical group responsible for building and scaling one of the companys fastest-growing products. Our team helps customers secure their Kubernetes environments across major cloud providers by offering deep visibility into misconfigurations, compliance risks, and security best practices.
Youll contribute to a high-impact codebase that scans, analyzes, and interprets complex Kubernetes configurations and behaviors at scale. This is a unique opportunity to shape the future of our KSPM product owning core backend components, driving architectural improvements, and delivering features that address real-world customer needs.
Were looking for engineers who are passionate about infrastructure, cloud security, and solving challenging problems at scale, and who want to make a meaningful impact on the security of modern, cloud-native systems.
Our Stack: Python, Go, K8s APIs, SingleStore, Postgres, Redis, Kafka, AWS, GCP, Azure, ElasticSearch
On a typical day youll
Design, implement, and maintain scalable backend services for onboarding, scanning, and analyzing Kubernetes environments
Collaborate with security researchers and product managers to translate complex requirements into impactful product features
Write clean, efficient, and testable code, ensuring high performance and reliability
Participate in design and code reviews to uphold technical excellence and team standards
Lead features end-to-end from design and planning to deployment and monitoring
Improve system observability, performance, and resilience in production environments
Work closely with cross-functional teams to continuously enhance product capabilities and customer value
Stay current with developments in the Kubernetes ecosystem and cloud security landscape.

As part of the Data Infrastructure team, youll help build data platform for our growing stack of products, customers, and microservices.

Our platform ingests and processes data from operational databases, telematics, and diverse product sources. Youll build robust backend services and data processing pipelines, leveraging state-of-the-art frameworks and cloud-native solutions, all while collaborating with Data Engineers, ML Engineers, Analysts, and Product Managers to turn real-world needs into resilient systems.

In this role youll:
Design & Develop Backend Services: Lead the design and implementation of backend systems and APIs for our distributed data platform

Build Data Ingestion & Processing: Architect and develop scalable ingestion pipelines with streaming ETL, Change Data Capture, and large-scale batch and stream processing

Own Data Platform Infrastructure: Implement and optimize scheduling, workflow orchestration, and data governance tools to support high-quality, compliant data flows

Drive Engineering Standards: Establish and promote backend best practices, ensuring high reliability, code quality, and maintainability across the team

Cross-functional Collaboration: Work closely with data engineers, ML engineers, product managers, and analysts to translate business needs into scalable backend systems

Mentorship: Share your backend and infrastructure expertise by collaborating, reviewing, and mentoring fellow engineers.