דרושים » תוכנה » Big Data engineer

at the company, we are revolutionizing the way businesses interact with the digital world by revealing to them everything that happens online.
our unique data and solutions empower over 4,300 customers globally, including industry giants like google, meta, openai, to make game-changing decisions that drive their digital strategies. in 2021, we went public on the new york stock exchange, and we continue to reach new heights! come work alongside our teammates across the globe who are bright, curious, practical, and good people.
were looking for a sharp and driven data analyst to join our fast - paced data labs team. as part of a high-performing group of analysts, youll handle complex, custom requests from some of the biggest names in the market, turning raw data into strategic, ad hoc insights. the work is intense and constantly evolving - it requires strong analytical skills and the ability to work independently under pressure. youll need to be curious, adaptable, and willing to dive deep to find answers where others might stop. if you thrive in a demanding environment and are excited by the opportunity to make a real impact, we want you on our team.
what does the day to day of a Big Data analyst customer facing ( data labs) at the company look like:
building custom-made reports end to end - from meeting with the client and understanding their needs, to writing the code and setting up the report for ongoing delivery.
apply your expertise in quantitative analysis and data mining to turn data into insights.
conduct research and develop tools which will help answer client's business. questions by using the company's raw data sets and algorithms.
partner with engineering teams to establish an infrastructure to scale solutions.
partner with advisory services team of consultants to answer strategic business questions and deliver custom data products seamlessly
this is the perfect job for someone who has:
analyzing billions of user-based events into meaningful insights for strategic clients.
why youll love being a team member:
youll actually love the product you work with: our customers arent our only raving fans. when we asked our employees why they chose to come work at the company, 99% of them said the product. imagine how exciting your job is when you get to work with the most powerful digital intelligence platform in the world.
youll find a home for your big ideas: we encourage an open dialogue and empower employees to bring their ideas to the table. youll find the resources you need to take initiative and create meaningful change within the organization.

We are seeking an experienced Solutions Data Engineer who possess both technical depth and strong interpersonal skills to partner with internal and external teams to develop scalable, flexible, and cutting-edge solutions. Solutions Engineers collaborate with operations and business development to help craft solutions to meet customer business problems.
A Solutions Engineer works to balance various aspects of the project, from safety to design. Additionally, a Solutions Engineer researches advanced technology regarding best practices in the field and seek to find cost-effective solutions.
Job Description:
Were looking for a Solutions Engineer with deep experience in Big Data technologies, real-time data pipelines, and scalable infrastructure-someone whos been delivering critical systems under pressure, and knows what it takes to bring complex data architectures to life. This isnt just about checking boxes on tech stacks-its about solving real-world data problems, collaborating with smart people, and building robust, future-proof solutions.
In this role, youll partner closely with engineering, product, and customers to design and deliver high-impact systems that move, transform, and serve data at scale. Youll help customers architect pipelines that are not only performant and cost-efficient but also easy to operate and evolve.
We want someone whos comfortable switching hats between low-level debugging, high-level architecture, and communicating clearly with stakeholders of all technical levels.
Key Responsibilities:
Build distributed data pipelines using technologies like Kafka, Spark (batch & streaming), Python, Trino, Airflow, and S3-compatible data lakes-designed for scale, modularity, and seamless integration across real-time and batch workloads.
Design, deploy, and troubleshoot hybrid cloud/on-prem environments using Terraform, Docker, Kubernetes, and CI/CD automation tools.
Implement event-driven and serverless workflows with precise control over latency, throughput, and fault tolerance trade-offs.
Create technical guides, architecture docs, and demo pipelines to support onboarding, evangelize best practices, and accelerate adoption across engineering, product, and customer-facing teams.
Integrate data validation, observability tools, and governance directly into the pipeline lifecycle.
Own end-to-end platform lifecycle: ingestion → transformation → storage (Parquet/ORC on S3) → compute layer (Trino/Spark).
Benchmark and tune storage backends (S3/NFS/SMB) and compute layers for throughput, latency, and scalability using production datasets.
Work cross-functionally with R&D to push performance limits across interactive, streaming, and ML-ready analytics workloads.
Operate and debug object store-backed data lake infrastructure, enabling schema-on-read access, high-throughput ingestion, advanced searching strategies, and performance tuning for large-scale workloads.

As a Senior Software Engineer your role will be to:

Play a key role in the design and architecture of cutting-edge, innovative data systems.
Develop and maintain a multi-tenant environment for our advanced measurement solutions.
Build and manage cloud-based, distributed computing environments to support scalable, high-performance operations.
Design and implement robust ETL workflows, integrating multiple data sources for cleaning, transformation, aggregation, and querying.
Troubleshoot and resolve complex issues related to data integration, storage, and retrieval.
Architect and build big data solutions capable of managing and automating the processing of tens of terabytes.
Optimize database performance and streamline query execution in large-scale environments.
Collaborate closely with Data Scientists to align technical solutions with data-driven objectives.