דרושים » הנדסה » Experienced Data Engineer

We are looking for a brilliant, quick-learner Data Engineer for our data engineering team - an independent logical thinker who understands the importance of data structuring for macro-business decisions.
The position combines high technical skills with business orientation, working closely with the analysts and the R&D team, and affecting the company's cross-departments decisions directly. Our Data Engineer should have the ability to speak in technical and practical terms, and more importantly, lead from one to the other, while dealing with challenges and creating them - to make our team even better than it is.
Roles and Responsibilities:
Creating and structuring end-to-end data pipelines & ETLs: from the source all the way to the analysts hands, enabling them the ideal conditions to make smart and data driven business decisions.
Cracking top industry data challenges while initiating and building creative technical solutions - in house Device Graph, Server-to-Server to multiple systems, Privacy challenges, Online-to-Offline and more.
Deep understanding of the business needs, technical requirements and the companys roadmap - and translating it into custom made data solutions and scalable products.
Craft code following best practices to ensure efficiency, while integrating CI/CD principles.
Writing multi-step scalable processes from more than 50 data sources - Marketing. Operations, CS, Product, CRM and more... tying them up to a valuable & useful source of insights for the analysts.
Understanding data challenges and weaknesses, and managing high standards monitoring and reliability processes.

We are looking for a Data Engineer.
Main responsibilities:
Provide the direction of our data architecture. Determine the right tools for the right jobs. We collaborate on the requirements and then you call the shots on what gets built.
Manage end-to-end execution of high-performance, large-scale data-driven projects, including design, implementation, and ongoing maintenance.
Monitor and optimize our (teams) cloud costs.
Design and construct monitoring tools to ensure the efficiency and reliability of data processes.

Lead the design, implementation, and ongoing management of our company's data pipeline architecture.
Lead team architectural discussions
Manage a team of 2-3 data engineers
Work as an integral part of the data team and work closely with data Scientists, data Analysts and data Engineers.
Work directly with others (Developers, Product, and Internal stakeholders) to develop a solid understanding of the business application and requirements for which the application is being designed.

Design, build, and launch data infrastructures that support multiple use cases across different products or domains.
Collaborate with engineers, product managers, data scientists, and other stakeholders to understand data needs.
Solve challenging data integration problems, utilizing optimal ETL patterns, frameworks, query techniques, and sourcing from structured and unstructured data sources.
Lead end-to-end data projects from infrastructure design to production monitoring and visualization.

Required Experienced Software Engineer, Demand
What are some of the things you do on a day-to-day basis?
Develop one of the largest real time big data operation in the world to support over 40TB of new data every day
Have end to end ownership: Design, build, ship, measure and maintain our frontend and backend services
Collaborate with the brightest software engineers team members
Influence directly on the way billions of people discover the internet
Develop at unimaginable scale, serving hundreds of requests per second
Work on innovative projects that are the next growth engines for us
Here are some of the things software developers in our group did in the last several months:
A unique data pipeline for processing and managing user data signals
Develop a complete user identities graph and find deterministic and probabilistic methods to enrich it
An algorithmic model to predict the performance potential of a specific audience
Infrastructure to create unique audiences for advertisers based on various signals (behavioral, contextual, etc)
An A/B tests system to explore variations and experiments over audiences
Understand and use big data algorithms to estimate key business metrics over billions of impressions
Build user interface using React that serve thousands of users
And many more
Our Tech Stack:
Java, JS, TS, Python, React, Spark, Kafka, Hadoop, Cassandra, Vertica, ES, MySQL, Memcached, HDFS, BigQuery, Kusto, Docker, K8S, Linux, Prometheus, Grafana, Airflow.

we are looking for a Performance Solution Architect to work with our globally distributed engineering team on internet-scale data lake analytics platform. This is our flagship product and offers incredible value-add on the already stellar performance of the open-source Trino software. This role provides you with the opportunity to directly contribute to the enhancement of performance. The role entails conducting performance analysis and comparing existing in-market solutions, formulating a comprehensive strategy for performance testing, analyzing the results, and offering appropriate recommendations for enhancing.

As a Data Performance Engineer
Be an expert in architecture and performance approaches
Partner closely with sales engineers, solutions, support, and engineering teams to deliver guidance on performance issues at any phase in the product life cycle.
Maintain a profound understanding of current market solutions and devise instrumentation and approaches for comparing them with the solution, paving the way for future enhancements to .
Collaborate with Product Management and Solution architects to continuously improve performance and eco-system roadmaps.