דרושים » הנדסה » Data Engineer

Lead the design, implementation, and ongoing management of our company's data pipeline architecture.
Lead team architectural discussions
Manage a team of 2-3 data engineers
Work as an integral part of the data team and work closely with data Scientists, data Analysts and data Engineers.
Work directly with others (Developers, Product, and Internal stakeholders) to develop a solid understanding of the business application and requirements for which the application is being designed.

Do you want to be a Senior Data Engineer on an elite Data Science team? Do you want to build data solutions that power AI and Data Analytics of a global Security Product? Do you want your work to be impactful on millions of users?

Join us and become part of a winning Data Science team that builds the brain of one of our most exciting security products, our Defender for Endpoint (MDE). As cyber-attacks have become more sophisticated, MDE helps enterprises detect, investigate, and automatically disrupt advanced attacks and data breaches on their networks. Our team is responsible for developing and deploying Machine Learning (ML) models that protect organizations worldwide and owning Data Analytics systems that facilitate data-driven decisions and operational excellence.

Responsibilities:
Create and maintain robust Big Data pipelines for Analytics and ML systems.
Optimize performance of Big Data scripts and queries.
Create monitoring and reporting infrastructure.
Develop systems that facilitate Data Science activities such as Analytics and Feature Extraction.

Who We're Looking For - The Dream Maker
We are looking for a hands-on data engineer who will build and develop the entire data engineering capabilities and infrastructure, from scratch. This role will possess a combination of technical expertise, problem-solving skills, and strong communication abilities. It will interface with all the departments of our rapidly growing organization in this transformative period.
Your Arena Data Standardization : Make sure that data is standardized, and manage efforts on that initiative (including past data), create a live documentation for the existing data schema (main entities + each field), ensure that data schema is consistent and participate in design reviews that involve database design, oversee the adoption of a common data access layer for our main DB entities (disputes, customer data, integrations, billing), add and maintain a validation processes ayer to prevent divergence from schema and closed set of value Data Correctness & Integrity : Set up processes to ensure data correctness, validity based on business requirements, processes to detect data duplication in our database, and take actions to remediate this with the business stakeholders Data Optimization and Operations : Monitor and Operate DB Performance, manage indices, alerts, scaling on a daily basis Data Engineering technologies and roadmap : Analyze and choose the right database and related technologies for our evolving needs including data warehouses, data lakes, graph database, relational and non-relational databases and ETL tools. Be a knowledgable source to consult on DB design, optimization and operations for our existing and future DB technologies: Mongodb, dynamodb, rockset, postgres, snowflake. Oversee ETL, ELT processes that are used in the company, both inside R&D and in other departments (R&D, Opertations, Marketing), using AWS Glue, HighTouch, Airbyte. Design data tiering practices to find the tradeoffs for cost/performance/flexibility/query Data Security, Access control and regulation : Support our efforts to map out PII data in our database and limit access to it, Implement encryption at rest and other practices to protect our databases, Execute data deletion tasks like removal of personal data, customer(shop/account) data as part of our SOC2/GDPR compliance Business Intelligence : Choose and configure a BI system that makes all of our data accessible in a single system to various stakeholders and departments in the company (R&D, Product, Operations, Finance, Sales, Marketing, Customer Success, etc.). Create ad-hoc and periodic reports & dashboards for stakeholder, on demand.

We are looking for a brilliant, quick-learner Data Engineer for our data engineering team - an independent logical thinker who understands the importance of data structuring for macro-business decisions.
The position combines high technical skills with business orientation, working closely with the analysts and the R&D team, and affecting the company's cross-departments decisions directly. Our Data Engineer should have the ability to speak in technical and practical terms, and more importantly, lead from one to the other, while dealing with challenges and creating them - to make our team even better than it is.
Roles and Responsibilities:
Creating and structuring end-to-end data pipelines & ETLs: from the source all the way to the analysts hands, enabling them the ideal conditions to make smart and data driven business decisions.
Cracking top industry data challenges while initiating and building creative technical solutions - in house Device Graph, Server-to-Server to multiple systems, Privacy challenges, Online-to-Offline and more.
Deep understanding of the business needs, technical requirements and the companys roadmap - and translating it into custom made data solutions and scalable products.
Craft code following best practices to ensure efficiency, while integrating CI/CD principles.
Writing multi-step scalable processes from more than 50 data sources - Marketing. Operations, CS, Product, CRM and more... tying them up to a valuable & useful source of insights for the analysts.
Understanding data challenges and weaknesses, and managing high standards monitoring and reliability processes.