דרושים » תוכנה » דרוש /ה Senior data engineer עבור חברת מוצר בתל אביב.

we are looking for a Data Integration Engineer.
As a Data Integration Engineer , you will use technical skills, analytical insights, and a business perspective to ensure we have the most accurate and complete data from each client to feed our data science models. You will be responsible for helping new and existing customers ensure they are receiving the best performance possible and leading the charge in processing the data of the largest eCommerce merchants in the world.
What You'll Be Doing:
Maintain/manage merchant data configuration layer of platform (automated data tagging, transformation, filtering, etc.)
Combine technical, business, and analytical objectives to come up with tailored solutions for onboarding merchants
Perform due diligence on merchant websites, business models, and data flows
Generate tailored data templates (JSON, CSV) to help guide merchant developers/data teams in building high-quality online (API) and offline (file transfer) integrations.
Write queries and scripts using Python, SQL, Spark, Databricks, or R to test, validate, and detect data issues in API calls within both sandbox and production environments. Additionally, transform and upload large historical data files to APIs
Ad hoc data wrangling and sanitization
Monitor automated data alerts - prioritize, track, and communicate merchant data issues/irregularities with internal and external stakeholders
Work closely with analysts, research, and data science teams to accommodate changes in industry data
Identify, research, and offer system-wide solutions for common data issues
Work closely with client-facing teams to engage customers regarding their data integrations
Support R&D, Product Management, Data Science, Integrations Engineering, Account Management, and Sales as a subject matter expert of product, technology, and merchants

Design, implement, and maintain robust data pipelines and ETL/ELT processes on GCP (BigQuery, Dataflow, Pub/Sub, etc.).
Build, orchestrate, and monitor workflows using Apache Airflow / Cloud Composer.
Develop scalable data models to support analytics, reporting, and operational workloads.
Apply software engineering best practices to data engineering: modular design, code reuse, testing, and version control.
Manage GCP resources (BigQuery reservations, Cloud Composer/Airflow DAGs, Cloud Storage, Dataplex, IAM).
Optimize data storage, query performance, and cost through partitioning, clustering, caching, and monitoring.
Collaborate with DevOps/DataOps to ensure data infrastructure is secure, reliable, and compliant.
Partner with analysts and data scientists to understand requirements and translate them into efficient data solutions.
Mentor junior engineers, provide code reviews, and promote engineering best practices.
Act as a subject matter expert for GCP data engineering tools and services.
Define and enforce standards for metadata, cataloging, and data documentation.
Implement monitoring and alerting for pipeline health, data freshness, and data quality.