דרושים » תוכנה » Senior Data Engineer

Our Data Platform Team Lead will drive innovation and build scalable data infrastructure that influences the heart health of thousands of users. In this role, you will manage a team of 4 senior data engineers & BI developers responsible for the end-to-end development of data product. You will work in close collaboration with other cross-functional teams, including analysts, data scientists, and engineers, to deliver high-quality solutions that drive data insights and business intelligence at scale. As team lead, you will guide and mentor your team ensuring they grow their skills and deliver impactful solutions. Your leadership will be critical in driving team productivity, technical excellence, and fostering an innovative culure.
Our Technologies stack: Python, Spark, Airflow, DBT, Kafka, AWS (Glue, EMR, S3, Athena and more), Docker, Kubernetes, MongoDB, Redis, Postgres, Elasticsearch, and more.
Responsibilities:
Leadership & Team Management: Lead, mentor, and manage a team of 5 senior data engineers. Foster a culture of collaboration, continuous improvement, and technical excellence.
Data Pipeline Development: Oversee the development and optimization of data pipelines and architectures to support our data flows. Ensure data processing is efficient, scalable, and aligned with business goals.
System Integration: Collaborate with cross-functional teams to integrate and optimize systems that retrieve and analyze data to influence user outcomes.
End-to-End Ownership: Take responsibility for the end-to-end development, deployment, and maintenance of our data systems, ensuring they meet business needs and industry standards.
Innovation & Continuous Learning: Stay up-to-date with emerging technologies and best practices. Identify opportunities to innovate and improve data systems and processes.
Collaboration with Stakeholders: Work closely with researchers, architects, and engineers to ensure that data systems align with research objectives and technical requirements.

We're hiring an experienced Data Engineer to join our growing team of analytics experts in order to help & lead the build-out of our data integration and pipeline processes, tools and platform.
The ideal candidate is an experienced data pipeline builder and data wrangler who enjoys optimizing data systems and building them from the ground u.
The right candidate must be self-directed and comfortable supporting the data needs of multiple teams, systems and products. The right candidate will be excited by the prospect of optimizing or even re-designing our companys data architecture to support our next generation of products and data initiatives.
In this role, you will be responsible for:
Create ELT/Streaming processes and SQL queries to bring data to/from the data warehouse and other data sources.
Establish scalable, efficient, automated processes for large-scale data analyses.
Support the development of performance dashboards & data sets that will generate the right insight.
Work with business owners and partners to build data sets that answer their specific business questions.
Collaborates with analytics and business teams to improve data models that feed business intelligence tools, increasing data accessibility and fostering data-driven decision-making across the organization.
Works closely with all business units and engineering teams to develop a strategy for long-term data platform architecture.
Own the data lake pipelines, maintenance, improvements and schema.

We are seeking a highly skilled Senior Data Engineer to join our Data Group and help drive the development and optimization of our cutting-edge data infrastructure.
As a key member of the Platform team, you will play an instrumental role in building and evolving our feature store data pipeline, enabling machine learning teams to efficiently access and work with high-quality, real-time data at scale.
In this dynamic, fast-paced environment, you will collaborate with other data professionals to create robust, scalable data solutions. You will be responsible for architecting, designing, and implementing data pipelines that ensure reliable data ingestion, transformation, and storage, ultimately supporting the production of high-performance ML models.
We are looking for data-driven problem-solvers who thrive in ambiguous, fast-moving environments and are passionate about building data systems that empower teams to innovate and scale. We value independent thinkers with a strong sense of ownership, who can take challenges from concept to production while continuously improving our data infrastructure.
As a Data Engineer you will...
Design and implement large-scale batch & streaming data pipelines infrastructure
Build and optimize data workflows for maximum reliability and performance
Develop solutions for real-time data processing and analytics
Implement data consistency checks and quality assurance processes
Design and maintain state management systems for distributed data processing
Take a crucial role in building the group's engineering culture, tools, and methodologies
Define abstractions, methodologies, and coding standards for the entire Data Engineering pipeline.

We are seeking a Senior Data Engineer to join our dynamic data team. In this role, you will design, build, and maintain robust data systems and infrastructure that support data collection, processing, and analysis. Your expertise will be crucial in developing scalable data pipelines, ensuring data quality, and collaborating with cross-functional teams to deliver actionable insights.

Key Responsibilities:

Design, develop, and maintain scalable ETL processes for data transformation and integration.
Build and manage data pipelines to support analytics and operational needs.
Ensure data accuracy, integrity, and consistency across various sources and systems.
Collaborate with data scientists and analysts to support AI model deployment and data-driven decision-making.
Optimize data storage solutions, including data lakehouses and databases, to enhance performance and scalability..
Monitor and troubleshoot data workflows to maintain system reliability.
Stay updated with emerging technologies and best practices in data engineering.

Required Senior Data Engineer (Analytics)
Tel Aviv
As a Senior Data Engineer, you will play a key role in shaping and driving our analytics data pipelines and solutions to empower business insights and decisions. Collaborating with a variety of stakeholders, you will design, develop, and optimize scalable, high-performance data analytics infrastructures using modern tools and technologies. Your work will ensure data is accurate, timely, and actionable for critical decision-making.
Key Responsibilities:
Lead the design, development, and maintenance of robust data pipelines and ETL processes, handling diverse structured and unstructured data sources.
Collaborate with data analysts, data scientists, product engineers and product managers to deliver impactful data solutions.
Architect and maintain the infrastructure for ingesting, processing, and managing data in the analytics data warehouse.
Develop and optimize analytics-oriented data models to support business decision-making.
Champion data quality, consistency, and governance across the analytics layer.
What your day might look like:
Leading the design and implementation of scalable data pipelines to support analytical workloads.
Collaborating with stakeholders to gather requirements, propose solutions, and align on data strategies.
Writing and optimizing ETL processes to ensure seamless integration of new data sources.
Designing analytics-focused data modeling solutions tailored for strategic decision-making.
Troubleshooting data issues and implementing measures to improve system reliability and accuracy.
Sharing knowledge and mentoring team members to promote a culture of learning and excellence.
This is an opportunity to make a significant impact by enabling data-driven decision-making at scale while growing your career in a dynamic, collaborative environment.

We are seeking a highly skilled Senior Machine Learning Engineer to join our dynamic Data Department. In this role, you'll work with petabyte-scale data to design, develop, and deploy state-of-the-art machine learning pipelines and systems. You'll build robust ML infrastructure using AWS services and orchestrate processes with Apache Airflow. If you're a passionate problem solver with a commitment to excellence and thrive in a collaborative environment, we offers a unique opportunity to make a significant impact. Here, your expertise will drive innovation and help shape the future of machine learning, all while working on groundbreaking projects at a massive scale.

What you'll be doing:
End-to-End Project Ownership: Take charge of feature design from concept through to deployment, ensuring robust, scalable solutions in a complex and dynamic environment.
Pipeline & Infrastructure Development: Architect and implement advanced machine learning pipelines that efficiently manage and process massive data volumes.
Collaboration & Teamwork: Embrace a team-first mindset"there is no I in team"actively supporting your peers while continuously learning and striving for excellence.
Problem Solving: Utilize your analytical skills to navigate technical challenges and deliver high-quality results on schedule, all while taking full ownership of your projects.

Were looking for an experienced and passionate Staff Data Engineer to join our Data Platform group in TLV as a Tech Lead. As the Groups Tech Lead, youll shape and implement the technical vision and architecture while staying hands-on across three specialized teams: Data Engineering Infra, Machine Learning Platform, and Data Warehouse Engineering, forming the backbone of our data ecosystem.

The groups mission is to build a state-of-the-art Data Platform that drives us toward becoming the most precise and efficient insurance company on the planet. By embracing Data Mesh principles, we create tools that empower teams to own their data while leveraging a robust, self-serve data infrastructure. This approach enables Data Scientists, Analysts, Backend Engineers, and other stakeholders to seamlessly access, analyze, and innovate with reliable, well-modeled, and queryable data, at scale.

In this role youll:

Technically lead the group by shaping the architecture, guiding design decisions, and ensuring the technical excellence of the Data Platforms three teams.

Design and implement data solutions that address both applicative needs and data analysis requirements, creating scalable and efficient access to actionable insights.

Drive initiatives in Data Engineering Infra, including building robust ingestion layers, managing streaming ETLs, and guaranteeing data quality, compliance, and platform performance.

Develop and maintain the Data Warehouse, integrating data from various sources for optimized querying, analysis, and persistence, supporting informed decision-makingLeverage data modeling and transformations to structure, cleanse, and integrate data, enabling efficient retrieval and strategic insights.

Build and enhance the Machine Learning Platform, delivering infrastructure and tools that streamline the work of Data Scientists, enabling them to focus on developing models while benefiting from automation for production deployment, maintenance, and improvements. Support cutting-edge use cases like feature stores, real-time models, point-in-time (PIT) data retrieval, and telematics-based solutions.

Collaborate closely with other Staff Engineers across us to align on cross-organizational initiatives and technical strategies.

Work seamlessly with Data Engineers, Data Scientists, Analysts, Backend Engineers, and Product Managers to deliver impactful solutions.

Share knowledge, mentor team members, and champion engineering standards and technical excellence across the organization.

We are looking for an experienced Data Engineer with expertise in cloud technologies, big data, and distributed systems to join our data engineering team.
This role requires the experience and skills to design and build key components and infrastructure for our global data teams (Data engineering, BI, Data science) with experience in designing, building, and maintaining streaming data pipelines and data lake architectures, together with hands-on expertise with technologies like Apache Spark, Kafka, and cloud-based data lake implementations.
As a Data Engineer you will
Build Infrastructure to empower our Engineers/Data Scientists/BI teams to work by best practices of data processing
Work in a high-volume production environment
Develop and manage ETL/ELT processes for structured and unstructured data
Collaborate with colleagues both locally and in remote locations
Influence the software architecture and working procedures for building data and analytics
Ensure data quality, integrity, and security within the data pipeline and data lake
Monitor, troubleshoot, and optimize data workflows to improve performance and reliability.

Are you a talented Senior Data Infra Engineer? If so, we want you to be part of our dynamic Data Engineering Team, contributing to our vision and changing the eCommerce landscape.
Youll be joining a collaborative team of engineers creating a reliable and performant data infrastructure platform. As a Senior Engineer on the team you will prioritize and tackle problems as they arise, working iteratively with internal and external stakeholders to deliver a great self-service data infrastructure and stability for our developers and analysts. Today we serve various eCommerce organizations, enabling them to make decisions based on the knowledge at the core of their business.
In this role, you can expect:
Lead technical design and implementation of major software components, systems, and features across teams.
Work with a variety of programming languages, systems, and cloud technologies, including: Python, DBT, Databricks, Spark, Looker, Airflow, Kubernetes, AWS, Terraform
Apply your technical experience in performance, architecture, interfaces and engineering best practices to face cutting-edge data related challenges.
Help build a data driven culture of quality and innovation by leading cross-team collaboration and execution of projects delivering high value to customers.
Manage trade-offs, priorities, and deliverables by applying your experience driving projects to successful completion.

Were looking for brilliant data engineers to join our rapidly growing team.

You will join a team consisting of senior software and data engineers that drive our data platform from data acquisition, to processing and enrichment and all the way to business insights. You will join an early stage team and company and will have a major impact on the decisions and architecture of our various products.

Responsibilities
Design and build data acquisition pipelines that acquire, clean, and structure large datasets to form the basis of our data platform and IP
Design and build data pipelines integrating many different data sources and forms
Define architecture, evaluate tools and open source projects to use within our environment
Develop and maintain features in production to serve our customers
Collaborate with product managers, data scientists, data analysts and full-stack engineers to deliver our product to top tier retail customers
Take a leading part in the development of our enterprise-grade technology platform and ecosystem
Harmonize and clean large datasets from different sources