דרושים » דאטה » Data engineer

Required Senior Data Engineer - Big Data
Our Core Data Platform team:
We're a leading force in the ad tech industry, revolutionizing how brands connect with their audiences.
Our platform processes billions of ad impressions daily, generating massive datasets that drive our core business.
We thrive on innovation and seek a Data Engineer to help us build and scale the data infrastructure that powers our insights and analytics.
This is a unique opportunity to work with cutting-edge technologies and make a direct impact on our products.
What will you do?
As a Big Data Engineer, you'll be a key part of our data platform team, responsible for designing, building, and maintaining robust and scalable data pipelines. You'll work closely with data scientists, analysts, and server side engineers to ensure our data is reliable, accessible, and ready for analysis. Your expertise will be crucial in expanding our data warehouse and data lake capabilities, enabling us to deliver next-generation ad tech solutions.
Your mission will be to:
Develop and Optimize Data Pipelines: Design, build, and maintain ETL/ELT pipelines using Apache Spark to ingest, process, and transform large-scale datasets from various sources.
Manage Cloud Infrastructure: Architect and manage our data infrastructure primarily on Google Cloud Platform (GCP) or Amazon Web Services (AWS). This includes services like BigQuery, S3, GCS, EMR, and AirFlow.
Enhance Data Storage: Improve and manage our data warehouse and data lake solutions, ensuring data quality, consistency, and accessibility for business intelligence and machine learning applications.
Collaborate and Innovate: Partner with cross-functional teams to understand data needs and implement solutions that support new product features and business initiatives.
Ensure Data Integrity: Implement monitoring, alerting, and logging systems to maintain data pipeline health and ensure data accuracy.

Were looking for a Big Data Engineer to develop and integrate systems that retrieve, process and analyze data from around the digital world, generating customer-facing data. This role will report to our Team Manager, R&D.
Why is this role so important?
A data-focused company, and data is the heart of our business.
As a big data engineer developer, you will work at the very core of the company, designing and implementing complex high scale systems to retrieve and analyze data from millions of digital users.
Your role as a big data engineer will give you the opportunity to use the most cutting-edge technologies and best practices to solve complex technical problems while demonstrating technical leadership.
So, what will you be doing all day?
Your role as part of the R&D team means your daily responsibilities may include:
Design and implement complex high scale systems using a large variety of technologies.
You will work in a data research team alongside other data engineers, data scientists and data analysts. Together you will tackle complex data challenges and bring new solutions and algorithms to production.
Contribute and improve the existing infrastructure of code and data pipelines, constantly exploring new technologies and eliminating bottlenecks.
You will experiment with various technologies in the domain of Machine Learning and big data processing.
You will work on a monitoring infrastructure for our data pipelines to ensure smooth and reliable data ingestion and calculation.

We are looking for a strong, hands-on Data Engineer to join our team and play a key role in building our data infrastructure from the ground up. In this role, you will design and implement scalable data pipelines and platforms, supporting both batch and real-time use cases. You will work closely with analysts and stakeholders to deliver reliable, high-quality data solutions, and take full ownership of data flows - from ingestion to consumption. This is a great opportunity for an executor who enjoys building, moving fast, and making an impact.
What will your job look like?
Design, build, and maintain robust and scalable data pipelines (batch and real-time) end-to-end.
Design and implement scalable, flexible data architectures to support evolving business needs.
Build and manage data platforms, including data lakes and data warehouses.
Integrate multiple data sources (structured and unstructured) into a unified data platform using batch (ETL) and real-time streaming solutions.
Design and implement efficient data models, schemas, and database structures (SQL / NoSQL).
Develop and implement data quality processes to ensure accuracy, consistency, and reliability.
Monitor, optimize, and troubleshoot data infrastructure to meet performance and SLA requirements.

we are looking for a Big Data Engineer.
As a Senior Big Data Engineer, working within Mobility Group, you will play a pivotal role in designing, developing, and maintaining the data infrastructure that powers our location analytics platform.
RESPONSIBILITIES:
Data Pipeline Architecture and Development: Design, build, and optimize robust and scalable data pipelines to process, transform, and integrate large volumes of data from various sources into our analytics platform.
Data Quality Assurance: Implement data validation, cleansing, and enrichment techniques to ensure high-quality and consistent data across the platform.
Performance Optimization: Identify performance bottlenecks and optimize data processing and storage mechanisms to enhance overall system performance and reduce latency.
Cloud Infrastructure: Work extensively with cloud-based technologies (GCP and AWS), to design and manage scalable data infrastructure.
Collaboration: Collaborate with cross-functional teams including Data Analysts, Data Scientists, Product Managers, and Software Engineers to understand requirements and deliver solutions that meet business needs.
Data Governance: Implement and enforce data governance practices, ensuring compliance with relevant regulations and best practices related to data privacy and security.
Monitoring and Maintenance: Monitor the health and performance of data pipelines, troubleshoot issues, and ensure high availability of data infrastructure.
Mentorship: Provide technical guidance and mentorship to junior data engineers, fostering a culture of learning and growth within the team.

As a Data Engineer, youll collaborate with top-notch engineers and data scientists to elevate our platform to the next level and deliver exceptional user experiences. Your primary focus will be on the data engineering aspects-ensuring the seamless flow of high-quality, relevant data to train and optimize content models, including GenAI foundation models, supervised fine-tuning, and more.

Youll work closely with teams across the company to ensure the availability of high-quality data from ML platforms, powering decisions across all departments. With access to petabytes of data through MySQL, Snowflake, Cassandra, S3, and other platforms, your challenge will be to ensure that this data is applied even more effectively to support business decisions, train and monitor ML models and improve our products.


Key Job Responsibilities and Duties:

Rapidly developing next-generation scalable, flexible, and high-performance data pipelines.

Dealing with massive textual sources to train GenAI foundation models.

Solving issues with data and data pipelines, prioritizing based on customer impact.

End-to-end ownership of data quality in our core datasets and data pipelines.

Experimenting with new tools and technologies to meet business requirements regarding performance, scaling, and data quality.

Providing tools that improve Data Quality company-wide, specifically for ML scientists.

Providing self-organizing tools that help the analytics community discover data, assess quality, explore usage, and find peers with relevant expertise.

Acting as an intermediary for problems, with both technical and non-technical audiences.

Promote and drive impactful and innovative engineering solutions.

Technical, behavioral and interpersonal competence advancement via on-the-job opportunities, experimental projects, hackathons, conferences, and active community participation.

Collaborate with multidisciplinary teams: Collaborate with product managers, data scientists, and analysts to understand business requirements and translate them into machine learning solutions. Provide technical guidance and mentorship to junior team members.

Grip Security is looking for a Senior Data Platform Engineer to join our community!
We are a fast-growing startup in the software-as-a-service and AI Security Industry. We provide innovative solutions to securing the whole organization-to-SaaS surface. (More details: https://grip.security)
Using the newest technologies, we're working on solving a huge problem all enterprises face today - to govern the accessibility of all their employees to all 3rd party vendors (GitHub, SendGrid, Atlassian, and thousands more!), and ensure there is no leftover/unwanted access to any of the organization's SaaS and AI assets. The SaaS and AI security field is complex and challenging; therefore, we're looking for super-talented people, who are not afraid of technical challenges and breaking down barriers to achieve good solutions.
The job
As a Senior Data Platform Engineer, you will play a key role in building and evolving Grips modern data platform - the infrastructure that powers product features and analytics across the company.
You will focus on designing and operating scalable, reliable data systems and platform tooling that support our Data Lakehouse, enabling engineers, analysts and research teams to work with data efficiently and with minimal friction.
Responsibilities:
Design, build and operate a cloud-native modern data platform.
Develop and optimize data processing frameworks and pipelines across batch and streaming workloads.
Improve developer experience and platform usability through tooling and automation.
Lead and support large-scale data migrations and architectural improvements.
Drive best practices around infrastructure, CI/CD, testing, and system design.
Collaborate with developers, analysts, data scientists and other stakeholders to develop new products and features.
Contribute to a strong engineering culture of ownership, learning, and knowledge sharing.

Were looking for a Data Engineer to join our Data Labs (DL) department, which specializes in professional services for our super-premium customers. This role will report to our DL (Datalabs) Data Science Team Manager in the R&D.
Why is this role so important?
We are a data-focused company, and our unique AI and machine learning capabilities are the center of our business.
As part of this role, you will create and support a complex data model pipeline that helps analyze the petabytes of data we receive from various sources, and research and develop new features and capabilities for our product solutions
As a data engineer in the Datalabs team, you will work on the very core of the company. Part of your role will be to create processes that help turn raw data into usable metrics and leverage AI models and statistical algorithms to support out-of-the-box requests from customers who want custom data labs. The Datalabs departments business-oriented nature also means you will be supporting a team of analysts and data scientists who interact directly with customers. Together with them, you will translate the voice of these customers into best-in-class data labs.
So, what will you be doing all day?
Building and maintaining our big-data pipelines
Take a major part in designing and implementing complex high-scale systems using a large variety of technologies
Be part of a team with smart and motivated engineers, and data scientists, to collaborate on the planning, development, and maintenance of our products
Implement solutions in the AWS cloud environment, and work in Databricks with PySpark

Our software team is growing, and we are looking for a software data engineer to be entrusted with designing, building, and optimizing large-scale data pipelines in both on-premise and cloud environments.


Your role will encompass the management and storage of binary and tabular data, integration and collaboration with our AI/ML teams and stable large scale ETL pipelines. We value agility, so staying updated and adaptable to our evolving tech stack is inherent to the role.

Responsibilities
Manage and design ETL processes, data cleansing, transformation, and integration.
Work closely with our ML/AI teams.
Apply solid expertise in SQL and other databases to support data operations.
Collaborate with the data team and stakeholders to align on requirements and deliverables.
Manage and set up visualization tools to enable data-driven decision making.
Monitor and maintain logging frameworks such as Grafana, Prometheus, Kibana, and Elasti.

Join us as a Data Engineer to help develop and maintain our rapidly growing data platform. You will be responsible for implementing scalable data pipelines, contributing to the development of custom tools, and ensuring massive datasets are processed efficiently to drive critical business decisions.
Responsibilities:
Implement and maintain scalable, production-grade data pipelines and infrastructure that support analytics and new product features.
Build and contribute to internal software and tooling that improves data team workflows, focusing on driving structure, maintainability, and engineering best practices.
Develop and manage key components of our new data platform, ensuring high reliability, performance, and scalability.
Work closely with security researchers, data analysts, and product teams to translate innovative cybersecurity ideas into functional, production-ready data solutions.
Apply and support best practices in data quality, governance, and observability to ensure our data systems remain robust and trustworthy as we scale.