לוח משרות דרושים איש ביג דאטה Big Data משרה מלאה

We are looking for a Senior Data Engineer.
Responsibilities:
Work closely with business and research teams to deliver high quality results to customers and partners.
Design and Implement complex end-to-end data pipelines including data extraction, feature engineering, data quality, and data serving.
Work with Large Language Models to deliver high scale, high quality features for customers.
Take ownership of a true research project from POC to production.
Contribute to a wide variety of projects using a range of technologies and tools.
If you are someone who thrives in a fast-paced environment where being self-directed, creative, and determined are a requirement, we would love for you to join us.

We're looking for a DataOps Engineer to join the DataOPs team of the Grow division.
The team is in charge of the operational stability, performance and cost of data infrastructures that serve either users (within or outside the company) and applications (to transfer data between applications). The main technologies we're working with are Druid, Spark Structured Streaming, Iceberg, Trino, Airflow and Aurora RDS.
As a team we put a lot of focus on reducing the cost and improving the performance of our data services hosted on the cloud.
We work on both AWS and GCP clouds, and our most important data infrastructures run on k8s, either on AWS EKS or on GCP GKE.
The role requires to make these data infrastructures as stable, cheap and performant as possible.
The short term success is be able to maintain all the above services as an on-call.
The long-term success is to participate in the development of the Druid and Streaming services and improve their stability, cost and performance.
The impact on the team will be to increase the impact of the team on the data infrastructures within Grow.
We're a team that moves fast, handles interesting technologies, and always strive to improve the stability, cost and performance of our infrastructures that manage traffic at a very high scale. The roles suits a devops, sre or dataops that want to be part of an excellent DataOps team that manages data transfers at high traffic of Millions/sec with minimum production issues while always focusing on cost and performance. And in addition, the team members are cool, professional people who love what they do.
What you'll be doing:
Improve stability of Druid, Streaming, Iceberg, Trino, Mysql infrastructures
Participate in the on-call rotation of these infra
Focus on monitoring, cost reduction and performance improvements
Develop scripts in python
Work in collaboration with customers of our infra.

We are looking for a Senior Data Engineer.
In your role as a Senior Data Engineer, you will manage large volumes of data and contribute to critical projects such as the single source of truth, Data Catalog, and Data Platform. Join our team at Viber and help us enhance our data-driven solutions.
Responsibilities:
Lead the designing, building, and maintaining of the organizations data architecture
Contribute to initiatives such as the implementation of a single source of truth, Data Catalog, and Data Platform
Manage large volumes of data, including real-time streaming of petabytes of data from hundreds of millions of users
Collaborate with different teams to ensure the efficiency and accuracy of data solutions
Oversee the overall management of the data platform.

We are looking for strong and motivated SRE to help us continue driving the Azure Data Explorer / Synapse Real Time Analytics revolution and make it THE technology for log search and text analytics across The company as well as providing value to our external customers.
Responsibilities:
As a SRE in Kusto your primary responsibilities will be:
Live Site Management  Almost all the company come to rely on Azure Data Explorer (Kusto) for keeping their business running. This fuels a lot of passion in our team to keep the systems working at high availability and performance.
As a Service Engineer, you will be part of a global team driving huge scale live sites 24X7 (with follow the Sun model) and is passionate to deliver the best service within as well as to external customers. 
Customer Focus our core value is Customer First. We in Kusto take pride in that and bring unwavering customer focus and support to help our customers utilize, embedded and build deep solutions on top of Kusto tailored to their needs. 
Automation As Kusto scale is huge and is expected to keep growing rapidly, we are committed to delivering automation and tooling to improve our live site management and adhere to scale without scale methodology.   
Design - Evaluate and contribute to product, service design and architecture, help shape Site Reliability Engineering strategies, review specifications, design and improve upon core processes.  
Observability - Identify system problems and recommend monitoring solutions & automation to improve processing efficiency and stability.  
Continuous integration/deployment - Implement/maintain and operate the build and release pipelines allowing our developers to safely code/test and deploy our products in very large scale.
Provide engineering design across different workloads including incident & problem management, change management, security and compliance.  
Community Building - Help us build and contribute to an exciting Azure Data explorer community.

We are looking for strong and motivated Senior SRE to help us continue driving the Azure Data Explorer / Synapse Real Time Analytics revolution and make it THE technology for log search and text analytics across as well as providing value to our external customers.
Responsibilities:
As a Senior SRE in Kusto your primary responsibilities will be:
Live Site Management  Almost all the company come to rely on Azure Data Explorer (Kusto) for keeping their business running. This fuels a lot of passion in our team to keep the systems working at high availability and performance.  
As a Senior Service Engineer, you will be part of a global team driving huge scale live sites 24X7 (with follow the Sun model) and is passionate to deliver the best service within as well as to external customers 
Customer Focus our core value is Customer First. We in Kusto take pride in that and bring unwavering customer focus and support to help our customers utilize, embedded and build deep solutions on top of Kusto tailored to their needs. 
Automation As Kusto scale is huge and is expected to keep growing rapidly, we are committed to delivering automation and tooling to improve our live site management and adhere to scale without scale methodology.   
Design - Evaluate and contribute to product, service design and architecture, help shape Site Reliability Engineering strategies, review specifications, design and improve upon core processes.  
Observability - Identify system problems and recommend monitoring solutions & automation to improve processing efficiency and stability.  
Continuous integration/deployment - Implement/maintain and operate the build and release pipelines allowing our developers to safely code/test and deploy our products in very large scale.
Provide engineering design across different workloads including incident & problem management, change management, security and compliance.  
Community Building - Help us build and contribute to an exciting Azure Data explorer community.

As a Senior Data Engineer at CodeValue, you'll play a crucial role in our data team, contributing to the development and maintenance of scalable data pipelines and systems. You'll be at the forefront of designing, implementing, and optimizing data solutions that drive our business objectives and empower data-driven decision-making processes. Collaboration with data analysts, data scientists, and other stakeholders will be essential to ensure data integrity, reliability, and accessibility. Responsibilities:
* Design, develop, and optimize data pipelines and architectures using a variety of technologies and tools including Python, SQL, Spark, Kafka, and Airflow.
* Develop efficient data models to facilitate storage, retrieval, and processing, with a focus on schema design for NoSQL databases, data lakes, and data warehouses.
* Ensure scalability of big data architecture to handle large data volumes and high traffic loads.
* Implement data quality checks, validation processes, and data governance measures to ensure accuracy and consistency of data.
* Monitor, troubleshoot, and debug data issues and performance bottlenecks.
* Implement security measures such as encryption, access controls, and data masking to protect sensitive data.
* Research and evaluate new data technologies and best practices to enhance data engineering processes and solutions.

Top Profiles:
Top Profiles