דרושים » תוכנה » Data Engineer

We are searching for an innovative and experienced Senior Big Data Engineer that will join us and be part of our big data group.
As a Senior Big Data Engineer, you will:
Lead the architecture and development of mission-critical, diverse and large-scale data pipelines over both public and on-prem cloud solutions.
Derive policies for data storage and versioning over peta-bytes scale complex storage solutions of multiple data lakes.
Design and develop smart ML infrastructure in order to build Agile ML processes (MLOps).
Work with Data Scientists to understand needs and design ML infrastructure solutions
Be a part of a collaborative heterogeneous data team which includes developers, data scientists, data engineers, MLOps and data scouts.

As a Senior Data Engineer at CodeValue, you'll play a crucial role in our data team, contributing to the development and maintenance of scalable data pipelines and systems. You'll be at the forefront of designing, implementing, and optimizing data solutions that drive our business objectives and empower data-driven decision-making processes. Collaboration with data analysts, data scientists, and other stakeholders will be essential to ensure data integrity, reliability, and accessibility. Responsibilities:
* Design, develop, and optimize data pipelines and architectures using a variety of technologies and tools including Python, SQL, Spark, Kafka, and Airflow.
* Develop efficient data models to facilitate storage, retrieval, and processing, with a focus on schema design for NoSQL databases, data lakes, and data warehouses.
* Ensure scalability of big data architecture to handle large data volumes and high traffic loads.
* Implement data quality checks, validation processes, and data governance measures to ensure accuracy and consistency of data.
* Monitor, troubleshoot, and debug data issues and performance bottlenecks.
* Implement security measures such as encryption, access controls, and data masking to protect sensitive data.
* Research and evaluate new data technologies and best practices to enhance data engineering processes and solutions.

Top Profiles:
Top Profiles

We are searching for an innovative Backend Engineer that will join us and be part of a SW team responsible of the full life cycle development of several web key applications including technical and statistical research, design, coding and integration.
This role will require you to move fast and deliver great products, you will be part of a smart, motivated, creative team of people who are filled with positive energy targeting to bring the best solutions to the finish line.
In this role youll :
Deliver scalable features to support our vision in a timely and quality manner
Building cutting-edge technologies that make a powerful impact on data-driven systems
Tackle tough problems and find creative ways to solve them
Produce (a lot) of high-quality, functional code that is readable, testable and maintainable
Leverage our in-house autonomous tools to manage all development flow, from setting up our development environment to creating git branches and deploying services to production
Be the owner of your domain to ensure code quality, performance, and scalability of our products

We are a leading mobile games company with a strong presence in the gaming industry. Our games are played by millions of users worldwide, and we strive to provide the best gaming experience through cutting-edge technology and innovative gameplay. We are seeking a highly skilled and experienced Data Engineering Director to lead our data engineering department and drive our data infrastructure to support internal data applications, analytics, data science models, and the games themselves. This is an exciting opportunity to join a dynamic and fast-paced environment at the forefront of mobile gaming.
Responsibilities
Lead and manage a team of data engineers, data product managers and QA, providing guidance, mentorship, and performance management.
Develop and execute the data engineering strategy to support internal data applications, analytics, data science models, and games features.
Collaborate with product managers, data scientists, and analysts to understand data requirements and design robust data solutions.
Oversee the design, development, and maintenance of scalable and high-performance data pipelines and ETL processes.
Implement and optimize data storage, retrieval, and processing systems for large volumes of data in real-time environments.
Evaluate and implement advanced open-source tools and technologies to improve the efficiency and effectiveness of the data engineering team.
Ensure data quality, data integrity, and data governance standards are maintained throughout the data infrastructure.
Monitor and troubleshoot data infrastructure performance and reliability issues, ensuring timely resolution.
Stay up-to-date with the latest trends and advancements in data engineering, big data technologies, and industry best practices.
Collaborate with cross-functional teams, including engineering, operations, and business stakeholders, to align data engineering initiatives with organizational goals and priorities.

One of the top security challenges customers have is to understand ahead of time potential attack paths that can happen in their systems, the actual risk vulnerable assets and entities impose and identify points of failure.
We come to solve all of that and surface this knowledge through a wide set of security products. Our strategic platform is based on a knowledge graph built to represent the digital assets and their connections which is the base for deriving smart knowledge, insights and calculation of attack paths, blast radius, chock points and more.
The platform is in use in different security products and plans to expand and grow to new horizons. The challenges span over handling large volumes of data, complex calculations of derived insights, new capabilities and modeling the ever-growing digital world into a coherent knowledge graph.
Were a diverse group of talented professionals consisting of software engineers, security researchers, program managers and data scientists collaborating to develop a security platform that secure our customers, including the biggest companies in the world.
As a Principal software engineer, reporting to group manager, you will lead and shape the next generation of the platform, select the best fit technologies, find solutions to complex problems, and build the system together with the team.

In addition, you will be working with our partners that are on-boarding to platform for ingesting and consuming data and pave the way for their success with us. You will also take significant part in shaping the vision of platform going forward

We are looking for an Algo-Dev Engineer to join one of our research teams. You will be working closely with our researchers, assisting them in achieving their research objective while developing tools and optimizing models in both offline and online environments.
Areas of responsibility include data-handling, deep dive into algo code, design, implementation, and deployment of technologies designed to enable innovative algo-trading projects and support existing and ongoing initiatives.
In this role you will :
Be involved in the execution of a significant new project, with high-end performance requirements and a deep understanding of the low-level implementation.
Participate end-to-end in research support, system architecture, implementation, simulation, testing and production.
Be responsible for designing and implementing research environments, offline and online data sources, coding machine learning algorithms, testing and deployment of solutions.
Collaborate with algorithmic and SW teams across the group to overcome our unique challenges.

Our unique research team is expanding, we are looking for smart and humble team members to join the team and solve complex problems.
Our technical challenges include developing new trading strategies, , improving the performance of our algorithms, finding new ways to beat the markets.
As an ML researcher you will collaborate with our R&D team to execute live trading strategies.
If you are looking to make an impact by putting into practice successful ideas and seeing immediately the outcome, make influence on Finals financial performance this is a great opportunity.
In this role you will:
Mange and lead independent research applying ML/DL/Signal Processing/Data Mining to a wide variety of datasets.
Creatively find new trading strategies
Work with other team members to optimize Finals Algorithms

We are looking for strong and motivated SRE to help us continue driving the Azure Data Explorer / Synapse Real Time Analytics revolution and make it THE technology for log search and text analytics across The company as well as providing value to our external customers.
Responsibilities:
As a SRE in Kusto your primary responsibilities will be:
Live Site Management  Almost all the company come to rely on Azure Data Explorer (Kusto) for keeping their business running. This fuels a lot of passion in our team to keep the systems working at high availability and performance.
As a Service Engineer, you will be part of a global team driving huge scale live sites 24X7 (with follow the Sun model) and is passionate to deliver the best service within as well as to external customers. 
Customer Focus our core value is Customer First. We in Kusto take pride in that and bring unwavering customer focus and support to help our customers utilize, embedded and build deep solutions on top of Kusto tailored to their needs. 
Automation As Kusto scale is huge and is expected to keep growing rapidly, we are committed to delivering automation and tooling to improve our live site management and adhere to scale without scale methodology.   
Design - Evaluate and contribute to product, service design and architecture, help shape Site Reliability Engineering strategies, review specifications, design and improve upon core processes.  
Observability - Identify system problems and recommend monitoring solutions & automation to improve processing efficiency and stability.  
Continuous integration/deployment - Implement/maintain and operate the build and release pipelines allowing our developers to safely code/test and deploy our products in very large scale.
Provide engineering design across different workloads including incident & problem management, change management, security and compliance.  
Community Building - Help us build and contribute to an exciting Azure Data explorer community.

We are looking for a Software Engineer 2, Backend (Java).
As a member of our Ad Review team, youll solve technical challenges, including the design and architecture of a back-end handling billions of requests per day, work on versatile platforms and solve large scale problems. Ad Review allows publishers leveraging our MAX platform to gain transparency and visibility into the ad inventory running in their apps.
The Impact Youll Make:
Develop and maintain large-scale distributed systems
Collaborate with various engineering teams to meet a wide range of technological challenges
Collaborate with cross-functional teams to identify requirements and plan new features.
Troubleshoot and resolve issues that arise during development, testing, and production.

We are searching for an innovative Senior Software Engineer that will join us and be part of a SW team responsible of the full life cycle development of several web key applications including technical and statistical research, design, coding and integration.
you will play a pivotal role in spearheading a transformative project aimed at replacing a monolithic software architecture with a more scalable and flexible microservices architecture.
You will be an important part of leading the technological aspects of the project
This role will require you to lead the redesign of an important product , you will move fast and help deliver a state of the art products, you will be part of a smart, motivated, creative team of people who are filled with positive energy targeting to bring the best solutions to the finish line.
In this role youll :
Deliver scalable features to support our vision in a timely and quality manner
Building cutting-edge technologies that make a powerful impact on big amount of instances
Tackle tough problems and find creative ways to solve them
Produce (a lot) of high-quality, functional code that is readable, testable and maintainable
Leverage our in-house autonomous tools to manage all development flow, from setting up our development environment to creating git branches and deploying services to production
Be the owner of your domain to ensure code quality, performance, and scalability of our products
Manage and complete tasks using TDD, continuous integration and modern development processes