דרושים » תוכנה » Senior Big Data Engineer

We are searching for an innovative and experienced Data Engineer that will join us and be part of our new data initiatives team in our data group.
As a Data Engineer, you will:
Be a part of a cross functional team of data, backend and DevOps engineers.
Be responsible for ingesting large volumes of new data, followed by deep understanding and inspection of the data in close collaboration with data scientists.
Lead the architecture, planning, design and development of mission-critical, diverse and large-scale data pipelines over both public and on-prem cloud solutions.

As a Senior Data Engineer at CodeValue, you'll play a crucial role in our data team, contributing to the development and maintenance of scalable data pipelines and systems. You'll be at the forefront of designing, implementing, and optimizing data solutions that drive our business objectives and empower data-driven decision-making processes. Collaboration with data analysts, data scientists, and other stakeholders will be essential to ensure data integrity, reliability, and accessibility. Responsibilities:
* Design, develop, and optimize data pipelines and architectures using a variety of technologies and tools including Python, SQL, Spark, Kafka, and Airflow.
* Develop efficient data models to facilitate storage, retrieval, and processing, with a focus on schema design for NoSQL databases, data lakes, and data warehouses.
* Ensure scalability of big data architecture to handle large data volumes and high traffic loads.
* Implement data quality checks, validation processes, and data governance measures to ensure accuracy and consistency of data.
* Monitor, troubleshoot, and debug data issues and performance bottlenecks.
* Implement security measures such as encryption, access controls, and data masking to protect sensitive data.
* Research and evaluate new data technologies and best practices to enhance data engineering processes and solutions.

Top Profiles:
Top Profiles

We are searching for an innovative Backend Engineer that will join us and be part of a SW team responsible of the full life cycle development of several web key applications including technical and statistical research, design, coding and integration.
This role will require you to move fast and deliver great products, you will be part of a smart, motivated, creative team of people who are filled with positive energy targeting to bring the best solutions to the finish line.
In this role youll :
Deliver scalable features to support our vision in a timely and quality manner
Building cutting-edge technologies that make a powerful impact on data-driven systems
Tackle tough problems and find creative ways to solve them
Produce (a lot) of high-quality, functional code that is readable, testable and maintainable
Leverage our in-house autonomous tools to manage all development flow, from setting up our development environment to creating git branches and deploying services to production
Be the owner of your domain to ensure code quality, performance, and scalability of our products

We are looking for strong and motivated Senior SRE to help us continue driving the Azure Data Explorer / Synapse Real Time Analytics revolution and make it THE technology for log search and text analytics across as well as providing value to our external customers.
Responsibilities:
As a Senior SRE in Kusto your primary responsibilities will be:
Live Site Management  Almost all the company come to rely on Azure Data Explorer (Kusto) for keeping their business running. This fuels a lot of passion in our team to keep the systems working at high availability and performance.  
As a Senior Service Engineer, you will be part of a global team driving huge scale live sites 24X7 (with follow the Sun model) and is passionate to deliver the best service within as well as to external customers 
Customer Focus our core value is Customer First. We in Kusto take pride in that and bring unwavering customer focus and support to help our customers utilize, embedded and build deep solutions on top of Kusto tailored to their needs. 
Automation As Kusto scale is huge and is expected to keep growing rapidly, we are committed to delivering automation and tooling to improve our live site management and adhere to scale without scale methodology.   
Design - Evaluate and contribute to product, service design and architecture, help shape Site Reliability Engineering strategies, review specifications, design and improve upon core processes.  
Observability - Identify system problems and recommend monitoring solutions & automation to improve processing efficiency and stability.  
Continuous integration/deployment - Implement/maintain and operate the build and release pipelines allowing our developers to safely code/test and deploy our products in very large scale.
Provide engineering design across different workloads including incident & problem management, change management, security and compliance.  
Community Building - Help us build and contribute to an exciting Azure Data explorer community.

We are seeking a highly skilled System Architect to join our team. The System Architect will be responsible for designing the system architecture for our SaaS solution, ensuring it meets the highest standards of security and performance. This role will require a deep understanding of modern cloud architecture and big-data tools, as well as experience in architecting complex systems in a SaaS environment.

Designing the system architecture for our SaaS solution, considering factors such as scalability, reliability, and security
Leading the design and implementation of product security measures to ensure the confidentiality, integrity, and availability of customer data
Collaborating with cross-functional teams to ensure alignment with business requirements and technical goals
Conducting regular assessments of the system architecture to identify potential risks and areas for improvement
Providing technical leadership and guidance to the development team in implementing architectural best practices
Keeping up to date with the latest trends and technologies to inform architectural decisions and bringing innovative solutions

XM Cyber is a global leader in hybrid cloud security. XM Cyber brings a new approach that uses the attacker’s perspective to find and remediate critical attack paths across on-premises and multi-cloud networks. The XM Cyber platform enables companies to rapidly prioritize and respond to cyber risks affecting their business-sensitive systems. As a Senior Backend engineer with Spark experience at XM Cyber, you'll be responsible for implementing core features, building infrastructure, and finding innovative solutions while getting into the language internals. We're looking for top talents who are ready to level up their skills in an exciting and fast-paced environment. You will be responsible for leading features and products end to end, from design to production; build and develop modules, data pipelines, and services.

As a Senior Backend engineer with Spark experience you'll be responsible for implementing core features, building infrastructure, and finding innovative solutions while getting into the language internals. We're looking for top talents who are ready to level up their skills in an exciting and fast-paced environment. You will be responsible for leading features and products end to end, from design to production; build and develop modules, data pipelines, and services.

We are looking for an Algo-Dev Engineer to join one of our research teams. You will be working closely with our researchers, assisting them in achieving their research objective while developing tools and optimizing models in both offline and online environments.
Areas of responsibility include data-handling, deep dive into algo code, design, implementation, and deployment of technologies designed to enable innovative algo-trading projects and support existing and ongoing initiatives.
In this role you will :
Be involved in the execution of a significant new project, with high-end performance requirements and a deep understanding of the low-level implementation.
Participate end-to-end in research support, system architecture, implementation, simulation, testing and production.
Be responsible for designing and implementing research environments, offline and online data sources, coding machine learning algorithms, testing and deployment of solutions.
Collaborate with algorithmic and SW teams across the group to overcome our unique challenges.

Power the Future with us! SolarEdge (NASDAQ: SEDG), is a global leader in high-performance smart energy technology, with over 4000 employees, offices in 34 countries, and millions of products installed in over 133 countries. Our diverse product offering comprises intelligent solar inverters, battery storage, backup systems, EV charging, and complete home energy management ecosystems. By leveraging world-class engineering capabilities and with a relentless focus on innovation, we strive to create a world where clean, green energy from the sun is the primary source of power for our homes, businesses, and just about everywhere we thrive.
We are looking for a Senior Java Developer with experience in building high-performing, scalable, enterprise-grade applications. The job requires deep understating in Java various technologies along with high motivation and willingness to provide high quality product. A good candidate will be comfortable in a fast-delivery environment, and equally capable of designing complex yet efficient solutions to meet end-user requirements. Responsibilities:
* Designing and developing high-volume, low-latency applications for mission-critical systems
* Contribute in all phases of the development lifecycle
* Write well designed, testable, efficient code
* Ensure designs are in compliance with specifications
* Prepare and produce releases of software components
* Support continuous improvement by investigating alternatives and technologies and presenting these for architectural review

Country:
Israel

City:
Herzliya

We are looking for a DevOps TL to join our DevOps team.
The perfect candidate will be a team player with a high level of professionalism and knowledge in DevOps technologies, with a leadership background.
IN THIS POSITION YOU WILL:
Provide architectural solutions for complex infrastructure requirements involving large-scale systems and rapid growth
Define and manage the automated production process
Take ownership of technical issues and work with our development group to resolve advanced issues and bugs