לוח משרות דרושים איש ביג דאטה Big Data משרה מלאה

We are looking for an experienced data leader to join our Data engineering group at our company. The Data Engineering group at our company is responsible for providing the technological solutions that best fits the business needs as reflected by the different data producers and consumers within the company, including product teams, BI analysts, marketing analysts, finance, data scientists, other backend teams and more.
What you will be doing
Reporting directly to the COO and part of the data leadership.
Work together with the different data producers and data consumers within the company and the data organization in order to understand their needs and work processes regarding their data and API needs and limitations.
Develop a deep understanding of the companys vision and strategic planning and mak
sure our data infrastructure is built to support the same ideas.
Identify bottlenecks in internal data processes and work to resolve them by planning and delivering technological solutions such as automating processes, optimizing data delivery and storage, re-designing infrastructure for greater scalability, integrating external tools etc.
Integrate new tools and solutions that can empower the companys data consumers and help assimilate them.
Lead a team of senior data engineers in providing a set of technological solutions best fitting with business needs.
Have full responsibility over data compliance in the organization and lead the design and implementation of data compliance and privacy processes.

We are seeking an experienced Data Engineer to join our Data Platform Engineering group at our company. This group is responsible for providing the technological solutions that best fit the business needs of various stakeholders, including product teams, BI analysts, marketing analysts, finance, data scientists, backend teams, and more.
What you will be doing
Build and own the infrastructure and services required for processing and storing data from a wide variety of sources, including mobile apps and internal/external data producers.
Design and build processes to integrate a wide range of edge systems across multiple cloud providers and handheld platforms reliably.
Assist data consumers across our company in defining requirements and refining existing processes using a wide variety of tools.
Define and own the systems and processes that deliver data to the data warehouse, while maintaining these systems and the warehouse itself.
Identify bottlenecks in internal data processes and resolve them by automating workflows, optimizing data delivery and storage, and redesigning infrastructure for greater scalability.
Integrate new tools and solutions to empower the companys data consumers and help assimilate them effectively.

This role is embedded within our Analytics department and requires a blend of analytical prowess, creative thinking, cross-functional collaboration, and the responsibility to challenge and innovate upon current AB testing methods. Success in this role directly impacts our product, monetization & marketing goals, and we reward results-driven performance.

To ensure success, you should be skilled at designing and analyzing AB tests, writing & debugging SQL & Python scripts, implementing advanced statistical methodologies, and passionate about optimizing business processes across all departments. You should also be able to lead & instruct other Analytics personnel to tailor AB testing solutions to different markets, scenarios, products, and goals.

Responsibilities
Standardization & Optimization:

Establish contingency plans and backup strategies to mitigate unforeseen challenges or failures during AB testing, ensuring the smooth execution of planned tests.
Conduct training sessions and workshops to disseminate technical knowledge and foster a culture of analytical excellence in AB testing across the department.
Lead the implementation of standardized AB testing processes and systems to ensure collaboration and synergy (Pycharm & BQ, Mixpanel, Jira, AppEvents Structure, etc.).
Establish quality assurance protocols for AB testing and reporting, ensuring consistency and accuracy throughout the company's analytics practices.
Facilitate the documentation of AB testing methodologies, frameworks, and best practices to promote knowledge sharing within the department (Confluence, Showcase, User Stories, etc.).
Hands-On Complex Cross-Department Projects:

Lead AB testing projects across various departments, ensuring alignment with organizational objectives and timelines.
Design, implement, and analyze complex AB tests to extract meaningful insights and trends, leveraging various analytics tools and methodologies.
Provide technical guidance and support to all data professionals in navigating complex technical and analytical challenges related to AB testing, enabling them to deliver high-quality solutions.
Innovation:

Drive innovation within the AB testing framework by exploring emerging technologies and methodologies, recommending their adoption where appropriate to enhance efficiency and effectiveness.
Collaborate closely with all department teams to understand their unique data requirements, ensuring that AB testing solutions are tailored to the diverse business needs.

Lead Big-Data Engineer - Cloud Engineering Platform Team We are looking for a Lead data Engineer to join the CTO Developer Experiences Platform Team to lead the implementation of the vision to build data Lake House & MLOps on the AWS cloud. On top of that the platform engineers are helping the product innovation team to build Generative AI experiences across products and services. You have an amazing opportunity to be part of the Generative AI revolution and build Generative AI products and services.
What are some of the things you do on a day-to-day basis? Plan and build data Lake House in the AWS cloud based on future technologies most companies will use in only 3-5 years. Have end to end ownership: Design, develop, deploy, measure and maintain our data platform. Solve production issues in the framework code. Collaborate with 40+ data engineers/scientists, understand their functional needs and wants and build products to accelerate their productivity and quality of work. Research and build Generative AI services and applications. Lead and mentor data engineers, providing guidance and fostering a culture of continuous learning and professional development. Participate in the software engineering, processes and standards with an impact on the whole delivery organization. Communicate complex architectural concepts and recommendations effectively to both technical and non-technical stakeholders. Help the in analyzing and adopting new technologies including assessing and embedding startup technologies.

Join Abra's DATA Team as a Data Engineer! Responsibilities
* Develop and maintain ETL processes within Azure environments
* Manage cloud-based data infrastructure, ensuring scalability and performance
* Design and build scalable data warehouses to support data-driven decision-making
* Develop AI-based solutions integrated with data systems
* work daily base with cutting-edge cloud data technologies and AI-based solutions.

XM Cyber is a leading hybrid cloud security company that's changing the way organizations approach cyber risk. XM Cyber transforms exposure management by demonstrating how attackers leverage and combine misconfigurations, vulnerabilities, identity exposures, and more, across cloud and on-prem environments to compromise critical assets. With XM Cyber, you can see all the ways attackers might go, and all the best ways to stop them, pinpointing where to remediate exposures with a fraction of the effort. XM Cyber is looking for a talented Senior Big Data Engineer ! Join a team of experts responsible for developing innovative features that integrate into XM Cyber's fully automated attack simulation. This role provides the opportunity to design & implement advanced server-side features using a wide range of technologies: Apache Spark, K8s, Airflow, MongoDB, Kafka, Dockers If you are up for the challenge and you have the 'XM factor', come and join us!

We are seeking a Senior Data Engineer to join our dynamic data team. In this role, you will design, build, and maintain robust data systems and infrastructure that support data collection, processing, and analysis. Your expertise will be crucial in developing scalable data pipelines, ensuring data quality, and collaborating with cross-functional teams to deliver actionable insights.

Key Responsibilities:

Design, develop, and maintain scalable ETL processes for data transformation and integration.
Build and manage data pipelines to support analytics and operational needs.
Ensure data accuracy, integrity, and consistency across various sources and systems.
Collaborate with data scientists and analysts to support AI model deployment and data-driven decision-making.
Optimize data storage solutions, including data lakehouses and databases, to enhance performance and scalability..
Monitor and troubleshoot data workflows to maintain system reliability.
Stay updated with emerging technologies and best practices in data engineering.

At our company, we are revolutionizing the insurance industry with the world's first Marketing OS - a comprehensive solution tailored to the unique marketing and distribution needs of insurance organizations.
Our intelligent solutions combine the power of AI, machine learning, and real-time data to reshape marketing strategies and drive profitable growth for top insurers.
Founded in 2015 and headquartered in Israel, our partners with leading US insurance companies, helping them uncover hidden growth opportunities and optimize their marketing budgets with unparalleled precision and efficiency.
We are looking for a Skilled Data Engineer who is passionate about handling data infrastructure, pipelines, and systems with strong problem-solving abilities while collaborating with multiple teams and playing a key role in their core team.
Responsibilities
Establishing robust and scalable data pipelines for acquiring, processing, and storing large volumes of data- from the Design stage, construction, install, test, and maintenance
Designing a scalable and flexible architecture that can grow with the company, supporting various use cases, therefore involves working closely with data analysts and stakeholders to understand requirements and design appropriate solutions.
Build and manage data warehouses and data lakes for storage and analysis of large dataset-choosing appropriate technologies, setting up storage solutions, and ensuring data accessibility and security.
Integrate various data sources (both structured and unstructured) into a unified data platform. This involves leveraging technologies like ETL (Extract, Transform, Load) processes or real-time streaming platforms
Design and implement data models, schemas, and database structures optimized for performance, scalability, and reliability. Knowledge of SQL and NoSQL databases is essential.
Develop and implement data quality processes to ensure accuracy, completeness, and consistency of data.
Monitor and optimize data infrastructure performance, identify and resolve bottlenecks, and ensure systems meet data availability and latency SLAs.
Implement security measures to protect sensitive data.
Work closely with cross-functional teams including data analysts and software engineers to understand data requirements and provide technical support
Stay updated with emerging technologies and best practices in data engineering, evaluating and incorporating new tools and techniques to enhance data infrastructure and processes.

We are interested in welcoming a Big Data Expert to our diligent Big Data team and take overall responsibility for developing, executing, and maintaining strategy and workflow while anticipating possible consequences, changes, and trends.
We believe that the perfect candidate possesses excellent leadership, communication, and social skills to build an effective and motivated team, utilizing the full potential of the skills and expertise of each member.

Responsibilities and tasks include:
Implementation, tuning and ongoing administration of Big Data infrastructure on Hadoop cluster and other NoSQL platforms
Managing end-to-end availability, monitoring performance, and planning capacity using a variety of open source and developed toolsets
Research and perfect best practices to support implementation of new features and solutions in Big Data and NoSQL space
Perform all levels of DBA support (e.g., plan and coordinate patching/upgrades)
Manage database backup and recovery
Troubleshoot and resolve database/application issues in a timely manner, tuning performance at the DB and SQL levels

We are seeking a talented and senior Engineer to join our Big Data Analytics Tools group in Israel.

This is an amazing opportunity to work with a world-class team and to hold responsibility for designing and implementing big data platforms and pipelines.

You will work with Engineers, Data Scientists, DevOps, and PMs and be in charge of designing and developing Apache Spark applications on AWS infrastructures that process large volumes of medical records securely while preserving patient privacy.

If you want to grow with us and work for a world leader company, now is the right time to join.
What You'll Do
Be part of an engineering team that focuses on Crossix core technology and peripheral analytical tools
Design and implement highly reliable and scalable Spark applications that efficiently process big data
Collaborate with data scientists on the design and implementation of ML data pipelines using PySpark and Python
Integrate with relational databases, MongoDB, and AWS services (e.g., EMR, S3, SQS)
Work in an agile team to improve the development life cycle, development practices, and testing facilities

We are looking for an experienced Backend Developer to join our data group.
Job Id: 20811
As a member of the team you will be a part of a fast, highly-scalable and fully managed data platform which handles terabytes of data per day in a cloud environment.
We are looking for an engineer who will work with multiple technologies stack: Kafka (Azure Event Hub), Kubernetes, Function Apps, Azure Data Explorer, MongoDB, etc.
Using several coding languages like Golang, NodeJS (TypeScript), and Python.
We are required to write efficient code that supports large-scale distributed systems.
Key Responsibilities:
Design and build new solutions/features to help our customers improve their cloud security.
Get experience with new technologies and languages, develop challenging solutions, and have a great opportunity to grow and create impact.
Constantly Improve existing implementations.
Adapt and take on more responsibilities and own your share of the product.
Work with product managers, business, and other teams.

we are looking for a senior developer to join a new big-data analytics team as part of our data platform.
The autonomous vehicle project generates huge amounts of data and our challenge is to enable it for usage by the entire organization (Deep Learning /Machine Learning Developers, Product Managers, Analysts, and more.)
We are using a top-notch tech stack to solve problems multiple databases and big data frameworks, data streaming, AWS infrastructure on a large scale, and many more.
What will your job look like:
Work on a large-scale system from early stages and watch it evolve
Take part in the design & development of a multi-service cloud-based big data platform
Evaluate various optional technologies and take part in the decision-making
Own key features and services

We are seeking a skilled and motivated Data Engineer to join our dynamic team. The ideal candidate will have extensive experience in building and optimizing data pipelines, handling large datasets, and working within cloud-based and on-premise environments. You will be responsible for designing and implementing efficient, scalable solutions to manage, process, and analyze high volumes of data, ensuring the reliability and performance of our data infrastructure.
What will your job look like:
Design, build, and maintain scalable data pipelines to process large datasets efficiently.
Develop and implement data models and architectures that support both real-time and batch data processing.
Ensure data integrity, security, and accuracy across all systems.
Collaborate with data scientists, analysts, and other engineers to ensure data availability and quality.
Optimize data retrieval and storage processes to handle large volumes of data seamlessly.
Work with structured, semi-structured, and unstructured data, integrating various data sources.
Troubleshoot and resolve data issues, ensuring continuous operation of the data infrastructure.
Maintain and enhance ETL processes, ensuring scalability and performance in handling large datasets.
Stay up-to-date with industry best practices and emerging technologies related to big data engineering.