לוח משרות דרושים איש ביג דאטה Big Data

We are looking for an experienced data engineer with a passion for engineering practices to join our team and help to redefine software excellence in the industry.
You will have an opportunity to own the whole data flow, from fetching the data and until visualizing it for users.
Your Responsibilities:
Be responsible for designing the full data flow, from extraction to visualizing in external tools, implementing, and maintaining it
You will translate User and Product manager requirements into a technical design and implement it to be part of large data engineering solutions
Support robust, scalable solutions to enhance business analysis capabilities, identify gaps and design processes, and fill them
Work with cutting-edge big-data tools and techniques
Collaborate with R&D, architects, data scientists, analysts, Projects Managers and DevOps in order to deliver the right solution

We are looking for excellent Customer Oriented and analytical people who are eager to work in a dynamic environment, have very good personal engagement skills, will never take no for an answer, are good at gathering and processing data and have the ability to improve and help grow our business globally.
If you are up to the challenge, this is the job for you.
Responsibilities:
Responsibility for activities related to the onboarding of international entities to our platform.
Independent management and execution of core customer related processes involving multiple tools, automation and control.
Integrating and cross-referencing data from multiple systems and sources. Conducting online research.
Working independently with other groups in the company as well as external entities, including global customers and suppliers.
Contribute to ongoing process improvement, leveraging international data sources and technological solutions.

Design, build, and launch data infrastructures that support multiple use cases across different products or domains.
Collaborate with engineers, product managers, data scientists, and other stakeholders to understand data needs.
Solve challenging data integration problems, utilizing optimal ETL patterns, frameworks, query techniques, and sourcing from structured and unstructured data sources.
Lead end-to-end data projects from infrastructure design to production monitoring and visualization.

We are looking for a Senior Data Engineer specializing in data stream processing, to help us grow and scale our data analysis platform. We have been growing rapidly over the last year, and were looking for someone to help us create the next generation of our platform that will allow us to handle a growing customer base and workload. You will have a key part in designing and implementing core elements of our data pipeline.



What you will be dealing with:

Build real-time data processing pipelines to discover medical devices, risks, and anomalies
Optimize and scale our data pipelines to help us handle a growing customer base
Design our data models for optimal storage and processing
Architect, design, and implement scalable and robust data solutions
Evaluate and recommend appropriate tools and technologies to support data infrastructure
Collaborate with data scientists, analysts, and other stakeholders to understand data requirements
End-to-end ownership of features, from inception to deployment

We are looking for a highly motivated Data\BI Engineer.


Responsibilities:

Full Stack data development: Build extracts/streams from multiple sources (business applications and unique products), Source-To-Target, Transformation, and dashboard development.
Work closely with product managers and key stakeholders to define the Metrics, KPIs, and our main dashboards, for our internal BI solutions as well as our customer-facing data products.
Partner with the engineering and architects to design optimal data streaming, data extracts, data transformation, and data modeling solutions.
Provide an end-to-end data solution, from requirements to design, development, and deployment.

We are seeking a highly skilled and experienced Data Engineer to join our Data Platform team. The ideal candidate will have significant experience in building data pipelines, data layers, and data platforms. This role will involve end-to-end development, from helping formulate requirements to full production implementation.
Building production-grade data pipelines and services
Design and Build data-lake/lakehouse
Taking ownership of major projects from inception to deployment
Architecting simple yet flexible solutions, and then scaling them as we gro

Our Research team is growing, and we are looking for a Senior Data Engineer to join the team.
Not Your Typical Senior Data Engineer Role
You're a crucial pivot in our R&D unit, ensuring our data flows seamlessly, is stored efficiently, and can be accessed and interpreted for justice at scale. You will be responsible for designing our data architecture, implementing and maintaining data pipelines from various sources, and building our databases.
There is no one way of doing things. We are open to new ideas and we encourage creativity, new initiatives and entrepreneurial minds.
Responsibilities:
You will devise scalable solutions to enhance the capabilities of our legal data team to analyze factual information and extract legal implications from it.
Design data analytics modeling solutions with the data science and ML engineers
Collaborate with peer engineering teams (backend & frontend developers and architects) as well as data scientists, product managers, and data analysts to understand business priorities and translate these requirements into data models.
Work with DevOps and engineers to design and implement our infrastructure.

We are looking for a Senior Data Engineer.
As a Senior Data Engineer, you will play a pivotal role in our Data Engineering team, driving a multitude of responsibilities essential to fueling our groundbreaking R&D endeavors. Youll have the autonomy to explore and implement cutting-edge technologies and data solutions, collaborating with diverse team of data scientists, developers, analysts, and stakeholders. Every day will present new learning opportunities and challenges as we strive together to reshape the future of work.
Responsibilities:
Design, develop, and maintain scalable data pipelines and infrastructure to support the collection, processing, and analysis of large volumes of data.
Collaborate with cross-functional teams, including data scientists, software engineers, and business stakeholders, to understand data requirements and develop solutions that meet business needs.
Implement best practices for data governance, security, and quality assurance to ensure the integrity and reliability of our data assets.
Optimize and tune existing data pipelines and processes for improved performance and efficiency.
Stay up to date with current best practices in the big data field.
Mentor and coach other members of the data engineering team, providing guidance and support to help them grow their skills and expertise.

We are interested in welcoming a Big Data Expert to our diligent Big Data team and take overall responsibility for developing, executing, and maintaining strategy and workflow while anticipating possible consequences, changes, and trends.
We believe that the perfect candidate possesses excellent leadership, communication, and social skills to build an effective and motivated team, utilizing the full potential of the skills and expertise of each member.
Responsibilities and tasks include:
Implementation, tuning and ongoing administration of Big Data infrastructure on Hadoop cluster and other NoSQL platforms
Managing end-to-end availability, monitoring performance, and planning capacity using a variety of open source and developed toolsets
Research and perfect best practices to support implementation of new features and solutions in Big Data and NoSQL space
Perform all levels of DBA support (e.g., plan and coordinate patching/upgrades)
Manage database backup and recovery
Troubleshoot and resolve database/application issues in a timely manner, tuning performance at the DB and SQL levels

We are looking for a Senior Data Engineer.
Responsibilities:
Work closely with business and research teams to deliver high quality results to customers and partners.
Design and Implement complex end-to-end data pipelines including data extraction, feature engineering, data quality, and data serving.
Work with Large Language Models to deliver high scale, high quality features for customers.
Take ownership of a true research project from POC to production.
Contribute to a wide variety of projects using a range of technologies and tools.
If you are someone who thrives in a fast-paced environment where being self-directed, creative, and determined are a requirement, we would love for you to join us.

We're looking for a DataOps Engineer to join the DataOPs team of the Grow division.
The team is in charge of the operational stability, performance and cost of data infrastructures that serve either users (within or outside the company) and applications (to transfer data between applications). The main technologies we're working with are Druid, Spark Structured Streaming, Iceberg, Trino, Airflow and Aurora RDS.
As a team we put a lot of focus on reducing the cost and improving the performance of our data services hosted on the cloud.
We work on both AWS and GCP clouds, and our most important data infrastructures run on k8s, either on AWS EKS or on GCP GKE.
The role requires to make these data infrastructures as stable, cheap and performant as possible.
The short term success is be able to maintain all the above services as an on-call.
The long-term success is to participate in the development of the Druid and Streaming services and improve their stability, cost and performance.
The impact on the team will be to increase the impact of the team on the data infrastructures within Grow.
We're a team that moves fast, handles interesting technologies, and always strive to improve the stability, cost and performance of our infrastructures that manage traffic at a very high scale. The roles suits a devops, sre or dataops that want to be part of an excellent DataOps team that manages data transfers at high traffic of Millions/sec with minimum production issues while always focusing on cost and performance. And in addition, the team members are cool, professional people who love what they do.
What you'll be doing:
Improve stability of Druid, Streaming, Iceberg, Trino, Mysql infrastructures
Participate in the on-call rotation of these infra
Focus on monitoring, cost reduction and performance improvements
Develop scripts in python
Work in collaboration with customers of our infra.

We are looking for a Senior Data Engineer.
In your role as a Senior Data Engineer, you will manage large volumes of data and contribute to critical projects such as the single source of truth, Data Catalog, and Data Platform. Join our team at Viber and help us enhance our data-driven solutions.
Responsibilities:
Lead the designing, building, and maintaining of the organizations data architecture
Contribute to initiatives such as the implementation of a single source of truth, Data Catalog, and Data Platform
Manage large volumes of data, including real-time streaming of petabytes of data from hundreds of millions of users
Collaborate with different teams to ensure the efficiency and accuracy of data solutions
Oversee the overall management of the data platform.