דרושים » תוכנה » Senior Data Engineer

Were looking for an exceptional data engineer to join our journey to create a data-based platform that will transform the shipping industry.
As a senior data engineer, you will take an instrumental part in laying the foundations and building the data infrastructure in the company, plan and implement the relevant data infrastructure and tools, be in charge of pipelining the companys data and be responsible for the integrity of the data as we scale up.
Responsibilities:
Contribute to the ongoing management of the data team platform including platform enhancements, capacity management, performance monitoring, troubleshooting and resolution of technical issues
Designing and optimizing data storage solutions, including data warehouses and data lakes.
Identify, design, and implement process improvements: automating manual processes, optimizing data delivery, re-designing infrastructure for greater scalability.
Developing and maintaining data pipelines for efficient extraction, transformation, and loading (ETL) processes.
Participate in proofs-of-concept on platform innovation, and effectively transition and scale those concepts into production at scale through, engineering, deployment and commercialization.
Part of a cross-disciplinary team, working closely with other data engineers, software engineers, data scientists, data managers and business partners.

We are looking for an experienced Senior Data Engineer to join our 'Data & AI' group. As a key member of our team, you will play a crucial role in designing and building data models, developing infrastructure, and optimizing data processes to support our data analysis, data science and engineering teams. You will collaborate with various stakeholders to ensure efficient data ingestion, processing, and analysis, contributing to the overall success of our data-driven initiatives.
Key Responsibilities:
Design and build robust data models and infrastructure to support data science and engineering teams.
Develop and optimize data processes, including ETL/ELT pipelines, for efficient data ingestion and processing.
Identify and understand business processes to derive actionable insights from the data.
Collaborate with BI analysts to create comprehensive reports and dashboards.
Implement and maintain scalable data solutions in a high-volume production environment.
Utilize modern technologies such as M3DB, Open-Search, Grafana, etc., for data processing and analysis.
Lead design initiatives for new products and contribute to best practices.
Work closely with cloud providers like AWS for data storage, computation, and orchestration.
Stay updated with advancements in data engineering, big data, and cloud technologies.

We're looking for a Senior Big Data Developer to join our Data Engineering team in Tel Aviv.

You will be a part of our Data Management platform, that is responsible for processing, storing, and serving data for all our core systems.

As a Senior Big Data Developer, we will encourage you to take a proactive & autonomous approach in research & development while working collaboratively with the team. Our ideal candidate is a fast but thorough problem solver, and a fun person to work with!

What Youll Do:

End-to-end feature development and ownership, from design to production, with a strong emphasis on innovation and efficiency.
Take part in building & designing the next generation of company Identity solutions.
Implement high scale Big-Data solutions and contribute to our platform infrastructure and architecture.
Research core technologies and integrations with external APIs and services.
Working with various stakeholders: Product, Engineering, Data providers etc.
Lead and mentor other developers through complex projects that will affect our core business.

We are looking for a Data Engineer Team Lead to join our Data Engineering team in Tel Aviv.

You will be leading one of our data platform teams, that is responsible for processing, storing, and serving data for all our core systems.

What Youll Do:

Lead and mentor a data lake team within our data organization.
Drive high-level projects with company-wide visibility.
Manage the team roadmap, team building, and SW project execution.
Collaborate with stakeholders, including developers, product managers, and business operations.
Take full ownership of end-to-end feature development, from design to production. Contribute to building and designing innovative big data solutions.
Research core technologies and integrate with external APIs and services.

We are looking for a Data Engineer.
Main responsibilities:
Provide the direction of our data architecture. Determine the right tools for the right jobs. We collaborate on the requirements and then you call the shots on what gets built.
Manage end-to-end execution of high-performance, large-scale data-driven projects, including design, implementation, and ongoing maintenance.
Monitor and optimize our (teams) cloud costs.
Design and construct monitoring tools to ensure the efficiency and reliability of data processes.

Lead the design, implementation, and ongoing management of our company's data pipeline architecture.
Lead team architectural discussions
Manage a team of 2-3 data engineers
Work as an integral part of the data team and work closely with data Scientists, data Analysts and data Engineers.
Work directly with others (Developers, Product, and Internal stakeholders) to develop a solid understanding of the business application and requirements for which the application is being designed.

Were looking for brilliant data engineers to join our rapidly growing team.
You will join a team consisting of senior software and data engineers that drive our data platform from data acquisition, to processing and enrichment and all the way to business insights.
You will join an early stage team and company and will have a major impact on the decisions and architecture of our various products.
Responsibilities:
Design and build data acquisition pipelines that acquire, clean, and structure large datasets to form the basis of our data platform and IP
Design and build data pipelines integrating many different data sources and forms
Define architecture, evaluate tools and open source projects to use within our environment
Develop and maintain features in production to serve our customers
Collaborate with product managers, data scientists, data analysts and full-stack engineers to deliver our product to top tier retail customers
Take a leading part in the development of our enterprise-grade technology platform and ecosystem
Harmonize and clean large datasets from different sources.

We are looking for a Senior Java Software Engineer to become an integral member of our EP GW Core team. we are actively seeking passionate and motivated Senior Java Software Engineer to become an integral member of our EP GW Core team. This dynamic team plays a pivotal role in developing and sustaining multi-tenant platform, responsible for efficiently streaming data from millions of agents to our backend detection servers.

In This Position You Will

Join an esteemed autonomous, cross-functional agile team where you will assume complete responsibility for features and/or services through the entire lifecycle from design to deployment.
Leverage cloud-native technologies within a GCP environment to deliver resilient and scalable solutions.
Specialize in designing, developing, and deploying Java services with a strong emphasis on high availability, low latency, and scalability.
Establish and sustain a cost-effective infrastructure capable of real-time processing for millions of events per second.
Engage in close collaboration with fellow engineers, product owners, and designers to tackle complex challenges in the field of cybersecurity.
Thrive in an environment that actively supports your individual growth.

we are looking for a Performance Solution Architect to work with our globally distributed engineering team on internet-scale data lake analytics platform. This is our flagship product and offers incredible value-add on the already stellar performance of the open-source Trino software. This role provides you with the opportunity to directly contribute to the enhancement of performance. The role entails conducting performance analysis and comparing existing in-market solutions, formulating a comprehensive strategy for performance testing, analyzing the results, and offering appropriate recommendations for enhancing.

As a Data Performance Engineer
Be an expert in architecture and performance approaches
Partner closely with sales engineers, solutions, support, and engineering teams to deliver guidance on performance issues at any phase in the product life cycle.
Maintain a profound understanding of current market solutions and devise instrumentation and approaches for comparing them with the solution, paving the way for future enhancements to .
Collaborate with Product Management and Solution architects to continuously improve performance and eco-system roadmaps.

Joining us means entering a career journey for seniors, building your tailored development roadmap. Here, you are the one to choose the technologies you want to practice, and steer your tech career to becoming a Backend Tech Lead.
While seniority doesn't signify the end of learning, it can often be difficult to find the time and hands-on experience to focus on your professional development.
you can choose what you want and need to learn, have a mentor to take you there, and the hands-on practice to "walk the talk".
Responsibilities:
Architect, design, and develop highly scalable and performant backend systems
Advanced algorithms, data structures, and distributed computing techniques
Develop and implement robust APIs
Leveraging industry best practices and standards, while ensuring flexibility, extensibility, and maintainability.
Implement data persistence solutions using both SQL and NoSQL databases,data modeling, query optimization, and indexing strategies.
Cloud-based infrastructures