דרושים » תוכנה » Senior Data Engineering

A global sports technology hub offering multiple solutions to millions of users worldwide. The company provides Real-Time results, updated stats, original content, aggregated information, customized news feeds, and more. Our products are based on cutting-edge technologies that enable live updates and on-demand content libraries of the highest quality and scale. We are looking for a talented and experienced data ENGINEER to join our data engineering team. In this role, you will be responsible for designing, implementing, and maintaining our data pipelines and infrastructure. You will collaborate closely with cross-functional teams, including data scientists, analysts, and software engineers, to ensure the availability, accessibility, and quality of our data assets. Your expertise in data processing, database technologies, and ETL processes will be essential in enabling effective data utilization and analysis.
Responsibilities:
* Design, develop, and maintain efficient and scalable data pipelines that extract, transform, and load data from various sources into target systems.
* Monitor and optimize data pipelines for performance, reliability, and data quality.
* Implement and manage data Storage solutions, including relational databases, data warehouses, and NoSQL databases.
* Implement data partitioning, indexing, and compression strategies for improved performance and scalability.
* Identify and resolve data quality issues, including data cleansing, standardization, and validation.
* Identify and implement performance optimization techniques to enhance data processing speed, query performance, and system scalability.
* Monitor and analyze data infrastructure and pipeline performance, identifying bottlenecks and implementing optimizations.
* Stay updated on emerging technologies and trends in data engineering, proactively identifying opportunities for innovation and improvement.

We're seeking talented data engineers to join our rapidly growing team, which includes senior software and data engineers.
Together, we drive our data platform from acquisition and processing to enrichment, delivering valuable business insights. Join us in designing and maintaining robust data pipelines, making an impact in our collaborative and innovative workplace.
Responsibilities:
Design, implement, and optimize scalable data pipelines for efficient data processing and analysis.
Build and maintain robust data acquisition systems to gather, process, and store data from various sources.
Work closely with DevOps engineers, Data Science and Product teams to understand their requirements and provide data solutions that meet business objectives.
Proactively monitor data pipelines and production environments to identify and resolve issues promptly.
Implement best practices for data security, integrity, and performance.
Mentor and guide junior team members, sharing expertise and fostering their professional development.

Were looking for an exceptional data engineer to join our journey to create a data-based platform that will transform the shipping industry.
As a senior data engineer, you will take an instrumental part in laying the foundations and building the data infrastructure in the company, plan and implement the relevant data infrastructure and tools, be in charge of pipelining the companys data and be responsible for the integrity of the data as we scale up.
Responsibilities:
Contribute to the ongoing management of the data team platform including platform enhancements, capacity management, performance monitoring, troubleshooting and resolution of technical issues
Designing and optimizing data storage solutions, including data warehouses and data lakes.
Identify, design, and implement process improvements: automating manual processes, optimizing data delivery, re-designing infrastructure for greater scalability.
Developing and maintaining data pipelines for efficient extraction, transformation, and loading (ETL) processes.
Participate in proofs-of-concept on platform innovation, and effectively transition and scale those concepts into production at scale through, engineering, deployment and commercialization.
Part of a cross-disciplinary team, working closely with other data engineers, software engineers, data scientists, data managers and business partners.

Required Senior Data Engineer
About the role:
You will specialize in designing and building a world class, scalable data architectures, ensuring reliable data flow and integration for groundbreaking biotechnological research. Your expertise in big data tools and pipelines will accelerate our ability to derive actionable insights from complex datasets, driving innovations in improving patients outcome and in delivering life savings treatment solutions.
In this role, you will work closely with data scientists, analysts, and other cross-functional teams to understand their data needs and requirements. You will also be responsible for ensuring that data is easily accessible and can be used to support data-driven decision making.
Location: Tel Aviv
What will you do?
Design, build, and maintain data pipelines to extract, transform, and load data from various sources, including databases, APIs, and flat files
Enhance our data warehouse system to dynamically support multiple analytics use cases
Reimplement and productise scientific computational methods
Implement data governance policies and procedures to ensure data quality, security, and privacy
Collaborate with data scientists and other cross-functional teams to understand their data needs and requirements
Develop and maintain documentation for data pipelines, processes, and systems.

Required Data Engineer
Full-Time
Tel Aviv
Who are you?
You are a seasoned Data Engineer with a deep understanding of data modeling, massive parallel processing (in both realtime and batch) and bringing Machine learning capabilities into large-scale production systems. You have experience at a cutting edge startup and are passionate about building the data infrastructures that fuels the worlds first intelligent agent. You are a team player with excellent collaboration, communication skills and a can do approach
What youll be doing?
Build, maintain, and scale data pipelines for both batch and real-time data processing across multiple sources and ecosystems.
Design and implement robust APIs and integrate diverse data systems to support data collection and aggregation.
Develop and manage advanced data architectures, including lakehouses, streamhouses, and data warehouses.
Collaborate with data scientists and other stakeholders to implement effective data solutions and integrate large language models (LLMs) into our systems.
Work with cross-functional teams to define business needs and translate them into technical implementations that leverage your deep understanding of data architectures and software engineering best practices.
Develop and lead initiatives to manage, monitor, and debug data systems, enhancing their reliability, efficiency, and overall quality.

We are seeking an adept Senior Data Engineer with a passion for tackling complex challenges across a diverse range of technologies.
Your role will involve a deep commitment to software design, code quality, and performance optimization.
As part of our Engineering team, your mission will be to empower critical infrastructure by enabling the detection, investigation, and response to complex attacks and data breaches on their networks.
You will play a pivotal role in developing pipelines to efficiently extract, transform, and load massive volumes of data.
Your expertise will contribute to the creation of a scalable, high-performance data lake that serves as a foundation for other services within the platform. Additionally, you will be responsible for translating intricate requirements into meticulous and actionable designs.
Responsibilities:
Be a significant part of the development of data pipelines to efficiently extract, transform, and load vast volumes of data.
Architect and build a scalable, high-performance data lake that supports various services within the platform.
Translate intricate requirements into meticulous design plans, maintaining a focus on software design, code quality, and performance.
Collaborate with cross-functional teams to implement data-warehousing and data-modeling techniques.
Apply your expertise in Core Linux, SQL, and scripting languages to create robust solutions.
Leverage your proficiency in cloud platforms such as AWS, GCP, or Azure to drive strong data engineering practices.
Utilize your experience with streaming frameworks, such as Kafka, to handle real-time data processing.
Employ your familiarity with industry-standard visualization and analytics tools, like Tableau and R, to provide insightful data representations.
Demonstrate strong debugging skills, identifying issues such as race conditions and memory leaks.
Solve complex problems with an analytical mindset and contribute to a positive team dynamic.
Bring your excellent interpersonal skills to foster collaboration and maintain a positive attitude within the team.

We are currently seeking a Data Architect to join our fast-paced company with a success driven culture. Our Data team specialize in delivering modern data processing and analytics solutions on top of the major public clouds. We are working in a multi-cloud environment on a wide variety of projects for leading customers which include successful startups and key enterprises.
As a data architect you will collaborate with our customers to design data analytics solutions, focus on delivering the right solution and drive feature innovation based upon customer needs.
Job Responsibilities:
Architect data solutions & platforms on major public clouds, technical design, and development
Design, Develop and Operate data pipelines for extraction, transformation, and loading (ETL/ELT) of data from a variety of data sources.
Expert in writing efficient SQL queries and optimize performance
Write Technical Designs and turn business requirements to technical solutions
Team player with a can-do attitude
Partner with analysts and data scientists to help ship projects into production grade systems.
Be a focal point for data externalization, and develop advanced dashboards.
Work with analysts and Software Engineers to develop data pipelines for highly complex processes using a combination of HFDS like file systems, Spark/Flink, Presto, Kafka and more.

We are looking for an exceptional Data Engineering Team Lead who is passionate about architecting, building, and maintaining data infrastructure from the ground up.
Responsibilities:
Build and maintain the companys central data platform.
Own the data architecture: ETL, Pipelines, Databases, Data integrations, and more.
Continuously maintain a healthy and up-to-date data tech stack, guaranteeing scalability and robustness.
Understand the organization's data needs and provide solutions to other data stakeholders, such as data analysts, engineers and product managers.
Produce state-of-the-art data engineering development methodologies, including code reviews, monitoring, tests (unit, component), infra as code, ci/cd, and more.
Provide expert-level technical leadership and mentoring to the team.
Collaborate with Analysts and Business Stakeholders on data requirements and functional specifications.
Establish data infrastructure for the Data Science team.

Were looking for brilliant data engineers to join our rapidly growing team.
You will join a team consisting of senior software and data engineers that drive our data platform from data acquisition, to processing and enrichment and all the way to business insights.
You will join an early stage team and company and will have a major impact on the decisions and architecture of our various products.
Responsibilities:
Design and build data acquisition pipelines that acquire, clean, and structure large datasets to form the basis of our data platform and IP
Design and build data pipelines integrating many different data sources and forms
Define architecture, evaluate tools and open source projects to use within our environment
Develop and maintain features in production to serve our customers
Collaborate with product managers, data scientists, data analysts and full-stack engineers to deliver our product to top tier retail customers
Take a leading part in the development of our enterprise-grade technology platform and ecosystem
Harmonize and clean large datasets from different sources.

We are looking for a Data Engineering Team Lead to join our in-house infrastructure group and play a pivotal role in contributing to the companys on-going success Come join us!
What You Will Do:
First, you will design a data pipeline architecture for obtaining, storing, ingesting, and routing large-scale amounts of data from various sources worldwide, both proprietary and commercial, in a distributed manner.
You will handle real time and vast data feeds which need to be accurately timestamped and recorded without congesting the network.
You will then lead a team of engineers to implement, maintain and consistently enhance the data pipeline, evaluate different data providers based on accuracy, cost, and richness, keep track of changes, monitor the quality of data sources, and suggest new ways to optimize storage and reduce latency.
Your Impact:
Conceiving innovative and novel ideas in all stages of the ETL pipeline.
End-to-end ownership POC, design, development cycles, deployment, and support.
Creative thinking using state of the art tech stack.