דרושים » תוכנה » Data Infrastructure Engineer

Required Data Engineer
Job Description:
Be responsible for designing, implementing and maintaining data pipelines from different sources into the organizational data warehouse (DWH)
Design and implement robust, scalable solutions making it easier to identify gaps and the design processes needed to solve them
Work with analysts and product managers to understand business priorities and translate requirements into data models
Collaborate with various stakeholders across the company like data engineers, analysts, data scientists, finance experts, etc.,
Collaborate with a broad forum of stakeholders, including architects and engineers, to create high quality deliverables.

We are seeking to hire a Backend Developer, ideally with some background in DevOps & Infrastructure fields, to support the companys tech side. Candidates will have the opportunity to code and develop in multiple programming languages, on a microservice oriented environment, using latest modern tech stack.

The position will work directly under our Head of Technology, but will also need to communicate well and be able to work with other peers and senior colleagues from different departments.

Well Count on You To:
Maintain existing code, solving bugs, implementing changes.
Developing new features, new tools, and working on new green-field projects for new product endeavors.
Help maintaining and keeping the stability of our infrastructure and availability of our services & products.
Building and Improving tech-related support systems such as monitoring, alerts, analytics, etc.
Supporting and helping the PoliSci team and the Sales team when working with internal (non-client facing) systems, usually due to clients demands.

Required Experienced Software Engineer, Demand
What are some of the things you do on a day-to-day basis?
Develop one of the largest real time big data operation in the world to support over 40TB of new data every day
Have end to end ownership: Design, build, ship, measure and maintain our frontend and backend services
Collaborate with the brightest software engineers team members
Influence directly on the way billions of people discover the internet
Develop at unimaginable scale, serving hundreds of requests per second
Work on innovative projects that are the next growth engines for us
Here are some of the things software developers in our group did in the last several months:
A unique data pipeline for processing and managing user data signals
Develop a complete user identities graph and find deterministic and probabilistic methods to enrich it
An algorithmic model to predict the performance potential of a specific audience
Infrastructure to create unique audiences for advertisers based on various signals (behavioral, contextual, etc)
An A/B tests system to explore variations and experiments over audiences
Understand and use big data algorithms to estimate key business metrics over billions of impressions
Build user interface using React that serve thousands of users
And many more
Our Tech Stack:
Java, JS, TS, Python, React, Spark, Kafka, Hadoop, Cassandra, Vertica, ES, MySQL, Memcached, HDFS, BigQuery, Kusto, Docker, K8S, Linux, Prometheus, Grafana, Airflow.

Were looking for an exceptional Data Team Lead to lead our data analytics team and transform the scraping industry. As a Head of Data, you will be a major focal point in the company, lead a team of data professionals and work closely with cross-functional teams to ensure data-driven decision-making and impactful insights.
What Youll be Doing:
Provide strong leadership and mentorship to a team of data analysts and data engineers by setting clear goals, providing regular feedback, and ensuring the teams professional growth and development
Work closely with Product, Sales and CS teams to gather needs for data insights and reports within the company
Own internal data in the company, including product and business analytics, end to end and be responsible for its delivery, infrastructure, accuracy and integrity
Work closely with the product team to lead data features of our own customer facing analytics dashboard
Lead the analysis of complex datasets to extract valuable insights, trends, patterns and anomalies that drive strategic decisions
Present findings and actionable insights to senior management and cross-functional teams
Lead the building and upgrade of existing data infrastructure to cope with performance, scalability, and growth ץ

Our Research team is growing, and we are looking for a Senior Data Engineer to join the team.
Not Your Typical Senior Data Engineer Role
You're a crucial pivot in our R&D unit, ensuring our data flows seamlessly, is stored efficiently, and can be accessed and interpreted for justice at scale. You will be responsible for designing our data architecture, implementing and maintaining data pipelines from various sources, and building our databases.
There is no one way of doing things. We are open to new ideas and we encourage creativity, new initiatives and entrepreneurial minds.
Responsibilities:
You will devise scalable solutions to enhance the capabilities of our legal data team to analyze factual information and extract legal implications from it.
Design data analytics modeling solutions with the data science and ML engineers
Collaborate with peer engineering teams (backend & frontend developers and architects) as well as data scientists, product managers, and data analysts to understand business priorities and translate these requirements into data models.
Work with DevOps and engineers to design and implement our infrastructure.

Were looking for a strong ML engineer to join our team and help lead the development of our ML infrastructure.
If youre passionate about ML, Python and high-scale big-data environments, come join the team!
What you'll do:
Lead the development of our ML Ops infrastructure, creating processes that support ML projects in the company from their development phase until their deployment to production and beyond.
Build and support an infrastructure for real-time model inference at scale, serving billions of requests each day.
Implement data-based processes and solutions processing massive amounts of data as part of our ML pipelines.
Work closely with our data scientists to deliver new projects, define processes and coding standards and gather requirements to further develop our infra.
Design and implement pipelines integrating ML models and prediction results into our core products.
Be the go-to person for any Python or ML Ops related question or idea, being a focal point for both our Research and engineering teams.

We are looking for a Software Engineer to join the Cluster team.
Why would you love this job?
As a member of the Core Platforms group, you will be responsible for the software behind the fastest NoSQL clusters on earth, supporting more than 200 million ops/sec at sub-millisecond latency with true linear scalability.
​Our ideal candidate is a strong individual that loves to work with a diverse team of bright and ambitious people.
You are passionate about technology in general and specifically the challenges around cloud, performance, and distributed computing. You are a quick learner, always eager to learn and improve.
You are able and willing to share your knowledge and guide other team members.
If youre all that, fun to work with, and want to make an impact while contributing to a wildly successful startup, then this is the right challenge for you.
What youll do:
Develop the next generation of our Cluster products and solutions.
Own and lead our Cluster features end-to-end, from design through development and deployment.
Debug, maintain, and improve the Cluster infrastructure, enhancing its ability to handle many thousands of databases with millions of requests per second.
Provide technical leadership and guidance to other team members.
Participate in various open source projects that we maintains and/or contributes to.
Work closely with team members, Product, DevOps, Support, Customer Success, and other R&D teams.

MA?LYS is one of the fastest-growing global D2C startups with a self-built e-commerce platform that allows us to leverage data and optimize marketing funnels to bring clinically tested body care products to women worldwide. With years of rapid growth and millions of customers worldwide. MA?LYS is on track to become one of the biggest body care brands in the world. The company has built a strong tech backbone to leverage its data, collected over the span of dozens of million of $ in online advertising spend. The data analysis and predictive modeling guide the company’s decision making and play a central role in its success, creating a unique competitive edge over the industry and other e-commerce players. We are a team of people who want to make lasting, impactful changes, who live (and love) to see results, who innovate with passion, and who love a good sense of humor. Is our vibe your vibe? We are seeking a highly skilled Data Engineer to join its exceptional Data Team. You will play a crucial role in building the data foundations, which play an essential part in the company's growth engine.
Your life at MA?LYS will look like…
* Developing and maintaining scalable data pipelines and analytics infrastructure
* Build the infrastructure and processes required for optimal extraction, transformation and loading of data from a wide variety of data sources, using Python, Airflow, Rivery and BigQuery.
* Full responsibility for company & data department monitoring, logging and anomalies, support the Data scientists and data analyst’s requirements and needs
* Collaborate with varied teams and departments in order to deliver useful & insightful data products
You will thrive in this role if you have…
* 4+ years of relevant experience as a Data Engineer
* Strong knowledge of SQL.
* Strong knowledge of Python.
* Experience in managing and maintaining cloud resources
* Experience with BI tools (Tableau/Power BI/Looker/Sisense or similar)
* Experience with Data Warehouses
* Experience building ETLs
* Understanding business processes and collecting user requirements Advantages:
* Experience with Airflow
* Experience with GCP and streaming components
* Experience with Power BI

We are seeking a Senior DevOps Engineer to join our team.
As a DevOps Engineer and lead the effort in designing, building, deploying and maintaining our companys infrastructure, deployment pipelines, and continuous integration/delivery workflows.
You will work closely with development teams to ensure efficient and reliable software delivery, as well as identify and implement improvements to our systems and processes.
Responsibilities:
Design, implement, and maintain highly available and scalable infrastructure on cloud platforms such as AWS, Azure, or GCP.
Build and maintain deployment pipelines
Design and implement data pipelines to support various data processing needs across the organization.
Work closely with development teams to ensure code is deployed efficiently and reliably while maintaining high standards of security and performance.
Identify and implement improvements to our systems and processes, including automation and monitoring solutions.
Troubleshoot and resolve issues related to infrastructure and deployments.
Collaborate with cross-functional teams to ensure seamless integration of new features and technologies.

An innovative network security solutions provider, is at an exciting time in its history and is growing fast! We are looking for a highly skilled and versatile Backend Engineer to join our development team. As a Backend Engineer, you will be responsible for designing, developing, and maintaining the backend infrastructure and components of our platform. As part of your role, you will also work on the frontend aspects of our platform and collaborate with stakeholders and cross-functional teams to optimize full-cycle system performance
Responsibilities:
Design, develop, and maintain backend systems and APIs to support our web applications
Implement and optimize data storage solutions, including databases, to ensure efficient and reliable data management
work closely with front-end developers to integrate backend functionalities and ensure a seamless user experience
Collaborate with product managers, stakeholders, and cross-functional teams to gather requirements, translate them into technical specifications, troubleshoot and resolve backend-related issues, and optimize system performance.