דרושים » ניהול ביניים » מפתח /ת data

We are looking for an experienced Backend Developer to join our data group.
Job Id: 20811
As a member of the team you will be a part of a fast, highly-scalable and fully managed data platform which handles terabytes of data per day in a cloud environment.
We are looking for an engineer who will work with multiple technologies stack: Kafka (Azure Event Hub), Kubernetes, Function Apps, Azure Data Explorer, MongoDB, etc.
Using several coding languages like Golang, NodeJS (TypeScript), and Python.
We are required to write efficient code that supports large-scale distributed systems.
Key Responsibilities:
Design and build new solutions/features to help our customers improve their cloud security.
Get experience with new technologies and languages, develop challenging solutions, and have a great opportunity to grow and create impact.
Constantly Improve existing implementations.
Adapt and take on more responsibilities and own your share of the product.
Work with product managers, business, and other teams.

We are looking for an experienced Backend Data Engineer to participate in the development of new services and optimization of our data processing infrastructure to support the growing scale and new product requirements.
As part of the role you will have the opportunity to:
Build end-to-end development of data infrastructure features, scalable data processing, database interaction and integration with CI/CD.
Take part in expanding our core data platform solutions, build new pipelines from scratch that ingest and process data at scale.
Work across a rich stack of technologies from Apache Kafka, Apache Storm, NoSQL, and relational databases.
Analyze and optimize performance, scalability, and stability of our product environments.
Work closely with the data-science team to implement production grade pipelines based on AI research.

Required Senior Data Infrastructure Engineer
What youre applying for:
As part of the Data Infrastructure group, youll help build our data platform for our growing stack of products, customers, and microservices.
We ingest our data from our operational DBs, telematics devices, and more, working with several data types (both structured and unstructured). Our challenge is to provide building tools and infrastructure to empower other teams leveraging data-mesh concepts.
In this role youll:
Help build our data platform, designing and implementing data solutions for all application requirements in a distributed microservices environment
Build data-platform ingestion layers using streaming ETLs and Change Data Capture
Implement pipelines and scheduling infrastructures
Ensure compliance, data-quality monitoring, and data governance on our data platform
Implement large-scale batch and streaming pipelines with data processing frameworks
Collaborate with other Data Engineers, Developers, BI Engineers, ML Engineers, Data Scientists, Analysts and Product managers
Share knowledge with other team members and promote engineering standards.

We are seeking a Senior Data Engineer to join our dynamic data team. In this role, you will design, build, and maintain robust data systems and infrastructure that support data collection, processing, and analysis. Your expertise will be crucial in developing scalable data pipelines, ensuring data quality, and collaborating with cross-functional teams to deliver actionable insights.

Key Responsibilities:

Design, develop, and maintain scalable ETL processes for data transformation and integration.
Build and manage data pipelines to support analytics and operational needs.
Ensure data accuracy, integrity, and consistency across various sources and systems.
Collaborate with data scientists and analysts to support AI model deployment and data-driven decision-making.
Optimize data storage solutions, including data lakehouses and databases, to enhance performance and scalability..
Monitor and troubleshoot data workflows to maintain system reliability.
Stay updated with emerging technologies and best practices in data engineering.

Were looking for a Senior Big Data Engineer in the Data Collection Ingest team to contribute to the design and coding of our data ingestion services.
This role involves working as part of a team that handles millions of requests per minute across hundreds of servers, processing billions of events each day.
This role will report to the R&D Director of Data Collection.
Why is this role so important?
As the most trusted platform for measuring online behavior, millions of people rely on our insights daily as the ground truth for their knowledge of the digital world. Producing these insights requires large scale raw data to be ingested reliably in high scale to provide stable signals for analysis.
As a Data/Server Developer you will have the opportunity to perform hands-on work and own our raw data ingestion pipeline end-to-end. Your work will have a direct impact on the quality and reliability of our data and the insights that our products are delivering to our customers.
So, what will you be doing all day?
Your role as Data/Server Developer of the Ingest Data Collection team means your daily responsibilities may include:
Design, code and manage end-to-end our data ingestion pipelines, both online and offline.
Run the production environment by monitoring availability and taking a holistic view of system health and data quality.
Own data infrastructure features from design to production using industry best practices with focus on quality and delivery.
Lead designs & decision-making processes of the team.
Solve diverse complex problems of scale, performance and business logic.
Collaborate with product managers and other team leaders to plan, nurture, and implement an efficient and effective development process.
Continuously learn and evaluate new technologies in the everlasting effort to perfect our products
Perform code reviews, evaluate implementations, and provide feedback about potential improvements.
Improve your skills, learn from and mentor top-notch engineers and enrich other team members.
Have lots of fun!