Responsibilities:
Work with other team members to improve, maintain and monitor the data ingestion domains in the data and AI platform.
Come to the office 3 times a week.
Innovate the ingestion and analytics domains and extend the capabilities and knowledge within the team.
Work with the architect of the domains.
Requirements: Python development specifically as data engineer expert or specialist with at least 5 years of experience- MUST
Mandatory - Experience and deep knowledge of Spark, Kafka, open table, NOSQL and SQL DBs.
Knowledge in JAVA. microservices and K8S.
Databrick experience and delta format.
Monitoring tools like Prometheus and Grafana- an advantage.
Working with Copilot writing prompts to enhance efficiency during development- an advantage.
This position is open to all candidates.