Looking for a Data Engineer to join our growing team of data experts.
Design, Build and Operate the infrastructure required for optimal extraction, transformation, and loading of data from a wide variety of data sources using SQL and cloud (mainly AWS) migration and big data technologies.
Optimize various RDBMS engines in the cloud and solve customers' security, performance and operation problems.
Design, Build and Operate large, complex data lakes that meet functional / non-functional business requirements.
Optimize various data types ingestion, storage, processing and retrieval from near real-time events, and IoT, to unstructured data as images, audio, video and documents, and in between.
Keep our customers data separated and secure to meet compliance and regulations requirements.
Work with customers' and internal stakeholders including the Executive, Product, Data, Software Development and Design teams to assist with data-related technical issues and support their data infrastructure and business needs.
Requirements:
Summary of Experience:
B.S.c in Computer Science, Electrical Engineering, Mathematics, Bioinformatics, or another quantitative field.
More than 3 years of experience as a Data Engineer/Software Developer.
Requirements:
Developing in high scale stream data processing architectures.
Hands-on experience with common frameworks: Kafka/Spark/Flink/etc.
Proficiency with server-side languages such as Python, Java, Scala.
Proficiency with SQL(RDBMS) technologies such as: PostgreSql, MySQL, SQL server, etc.
Experience with No-SQL technologies such as: Elasticsearch, MongoDB, Redis, etc.
Experience with Dockers, K8 and CI/CD pipelines.
Experience of work in a public cloud environment: GCP/Azure/AWS.
Experience with AWS cloud services: EC2, RDS, EMR, Redshift etc.
Nice to have:
Hands-on experience with machine & deep learning.
Experience of work in a public cloud environment: GCP/Azure/AWS.