We are seeking a highly skilled Senior data Engineer to join our dynamic team. This role offers the chance to make a significant impact by enhancing the performance, scalability, and stability of our data pipelines. As a leader and mentor, you will be instrumental in pioneering new features and driving the continuous improvement of our production code.
What You'll Do:
Design and implement ETL functions to optimize forensic data processing.
backend development working to implement new APIs and abilities to enrich new capabilities in
Platform product.
Execute PoCs for new data platform features and integrate successful ones.
Enhance the performance and stability of production-level code.
Utilize AWS services, including Step Functions, AWS lambda, SQS, SNS, Event Bridge, AWS Athena, ECS Fargate, AWS Glue, and EMR, to manage data workflows.
Perform basic DevOps task
Requirements: At least 3 years of proven hands-on data engineering experience on AWS, specifically in ETL related technologies like Spark, Glue, Athena, Step Functions, Parquet.
Proven experience in data cleansing, manipulation and aggregation using Python and/or scala.
A total of 5 years of experience in software development.
Experience in deploying AWS Lambda functions and utilizing APM tools.
AWS data Engineering certification is a plus.
This position is open to all candidates.