We are looking for a Senior Data Engineer to join the manufacturing data Engineering team and help us craft data collection solutions, quality control methodologies and monitors, support data enlargement scale. As a Data Engineer, you will play a significant role in bridging the gap between machine learning and software engineering. Your primary responsibility will be to develop, deploy, and maintain the infrastructure, data pipelines and workflows required for the end-to-end solution collecting the data till loading to data warehouse. If you are genuinely passionate about data engineering platforms, methodologies and possesses excellent problem-solving, we'd love to hear from you!
What youll be doing:
Collaborate with multi-functional teams, including full stack engineers, data scientists, data engineers, and DevOps, to craft, implement robust reliable data pipelines, infrastructure and workflows.
develop and support data models, schemas, and database structures that provide blazing-fast analytics performance. Constantly optimize data workflows to ensure flawless real-time and batch data processing.
Implement data quality checks and monitoring mechanisms to ensure data integrity and accuracy at every stage. detect and resolve bottlenecks swiftly to maintain a highly available and reliable data ecosystem.
Control, monitor and optimize worldwide production servers.
Build and maintain scalable data pipelines, ensuring efficient data storage, retrieval, and transformation.
Stay ahead of the curve in data engineering technologies and trends. Introduce new tools, techniques, and standard methodologies to improve our data infrastructure, empowering data scientists and analysts alike.
Feed a culture of learning and knowledge-sharing within the team. Guide and mentor junior data engineers, applying your expertise to uplift the entire department.
Requirements: What we need to see:
Bachelors or masters degree in computer science, Engineering, or a related field.
5+ years of relevant experience.
Demonstrated track record as a hands-on Data Engineer, driving the successful delivery of sophisticated data projects. Your experience speaks volumes.
Experience with cloud-based data platforms like AWS, Azure, or GCP. You harness the power of the cloud to unlock data's full potential.
Strong programming skills in languages such as Python or Scala, with experience in building scalable and efficient systems.
Experience with containerization technologies like Docker and orchestration tools like Kubernetes.
Solid knowledge in Linux environment.
Ways to stand out from the crowd:
Attention to detail is unwavering. You take pride in delivering data of the highest quality, turning it into insights that power critical business decisions.
Experience working and data engineering frameworks such as Kafka, Cloudera, Spark, Airflow or Hadoop.
Growing in a multifaceted environment, able to balance multiple priorities admirably without compromising on quality or precision.
This position is open to all candidates.