We are seeking a skilled Data Engineer to work on critical infrastructure for our computer vision projects.
You will collaborate with a cross-functional team of data scientists, software engineers, and project managers to design, implement, and maintain scalable data solutions.
Your expertise in handling large-scale data systems will drive the success of our machine learning models and predictive systems.
Responsibilities:
Design and construct robust data pipelines specifically tailored for computer vision applications, ensuring efficient data flow from ingestion to processing.
Manage and enhance our cloud infrastructure to support the scalability and deployment of machine learning models.
Develop and maintain databases with both SQL and NoSQL technologies to ensure quick access and storage of complex datasets.
Implement automated scripts and programs using Bash and Python to streamline data operations.
Monitor the performance of data pipelines and infrastructure, making adjustments as necessary to optimize processing.
Collaborate closely with the machine learning team to understand their data needs and ensure alignment with project goals.
Stay updated with the latest industry trends and technologies, implementing best practices in data management and pipeline development.
Requirements: Bachelors degree in Computer Science, Engineering, or a related field.
3+ years of experience as a Data Engineer or in a similar role.
Strong proficiency in Python and Bash scripting.
Extensive experience with cloud platforms (AWS, Azure, Google Cloud) and understanding of cloud services and architecture.
Proven experience in designing and building data pipelines for computer vision projects.
Deep knowledge of both SQL and NoSQL databases.
Preferred Qualifications:
Familiarity with ML frameworks (e.g., PyTorch, Tensorflow).
Experience with Docker, Kubernetes, or other container orchestration technologies.
Certifications in cloud technologies and database management.
This position is open to all candidates.
