We are seeking an experienced Data Engineer to join our Data Platform Engineering group at our company. This group is responsible for providing the technological solutions that best fit the business needs of various stakeholders, including product teams, BI analysts, marketing analysts, finance, data scientists, backend teams, and more.
What you will be doing
Build and own the infrastructure and services required for processing and storing data from a wide variety of sources, including mobile apps and internal/external data producers.
Design and build processes to integrate a wide range of edge systems across multiple cloud providers and handheld platforms reliably.
Assist data consumers across our company in defining requirements and refining existing processes using a wide variety of tools.
Define and own the systems and processes that deliver data to the data warehouse, while maintaining these systems and the warehouse itself.
Identify bottlenecks in internal data processes and resolve them by automating workflows, optimizing data delivery and storage, and redesigning infrastructure for greater scalability.
Integrate new tools and solutions to empower the companys data consumers and help assimilate them effectively.
Requirements: 5+ years of development using Python, Scala, Java, or other modern programming languages
2+ years of hands-on work designing, building, and optimizing data-intensive distributed systems
Proven ability to manage payloads running on major cloud providers
Comfortable collaborating with cross-functional teams in fast-evolving tech environments
Strong background in Big Data technologies such as Flink, Spark, Kafka, Hive, and Airflow
Experience with SQL, data modeling, and relational databases as well as a deep understanding of ETL & ELT.
This position is open to all candidates.