We're looking for an experienced Data Engineer Team Lead to join our growing data group. In this role, youll not only design and implement high-scale, data-intensive platforms but also lead a team of talented engineers, driving the evolution of our data infrastructure. You will research and implement cutting-edge algorithmic solutions and collaborate with cross-functional teams on significant, high-impact projects that support our mission of providing accurate and actionable business intelligence.
Where does this role fit in our vision?
Every role at our company is designed with a clear purposeto integrate collective efforts into our shared success, functioning as pieces of a collective brain. Data is at the heart of everything we do. Our data engineers are responsible for building the core products that drive our business. The data teams own and manage the pipelines that create our assets, with a strong focus on the company KPIs.
What will you be responsible for?
Solve Complex Business Problems with Data Integration and Engineering Solutions
Develop and implement robust, scalable data pipelines and integration solutions within our Databricks-based environment.
Leverage technologies like Spark, Kafka, and Airflow to tackle complex data challenges and enhance business operations.
Design innovative data solutions that support millions of data points, ensuring high performance and reliability.
Collaborate with Business Stakeholders and Define Priorities
Partner with Product Managers, Data Scientists, and other key stakeholders to prioritize data initiatives that directly impact our core product offerings and user experience.
Ensure data solutions align with business goals, helping drive product features that bring value to our users and streamline B2B sales processes.
Requirements: 3+ years of experience in leading people
3+ years of experience in data engineering
5+ years of experience as a software developer (Python preferred)
Proficient in the composition of Advanced SQL (analytical functions) and query performance tuning skills
Experience working within the AWS ecosystem (AWS S3, Glue, EMR, Redshift, Athena) or comparable cloud environments (Azure/GCP)
Experience extracting, ingesting, and transforming large data sets
Experience with working with multiple kinds of databases (relational, document storage, key-value, time-series) and their associated query languages - specifically understanding when to use one vs. another
Experience with big data platforms such as Spark, Databricks, and Kafka as a streaming bus
Experience utilizing enterprise data warehousing systems such as Redshift or Snowflake
AI-savvy: comfortable working with AI tools and staying ahead of emerging trends.
This position is open to all candidates.