Data Engineer Luxurynsight

Context

Our full data pipeline starts with the crawling and ingestion of massive volumes of social media & physical events data, which are then analyzed by our computer vision models. These predictions mapped to fashion trends and aggregated into time series that feed the metrics and forecasts at the core of our product.

Team

The Data Engineering team owns this entire pipeline: from crawling and ingestion, through transformation and orchestration, to making reliable, well-structured data available to the rest of the company, Data Science, Product, and beyond. We’re responsible for the health, scalability, and evolution of the data stack that everything else at Heuritech is built on.

Our stack is built around Snowflake, dbt, Airflow, Celery, K8s, AWS, and Datadog.

Role

As a Data Engineer, your mission will be to build, maintain, and scale the systems that turn raw crawled data into trustworthy, usable data for the whole company. This includes:

• designing and maintaining Airflow DAGs and orchestration logic

• building and evolving dbt models and transformations in our Snowflake data warehouse

• improving the reliability, monitoring, and data quality of our pipelines

• working on the crawling stack that feeds our pipeline, and its infrastructure

• contributing to internal tools that make data more accessible across teams

• exploring and prototyping new tools or architectures to improve how we orchestrate and process data

You’ll have real ownership over the projects you’re staffed on, with the autonomy to shape the approach and drive improvements as you see fit.