Contextual bandits & real-time optimisation
Built some of the first real-time contextual bandit systems for high-volume recommendations in the Nordics, and real-time webpage optimisation for fashion retail. Constraints: per-observation online updates, partial (bandit) feedback, non-stationary reward distributions, and serving inside sub-second request budgets. Evaluation done off-policy (IPS / doubly-robust) rather than on live traffic where experimentation was constrained.