Uplifting conversion across the acquisition funnel with personalization using contextual bandits on AWS
Amazon Payments deployed a multi‑objective contextual multi‑armed bandit using the Upper Confidence Bound (UCB) strategy on Amazon SageMaker AI to personalize content across an acquisition funnel. In a seven‑week online A/B test they observed a high single‑digit percentage relative lift in final‑funnel conversion for one customer segment, while another segment saw no gain, highlighting that content quality, not the bandit model, was the limiting factor. The approach conditions on visitor feature vectors, enabling transfer of learned patterns without separate traffic pools, and the solution is shared via a public code repository for hands‑on testing on synthetic data. Engineers can integrate this deterministic, auditable bandit selection into their personalization pipelines to continuously improve conversion while balancing exploration and exploitation.
⚡ Key Takeaways
- High single‑digit percentage relative lift in final‑funnel conversion for one customer population in a seven‑week A/B test.
- Used Upper Confidence Bound (UCB) selection for deterministic, auditable decisions.
- Implemented a multi‑objective contextual multi‑armed bandit that optimizes the entire conversion funnel.
- Provided a SageMaker‑based code repository to run the method on synthetic data.
- The primary limitation was content quality, not the bandit algorithm itself.
Deploying a deterministic, context‑aware bandit on SageMaker lets production teams continuously personalize at scale with explainable decisions, directly boosting conversion without waiting for static A/B test cycles.
✅ Practical Steps
- Clone the published code repository and execute the SageMaker notebook to train and evaluate the contextual bandit on synthetic data.
- Deploy the trained bandit model to a SageMaker endpoint following the architecture outlined in the article to serve real‑time personalized content.
Want the full story? Read the original article.
Read on AWS ML Blog ↗