The confusion was caused by the fact that the favicon was updating, but the rest of the site was not. Can only assume that the favicon is not cached by SG Optimizer
OK, I found the issue, but hopefully this will help others. I have SG Optimizer installed which has a cache option. Purging the cache resolved the problem.