Placing an ad on one specific page only

I go to a page, place the Advertisement widget in the side column, place an advert in it, and it works. The problem is that this advert then overrides all other adverts in the same position in the side column on all other pages too.
Clearly I’ve got a setting wrong but I’ve wasted a day trying to find it. Help please!