Remove the text "All Day" from the widget

One (slightly ungainly) approach would be to create a translation file containing a translation for that string.

A smarter way to change this, though more involved, would be to basically build your own custom widget and replace the existing one – not quite as hard as it sounds as you can inherit all of the existing code and change only the method responsible for outputting that piece of text.