Cache Rebuild does not always update home page

I enabled the ‘Cache rebuild. Serve a supercache file to anonymous users while a new file is being generated. (Recommended)’ option because I suffer very high CPU usage when I update a post or publish a new one.

However, in may cases, when I update a post (e.g. to correct a mistake), the home page does not get updated and the previously cached page is served when the old content.

I understand that the old home page should be served for some seconds while the new cache is generated, but that is not the case. The old cached page is served for ever.

https://wordpress.org/plugins/wp-super-cache/