Last modified Time is wrong on sitemap.xml
You can check screenshot here
You can check my sitemap here
Post and Page modified time it’s ok but category , post tags and all taxonomy sitemap’s modified time it’s wrong…
Please fix this on next version yoast. 🙂
Sorry for my very bad english.
https://wordpress.org/plugins/wordpress-seo/