WordPress SEO by Yoast

I use P3 Plugin Performance Profiler and this plugin is taking up 57% of the run-time. A big leap recently. Overall I have 22 plugins, with a total load time of 0.224 sec. Someone told me that it may not be best for WordPress.org, more for .com. Please could I have some advice, as new to this? Thanks