Sucked that the only Google result for this is addressing the problem and no one had fixed it. I also noticed for some reason on a "posts" page the $post->ID; always returns the ID of the first post displayed, so any attempt at trying to use that was futile, seems like a big bug.
Anyway so I weeded through a lot of the WP functions and what not and figured out a solution. Your average title may look like:
<title><?php wp_title('|',true,'right'); bloginfo('name'); ?></title>
The only solution I could figure out was to not use wp_title(); and get the page title like this:
<title><?php echo get_the_title($wp_query->queried_object_id); ?> | <?php bloginfo('name'); ?></title>
Hope this helps other people. Also note that if you're using that AiO SEO Pack you'll have to do some fiddling w/ the plug-in file since it overwrites the title, and is apparently using similar wp_title() calls as any regular WordPress.