How about using the RSS feeds from your WP blog.
Either using a few lines of php (5+) yourself (example using a feedburner RSS feed, but could be any rss feed),
<?php // Load the XML file into a Simple XML object
$filename = http://feeds.feedburner.com/<em>yourfeedname</em>";
$feed = simplexml_load_file($filename);
// Iterate through the list and create the unordered list
echo "<ul>";
foreach ($feed->channel->item as $item) {
echo "<li><a href='" . $item->link . "'>" . $item->title . "</a></li>";
}
echo "</ul>";
?>
This will display an unordered list of your feed titles including a hyperlink to the WP post.
Additionally you could also display the RSS contents by adding
echo "<li>" . $item->description . "</li>";
before the closing "}"
Then use your site's CSS for styling.
You can also use the Google Feed API (you can see it in action on my site but I don't think I can add a link here. I use the Google Feeds API to display "recent posts", "recent comments" and "Other news" with a mashup of a few external RSS feeds).
CARP (do a google search) is another way to convert RSS to html and allows you to include it in a website.
After all, RSS is about Content Syndication!
hope this helps.