I started with a clean install of my VPS from the template, and logged into the Power Panel. I went to Add/Remove Software (under Container Management) and chose to remove "Plesk 9.2.3.0 for Windows application template" from the list of installed software. Applying the changes started a lengthy process that took just under 15 minutes to complete.
I'm not really sure how the removal of Plesk is automated by the Parallels Power Panel, but a short while after logging off my Windows session on the server the free RAM is showing in Power Panel as 736.6 MB, significantly more than the 710 MB or so that was free after originally starting the server with a "clean" install from Webfusion's template. Logging back in via Remote Desktop, the desktop shortcut and tray icon for Plesk have gone, the Plesk Control Panel process has gone, and it doesn't appear in the list of installed programs in Control Panel; it's definitely been uninstalled. However the C:\Parallels\Plesk folder is still there, which I will delete manually to free up a bit more disk space.
Update:
When I tried to delete the C:\Parallels folder to free up some disk space, I got the message that I "needed permission" to continue, which suggests that it could have been read-only. However, I have found a cleaner way to remove Plesk. Since I removed it from the list of installed software in Parallels Power Panel, I have re-installed the container (choosing to delete container files). It looks like Power Panel automates the Plesk installation when you install from the template; without Plesk selected it seemed much quicker, and this time there is no trace of Plesk on the VPS. The initial free disk space is 25.81 GB, compared to 25.35 GB for a "clean" installation with Plesk.
Update:
Anyone planning to install SQL Server 2008 will probably want to start with a clean VPS template without Plesk, as described above. It seems that having Plesk included in the VPS template installs some kind of installation of SQL Server 2005 which conflicts badly with the new SQL Server 2008 installation. The only way that I have managed to install SQL Server 2008 Express is by starting with a clean template. I will describe full details of setting up your VPS with IIS and SQL Server Express in a separate post, coming soon.