Well it seems that trying to publish the images over xml-rpc comes up with this error message:
It seems that it didn't like posting the images. So if you change LiveWriter to upload the images via FTP, that error message goes away. After hitting publish it comes up with another error,
This it seems you can ignore. It uploads the images, and it publishes everything correctly. I guess it wouldn't be a Microsoft product without random error messages somewhere.