Oops, right after posting I got a brainwave:
$ErrorMsg = $ErrorMsg + 'New error message < br >'
(extra spaces added for viewing)