Thanks, that worked.
My confusion was due to a bug where the "Show the Message of the Day" checkbox appeared unchecked even though the server must have thought it was checked. When I checked and unchecked it and clicked save, the welcome header disappeared.