A town centre will lose its last remaining post office when the WHSmith branch it is based in closes, it has been confirmed.