why you are resembling it with clothes
patch means bandage,
you can drag this topic to other idea such as honour is damaged if you are patch by others it will be shameful for a person with conscience that he is bandages by anyone else not he himself. and so on
may be i am wrong but its my own idea you can oppose it, every one has one's own opinion