I'm assuming (yea, I know..never assume..) that your doing this patchwork by hand?
Yes. hem your patches first to keep them from fraying. If the holes are all located in one general area, a large...