I'm surprised nobody has mentioned this, but you know how a lot of staplers have the turnable base, which pushes the ends of the staple outward? Well, it's called pinning:

Pinning

This method is by far the least known and utilized stapling method. It is used to temporarily bind documents or other items, often cloth or clothing, for sewing. In order to pin, the anvil must be shifted so that the staple bends outwards instead of inwards. The staple binds the item with relative security, but can be easily removed by pulling the staple along the plane of the paper. This method varies between staplers, as some anvils need to be simply pushed forward to allow pinning, while others must be rotated. Some staplers implement pinning by bending one leg of the staple inwards, while bending the other outwards. Some modern staplers do not even include support for pinning.
Give this a try next time you're sewing, you'll be pleasantly surprised.