I used to use panniers/frame racks but there is another way:
I've learned that my hammock/UQ/TQ and tarp will fit into an eVent dry/compression bag and fit under the handlebars or on a minimalist rack above the front tire.
Minimalist rack: http://salsacycles.com/components/minimalist_rack/
My food/stove/fuel go into this bag: https://www.revelatedesigns.com/inde...=4&ProductID=7
The frame bag at Revelate holds my camp clothes and bike tools.
Camera/wallet go into the Revelate 'gas tank' which mounts on the top tube next to the stem.
This system works with or without the minimalist rack.
For water I use the Salsa Anything Cage-it can also carry a small tent or whatever you want to put there: http://salsacycles.com/components/anything_cage/
What this allows you to do is completely avoid panniers if you want to and avoid the metal racks to carry the panniers. It's just lightweight backpacking/hammocking kit applied to a bike.
A lot of my kit is specific to Salsa bikes but the frame bag is made to fit whatever bike you are using. The name of the game is of course weight reduction and less fiddle factor...seems like I used to fiddle with panniers-not a lot once they are dialed in, but the frame bag,seat bag, etc. just make it simpler AND you wont be tempted to pack too much. The tube bag easily holds 3 days food.
I sometimes use a rear rack that is pannier capable but it alone weighs more than all the bags I mentioned above