Is it really worth it to pay more for local food?

While I like the idea of buying food from my local grower, it's sometimes cheaper in the store. Should I save my money?