I don't tumble dry or use conditioner and I still have the problem every year. I do wear them a lot.
It's just a shame all the money I spend on shirts now only lasts 1 year. Yet I still wear the shirt that I had when I was 12 (it was very baggy then, good fit now) and it's still in very good condition.