I agree with they need MORE reasons, but they already do have a reason.
Weight.
I'm pretty sure comfort will go into these effects also later. Plus other skill types, like dodge parry and block. Once the combat revamp is done we will know more.
I would like to seen bonuses and negs to each.
I think one major bonus to things like grass and cloth are they are super super easy to get the resources for them.