The choice of pvp gear should be based on the opponent your facing.
For example, you are a Swordsman and are going to fight a Dende Priest. As TMQ for humans is one sided based (either physical or energy) it makes sense to wear an energy def set.
For opponents which deal physical damage you should wear physical based armour.
So keep 2 sets, 1 for energy opponents and one for physical opponents.