Few consumer goods are immune from the effects of new tariffs on imported goods, but apparel may be among the hardest hit.