I actually found a Blackthorne boot and a few Imperial Gems on Master difficulty.
I think it's only class specific Sets that are Torment only.
Class specific sets and some new level 70 items which are torment specific.
Imperial gem drops start in master, it tells you on the difficulty slider.