Most of his albums have been re-released on Factory too/London Records since the demise of Factory. You must try Vini Reilly, which was the first album he created with heavy use of the sampler. The more recent album Time Was Gigantic... When We Were Kids has some angelic songs with which to contrast his mainly instrumental work.
Depeche Mode song writer Martin L. Gore covered one of Vini's old songs, "Smile in this Crowd," on his Counterfeit EP.