Re: Pere Ubu, As most say, Modern Dance, The Datapanic box is great value (and has Modern Dance on it anyhoo, also the epic b-Side Heart Of Darkness)
Can I also give a big thumbs up to the much later (dare I say recent) 'Why I Hate Women' album. Probably my fav' Ubu album bar non. Kinda crosses over with the David Thomas album 18 Monkies, in that the music draws from similar sonic pallates, but some great songs on both. Content range from raw to tender/heartfelt. Some great out there synth sounds, and some great old rockers too. Can Highly recommend 'Long Live Pere Ubu (Musical retelling of the Ubu Roir, Jarry play)' and 'Lady From Shangai' too, which pretty much brings you right up to date.
Bit of an anomly, but I really enjoy the cobbled together live fan footage album of '360 Degrees of Simulated Stereo Sound'. V. Lofi recording, but captures the band in full flow from a few gigs in their early incarnation.