For some reason I had always thought this song came out when I was in college, but I’m seeing an album release date of 1989, with the single released in 1990. It got to #14 on the U.S. modern rock charts. This song disappeared from me for a long time until I finally ran across the album ‘Joy: 1967-1990’ at a used record store somewhere, probably Lou’s Records on Pacific Coast Highway in Encinitas.
Ultra Vivid Scene was basically Kurt Ralske, and from his Wikipedia page, I get the impression that he was more an artist who dabbled in a number of things, including music. The background vocals you hear are indeed Kim Deal, formerly of the Pixies, and probably futurely of the Pixies as well.