There also those mem stick recorders which might be an
option.

Also from my brief tour of the Linux world, they seem
to be enchanted with Ogg Vorbis file format for it's
compactness and sound quality.

I have been subscribed to the Audiograbber forum
for years. Over there I think they'd be able to give
the lowdown on this stuff plus whatever is offered
in here.