How grimy are we talking here? Just using plain water and a soft cloth should do the trick, but if they're in terrible shape, try diluting some rubbing alcohol with water and see if that cleans them up. In my experience, scratches on a DVD aren't a big deal. They usually still play just fine.