I'm building a pair of 4pi and I wonder if should I put any type of gasket between the horn and the driver?

I had some pieces of 'acoustical underlayment for laminate floor' remaining from floor installation and I uses it as gasket. It's about 2mm thick.
Is there any problem in having the driver 2mm away from the horn?
Is it better to have them face to face?

Thanks!