It certianly wouldn't hurt to give it a little wiggle room, I tore one of the lag screws out (drivers side) at the track. The upper tube connection is very rigid and when the engine moves on a hard launch it pulls the intercooler toward the engine.
Rather than risk breaking the IC tank I just put in another bolt but didn't tighten it all the way. In truth, the lower mounts and the upper IC tube are probably enough to hold it, but a pair rubber isolators would be the best way to secure it.
David