You should still get sound even with small amps but it would be rather weak. Check first the source of the signal. Test with different sources to be sure. Check for loose connections.
It powers my 2 12" punch subs full force then after a few minutes i lose all sub-noise. Is my amp too small?