We give generating functions for Gauss sums for finite general linear and unitary groups. For the general linear case only our method of proof is new, but we deduce a bound on Kloosterman sums which is sometimes sharper than Deligne's bound from algebraic geometry.