When we study Lorentz transformation in the framework of quantum gauge theory of gravity, we will find that the vacuum gravitational gauge field will be changed under gravitational gauge transformation, which will change the structure of the physical space-time and cause clock dilation effect. The study in this paper provides us with new insights to understand the essential and intrinsic relation between special relativity and general relativity. It provides us with a new way to unify special relativity and general relativity.