The contraction of the arrector pili muscle causes the skin to recoil back if it is pulled away from the underlying tissue.