If your rack is metal, then something might be connecting through that.
Also some sensitive gear might be next to a power transformer, and picking up the 60 hz from there. Could be enviromental, too.
Have rarely found a ground loop, but they do exist.