My old office building made sounds like that on really windy days, but the movements were almost imperceptible.
My current office building is much newer and much taller. It doesn’t creak as much and the movement here is almost imperceptible, too (I assume thanks to counterweights). But on one floor with double-height ceilings that are a bunch of light fixtures that hang several feet and on really windy days those light fixtures will sway back and forth quite dramatically.