The Wikipedia article also explains how Jesse Owens had to take the freight elevator in the Waldorf Astoria to reach the party celebrating him, because the guest elevator was for whites.
I read something that stated that the French themselves were kinda racist about making sure that Paris was liberated with all white people, despite the French army including a lot of black soldiers, many from French colonies in Africa, so I’m not 100% sure about pinning it all on the Americans and Brits. However, regardless of nationality, I think it’s accepted that white people pulled unfair strings there.