Why YouTube gets stuck buffering so much

Virgin user from London here. YouTube is incredibly crap (even at lowest resolutions), Vimeo and other not so popular sites - just fine. Then… Skype (voice only) is also unusable while Google hangouts works perfectly, even with quite high quality video. That’s 20mbps internet… I should probably get a VPN and see what happens.