Ivy Leagues want smart poor students for their image. If you scored well enough to get into one, they want you there. You are more likely to raise the academic standing of the institution than legacy admissions of the idle rich.
Plus statistically you are more likely to make something of yourself other than take over Dad’s estate/company/country
