To drive to or from Mexico or Canada as a U.S. citizen, you have to have either the passport book or the passport card. Everywhere else, you can only use the passport book.
You haven’t left the country for a while if you didn’t know that there are full passport controls at both our northern and southwestern borders now.
