That’s not what the colloquial use of the word “literally” means. It emphasizes what is being said. If you say “I am speaking literally,” it still means the same thing it always did. But if I say “I am literally not interested in whether my use of literally is correct or not,” you know what I mean. There’s literally no confusion. So stop pretending there is.
