That’s actually a point of historical epidemiological debate. it’s one of those things that gets trotted out, but may not be historically accurate.
Also, have you ever read Pastwatch by Orson Scott Card? I’m not a fan of everything he sort of inherently argues in the book, but it’s an interesting look at history, time travel, and “fixed points in time.”