They’re called garden path sentences, they’re meant to trip you up.
Makes me think of the Winograd Schema Challenge, proposed as a replacement for the Turing Test because maybe “being able to deceive humans” shouldn’t necessarily be priority one for AI. Basically you have a sentences such as:
The city councilmen refused the demonstrators a permit because they [feared/advocated] violence.
And depending on whether you use the word “feared” or “advocated”, the AI should be able to tell you who “they” is referring to.
