Correct.
It's all about interference. Basically, the things that happen receive contribution from all the ways they can happen, and the different ways don't add normally, they don't simply accumulate they interfere. Your knowledge of the situation can allow you to rule out certain contributions, thereby destroying the interference. The interaction is physical, so occurs even if you don't use the information, that's where the setup comes in. But there's no need for any backward causality in time, and efforts to include it usually are more ungainly than the classical notions they attempt to resuscitate.