It’s true that taking notes forces me to go over everything twice, but it’s the image of what was written down that I remember. I used to buy used books in college. If they had been marked by a previous owner, I’d even see the highlights or notes someone else wrote in the margins.
The only time I really remember sounds alone comes from listening to music. When trying to recall a song, I can hear it like tuning into a radio station. During the years when I played in a band, sometimes we had to memorize from a score. The ability to close my eyes and read the notes while playing helped a lot.