Hilchos Rechilus, chapter 5, section 2

Listening to rechilus, even without believing it, is also forbidden, just as with lashon hara earlier (p. 58).