Hilchos Lashon Hara chapter 4, section 2

It makes no difference whether it is a clear negative commandment or a clear positive commandment that everyone knows about – where the story would surely shame the person very much in the listener's eyes – or something that many Jews are not careful about, like saying that someone does not want to learn Torah.

Either way, it is forbidden, because in the end the speaker is saying that this person does not keep the Torah properly.