Maybe I'm a little dense . . .

. . . but if he was doing it under his robe, and nobody saw his genitals, how can it be indecent exposure?

Remove him from the bench, yeah. And charge him for criminal mischief or something like that, but don't trump up a charge that you know isn't what happened.