Actually, I think it's that he doesn't want off-the-cuff comments made at numerous speeches being turned against him the next time he writes a judicial opinion. The justices really try to hold themselves aloof from the media, you know. They try to maintain an appearance and aura of sequestered legal reflection and reasoning largely unaffected by the ebb and flow of mass media.
Of course, they make gaffs. Like when S.D. O'Connor mentioned that if Gore won, she wouldn't be able to retire when she wanted (because she can't trust a Democrat to replace her).