I agree we need to put up with rubbish, I don't agree that we should pay for it

I like some of this thought from A.Word.A.Day:

The price of freedom of religion or of speech or of the press is that we must put up with, and even pay for, a good deal of rubbish.
-Robert H. Jackson, US Supreme Court justice (1892-1954)

I totally agree that we do need to put up with certain amount of rubbish.

I don't understand what Justic Jackson was thinking when he said we also need to pay for it.