But the Berry sentence itself is a specification for that number in only ten words!
This is clearly paradoxical, and seems to indicate that "nameable in under ten words" is not cleanly enough defined. Using programs or proofs of bounded lengths, one may in fact construct a rigorous version of the paradox; this has been done by Gregory Chaitin in order to produce an incompleteness theorem similar in spirit to Gödel's incompleteness theorem; see algorithmic information theory for an exposition.
The Berry paradox was actually created by Bertrand Russell, who named it after G. G. Berry. Berry had provided the original idea in a letter to Russell about the less specific "the first ordinal that cannot be named in a finite number of words".