Patterson has a lot of tools. He's tall, he's athletic, he can run like a deer, and he has a 7-6 wingspan. He's also raw, not refined offensively, and skinny. So as you and djcon point out, it could go either way.
But trashing the kid? I mean -- it's possible that he doesn't pan out in any capacity, a la Sean William, and ends up being just a practice warm body.
Or maybe he "only" ends up eventually settling in as a quality backup center, a la Baye Moussa Keita or Jeremy McNeil [and there's solid value in that].
And if the stars align, then maybe he'll be able to actualize his full potential a la Jesse and turn into a quality starter.
I'm not predicting which outcome will eventually prove to be how things pan out. But gambling on athleticism long term isn't a bad choice, if we can land some portal transfers to contribute short term.