I don't know if it was "so quickly."
Looked to me like Judah was carrying on while the ball should have been inbounded. The ref let it go for a few seconds, but then wanted to get the ball back in play. When he reached for it, Judah pulled it away.
I'm fairly certain that Judah wasn't trying to get into it with the ref. And I'm guessing that he didn't realize it was the ref reaching for the ball [based upon Judah's reaction, I believe [and I acknowledge that this is my opinion only] that he assumed it was a Louisville player, which is why he pulled the ball away].
But put yourself in the ref's shoes. A kid is complaining about a missed call, then goes on and on with his coach on the sideline while the game should be actively live. To get things rolling, you try to get the ball from said player to get the game back on track, and the kid pulls it away.
Seemed to me like it wasn't that quick -- it was all of the stuff in combination that drew the T.