A quick look at statistical research done over the past 15 years clearly supports the value of Star rankings, even if the metric is FAR from perfect.
A study from 2013 broke the Power "6" conferences recruiting classes into accumulative star rankings from 5 star to 1-star programs. For example, FIVE star programs based on star rankings included: Alabama, Auburn, Florida, Florida State, Georgia, LSU, Michigan, Notre Dame, Ohio State, Oklahoma, and Texas. SU, was listed as a ONE star program for this time period. Over the same four-year span, those 75 teams played head-to-head 1,488 times. Here are the results of those games, with winning records in black and losing records in red:
To describe those results as "compelling" would be selling them short. It's a landslide. On the final count, the higher-ranked team according to the recruiting rankings won roughly two-thirds of the time, and
every "class" as a whole had a winning record against every class ranked below it every single year.
Recruiting Rankings Matter
Then there is this joker:
“It cracks me up when [people] say the ratings don’t matter,” Ohio State coach Urban Meyer told the Big Ten Network, according to 247Sports. “If they’re keeping score, we’d like to win that thing. I do look at that. The recruiting services, although they are not 100 percent correct, they’re very close. A lot of those guys that are highly-rated guys turn out to be great players.