I disagree about the OL and the defense. Both were getting better by the end of the 2004 season.
Ray Rice would have joined CB Courtney Greene.
And he would have joined guys like Steve Gregory(NFL), Jameel McClain (NFL), Ryan LaCasse (NFL) James Wyche (NFL) Kelvin Smith, Tanard Jackson (NFL), Dowayne Davis (NFL), Joe Fields (NFL), Joe Kowalewski (NFL), Jerry Mackey (NFL?) , Jason Greene, Quinn Ojinaka (NFL), Steve Franklin, Damien Rhodes, Brendan Carney and soph QB Perry Patterson - who set a completions record in 2004 - as well as other players returning from the Champs Bowl team.
I agree that team needed a WR - Rice Moss and some others might have helped but that was a weak area no doubt.