I view rankings as an assessment of how good a voter believes a team is. The polls should not be a system of merit/demerit based on wins and losses, as not all schedules are created equal. I don't subscribe to 'Team A lost, so they should drop no matter what." Personally, if you believe Team A is the best team in the country, hypothetically, at full strength, then a loss on the road to a top-15 team and playing without the best player probably should not change that opinion. Correct? If, then, rankings are supposed to reflect who the best team is... then vote that team No. 1.
I realize that rankings haven't traditionally worked this way, but IMHO, that's supposed to be the intent behind them.