The accused are entitled to face their accusers. Victims, being the accusers, are in the precarious position of having been dominated/controlled but the accused. Usually, it includes a psychological element as well as the physical and s e xual elements of control.
The combination, and often the duration, make for an extremely tough barrier to cross when called upon to testify. Further, a good defense attorney will rip apart a victim/accuser's testimony as they are generally confused the first time they tell their story, though it may be corrected later, a good attorney will attempt to paint the victim/accuser of lying, causing a breakdown of testimony. Jurors then get confused, the seed of doubt is planted.
Thus, many s e xual assaults get plea bargained just to secure a conviction, some punishment and to mark the perpetrator as a s e x offender.
It sucks, but prosecutors know it is better than letting the S.O.B.s out with no conviction or punishment. Few victims can hold their own on cross.
To your question, victims rights groups can only go so far, too. They can support the victim but cannot force the victim to testify.
What really sucks is that so many people in power think they are helping a predator rehabilitate themselves when I truth they are merely facilitating the perpetrator, especially regarding child perps.