The Haredim are responding to the biblical admonition against coveting thy neighbor's wife which could lead to adulterous behavior. The commandment is directed against men, it doesn't require unmarried women to wear modest clothing and keep apart from men. Why are they are putting the blame on women instead of on their own inability to resist temptation? Even if they can find convincing Talmudic reasoning to justify their actions Haredim have to respect women's rights to use public space just as freely as men.
Ofir Akunis officially replaces Danny Danon as minister of science, technology, and space (Haaretz)
from the article: Haredi man charged with sexual harassment of female IDF soldier