"...Some muslim men..."
That's the thing - these characters would be considered pretty dodgy and sleazy by people in their own countries. They are indeed Muslims, but they are bad Muslims, failed in life, unobservant, sexually-frustrated, ill-educated, semi-criminal, drinking and drug-taking in violation of Muslim precepts. Their world-model is a sludgy cocktail of cherry-picked Islamic anti-kaffir attitudes, combined with archaic rural folk beliefs about women and "chastity". The cultures of the countryside and city are different - and most of the Pakistani population of England originates from Mirpur, a grim region of agricultural villages.
There's also the dislocation of being neither one thing nor the other. The mill jobs that their fathers emigrated for are long gone, and Mirpuris - lacking the Hindu community's obsession with education and talent for assimilation - find themselves adrift, the UK-born generations frequently mastering neither English nor Punjabi. Marinade with some partially-masticated race politics, so construing the abuse of these girls as payback to the racist English, and you've got yourself the toxic outlook that these men hold.