I would recommend watching the Hiking the Himalayas BBC documentary and their episode where they walk through Pakistan. They were warned several times, and even given a police escort. But they had no problems. People were friendly, but there was still a lot of risk and danger. They were recommended to not go to most areas.