Yes you are right that most of the AJK people are same as pothoharis and hazarawal in terms of language and culture, but who knows how many times people have changed their languages during the course of the history, I have studied ancient kashmir history where Poonch and Rajauri always played a very important role for the kingdom centred in Srinagar.
On the other note , I found this strate video from Kishtwar area which is outside of Kashmir valley on eastern side where many of the rajputs clans of pothohar reside, surprisingly most of them speak the kashmiri kashur language of kashmir valley which is quite surprising for me,
This Khokhar singer of kishtwar is a famous kashur/kashmiri language singer
It looks to me Dardic languages were once a lot more widespread than their current concentration in northern pakistan and indian kashmir valley.