Tory councillors blame Parliamentary Party for losses