'They're trying to divide us': Farmers' body refuses to attend meet with Centre