Speculation rises that ministerial-level talks between Korean and Japan may not take place