Yes, it is true. There may be displacement in the absence of force.
We know that, F = ma,
In the absence of force, F = 0, then ma = 0
⇒ a = 0 [as m ≠ 0]
If a = 0, the object is either at rest or in a state of uniform motion in a straight line. In case the object is moving in a straight line, there must be displacement. So, in the absence of force, there may be displacement in the object.