The difference between the concrete and the mortar is due to the size of aggregates present. Whereas in mortars we use only fine aggregates, that is sand or its equivalent, in concrete we use both fine and coarse aggregates.
It is well known that the strength of concrete depends on the the maximum size of aggregates, beside other factors. Therefore if concrete can be used in a given situation, it should be used in preference to mortar as it would work out cheaper.