In the situation presented, is it permissible to overtake the vehicle in front from the right side while exercising utmost caution?

You must not overtake a vehicle, including a bicycle, on or immediately before this pedestrian crossing. Article 26(3)(1) makes an exception for crossings with controlled traffic. That exception does not apply here; exercising special caution alone does not make overtaking permissible.