What you should cut are all the free sugars (to <5 % EI, which doesn’t include other types of carbohydrates like starch or whole vegetable simple intrinsic simple carbohydrates). There is no significant advantage of reducing the rifined ones more than other free sugars.