Students accused of ‘cultural vandalism’ over calls to remove the legacy of Victorian polymath they claim ‘invented racism’