If the Crown Estate get their way, London will lose one of its most precious places, says Ranjit Mathrani