This is poor thinking. Almost nothing in life is 100% safe, and few things are so dangerous you can't do them at all. So it's a matter of risk and how much risk you are prepared to take.
The granny charger is higher risk than a properly installed permanent chargepoint, but both are very low risk in the first place and so it may be that the slightly higher risk of the granny charger is still below your personal acceptance of risk.
There is also the question of how often you use it - if you use the granny charger a handful of times a year, but the permanent charger every day, then the added risk is minimal.
One analogy is with a spare tin of petrol for an ICE car. Filling up at a petrol station is lower risk than keeping a stash of petrol cans at home and filling up there - you'd think I was crazy to suggest that - but most of us are happy to use a spare tin once in a blue moon if we run out.
Some of the risks associated with the granny lead are higher in the general case - plugging it into the "average" socket around the UK - and can be lower (or higher) for the particular socket you happen to have chosen for your daily use.
Technical issues giving rise to the difference in risk include: earthing (most random 13A sockets will use a PME earth, forbidden for outdoor charging), type of RCD (most random sockets will have at best type AC and might not have RCD at all), contact quality of the 13A socket itself (most have limited life if used at full power every day, especially after they become worn from repeated plugging/unplugging), and the fact that the 13A plug/cable is live at the point of plugging/unplugging. So you could install a 13A socket specially for charging, make suitable earthing arrangements, fit a good RCD, choose a metal-clad socket of high quality to reduce overheating risk, and never unplug it to avoid wear - you'd now have a setup almost as safe as a dedicated chargepoint. But it would have cost you almost as much!
However, for me the decisive argument is not the safety issue but this: only one UMC came "free" with the car. Unless you buy another one, you either leave it permamently plugged in at home (in which case you will probably find you've forgotten to take it with you on a trip and cause yourself inconvenience worth well over £500), or else you unplug it, roll it up and stash in the boot every morning before setting off in the car, getting your hands dirty and wasting time (again, to me this is well worth £500 to avoid the trouble). Furthermore, this way you are relying on your UMC as your one and only means of charging: if it breaks (or perhaps "when", given you are using it every day) you are in big trouble. Conversely, with the permanently installed chargepoint you have your UMC always there in the boot for any emergency, including the case of your home chargepoint having broken down.
Subsidiary arguments include the fact that slow charging makes it hard to use off-peak electricity (both a cost driver and a green issue), winter time defrosting (where the 13A socket won't supply enough power to run the heater, so you will run down your main battery and lose range).