I now have over a week of actual data on how my new heat pump is performing.
Prior to installation, I had gas heating on to 18 degrees from 6am-9pm, with the odd boost upwards if I was feeling particularly cold. Now, I have heating 24 hours a day - 20 degrees 6am-9.30pm, 18 degrees the rest of the time. The only caveat to that is I've been told the Maduka room thermostats can overestimate, and I've not tested it, but it definitely feels significantly warmer than before.
Compared with the week prior to installation, my total energy costs (on same tariff as before) are a whopping 26% cheaper (from £50 to £36) and compared with the week before that, 19% cheaper. I have now switched to the Octopus Cosy tariff, which gives you three almost half price periods of electric and one expensive peak time, and based on the first two days of using that I will save an additional 13-14%.
This is a bit unexpected - my calculations before going ahead with this was that I would come out approximately the same in costs - or perhaps slightly cheaper, down entirely to the removal of the gas standing charge. Some of this is probably down to the age and inefficiency of the old system but I'm beyond impressed. And my energy usage has gone down from around 500 KwH to 135 - it's like pure voodoo.
Yes there's a learning curve, they are not a like-for-like replacement for a boiler. I'm still tinkering with the settings and the apps / control panel really need to be more consumer friendly (I think Octopus is doing this with its Cosy brand of heat pumps - mine's a Daikin, and they are not easy to understand). But so happy with it - just waiting to see how it copes with a proper cold, minus temperature day.