I have an 11 month old 2024 RAV4 Cruiser Hybrid and our winter temperatures are nowhere near as low as yours. Our coldest days are around 13C max and about 2C min.
Like you I bought the hybrid mainly to reduce fuel costs. Over the last 11 months (filling up every 4-5 weeks and around 800kms) I have been averaging 4.9 - 5.1 Litres/100kms (46.1 - 48mpg) between refuellings according to the car's computer. A few times (2 or 3) I also manually calculated the fuel consumption using the kms travelled and the number of litres put in at the pump. My calculated fuel consumptions were always within +/- half a litre per 100 kms so I take the computer's fuel consumption numbers as pretty accurate.
I have had to change my driving habits to a large extent to maximise the benefits of the hybrid system - mainly adopting the concept of
one pedal driving.
Basically, to get the maximum benefit you need the car's propulsion to be at least assisted by the high voltage battery while the engine is running or have the battery propel the car down the road with the engine off as much as possible.
This means letting the car coast as much as possible (with foot off the accelerator) when approaching traffic lights, turns, stops etc etc in order to have charge available in the battery as long as possible (regenerative braking). Also, I notice that even when that annoying "EV unavailable" message appears when you press the EV button you can still put the car in EV mode (engine stops running) by easing off the accelerator or taking the foot off altogether and then just very slightly touching/pushing the accelerator. When on flat or even slightly uphill roads taking the foot off the accelerator and then just very slightly pushing it will get the car to continue moving with just the battery and the engine off if you have sufficient charge in the battery (hence use regenerative braking as much as possible).
If you drive the hybrid car like a normal petrol only car then the benefits from the hybrid system will be significantly reduced, especially in city/suburban environments.
Hopefully the above will see you achieve much better fuel consumption numbers.