Love it but have generally the same criticisms as you. Luckily there are mods that help both of these issues:

this one helps slightly with performance: https://www.nexusmods.com/oblivionremastered/mods/35

and this one with difficulty: https://www.nexusmods.com/oblivionremastered/mods/58

Also playing on steam deck I can’t tell if aim assist is helping at all. Can be difficult to look at each gold to pick it up with a controller.

For those that can’t be bothered to click: It’s dengue fever