That is a problem I’ve experienced with combat as well.
One way to solve that is put combat in an enclosed area, like a smaller hallway. I’ve found it makes combat much harder, as the player has less room to maneuver. Another way is to make a non-fighting challenge, like using the choice system to do some trivia or a riddle. Another idea is having the boss be lots of little monsters (maybe it could be a hive mind?) so that it’s harder for the player to move past them all.
Best of luck with your game! 🙂