Is it possible to always pass all keyboard input from the window to the game, but still keep mouse input to the window?
Check the manifest.json named ignore_keyboard_events, It might work for your use case.