wayland and program-specific hotkeys

That's the funny part: you don't.

The feasible way to use program-specific shortcuts is by binding it with sway config and invoking command line utilities to do the IPC job.

For OBS that's obs-cmd utility.