Very cool project! Out of curiosity, after reading the story section in the README, I thought of Sikuli. Would JavaScript bindings to the Sikuli API meet your desired use case, or are you looking to provide other functionality, improve performance, etc?