Seq2act

Google open-sourced Seq2act, a new model that translates natural-language instructions (“How do I turn on Dutch subtitles on YouTube?”) into mobile UI action sequences (tap the video; tap the settings button; tap closed captions; select Dutch from the list). This isn’t quite productized yet, but who wants to bet that the next major version of Android will allow you to say “OK Google, turn on Dutch subtitles” in the YouTube app—as well as millions of other commands in other apps—and that the phone will just tap the right buttons in the background and do it for you? This is the stuff that makes me jealous as an iPhone user.