#19: Microsoft's $1B OpenAI investment, Lyft's dataset, and what makes a peacock a peacock?

Hey everyone, welcome to Dynamically Typed #19. Today’s edition is a bit shorter than usual, but with good reason: I’m writing it early because the rest of this week I’ll be super busy with Amsterdam Pride events! 🏳️‍🌈🎉

Anyway: the past fortnight’s biggest news was OpenAI’s $1 billion investment in OpenAI and the community’s reaction to their partnership. Other stories include Ben Evan’s blog post about the productization of computer vision on the edge, Misa Ogura’s FlashTorch feature visualization toolkit, and Lyft’s open-sourcing of a self-driving car dataset. Finally, National Geographic covered some interesting work being done in the AI + climate change space. Let’s dive in.

To raise enough money to pay for the recruiting and computing needed to compete with the likes of DeepMind, much of the OpenAI nonprofit (and its employees) has been pivoted to become the for-profit OpenAI LP. The community’s reaction, unsurprisingly, has been mixed; especially OpenAI’s lofty marketing talk about the pre- and post-artificial general intelligence (AGI) periods of the company’s future raised some eyebrows.

This “pre-AGI period” is also where the Microsoft investment and partnership comes in: they will become OpenAI’s “exclusive cloud provider” and their main strategy for productizing the lab’s AI research.

This is great for Microsoft’s AI cloud (and klout), but I’m not too sure what it says about the future of OpenAI. Since they won’t disclose the terms of the investment, it’s hard to know how much the company’s original mission—"the creation of beneficial AGI"—will fall to the wayside to make room for productization.

(And if it does, is that necessarily a bad thing? After all, productized AI is what this section of Dynamically Typed is all about. I’d love to hear your thoughts, so use that reply button!)

Read more about OpenAI + Microsoft here:

Ben Evans of Andreessen Horowitz wrote a post about the potential of computer vision to touch almost everything. On the back of imaging sensors that have become ridiculously cheap in recent years (because of the efficiency of the smartphone supply chain), Evans argues that “imaging plus ML” will power a lot more AI computing on the edge:

I think that especially the former makes for an interesting thought experiment. Let’s take a look at fire detection: in the past, we found out a house was on fire only once a human saw it; then, smoke alarms were invented that started doing that job (and saving lives) automatically; now, imaging plus ML can “see” a fire on a camera feed—without the need of a single-purpose input. Of course, smoke alarms are already cheap and widely available, so they probably won’t get replaced by AI cameras.

But what other specialized sensors can become more affordable or more ubiquitous if they can be replaced by a computer vision model? And what things that a human can monitor now, for which we have no specialized sensors, can we start to track using AI-powered cameras? That’s where cheap imaging plus ML will have a huge impact. (Pervasive facial recognition and image censorship, sadly, are obvious immoral examples that are already being put into production.)

As always, Evan’s post is worth a read: Computers that can see.

Misa Ogura wrote about FlashTorch, her open source feature visualization toolkit for neural networks in PyTorch. Her post first gives a nice history of feature visualization:

Ogura then covers class saliency maps, activation maximization, neuron arithmetic, and activation atlases (see DT #9). Finally, she introduces FlashTorch, which implements saliency maps to show what parts of an image has the most influence on a classification, and dives into some some of its implementation details. As someone who isn’t too deep into computer vision (yet 🤫), I learned a lot from this post. More:

Lyft has open-sourced its autonomous driving dataset. It includes 55,000 human-labeled frames of 3D imagery, each taken from 7 cameras and 3 lidars:

Data collection and labeling like this is immensely expensive, so I’m happily surprised to see Lyft take such a collaborative approach to the self-driving car problem. I wonder how they convinced their investors to OK this. Either way, check out Lyft’s page for the dataset on their Level 5 site, which includes some very cool interactive dataset samples: Lyft Level 5 Dataset: Moving autonomous vehicles forward, together.

Quick ML resource links ⚡️ (see all 32)

National Geographic interviewed David Rolnick, co-author of “Tackling Climate Change with Machine Learning,” the 97-page vision paper that came out of the similarly named ICML workshop earlier this year (see DT #16).

The article then goes deeper into three specific areas where machine learning researchers can help in mitigating the climate crisis:

For in-depth views into each of these projects, check out Jackie Snow’s article for National Geographic: How artificial intelligence can tackle climate change.

Thanks for reading! As usual, you can let me know what you thought of today’s issue using the buttons below or by replying to this email. If you’re new here, check out the Dynamically Typed archives or subscribe below to get a new issues in your inbox every second Sunday.

If you enjoyed this issue of Dynamically Typed, why not forward it to a friend? It’s by far the best thing you can do to help me grow this newsletter. 🏳️‍🌈