🕹🤖 Edge#60: Google’s Switch Transformer
the biggest language model in history with over one trillion parameters
💥 What’s New in AI: Google’s Switch Transformer is the Biggest Language Model in History with Over One Trillion Parameters
OpenAI’s GPT-3 is, arguably, the most famous deep learning model created in the last few years. One of the things most impressive about GPT-3 is its size. In some contexts, GPT-3 is nothing but GPT-2 with a lot more parameters. With…