🕹🤖 Edge#60: Google’s Switch Transformer

the biggest language model in history with over one trillion parameters

💥 What’s New in AI: Google’s Switch Transformer is the Biggest Language Model in History with Over One Trillion Parameters

OpenAI’s GPT-3 is, arguably, the most famous deep learning model created in the last few years. One of the things most impressive about GPT-3 is its size. In some contexts, GPT-3 is nothing but GPT-2 with a lot more parameters. With…