Edge#106: š„The āWhatās New in AIā recap#2ļøā£
Every six months we provideĀ a summaryĀ ofĀ what weāve recently covered in TheSequence. Catch up with what you missed and prepare for the next half of the year.Ā This issue is the second part of the āWhatās New in AIā recap. Whatās New in AI is a deep dive into one of the freshest research papers or technology frameworks that is worth your attention.
Starting next week, look for our fresh Edges about data labeling, series on Transformers, and other fascinating ML topics. Now, letās review what we have:
(read along, no subscription is needed) Edge#74: How Uber, Google, DeepMind and Microsoft Train Models at Scale. Large-scale training is one of the most challenging aspects of building deep learning solutions in the real world. In this issue, we review some of the top architectures, specifically:Ā
Google GPipeĀ
Uber HorovodĀ
DeepMind TF-ReplicatorĀ
Microsoft DeepSpeedĀ
->read how the technology giants address the challenge of large-scale training
Edge#80: TensorFlow Quantum Just Turned One Year Old. In this Edge, we overview:
Quantum machine learningĀ and its two main components:Ā Quantum Datasets and Hybrid Quantum Models.
Quantum computing frameworkĀ Cirq.
TensorFlow QuantumĀ (TFQ) āĀ a framework for building QML applications. As well as, the steps that TFQ follows to train and build QML models.Ā
Edge#86: How DeepMind Prevents RL Agents from Getting āToo Cleverā: Recently, DeepMind started analyzing the problem of task specification in more detail andāÆproposed the notion of aligned RL agents that have the objective of achieving the best possible result in their environmentā¦Ā ->read more
Edge#90: OpenAI Safety Gym is an Environment to Improve Safety in RL Models: The idea of incorporating safety as a measure in RL agents is certainly intriguing and Safety Gym is one of the first fully automated approaches to enable these ideas for the next generation of RL agents ->read our deep dive
Edge#98: OpenAI Built RL Agents that Mastered Montezumaās Revenge by Going Backwards. It turns out that replaying a knowledge sequence backwards for small time intervals is an incredibly captivating method of learning and also a marvel of human cognition.Ā How would a similar skill look in artificial intelligence (AI) systems? Read more->
Edge#100:Ā Facebook NetHack Challenge is Likely to Become One of the Toughest Reinforcement Learning Benchmarks in History. Despite all its success, Facebook AI Research (FAIR) believes that RL needs to be pushed to new levels and, for that, they are turning their attention to a new game: NetHackĀ -> learn more about NetHack competition and how it can advance the research
Edge#102: DeepMind Wants to Redefine One of the Most Important Algorithms in Machine Learning as a Game. The DeepMind work is one of those papers that you canāt resist reading just based on the title ->what did DeepMind come up with and how it can be expanded to some of the fundamental optimization problems in machine learning? Read further
(read along, no subscription is needed) Edge#104:Ā AllenNLP Makes Cutting-Edge NLP Models Look Easy: Created by theĀ Allen Institute for AI,Ā AllenNLP provides a simple and modular programing model for applying advanced deep learning techniques to NLP research, streamlining the creation of NLP experiments and abstracting the core building blocks of NLP models ->read this overview that got over 90 likes ;)
Next week we start with Data Labeling. Stay tuned!