š§ Meta AI Ideas for Autonomous Intelligence
Weekly news digest curated by the industry insiders
šĀ EditorialĀ
Recreating the cognitive patterns of human intelligence has long been the elusive goal of artificial intelligence (AI). Despite the massive progress in deep learning, AI systems remain pretty far from resembling human-like intelligence. One of the hallmarks of human intelligence is our ability to develop models of the world using a lot of background knowledge and very minimum interactions with a given environment. We donāt need to learn every single concept to master a new task. We often refer to this as common sense, and it seems to be one of the missing building blocks of the current generation of AI systems. Recent deep learning disciplines such as self-supervised learning (SSL) seem to have a solid foundation for building AI agents that can develop models of the world relatively inexpensively by reusing existing knowledge.Ā Ā
In the Meta (Facebook) AI āInside the Labā event a few days ago, AI legend Yann LeCun outlined an architecture to build AI agents that can create models of the world in a self-supervised way and then use those models to predict, reason and plan. LeCunās architecture is based on six core modules, each able to compute differentiable objective functions and pass them to the upstream modules. Not surprisingly, SSL is at the center of LeCunās ideas as a way to build predictive models of the world. However, each of the six core modules encompasses many areas of AI research. Everything indicates that LeCunās architecture would evolve as the foundation for Metaās AI capabilities for metaverse environments.Ā
šŗš» TheSequence Scope is our Sunday free digest. To receive high-quality educational content about the most relevant concepts, research papers, and developments in the ML world every Tuesday and Thursday, pleaseĀ subscribeĀ toĀ TheSequence Edge šŗš»
šĀ Next week in TheSequence Edge:
Edge#169:Ā we explain CycleGANs;Ā walk through the original CycleGAN paper; overview Mimicry.Ā
Edge#170: we deep dive into Superb AI data training platform.
Now, letās review the most important developments in the AI industry this week
š ML Research
An Architecture for Autonomous IntelligenceĀ
As part of the Meta AIās Inside the Lab event last week, Meta AI Chief Scientist Yann LeCun outlined an architecture for autonomous AI systems which can break the boundaries of traditional supervised learning āread more on Meta blog
Whatās Next for Deep LearningĀ
Amazon Research published an insightful blog post about the integration of neural networks and symbolic systems as the foundation for the next phase of deep learning āread more on Amazon Research blog
Competence-Based RLĀ
Berkeley AI Research (BAIR) published a paper benchmarking different unsupervised RL methods and introducing a new competence-based RL algorithm that seems to outperform other alternatives āread more on BAIR blog
Translating 100 Written and Spoken Languages in Real-TimeĀ
Meta (Facebook) AI Research (FAIR) published a blog post detailing the evolution of their work in multi-language translation systems for text and speech āread more on FAIR blog
š¤ Cool AI Tech Releases
TorchRecĀ
The PyTorch team open-sourced TorchRec, a library for building recommendation systems āread more on PyTorch blog
ML Ready PipelinesĀ
ML startup cnvrg.io announced AI Blueprints, an open-source collection of ML pipelines that shorten the implementation cycle of data science teams āread more on cnvrg.io blog Ā Ā
š We recommend
š Ā Real World ML
Salesforce Research published a blog post detailing the architecture for their app recommendation system āread more on Salesforce blog
šÆ Useful Tweet
We turn our educational Edges into threads and recommend helpful books and courses.
šø Money in AI
Former Google CEO Eric Schmidt committed to investing $125 million over five years into AI2050, an initiative aimed to support AI research with a positive impact. The funding is provided through Schmidt Futures.
GraphQL developer platform Hasura raised $100 million Series C funding led by Greenoaks. Hiring remote.
ML Observability Platform Aporia (check the overview in Edge#160) raised a $25 million Series A funding round led by Tiger Global. Hiring in Tel Aviv/Israel.
Compliance operating system platform anecdotes raised $25 million in Series A funding round led by āRed Dot Capital Partners. Hiring in Israel.
Kubernetes development platform Okteto raised a $15 million Series A funding round led by Two Sigma Ventures. Hiring remote in the US/EU.
Synthetic avatars creating platform Neosapience raised $21.5 million in a Series B round led by BRV Capital Management. Hiring in Seoul/South Korea.
Real-time data engineering company Decodable raised a $20 million round led by Venrock and Bain Capital Ventures. Hiring remote.
Sales engagement platform Vymo raised $22 million in a Series C funding round led by Bertelsmann India Investments.
Property operations software platform Facilio raised $35 million in Series B financing led by Dragoneer Investment Group.
Automation company for life sciences Automata raised $50 million in a Series B funding round led by Octopus Ventures. Hiring in London/UK.
No-code platform Skael raised $38 million in a Series A financing round led by RTP Global. Hiring in the US, Mexico, EU - remote.