Sitemap - 2021 - TheSequence

๐Ÿ•‹ 8 Free ML courses โ€“ our favorites

๐Ÿซ€MLOPs recap, part 1

๐Ÿ”ฎ๐Ÿค“ Some Non-Obvious ML Predictions for 2022

๐Ÿšš ๐Ÿš› Edge#152: How DeepMind and Waymo Train Self-Driving Car Models?

๐Ÿ“š Your Reading List for 2022

๐Ÿ‘ฏโ€โ™€๏ธ๐Ÿ“ฆ Edge#151: Model Packaging

๐Ÿฅœ Metaโ€™s Clever Idea to Handle Uncertainty in ML models

๐Ÿท Data Labeling for ML, part 3

โœจ Edge#150: Microsoftโ€™s SynapseML is a New Framework for Large Scale Machine Learning

๐Ÿ“บ 3 tips to optimize your infrastructure for data-driven targeting*

๐Ÿ”Ž Edge#149: Model Tracing and Lineage

๐Ÿ•น A Massive Leap in ML for Gaming

๐Ÿ“ The Definitive ML Observability Checklist*

โž—โœ–๏ธ Edge#148: The OpenAI Model to Solve Text Math Problems

๐ŸŽ™ Doug Downey/Semantic Scholar: Applying Cutting Edge NLP at scale

๐Ÿฎ Edge#147: MLOPs โ€“ Model Serving

โœด๏ธ Amazonโ€™s Big ML Week

๐Ÿ“• If only someone wrote the book on ML Observability*

๐Ÿ”บ Edge#146: A Deep Dive Into Arize AI ML Observability Platformย ย 

๐Ÿ“ Guest post: A Guide to Leveraging Active Learning for Data Labeling

๐Ÿ”ฌ Edge#145: MLOPs โ€“ model observability

๐Ÿ‘จ๐Ÿผโ€๐ŸŽ“๐Ÿ‘ฉ๐Ÿฝโ€๐ŸŽ“ The Standard for Scalable Deep Learning Models

โ–ช๏ธโ–ซ๏ธโ–ช๏ธโ–ซ๏ธ Edge#144: How Many AI Neurons Does It Take to Simulate a Brain Neuron?

๐ŸŽ™ TheSequence Chat: a year of interesting conversations

๐Ÿ— Edge#143: Feature Stores in ML Pipelines: A Recap

โ™Ÿโ™Ÿ Chess Learning Explainability

๐Ÿค–Edge#142: How Microsoft Built a 530 Billion Parameter Model

โ˜๏ธ CoreWeave is allocating $50 million to scale the best compute infrastructure for ML*

๐Ÿฉบ Edge#141: MLOPs โ€“ Model Monitoring

๐Ÿ‰ NVIDIA's ML Software Moment

๐ŸŒŸShare your opinion on MLOps and get rewarded*

โ˜๏ธ Edge#140: cnvrg.ioโ€™s Metacloud aims to help AI developers to fight vendor lock-inย ย 

๐ŸŽ™ Brian Venturo/CoreWeave about GPU-first ML infrastructures

๐Ÿ”ฅ Edge#139: MLOps โ€“ one of the hottest topics in the ML space

โž—โœ–๏ธ OpenAI New NLP Challenge: Mathematical Reasoning

๐Ÿ“ Guest post: How to build SuperData for AI [Full Checklist]*

๐Ÿท Edge#138: Toloka App Services Aims to Make Data Labeling Easier for AI Startups

๐Ÿ“Œ Event: MLOps Cocktails Done Right: How to Mix Data Science, ML Engineering, and DevOps*

๐Ÿค“ Self-Supervised Learning Recap

๐Ÿค”๐Ÿคฏ Addressing One of the Fundamental Questions in Machine Learning

๐Ÿคฉ Early access: try the world's most flexible AI cloud*

๐Ÿ”ตโšช๏ธEdge#136: Kili Technology and Its Automated Data-Centric Training Platform

๐ŸŽ™ Olga Megorskaya/Toloka: Practical Lessons About Data Labeling

๐Ÿ‘“ Edge#135: Self-Supervised Learning for Computer Visionย 

๐Ÿค–โœจ ML, Physics and Robotics

๐ŸŽ™ Rinat Gareev/Provectus About Data Quality and Enterprise ML Solutions

๐Ÿ”ต๐Ÿ”ด Edge#134: Run:AI's 2021 AI Infrastructure Survey

๐Ÿ“ Guest post: 7 key considerations to develop a scalable annotation pipeline

๐Ÿ—ฃ Edge#133: Self-Supervised Learning for Speechย 

๐Ÿ—ฃ๐ŸŽ The Race for Big Language Models Continues

๐ŸŸ ๐ŸŸฃ Edge#132: WhyLabs, AI Observability as a Service

๐ŸŽ™ Paroma Varma/Snorkel on programmatic approaches to data labeling

โœ๐Ÿฝ Edge#131: Self-Supervised Learning for Language

๐Ÿง ๐Ÿง ๐Ÿง  The Thousand Brains Theory, A New AI Book You Must Read

๐Ÿ“ Guest post: Data Aggregation is Unavoidable! (And Other Big Data Lies)

๐Ÿง™๐Ÿปโ€โ™‚๏ธ Edge#130: The ML Engineering Magic Behind OpenAI Codex

๐Ÿน Edge#129: Self-Supervised Learning as Non-Contrastive Learningย 

๐ŸŒ‹ The Biggest Problems in ML Safety

๐Ÿ“Œ Join us free for TransformX on Oct 6-7

๐Ÿค– Edge#128: Wu Dao โ€“ the Biggest Transformer Model in History

๐ŸŽ™ Judah Phillips / Squark about No-Code Predictive Analytics

๐Ÿผ Edge#127: How Contrastive Learning Influences Self-Supervised Learning methods

๐Ÿ‘‘ The GPT-3 Influence Factor

๐Ÿ“Œ Join us on Oct 6: Data Aggregation is Unavoidable! (And Other Big Data Lies)*

๐Ÿ”ท๐ŸŸฅ Edge#126: Pachyderm 2 Brings ย New Data Capabilities to ย Accelerate your ML Lifecycle

๐Ÿ“Œ Event: Data Discovery and Observability for ML Engineers

โšก๏ธEdge#125: Self-Supervised Learning as Energy Based Methods

๐Ÿ‘‘ Big Tech and their Favorite Deep Learning Schools

๐Ÿท Data Labeling for ML, part 2

๐ŸฆพTransformer Architectures Recap

๐ŸŽ™ German Osin/Provectus About Data Discovery and Observability in ML Solutions

๐ŸŒŒ Edge#123: A New Series About Self-Supervised Learning

๐Ÿท๐ŸฅŠ The Fight Against Labeled Dataset Dependencies

๐ŸŒŸ Take part in the ML Insider Survey

๐ŸŽญ Edge#122: Unified VLP is a Transformer Model for Visual Question Answering

๐ŸŽ™ Bryce Daines/CDS at Modulus Therapeutics: Using ML to Power Next Generation Cell Therapy

๐Ÿ•๐Ÿ•š Edge#121: Transformers andย Time Seriesย ย ย ย 

๐Ÿฅ— Will Machine Learning Data Infrastructures Become Commoditized?

โšช๏ธ๐ŸŸ ๏ธ Edge#120: Howย to Leverageย Open-Sourceย Data Labeling for your Business

โš’ Edge#119: Data Labeling โ€“ Build vs. Buy vs. Customize

๐Ÿ—„ ML to Power a New Generation of Databasesย 

๐Ÿ”ด Cutting-Edge, No-Code Data Science: Powerful, Flexible, Nimble and Explainable AI Automation*

๐Ÿ‘ฏโ€โ™€๏ธ Edge#118: DeepMind Releases Two New Super Models to Handle Any Type of Dataset

โ˜๏ธ The #1 Easy Way You Win Machine Learning*

๐Ÿ‘ Edge#117: Transformers and Computer Visionย 

๐Ÿ˜ฑ Distributed ML Training is the Problem Everyone is Going to Have

๐Ÿ“ Guest post: Introducing Low-Latency Streaming Pipelines for Real-Time ML

๐Ÿ’ช๐Ÿป Edge#116: AI2-Thor is an Open-Source Framework for Embodied AI Research

๐ŸŽ™ Greg Finak/ CTO of Ozette: using ML to extract intelligence from the immune system

๐ŸคฉEdge#115: OpenAI GPT-3, OpenAI API for GPT-3; and how to make transformers more efficient

๐Ÿ’ป OpenAI Codex, a Programming Challenge and one of the Most Impressive AI Demos Ever Created

๐Ÿ‘ Edge#114: AI2โ€™sย Longformerย is a Transformer Model for Longย 

๐Ÿข Edge#113: Google BERT; TAPAS that Query Tabular Datasets; and AutoNLP

๐Ÿ‘พTransformers are Getting More Ambitious

๐Ÿง  Edge#112: How DeepMindโ€™s Compressive Transformer Improves Long-Term Memory in Transformer Architectures

๐ŸŽ™ Emad Elwany/CTO at Lexion on using deep learning to reimagine contract management systems

๐Ÿค— Edge#111: The concept of Attention; Google Switch Transformer; and Hugging Face

๐Ÿ”ฑ Triton: GPU Programming for Deep Neural Networks

๐Ÿ”ท๐ŸŸฅ Edge#110: How The Pachyderm Platform Delivers the Data Foundation for Machine Learning

๐Ÿค– Edge#109: What are Transformers?

๐Ÿ›  Introducing the Real World ML Section

โšช๏ธโšซ๏ธ Edge#108: How to Improve Model Accuracy with Crowdsourced Data Labeling โ€“ Real World Use Cases

๐ŸŽ™Albert Azout/Level Ventures on the state of AI market and the areas to pay attention to

๐Ÿ—‚ Edge#107: Crowdsourced vs. Automated vs. Hybrid Data Labeling

๐Ÿงฌ The AlphaFold Race is On!

Edge#106: ๐Ÿ’ฅThe โ€œWhatโ€™s New in AIโ€ recap#2๏ธโƒฃ

Edge#105: ๐Ÿ’ฅThe โ€œWhatโ€™s New in AIโ€ recap#1๏ธโƒฃ

๐Ÿ”ฎ The Future of Deep Learning According to Three Legends ๐Ÿง™๐Ÿปโ€โ™‚๏ธ ๐Ÿง™๐Ÿปโ€โ™‚๏ธ ๐Ÿง™๐Ÿปโ€โ™‚๏ธ

๐Ÿท Data Labeling for ML

๐Ÿ”น๐Ÿ”ธEdge#104: AllenNLP Makes Cutting-Edge NLP Models Look Easy

๐ŸŽ™ Joe Doliner/CEO of Pachyderm on developing a canonical ML stack and main challenges for mainstream developer adoption

๐Ÿ†๐Ÿ“š Reinforcement Learning Recap

๐Ÿ‘ฉ๐Ÿปโ€โœˆ๏ธThe GitHub CoPilot Milestone

๐Ÿ’ฅ Edge#102: DeepMind Redefines One of the Most Important Algorithms in ML as a Game

๐Ÿค” Edge#101: The Exploration-Exploitation Dilemma in RL; Bayesian Exploration; and TF-Agents for TensorFlow

โ›ฒ๏ธ The Importance of Open-Source ML Datasets

๐Ÿ“Œ Join us July 14th at MLCon โ€“ The AI & ML Developer Conference

Edge#๐Ÿ’ฏ: Will NetHack Challenge Become One of the Toughest RL Benchmarks in History?

๐ŸŽ™ Piero Molino on creating Ludwig and the Importance of Low-Code ML

๐ŸŒ Edge#99: What are Trust Region and Proximal Policy Optimization; PPO to master Dota2; and RLlib

๐Ÿ”ฅ A New Release of PyTorch is Here

๐Ÿ—ฟ Edge#98: OpenAI Built RL Agents that Mastered Montezumaโ€™s Revenge by Going Backwards

โšฝ๏ธ Edge#97: Policy Optimization in RL; how to master football with RL; and DeepMindโ€™s bsuite

๐Ÿ“ฒ Why Mobile Deep Learning is Tougher Than You Think

๐Ÿ”นโ—ฝ๏ธ Edge#96: Molecula is a Feature Extraction and Storage Platform Designed for Enterprise ML Workloads

๐ŸŽ™Oren Etzioni/CEO of Allen Institute for AI (AI2) on advancing AI research for the common good

๐Ÿšฉ Edge#95: What is DQN; how DeepMind masters Quake III; and OpenAI Gym as a must-have tool

๐Ÿ–ผ AI Incumbents and Their Favorite ML Frameworks

๐Ÿ”ธโ—ฝ๏ธEdge#94: Determined AI Tackles the Monster Challenge of Distributed Training

๐Ÿ•ต๐Ÿปโ€โ™€๏ธ Edge#93: Q-Learning, Google SEED RL architecture, and Facebookโ€™s ReAgent

๐Ÿ”ฅ PyTorch is Getting Serious About the Enterprise

๐Ÿคนโ€โ™‚๏ธ Edge#92: Cogito Brings Human-in-the-Loop Data Annotation to Enterprises

๐ŸŽ™ Hyun Kim/CEO of Superb AI on true data labeling automation

๐Ÿ•น Edge#91: Model-Free RL; Atari57 that outperformed humans; and DeepMind's OpenSpiel, an RL framework for games

๐ŸŒŠ Googleโ€™s New Wave of Machine Learning Capabilities

๐Ÿ’ฅ Edge#90: OpenAI Safety Gym is an Environment to Improve Safety in Reinforcement Learning Models

โ›‘๐Ÿ‘‘ Edge#89: Feature Learning โ€“ What Makes Some Features Better Than Others?

๐Ÿง  What is TheSequence? The guide to our content universe

๐Ÿค“๐Ÿ˜ก๐Ÿ‘น Open Source ML from Large Tech Incumbents: The Good, The Bad and the Ugly

๐ŸŽ™H.O. Maycotte/CEO of Molecula on shifting from โ€œdata as fuelโ€ to โ€œfeatures as fuelโ€

๐Ÿ—ฃ๐Ÿค– Edge#88: How IBM Uses Weak Supervision to Bootstrap Chatbots and How You Can Do It Too With Snorkel Flow

๐Ÿง˜โ€โ™€๏ธ๐Ÿ“š Edge#87: Model-Based Reinforcement Learning, Google Dreamer, and Uber Fiber.

๐Ÿคœ๐Ÿค› AI/ML startups align to build a canonical stack and compete with the incumbents

๐Ÿง ๐Ÿค– Edge#86: How DeepMind Prevents RL Agents from Getting "Too Clever"

๐Ÿ†๐Ÿ“š Edge#85: Reinforcement Learning โ€“ very popular and yet misunderstood deep learning discipline

๐Ÿ‘€๐Ÿ‘€ Self-Supervised Learning is Making Inroadsย 

โšช๏ธโšช๏ธ๐Ÿ”ต Edge#84: Snorkel Flow โ€“ One of the Most Comprehensive ML Platforms on the Market

๐ŸŽ™ William Falcon: "We did our job right if the term MLOps disappears"

๐Ÿฅƒ ๐Ÿ‘ฏ Edge#83: One-Shot Learning, Siamese Networks, and ONNX standard

๐Ÿ›ด๐Ÿšฒ The Race to Improve Reinforcement Learning

โšช๏ธ๐Ÿ”ต Edge#82: Fiddler is Bringing ML Monitoring to Enterprises

๐ŸŽ™ Franรงois Chollet: Keras, TensorFlow and New Ways to Measure Machine Intelligence

๐Ÿฅ› Edge#81: Zero-Shot Learning and How It Can Be Used

โ‡๏ธ The Nvidia AI Network Effect Goes Beyond Hardware

๐Ÿ“Œ Event on April 21-22: apply() โ€“ the ML Data Engineering Conference

๐Ÿ’ปโš›๏ธ* Edge#80: Some Things You Should Know about TensorFlow Quantum

๐Ÿฅƒ๐Ÿฅƒ Edge#79: Few-Shot Learning, Prototypical networks, and TorchMeta

โ“‚๏ธ๐ŸŒ€ The MLOps Space is Getting Crowded and Confusing

๐Ÿ’ช๐Ÿป AutoML recap

๐Ÿฅ—๐Ÿฅฉ Edge#78: Feast is an Open Source, Lightweight Feature Store You Should Know About

๐ŸŽ™ Adam Wenchel/CEO of Arthur AI on ML explainability, interpretability, and fairness

๐Ÿ—๐Ÿช Edge#77: How Feature Stores Were Started

โ˜๏ธโš–๏ธ MLย Fairness is Everybodyโ€™s Problem

๐Ÿ”Ž ๐Ÿ‘ฏโ€โ™‚๏ธ Edge#76: Googleโ€™s Model Search is a New, Open-Source Framework for Finding Optimal ML Models

๐Ÿฅƒ๐Ÿ“š Edge#75: N-Shot Learning, how OpenAI Uses it; and learn2learn Meta-Learning Framework

๐Ÿ”†๐Ÿ”… Go Big First, Then Compress

๐ŸŽ™ Iskandar Sitdikov/Provectus: Healthcare has it all: NLP, computer vision, recommendations, and a whole lot more

๐Ÿ‘ฏโ€โ™€๏ธ๐Ÿ‘ฏ Edge#74: How Uber, Google, DeepMind and Microsoft Train Models at Scale

๐Ÿ“Œ Event: AI & Automation for Document Processing in Healthcare

๐Ÿ๐ŸฆŽ Edge#73: Meta-Learning and AutoML, OpenAIโ€™s Reptile Model, and the Auto-Keras Framework

๐Ÿ‘‰๐Ÿ•ณ๐Ÿ‘ˆ Closing the Gap Between Deep Learning Software and Hardware

๐Ÿคฉ๐Ÿ’ฅ 'What's New in AI' Recap 2

๐Ÿ”ดโšช๏ธ Edge#72: Tecton โ€“ The Enterprise Feature Store Built by the Creators of Uber's ML Platform

๐Ÿ”Žโ—ผ๏ธ Edge#71: What is Differentiable Architecture Search?

๐Ÿšœ ๐Ÿ›ต Using Transformers in Mainstream Deep Learning Applications

๐Ÿคฉ๐Ÿ’ฅ 'What's New in AI' Recap

//๐Ÿ’จ Edge#70: Typed Features to Accelerate ML Experimentation at Scale

๐ŸŽ™ Manu Sharma/CEO of Labelbox about the future of data labeling automation

๐Ÿ”Ž๐Ÿ” Edge#69: Search Strategies in Neural Architecture Search

โ™จ๏ธ Making Sense of Microsoftโ€™s Recent Machine Learning Announcementsย 

๐Ÿ“•๐Ÿ“–๐Ÿ“— Natural Language Understanding Recap

๐Ÿ”ต๐Ÿ”ด Edge#68: Run:AI Decouples Machine Learning Pipelines from the Underlying Hardware

๐Ÿ”ช Edge#67: Dissecting Neural Architecture Search in the context of AutoML

๐Ÿ‘ฉ๐Ÿฝโ€๐Ÿ”ง๐Ÿ‘จ๐Ÿปโ€๐Ÿ”ง Continuous Data Improvements and ML Performance

๐Ÿƒ๐Ÿ˜Ž Edge#66: Pluribus โ€“ superhuman AI for multiplayer poker

๐ŸŽ™ Mike Del Balso/CEO of Tecton: There is too much depth in this space for feature stores to be just a โ€œfeatureโ€

โ—ป๏ธโ—ผ๏ธ Edge#65: Bayesian hyperparameter optimization; how Amazon uses AutoML for the entire lifecycle of ML models; and Azure AutoML

๐ŸŽ๐ŸŽ The AI Chip Race is Getting More Specialized

๐Ÿค“๐Ÿ˜Ž Emerging ML Methods Recap

๐Ÿ›  Edge#64: The Architectures Powering ML at Google, Facebook, Uber, LinkedIn

๐Ÿ”ณ๐Ÿ”ณ Edge#63: Blackbox Hyperparameter Optimization, AutoML to train Waymoโ€™s self-driving cars; H2O AutoML

๐Ÿ™ˆ๐Ÿ™‰๐Ÿ™Š GPT-3 and Large Language Models can Get Out of Control

๐Ÿ”๐Ÿ” Security and Privacy Recap

๐Ÿ‘ฉโ€๐Ÿ’ป Edge#62: Data Discovery and Management Architectures at LinkedIn, Uber, Lyft, Airbnb and Netflix

๐ŸŽ™ Jan Beitner, Creator of PyTorch Forecasting

๐Ÿ‹๏ธโ€โ™‚๏ธ๐Ÿคธโ€โ™€๏ธEdge#61: Understanding AutoML and its Different Disciplines

๐Ÿท ๐Ÿ”ฅTraining Data Labeling is One of the Hottest Markets in Machine Learning

โณโŒ›๏ธTime-Series Forecasting Wrap-Up

๐Ÿ•น๐Ÿค– Edge#60: Googleโ€™s Switch Transformer

โ˜๏ธโฐ Edge#59: NeuralProphet, the final chapter on time-series

๐Ÿ’ธ๐Ÿคท๐Ÿฝโ€โ™‚๏ธ Running AI Compute Infrastructures Without Breaking the Bank

๐ŸŽ™ Jim Dowling/CEO Logical Clocks: The future of feature stores

๐Ÿ‘„๐Ÿ‘ Edge#58: OpenAIโ€™s CLIP and DALLยทE Draw Inspiration from GPT-3 to Connect Language and Computer Vision

๐Ÿค– ๐Ÿ•• Edge#57: Transformer Architectures for Time Series

๐Ÿค“โ˜๏ธThe Need for Open-Source Datasets and Benchmarks

โšช๏ธ โšซ๏ธ Edge#56: DeepMindโ€™s MuZero that Mastered Go, Chess, Shogi and Atari Without Knowing the Rules

โณ Edge#55: DeepAR, multi-dimensional time-series forecasting, and Sktime

๐ŸŽˆ Are Feature Stores the Next Bubble in AI?

๐ŸŽ™ Krishna Gade/CEO Fiddler AI: Challenges with model explainability

โ™ฃ๏ธ Edge#54: Facebook ReBeL That Can Master Poker

๐Ÿ’ฌ Edge#53: What are Facebookโ€™s Prophet and AR-Net, and how PyTorch Forecasting enables deep learning models for time-series forecasting

๐Ÿšœ Transformers Continue Setting Records

๐Ÿค– Edge#52: Google Meena That Can Chat About Anything

โฑ Edge#51: Arima, GluonTS, and AutoML for Time Series Forecasting

1๏ธโƒฃ2๏ธโƒฃ3๏ธโƒฃ Three Data Science Trends that are Hard to Live Without in 2021