2022

January

• RETRO vs LaMDA - Clash of the Transformers - January 25, 2022
  AI  Presentation  Machine Learning  Transformers  RETRO  LaMDA 
• Text Similarity for NLP - January 7, 2022
  AI  Workshop  Machine Learning  Transformers  BERT  SentenceBERT 

2021

December

• Back to Basics 03 - December 16, 2021
  AI  Presentation  Machine Learning  Back to Basics  Transformers  BERT  NLP  GDSC 
• Back to Basics 02 - December 9, 2021
  AI  Presentation  Machine Learning  Back to Basics  CNN  GDSC 
• Back to Basics 01 - December 2, 2021
  AI  Presentation  Machine Learning  Back to Basics  MLP  GDSC 

November

• GPT : Beams, Sampling & more - November 25, 2021
  AI  Presentation  Machine Learning  Transformers  GPT  Beam Search  top_k  top_p 

October

• PerceiverIO - August 26, 2021
  AI  Presentation  Machine Learning  Transformers  BERT  Perceiver  PerceiverIO  PonderNet 

July

• Back to Basics 03 - July 20, 2021
  AI  Presentation  Machine Learning  Back to Basics  Transformers  BERT  NLP 
• Back to Basics 02 - July 13, 2021
  AI  Presentation  Machine Learning  Back to Basics  CNN 
• Back to Basics 01 - July 6, 2021
  AI  Presentation  Machine Learning  Back to Basics  MLP 

April

• Positioning Yourself for the Future: AI from the Backend - April 10, 2021
  AI  Presentation  SGInnovate  Singapore  NewFrontier 

February

• TensorFlow Everywhere - February 18, 2021
  AI  Presentation  TensorFlow  Research 

2020

September

• Where the jobs are in AI, and Why - September 12, 2020
  AI  Presentation  SGInnovate  Singapore  NewFrontier 

July

• TensorFlow 2.3 from source on Fedora 32 - July 29, 2020
  AI  TensorFlow  Fedora  Python 

February

• Deep Learning State of the Art - February 6, 2020
  AI  Presentation  Causality  Hyperparameters 

2019

December

• TensorBoard Lite - December 19, 2019
  AI  Presentation  TensorFlow  PyTorch  TensorBoard 
• TensorFlow 2.1 from source on Fedora 30 - December 4, 2019
  AI  TensorFlow  Fedora  Python 

November

• Faces in the Browser using TensorFlow.js - November 30, 2019
  AI  Presentation  TensorFlow  TensorFlow.js 
• Neural Structured Learning - November 12, 2019
  AI  Presentation  TensorFlow  Probability  Hyperparameters 

October

• TensorFlow . Probability : Hyperparameter Search - October 10, 2019
  AI  Presentation  TensorFlow  Probability  Hyperparameters 

September

• AI Day.TH : Transformers and Unicorns - September 29, 2019
  AI  Presentation  TensorFlow  Transformers  NLP  BERT  GPT2  ALBERT  AIDay  Thailand 

August

• BigDataX : TFX (and a little bit of TFLite) - July 13, 2019
  AI  Presentation  TensorFlow  TFX  TFLite  TensorFlow Extended  TensorFlow Lite 
• XLNet (Singapore AI Day) - July 6, 2019
  AI  Presentation  ImageNet  TransferLearning  MetaLearning  OneShotLearning  Reptile  AIDay 

June

• PyCon.TH : CNNs for Images in TF2.0 - June 16, 2019
  AI  Presentation  TensorFlow  CNNs  PyCon  Thailand 
• Single-Path NAS and the Lottery Ticket Hypothesis - May 30, 2019
  AI  Presentation  TensorFlow  AutoML  NAS  Neural Architecture Search  Lottery Ticket Hypothesis 

April

• TensorFlow 2.0 : CNNs for Images - April 16, 2019
  AI  Presentation  TensorFlow  CNNs 

March

• TF.summit highlights - March 14, 2019
  AI  Presentation  TensorFlow  TF.summit  EdgeTPU  TFLite 

February

• The Rise of the Language Models - February 26, 2019
  AI  Presentation  NLP  OpenAI  GPT2  transformers  Malaysia 
• NeurIPS Lightning Talks - February 26, 2019
  AI  Presentation  TensorFlow  NeurIPS  NIPS 
• Embed All The Things - December 18, 2018
  AI  Presentation  TensorFlow  Embeddings 
• Building, growing and sustaining ML communities - December 8, 2018
  AI  Presentation  TensorFlow  Communities  NIPS 

November

• Learning Language with BERT - November 21, 2018
  AI  Presentation  TensorFlow  Magenta 
• Deep Learning Voices - November 12, 2018
  AI  Presentation  WaveNet  TTS 

October

• New Stuff in TensorFlow and Machine Learning - October 27, 2018
  AI  Presentation  TensorFlow  TensorFlow.js 
• Raw Audio to Piano Transcription - September 27, 2018
  AI  Presentation  TensorFlow  Magenta 
• Did the Model Understand the Question? - September 4, 2018
  AI  Presentation  TensorFlow  Explainability  Interpretability  VisualQA 

August

• Google Cloud Next Extended - August 25, 2018
  AI  Presentation  TensorFlow  AutoML 
• Go Faster with float16 - July 19, 2018
  AI  Presentation  TensorFlow  Mixed Precision  Nvidia 
• NLP Trends : The Rise of the Language Model - June 21, 2018
  AI  Presentation  TensorFlow  NLP  OpenAI 
• TensorFlow.js (Google IO report) - May 17, 2018
  AI  Presentation  TensorFlow  GoogleIO  TensorFlow.js 
• Intrinsic Dimension - May 15, 2018
  AI  Presentation  PyTorch  Intrinsic Dimension 
• Learn to Learn to Learn (Singapore) - April 29, 2018
  AI  Presentation  ImageNet  TransferLearning  MetaLearning  OneShotLearning  Reptile  AIDay 
• Learn to Learn to Learn (Thailand) - April 21, 2018
  AI  Presentation  ImageNet  TransferLearning  MetaLearning  OneShotLearning  Reptile  AIDay 

March

• Deep Learning DIY - March 25, 2018
  AI  Presentation  ImageNet  TransferLearning  MetaLearning  OneShotLearning  Reptile  FOSSASIA 
• Introduction to CNNs (Speech Stamps) - March 6, 2018
  AI  Presentation  TensorFlow  CNNs  SpeechRecognition 

February

• NIPS Tutorial Synposis - February 22, 2018
  AI  Presentation  TensorFlow  NIPS 

January

• 2018 : What's new and what's changed - January 23, 2018
  AI  Presentation  TensorFlow  WaveNet 
• NIPS 2017 Itinerary - December 11, 2017
  AI  Conference  NIPS2017 

November

• Going Deeper - Transfer Learning - November 21, 2017
  AI  Presentation  TensorFlow  CNNs  TransferLearning 

October

• Relationships from Entity Stream - October 19, 2017
  AI  Presentation  PyTorch  Relation Networks  Relationships 
• Deep Pockets - October 2, 2017
  AI  NeuralNetworks  Research 

September

• Failures, Hurdles & Opportunities - September 27, 2017
  AI  NeuralNetworks  Research 
• TensorFlow from Source - September 21, 2017
  AI  Presentation  TensorFlow 
• Unsupervised Learning - September 18, 2017
  AI  NeuralNetworks  Unsupervised 

August

• TensorFlow from source on Fedora 26 - August 30, 2017
  AI  TensorFlow  Fedora  Python 
• Smaller Networks - August 24, 2017
  AI  Presentation  TensorFlow  Keras  CNNs  ImageNet 
• Tips and Tricks - July 20, 2017
  AI  Presentation  TensorFlow  Keras 
• Relation-Networks in PyTorch - July 6, 2017
  AI  Presentation  PyTorch  Relation Networks  Relationships 

June

• Beginners Day - June 24, 2017
  AI  Presentation  Training  TensorFlow  Keras  Dense  CNNs 
• Captioning - June 22, 2017
  AI  Presentation  TensorFlow  Keras  RNNs  CNNs  Attention  AIAYN  NLP 

May

• Text and RNNs - May 25, 2017
  AI  Presentation  TensorFlow  Keras  RNNs  NER  NLP 
• Fun with TensorFlow - May 20, 2017
  AI  Presentation  TensorFlow  Keras  ReinforcementLearning  BubbleBreaker  AlphaGo 

April

• Generative Art : Style-Transfer - April 13, 2017
  AI  Presentation  TensorFlow  CNNs  ArtStyleTransfer 

March

• Introduction to CNNs - March 20, 2017
  AI  Presentation  TensorFlow  CNNs  SpeechRecognition 
• Deep Learning DIY - March 18, 2017
  AI  Presentation  NLP  CNNs  SpeechRecognition  FOSSASIA 

February

• TensorFlow Estimator extra outputs - February 27, 2017
  AI  TensorFlow  Estimator 
• TensorFlow Estimator input_fn - February 25, 2017
  AI  TensorFlow  Estimator  CNN  MNIST 
• Going Deeper - Transfer Learning - February 16, 2017
  AI  Presentation  TensorFlow  CNNs  TransferLearning 

January

• RNNs and NLP - January 23, 2017
  AI  Presentation  NLP  RNNs  PyData 
• Learning NER from Experts - January 19, 2017
  AI  Presentation  NLP  SGInnovate 

2016

December

• Deep Learning Frameworks - December 27, 2016
  AI  NeuralNetworks  MNIST 
• Review of TensorFlow sugar coatings - December 10, 2016
  AI  NeuralNetworks  TensorFlow 

November

• Layers on top of TensorFlow - November 26, 2016
  AI  NeuralNetworks  TensorFlow  MNIST 
• ICONIP 2016 : Sparse Word Embeddings - October 16, 2016
  AI  Presentation  Poster  WordEmbeddings  Sparse  theano  blocks 
• Consciousness and the Social Machine - August 28, 2016
  AI  AGI  PaperTakeaway  Conciousness  Attention Schema  Awareness  Chatbots 
• Fifth Elephant : Deep Learning Workshop - July 30, 2016
  AI  Presentation  Workshop  NeuralNetworks  theano  lasagne  VirtualBox 
• NLP Lessons Learned - July 29, 2016
  AI  Presentation  NLP 
• DataScienceSG 2016 : Deep Learning Workshop - July 23, 2016
  AI  Presentation  Workshop  NeuralNetworks  theano  lasagne  VirtualBox 

June

• PyConSG 2016 : Deep Learning Workshop - June 23, 2016
  AI  Presentation  Workshop  NeuralNetworks  theano  lasagne  VirtualBox 

May

• arXiv : Compressing Word Embeddings - May 16, 2016
  AI  Paper  Word Embeddings  Sparse  NLP  theano 

April

• FOSSASIA 2016 : Deep Learning Workshop - March 19, 2016
  AI  Presentation  Workshop  NeuralNetworks  theano  lasagne  VirtualBox 

January

• IES-2015 : Learning NER from Experts - November 24, 2015
  AI  Paper  Presentation  NER  Named Entity Recognition  NeuralNetworks  theano  blocks 
• TensorFlow @ PyData SG - November 17, 2015
  AI  TensorFlow  python  Presentation 
• TensorFlow Installation - November 11, 2015
  AI  TensorFlow  python  Nvidia 
• Contributing to TensorFlow - November 10, 2015
  AI  TensorFlow  theano  python 

October

• A Small Theano Epiphany - October 27, 2015
  AI  theano  python 
• Binary Classification vs Probability Regression - October 23, 2015
  AI  NeuralNetworks 
• Building Google's 1 Billion word corpus - October 19, 2015
  AI  NeuralNetworks  Corpus 
• Theano and Blocks* in development mode - October 9, 2015
  AI  theano  blocks  git 

September

• Reinforcement Learning Course - August 31, 2015
  AI  NeuralNetworks  ReinforcementLearning 
• GTC South Asia : NER Poster - August 27, 2015
  AI  Presentation  Poster  NER  Named Entity Recognition  NeuralNetworks  theano  blocks 
• The Future of Mind - SG Futurists MeetUp - August 16, 2015
  AI  NeuralNetworks  GOFAI  AGI  Presentation 
• Machine Learning - Going Deeper with Python and Theano - June 19, 2015
  AI  theano  blocks  bokeh  NeuralNetworks  pycon  Presentation 
• Batch Normalization - Accelerating Deep Network Training by Reducing Internal Covariate Shift - February 14, 2015
  AI  NeuralNetworks  PaperTakeaway 
• 1 Billion Words for NLP - January 15, 2015
  AI  NLP  NeuralNetworks  Presentation 

2014

December

• Deep Learning with a little Javascript - December 18, 2014
  AI  NLP  NeuralNetworks  Presentation 
• Understanding English - In 600 lines of Scala - December 10, 2014
  AI  NLP  NeuralNetworks  Presentation 

November

• Trailblazing - November 17, 2014
  AI  NLP  NeuralNetworks  PCA 
• Evaluating entity linking with wikipedia - 2013 - October 30, 2014
  AI  NLP  NER  NEL  PaperTakeaway 
• Low Entropy Coding with Unsupervised Neural Networks - Harpur 1997 - October 14, 2014
  AI  NeuralNetworks  PaperTakeaway 
• GloVe - Global Vectors for Word Representation - Pennington, Socher, Manning 2014 - October 13, 2014
  AI  NeuralNetworks  NLP  WordEmbedding  PaperTakeaway 
• Learning word embeddings efficiently with noise-contrastive estimation - Mnih 2013 - October 12, 2014
  AI  NeuralNetworks  NLP  WordEmbedding  PaperTakeaway 
• Scalable Hierarchical Distributed Language Model - Mnih and Hinton 2009 - October 7, 2014
  AI  NeuralNetworks  NLP  WordEmbedding  PaperTakeaway 

September

• Word Representations in Vector Space - Mikolov 2013 - September 29, 2014
  AI  NeuralNetworks  NLP  WordEmbedding  PaperTakeaway 
• Neural Probabilistic Language Model - Bengio 2003 - September 28, 2014
  AI  NeuralNetworks  NLP  WordEmbedding  PaperTakeaway 
• Do Deep Nets Really Need to be Deep? - September 17, 2014
  AI  NeuralNetworks  PaperTakeaway 
• Combatting overfitting in Trading - September 16, 2014
  AI  AlgorithmicTrading  MachineLearning 

August

• Namecard OCR in Javascript - August 25, 2014
  AI  Presentation  javascript  nodejs  tesseract  dv 

July

• Sentence Dependencies - d3 Visualization - June 15, 2014
  AI  Presentation  javascript  d3js 
• New-Wave Robotics - March 27, 2014
  AI  Robots  Presentation 

2013

March

• Neurons : Pyramids vs Sheets - December 30, 2012
  AI  Fundamentals  NeuralNetworks 
• Eye Movements - December 23, 2012
  AI  Fundamentals 
• The Grandmother Neuron - December 16, 2012
  AI  Fundamentals  NeuralNetworks 
• Sparse Networks - December 9, 2012
  AI  NeuralNetworks 
• Real Neurons are Very Complex - December 2, 2012
  AI  NeuralNetworks 

November

• How Much Domain Knowledge is Built-In? - November 25, 2012
  AI  NeuralNetworks 
• Taking Advantage of Paradigm Shifts - November 18, 2012
  AI  Philosophy  Fundamentals 
• Where's the End of the Rainbow? - November 11, 2012
  AI  Philosophy  Fundamentals 
• Learning without Labels - November 4, 2012
  AI  Fundamentals  NeuralNetworks 

October

• Parallelism through Time - October 28, 2012
  AI  Parallelism  NeuralNetworks 
• Dropouts : 2^N networks for 2xN work? - October 21, 2012
  AI  Fundamentals  NeuralNetworks  Dropouts 
• Unreliability & Robustness - October 14, 2012
  AI  Fundamentals  NeuralNetworks  Dropouts 
• Hierarchy and Connectedness - October 7, 2012
  AI  Philosophy  Fundamentals  NeuralNetworks 

September

• How to Create a Map of Concepts - September 30, 2012
  AI  Philosophy  Fundamentals  Concepts 
• Sleep and Dreams - September 23, 2012
  AI  Philosophy  Fundamentals  Narratives 
• Miller's Law and its AI implications - September 16, 2012
  AI  Philosophy  Fundamentals  Concepts 
• Consciousness has a Narrative Quality - September 9, 2012
  AI  Philosophy  Fundamentals  Narratives 
• Levels of Processing - September 2, 2012
  AI  NeuralNetworks  Fundamentals 

August

• Brain Homogeneity is Very Encouraging - August 26, 2012
  AI  Philosophy  Fundamentals  NeuralNetworks 
• Bringing the Singularity Closer - August 19, 2012
  AI  Philosophy  Fundamentals 
• There's no Shopping List for Artificial Intelligence - August 12, 2012
  AI  Philosophy  Fundamentals