GPU Inference at Edge: NVIDIA Jetson TX-2

NVIDIA Jetson TX2, a 64-bit arm board equipped with 256 CUDA cores (Pascal architecture), has arrived at the home during the holiday season. I was so lucky having the board together with the development kit for only 300 Eur, including the shipping fee (from UK to NL) due to the educational discount (the normal price … Read moreGPU Inference at Edge: NVIDIA Jetson TX-2

Deep learning inference on android phone

The demo that you’ll always see at any AI/IoT expo/exhibition!The difference is that I’m using my Android instead of a PC or a development board like Rasberry Pi.  The application could be downloaded from Google Play (not mine!). Its name is Object Detector and Classifier (Try it! Believe me, it’s fun!). It uses Mobilenet v2 … Read moreDeep learning inference on android phone

Tensorframes: Tensorflow + Spark

Combining data-intensive best solution (apache spark) and compute-intensive best approach (Tensorflow with GPU) results in Tensorframes. The speedup is remarkable. Hopefully, I could get a multi-GPU cluster to play with. Spark Summit EU talk by Tim Hunter from Spark Summit

Battle of ML/DL framework on stand-alone vs. distributed platform

Will steep improvement of algorithm + decrease on hardware cost (CPU, memory, disk) drag the distributed approach irrelevant? IMHO, at this time, the winner is h2oai which gives an impressive performance in stand-alone mode and supports distributed platform (i.e., atop Spark using h2o sparkling water). I was so surprised that Standford’s statistics maestro, Tibshirani & … Read moreBattle of ML/DL framework on stand-alone vs. distributed platform

Combining neural network and GPU in Google Cloud Platform

Imagine we want to recognize/identify an object in the images streamed from camera feeds (such as to recognize thief/suspect at the immigration checkpoint, airports, stations, etc.). To do that, the convolutional neural network (CNN) is currently the most used method. Such popular CNN architectures such as LeNet, AlexNet, VGG, GoogLeNet, ResNet, YOLO, etc. could be … Read moreCombining neural network and GPU in Google Cloud Platform