big_data_developer

GPU Inference at Edge: NVIDIA Jetson TX-2

NVIDIA Jetson TX2, a 64-bit arm board equipped with 256 CUDA cores (Pascal architecture), has arrived at the home during the holiday season. I was so lucky having the board together with the development kit for only 300 Eur, including the shipping fee (from UK to NL) due to the educational discount (the normal price … Read moreGPU Inference at Edge: NVIDIA Jetson TX-2

The analytic function of MySQL

I just realized the newest version of MySQL (version 8.0) supported oracle-based “analytic function”, meanwhile his sister MariaDB had those two years ago.

Battle of ML/DL framework on stand-alone vs. distributed platform

Will steep improvement of algorithm + decrease on hardware cost (CPU, memory, disk) drag the distributed approach irrelevant? IMHO, at this time, the winner is h2oai which gives an impressive performance in stand-alone mode and supports distributed platform (i.e., atop Spark using h2o sparkling water). I was so surprised that Standford’s statistics maestro, Tibshirani & … Read moreBattle of ML/DL framework on stand-alone vs. distributed platform

Dataiku: flexible data science tools

In the previous post, the flexibility given by data science tools greatly reduces the performance, i.e., the execution speed. Fortunately, Dataiku, a data science tool, provides multiple ways to aggregate big data: 1) using the built-in building blocks; 2) using a custom R script with the built-in I/O blocks; or3) using an independent custom R … Read moreDataiku: flexible data science tools

Google Cloud Speech API

Very often I need to verify whether a video containing certain keywords that I am looking for. That is very difficult to be done unless I watch the entire video or download the subtitle. However, most videos do not have a subtitle inside. I then found out the transcription services on the Internet but the … Read moreGoogle Cloud Speech API

Flexibility vs. Speed

Data science tools such as Rapidminer, Dataiku, and KNIME offer so much flexibility and provide easy-to-understand building blocks that abstract data processing functions. It allows data analysts implementing a business case quickly. However, it comes with a price: slowing down the execution speed due to variable transfer between tasks. Here is the trial. Aggregating 100 … Read moreFlexibility vs. Speed

CPU vs. GPU

Inspired by the benchmark from Matt Dowle (https://h2oai.github.io/db-benchmark/), I compared his benchmark with GPU (Detail: https://lnkd.in/e7iHg7N). For processing big data, GPU K20 2 GB is slightly better than 20 cores CPU Xeon 2.6 GHz 125.8 GB RAM, even much better in some tests 🙂 Of course, the performance comes with a price. Thanks to Omnisci … Read moreCPU vs. GPU

Low-powered living body detection

A friend asked me to design a low-powered living body detection system for a rural farm in Indonesia. The constraints are no electricity and limited Internet connectivity. The system is designed in microservices atop Raspbian to ease massive rollout.

GPU Database

I think one of the promising technology in the next couple of years is the use of GPU for accelerating any kinds of job. One of the company follows the direction is OmniSci (formerly MapD). They have a live demo showing how fast GPU processes almost 400 million tweets and visualizes them geographically in less … Read moreGPU Database