The power of data analytics
My key takeaway: these 3 books agree on one thing: in the age of cutting-edge technology implementation like AI, social media; social science (i.e., the knowledge about how we understand interpersonal interaction) is needed more than ever today. Lee accentuates that jobs related to understanding human such as caregivers will have an important role in … Read moreBook review: AI Super Powers, Social Physics, Sensemaking
Investigating big data technology in my job also means observing the revolution in networking technology as the mean for transporting the data. For years, the networking spaces were dominated by just a number of players, i.e. Cisco, Juniper, etc. I was so surprised looking at disruptive innovators such as Cumulus Linux which offers independent network … Read moreBig data networking disruptive technology
Will steep improvement of algorithm + decrease on hardware cost (CPU, memory, disk) drag the distributed approach irrelevant? IMHO, at this time, the winner is h2oai which gives an impressive performance in stand-alone mode and supports distributed platform (i.e., atop Spark using h2o sparkling water). I was so surprised that Standford’s statistics maestro, Tibshirani & … Read moreBattle of ML/DL framework on stand-alone vs. distributed platform
In the previous post, the flexibility given by data science tools greatly reduces the performance, i.e., the execution speed. Fortunately, Dataiku, a data science tool, provides multiple ways to aggregate big data: 1) using the built-in building blocks; 2) using a custom R script with the built-in I/O blocks; or3) using an independent custom R … Read moreDataiku: flexible data science tools
Data science tools such as Rapidminer, Dataiku, and KNIME offer so much flexibility and provide easy-to-understand building blocks that abstract data processing functions. It allows data analysts implementing a business case quickly. However, it comes with a price: slowing down the execution speed due to variable transfer between tasks. Here is the trial. Aggregating 100 … Read moreFlexibility vs. Speed
This is why a smart home is needed: to understand your home better and communicate with pros on their own language — My dialog with the dishwasher’s company (DC): Me: Hi, I’d like to inform you about my dishwasher’s problem. DC: Sure, please give me your address (by address, they know what type of the … Read moreWhy do we need a smart home?
Inspired by the benchmark from Matt Dowle (https://h2oai.github.io/db-benchmark/), I compared his benchmark with GPU (Detail: https://lnkd.in/e7iHg7N). For processing big data, GPU K20 2 GB is slightly better than 20 cores CPU Xeon 2.6 GHz 125.8 GB RAM, even much better in some tests 🙂 Of course, the performance comes with a price. Thanks to Omnisci … Read moreCPU vs. GPU
A friend asked me to design a low-powered living body detection system for a rural farm in Indonesia. The constraints are no electricity and limited Internet connectivity. The system is designed in microservices atop Raspbian to ease massive rollout.
I think one of the promising technology in the next couple of years is the use of GPU for accelerating any kinds of job. One of the company follows the direction is OmniSci (formerly MapD). They have a live demo showing how fast GPU processes almost 400 million tweets and visualizes them geographically in less … Read moreGPU Database
As an online shopper, I need to regularly check my mailbox, 5 floors separated from home. It is really annoying to check whether a new delivery arrives. I came out with this mailbox checker solution that should draw low power (less frequent battery replacement, >6 months) and small (portable). To detect mailbox door activity, I … Read moreMailbox checker