The power of data analytics
One of IoT application for the smart home: electronic appliance energy monitoring. I used Sonoff PoW as the measuring and switching device. To be integrated only into our private network, we need to flash the firmware. I used Tasmota’s ESP8266 firmware (https://github.com/arendst/Sonoff-Tasmota) and followed the instruction given in the web (Disclaimer: you have to solder … Read moreEnergy monitoring device
Reflecting from the fire in the Office of Ministry of Transportation This is an industrial-grade smoke detector that sounds very noisy and transmits an “RF-433 MHz alarm” when exposing heavy smoke (e.g., in case of fire). I converted it to a network device using an MQTT-RF bridge, so:1) it can be monitored anywhere, anytime, and … Read moreIntegrating RF smoke sensors into Smart Home
Our Android phone is by default equipped with multiple sensors, e.g., accelerator sensors, magnetic field, photo light detector, noise level sensor, etc. I have an unused LG G4 which I turned into a sensor device. To convert the sensor readings into MQTT message, Sensor Node Pro is used. Telegraf is embedded to the MQTT server … Read moreAndroid sensors to Smart Home
In any good IT platform, main features must be prepared in front, by-design. Scalability and high availability are two must-have capabilities in any big data system today. Out-of-service, inaccessible, server busy, and too long response time are some issues that are avoided by any organization for years. Impressed by the performance of Influxdb compared to … Read moreInfluxDB cluster: Setup & Installation
Investigating big data technology in my job also means observing the revolution in networking technology as the mean for transporting the data. For years, the networking spaces were dominated by just a number of players, i.e. Cisco, Juniper, etc. I was so surprised looking at disruptive innovators such as Cumulus Linux which offers independent network … Read moreBig data networking disruptive technology
Democratization is a trending word in today’s era, i.e., private-owned have to be community-driven, vendor to be open source, elite to be everybody, locked to be freedom. In the hardware domain especially in switch/routing technology that is dominated by just a bunch of vendors, democratization can be seen in the advent of new technologies such … Read moreOpenWRT: Network Democratization
In the previous post, the flexibility given by data science tools greatly reduces the performance, i.e., the execution speed. Fortunately, Dataiku, a data science tool, provides multiple ways to aggregate big data: 1) using the built-in building blocks; 2) using a custom R script with the built-in I/O blocks; or3) using an independent custom R … Read moreDataiku: flexible data science tools
Data science tools such as Rapidminer, Dataiku, and KNIME offer so much flexibility and provide easy-to-understand building blocks that abstract data processing functions. It allows data analysts implementing a business case quickly. However, it comes with a price: slowing down the execution speed due to variable transfer between tasks. Here is the trial. Aggregating 100 … Read moreFlexibility vs. Speed
A friend asked me to design a low-powered living body detection system for a rural farm in Indonesia. The constraints are no electricity and limited Internet connectivity. The system is designed in microservices atop Raspbian to ease massive rollout.
I think one of the promising technology in the next couple of years is the use of GPU for accelerating any kinds of job. One of the company follows the direction is OmniSci (formerly MapD). They have a live demo showing how fast GPU processes almost 400 million tweets and visualizes them geographically in less … Read moreGPU Database