data_engineer

Tableau, the “de facto” distributed visualization platform for big data

Long time not checked Tableau, this application has incorporated new connectors for recent technologies, e.g., Google Big Query, Spark SQL, etc. It surely positions itself as the ‘de facto’ distributed visualization platform for big data. I was wondering when Tableau delivers its desktop version on Linux platform. Microsoft Excel Text File Microsoft Access JSON File … Read moreTableau, the “de facto” distributed visualization platform for big data

Spin up Oracle database in minutes using Docker

Oracle database is one of most wanted skill perhaps until today. As far as I know, compared to its rivals such as MySQL and Postgres, its installation requires substantial effort. The application itself also draws huge memory and storage. Today, Oracle is contained in a ready-to-use container. Only in minutes, an Oracle instance could be … Read moreSpin up Oracle database in minutes using Docker

Blockchain in KLM @Blockchain Expo 2018

Since early 2018, KLM put blockchain technology in their backend for easing data sharing among parties in the operation & maintenance lifecycle.

IBM Blockchain Demo @IoT Expo 2018

Interesting to see IBM demo about how blockchain will change the way people do coffee trading thru smart contracts among supply chain actors. Some captured slides: https://www.dropbox.com/sh/p1wuu2fvl0ikx63/AAABVkF7ULHReUUW4dMfwZvEa?dl=0

Microsoft Azure IoT edge

Just launched before IoT expo Amsterdam 2018 (19-20 June 2018), a brilliant approach by Microsoft Azure: embedding intelligence to the IoT devices (namely IoT edges), proposing containerized-driven devs-ops using all their SaaS, providing a public registry for massive involvement, and building a partnership with IoT hardware vendors. It’s a big ecosystem. Just get the deployment … Read moreMicrosoft Azure IoT edge

Edge embedded system: UP core

Hardware makers are competing to make a credit card-sized single board computer (SBC) that has ‘enough’ computing power on which ‘intelligence’ can be put. As an example, a drone that could take actions immediately when perceiving a certain pattern without beforehand coordinating with the ground station. Interestingly one of them is based on Eindhoven, UP … Read moreEdge embedded system: UP core

Sonoff RF Bridge (before the firmware flashed)

Turning a remote controller into a (WiFi) lamp switcher using a Sonoff RF bridge that converts a learned RF incoming signal to an MQTT publishing action. Sonoff original application is used (it needs to send the message to the Sonoff cloud). IFTTT (If-This-Then-That) is created to respond to an RF request to turn on a … Read moreSonoff RF Bridge (before the firmware flashed)

IoT market landscape

Many IoT vendors at the last IoT conference in Amsterdam (27-28 June 2018) prefer ZigBee as the connectivity protocol to RF or WiFi due to very low power and advanced functionalities. However, there are 2 main concerns: 1) it brings proprietaries to the market (must be connected to gateway from the same vendor); 2) the … Read moreIoT market landscape

Battle of Time-series Database (TSDB)

The rise of time-series database is accelerated by massive IoTs. It can provide users low latency queries & distributed storage. Competition of TSDB vendors is dynamic and progressive on which newcomers introduce better & better performance and functionalities. The full comparison is as follows. https://docs.google.com/spreadsheets/d/1sMQe9oOKhMhIVw9WmuCEWdPtAoccJ4a-IuZv4fXDHxM/edit#gid=0