.:: Data Sains Lab ::.

The power of data analytics

  • About
Skip to content

Tag: bigdata

June 2, 2019

Sonoff RF Bridge (before the firmware flashed)

Turning a remote controller into a (WiFi) lamp switcher using a Sonoff RF bridge that converts a learned RF incoming signal to an MQTT…

Share this:

  • Tweet
  • WhatsApp
  • Print
  • Email
June 2, 2019

Battle of Time-series Database (TSDB)

The rise of time-series database is accelerated by massive IoTs. It can provide users low latency queries & distributed storage. Competition of TSDB vendors…

Share this:

  • Tweet
  • WhatsApp
  • Print
  • Email
June 2, 2019

Integrating RF smoke sensors into Smart Home

Reflecting from the fire in the Office of Ministry of Transportation This is an industrial-grade smoke detector that sounds very noisy and transmits an…

Share this:

  • Tweet
  • WhatsApp
  • Print
  • Email
June 1, 2019

Big data networking disruptive technology

Investigating big data technology in my job also means observing the revolution in networking technology as the mean for transporting the data. For years,…

Share this:

  • Tweet
  • WhatsApp
  • Print
  • Email
June 1, 2019

Big Data Expo NL

I was so lucky visiting the annual Big Data Expo @ Utrecht, the Netherlands on 19-20 September 2018 (https://www.bigdata-expo.nl/en) Here are some presentations I…

Share this:

  • Tweet
  • WhatsApp
  • Print
  • Email
June 1, 2019

Tensorframes: Tensorflow + Spark

Combining data-intensive best solution (apache spark) and compute-intensive best approach (Tensorflow with GPU) results in Tensorframes. The speedup is remarkable. Hopefully, I could get…

Share this:

  • Tweet
  • WhatsApp
  • Print
  • Email
June 1, 2019

InfluxDB compression

I’m always amazed at how people improve data storing technique, e.g., Influxdb, a time-series NoSQL database, that not only responds to a query very…

Share this:

  • Tweet
  • WhatsApp
  • Print
  • Email
June 1, 2019

Combining neural network and GPU in Google Cloud Platform

Imagine we want to recognize/identify an object in the images streamed from camera feeds (such as to recognize thief/suspect at the immigration checkpoint, airports,…

Share this:

  • Tweet
  • WhatsApp
  • Print
  • Email
June 1, 2019

Polyglot data science applications

There is no such a “Swiss Army knife” tool; every tool has its advantages in a certain circumstance, e.g., we know R has the…

Share this:

  • Tweet
  • WhatsApp
  • Print
  • Email
June 1, 2019

Why we need a big data platform such as Hadoop & Spark?

On the last post, I mentioned that aggregating & sorting 100 million rows dataset (~ 2.4 GB) using monolithic approach takes 4 seconds to…

Share this:

  • Tweet
  • WhatsApp
  • Print
  • Email

Posts navigation

Previous 1 2 3 Next

Recent Posts

  • Jupyter Matlab kernel
  • Home Lab
  • Benchmark Python’s Dataframe: Pandas vs. Datatable vs. PySpark SQL
  • Google BigQuery, a serverless Datawarehouse-as-a-Service to batch query huge datasets (Part 2)
  • Apache Hadoop: What is that & how to install and use it? (Part 2)

Recent Comments

  • Google BigQuery, a serverless Datawarehouse-as-a-Service to batch query huge datasets (Part 1) - .:: Data Sains Lab ::. on Google BigQuery, a serverless Datawarehouse-as-a-Service to batch query huge datasets (Part 2)
  • Google BigQuery, a serverless Datawarehouse-as-a-Service to batch query huge datasets (Part 2) - .:: Data Sains Lab ::. on Be cautious to include legacy resources as part of the big data system
  • Apache Hadoop: What is that & how to install and use it? (Part 1) - .:: Data Sains Lab ::. on Apache Hadoop: What is that & how to install and use it? (Part 2)
  • Apache Hadoop: What is that & how to install and use it? (Part 1) - .:: Data Sains Lab ::. on Why we need a big data platform such as Hadoop & Spark?
  • Google BigQuery, a serverless batch query of big datasets - .:: Data Sains Lab ::. on Be cautious to include legacy resources as part of the big data system

Archives

  • April 2021
  • January 2020
  • June 2019

Category

  • architect
  • big_data_developer
  • data_analyst
  • data_engineer
  • data_scientist
  • others
  • project_manager
  • Uncategorised

Meta

  • Log in
  • Entries feed
  • Comments feed
  • WordPress.org
Copyright .:: Data Sains Lab ::.. All rights reserved. | Powered by WordPress & Writers Blogily Theme
loading Cancel
Post was not sent - check your email addresses!
Email check failed, please try again
Sorry, your blog cannot share posts by email.