(只提供英文版本)

Big Data – Blog by YY

Data Integration

Types of Data Integration being mentioned publicly would be “Event-driven” and “Data-driven,” however, they are not the different in words definition, but also the “ action “ that triggers the syncing action.

In fact, as the emergence of Internet Of Things, people have been moving from the stage of early- adopters to the more challenging, but more profitable era of mainstream enterprise technology.

However, in this weekly post, I am gonna explain the difference between the two, instead of just  focusing on one topic, either “Event-driven” or “Data-driven.”

繼續閱讀

(只提供英文版本)

Big Data – Blog by YY

Database v.s. Data warehouse

Questions being popped out in BIG DATA field might be, “what is the difference between database and data warehouse,」 or “if I already had databases, do I really need a data warehouse? “

Actually, these questions are fair ones. The reason is the two may appear to be similar; however, there are important differences in itself, like the architecture, technology or even the usage patterns.

In this post, I will provide simpler and generic explanation between the two.

As usual, which one to choose is totally based on the need from organizations/companies/clients.

繼續閱讀

CICD – Blog by John Chang

Continue Integration and Continue Delivery

這個月專注於幫客戶的專案建構自動化的部屬流程。

目前部署的情況是，由開發商將source code打包好後上傳至S3 bucket，再由我們的IT人員把檔案抓下來，接著就是用command line搭配shell script進行某台機器的更新。繼續閱讀

(只提供英文版本)

Big Data – Blog by YY

Data Processing II

In the previous part of the series, we looked at various data processing techniques, from traditional (Batching processing) to the one (Hybrid-processing) commonly being used nowadays. Besides, in the previous series, we only focused on “INPUT.” However, “OUTPUT” part, is what upper level managers care about, because it involved how the INPUT being calculated, what fields in INPUTs being joined, and, etc regarding the numbers/analytics charts in reports, as well as the index that indicates the status in organizations.

繼續閱讀

(只提供英文版本)

Big Data – Blog by YY

Data Processing

Architecture Design, as the heart in every aspect, is a complex task.

For example, the architecture design in automobile, the one in skyscraper, and etc. The reason is the architect needs to take everything, if possible, into consideration.

繼續閱讀