Data Quality

(只提供英文版本)

Big Data – Blog by YY

Data Quality

Data, as the core factor in Data world. We might wonder whether there is criterion existed before everything getting started. What I meant “ everything getting started “ is the process of ETL, data deposit into DataBases(DBs)/DataWarehouses(DWs), and, of course, the afterwards analysis against the source we currently have.

The answer is “ YES “ and that is the topic I will introduce, “ Data Quality. “

Why it is important, because “ Quality data “ means “ USEFUL DATA, “ meaning data must be consistent and unambiguous. Data that is not high quality can undergo data cleansing to raise its quality.

繼續閱讀

Continue Integration and Continue Delivery

CICD – Blog by John Chang

Continue Integration and Continue Delivery

目前許多軟體公司開發的方法皆採用敏捷式開發,敏捷式開發的優點是,在比較小且快速的循環中,持續驗證開發結果,以確保產品符合原始需求。例如著名的Scrum即是一種敏捷式開發。要完成這種開發模式,需要很多自動化的工具,而持續整合與持續交付就是一個關鍵的過程。

繼續閱讀

Types of analytics

(只提供英文版本)

Big Data – Blog by YY

Types of analytics

“Machine Learning,“ hot field that bursted into our attention after AlphaGo defeated professional Go players.
However, beyond confidential algorithms being used in AlphaGo, fundamental concepts for us to grab the fields are necessary.

In the weekly blog, commonly used analytics types will be introduced in the next section.

 

繼續閱讀

AWS Cloud and DevOps with the intention to bring more enterprise on to the cloud and practicing

DevOps – Blog by John Chang

AWS Cloud and DevOps with the intention to bring more enterprise on to the cloud and practicing

CALMS是DevOps團隊開發的一種概念框架,它代表著culture, automation, lean, measurement, sharing. Culture代表團隊的價值、態度,這些會反映在公司中的開發、維護以及測試等相關環境中。

繼續閱讀

Limitations on QuickSight

(只提供英文版本)

Big Data – Blog by YY

Limitations on QuickSight

In the previous blog, I mentioned how to do data analysis in between QuickSight, data visualization service, and, S3, where the sources coming from. Like other services, this kind of integration has pitfall as well. I am gonna list pitfall regarding integrating QuickSight and S3 for off the wrong route in development.

繼續閱讀