docker build -t [image tag] Build a new image, and give this image a tag name. docker run [image id or image tag] Create and start a container by image id or by image tag.

The idea of data lake is, instead of using a formal database, we just throw all the raw data (could be log files, csv for JSON files, etc.) into a big data repository, that’s what we call a data lake. It’s a common approach for big data applications. AWS S3 + Glue + Athena For example…

We have talked about the scaling for web servers. System Scalability — Web servers As business grows, we are preparing our application to be able to handle significant traffic increase, like millions of…adelachao.medium.com In this article, we will look at the scaling of database. Cold standby — periodically backup We have a primary database running, and a standby database idling sideway. Periodically backup the primary database and save the backup file somewhere, for example, AWS S3.

In this article, we use a subscription to get access to a real-time feed of CloudWatch log events and have it delivered Kinesis stream. When log events are sent to Kinesis, they are base64 encoded and compressed with the gzip format. Prerequisite : CloudWatch log group/stream/event This article uses the test log group created in…

This article is to introduce how to send CloudWatch log event from Lambda function to a specific log stream. A log event is a record of some activity recorded by the application or resource being monitored. A log stream is a sequence of log events that share the same source. …

Radix sort does not compare numbers, instead, it takes advantage of number’s property, e.g. length, to fast sort numbers without having to do comparison. Given a list of numbers Find the maximum length among all numbers, that is, the largest number’s length Start a loop from 0 up to the…

The idea of quick sort is Given an array, recursively splitting the array by a pivot, that is, – all values less than the pivot value are moved to the left of pivot – all values greater than the pivot are moved to the right of pivot – until the array to…

As business grows, we are preparing our application to be able to handle significant traffic increase, like millions of requests coming at the same time. Single Server = Single point of failure A single server architecture may be good enough for simple purpose which doesn’t get much traffic, for example, a personal website, a marketing website for…

In another article (Graph Topological Sort — JavaScript implementation) I implement topological sort using DFS, here is the implementation of Kahn’s Algorithm, inspired by this tutorial video: Kahn’s Algorithm Repeatedly remove vertices without any dependencies from the graph and add them to the topological ordering array When one vertex is removed…