This paper identifies the 3 requirements for an internet service: Scalability, availability & cost-effectiveness although for some internet services, it doesn't need the strong guarantee of ACID, the service may just require high availability of data (ie: using BASE property). It then goes on to describe the cluster architecture which is made of commodity building blocks. As the figure 1 described, the cluster has a pool of workers in whih some might be caches that's being used everytime jobs are being issued. This pool of workers are being load balanced by the manager which collects load information from the workers which asks to the front ends to adjust the current scheduling decision. The front-end mentioned here is an interface to the outside world, such as a HTTP server that matches incoming requests with one or more worker nodes.
This leads to an interesting argument of should we need ACID or BASE? It could be easily seen that if the data is not changed a lot of times, such as the Internet, then the property of BASE is sufficient. However, if it involves something critical such as stock market trading, then ACID may be necessary to be implemented. This paper is really good since as we know today, many of the cloud providers today use a similar infrastructure
No comments:
Post a Comment