Google Linux 集群简介
-
(uplooking.com 这是篇老文章 2002年11月) Google的linux集群目前每天要处理150,000,000查询,查找多达数T(1,000,000,000)的web索引,而平均响应时间小于1/4秒,保证近100%的可用率。我们将讨论将其实现的软件及硬件的架构。
The Google Linux Cluster Abstract
Google's Linux cluster currently processes over 150 million queries per day, searching a multi-terabyte web index for every query with an average response time of less than a quarter of a second with near-100% uptime. In this talk I'll describe the software and hardware infrastructure that makes this performance possible.
I will start with an overview of the main problems facing a web search engine, and discuss Google's PageRank algorithm, which helps it to frequently return the right results on the first results page. PageRank is computed with a large-scale off-line computation over the web's link graph which models the behavior of a random web surfer.
Google's software architecture harnesses the power of thousands of cheap Linux PCs and organizes them into a scalable, reliable, high-performance computing system. At the same time, we aim to keep the architecture as simple as possible. Our solution structures the system as a collection of TCP-and UDP-based servers and guarantees reliability via replication of servers combined with software load balancing and failover.
On the hardware side, the main goals are performance and cost; reliability explictly isn't a goal, since that requirement is provided by software. We use custom-built rackmount systems assembled from standard PC components, ensuring volume availability and competitive pricing. A compact rack design minimizes colocation space costs but pushes the envelope of commercially supportable power density.
精彩Linux视频、嵌入式视频、Android视频、Oracle视频,免费先学!
查看:尚观Linux培训学员最新就业薪资待遇统计报告!
查看:UGA-4G Android开发架构师大纲
查看:UDA-Linux服务器开发架构师大纲
查看:UEA-嵌入式内核驱动开发者大纲
查看:UOA-Oracle数据库集群架构大纲
查看:ULA-Linux系统与集群架构师大纲
填表获取 Linux、嵌入式、Oracle 技术资料



















