Data stream systems (DSMSs) have matured to the point that they can be used in a large-scale industrial setting. In this talk, I will discuss how a combination of a DSMS (the GS monitor) and a streaming warehouse (DataDepot) combine to enable very large scale network monitoring in a tier-1 Internet Service Provider. The talk will emphasize the scaling challenges we faced and how they were overcome.
Theodore Johnson received a B.S. in Mathematics from Johns Hopkins University in 1986, and a Ph.D. in Computer Science in 1990. From 1990 through 1996, Theodore was an assistant, then associate procesor in the Computer and Information Science department of the University of Florida. In 1996, Theodore joined the Database Reseach department of AT&T Labs - Research, where today he is a Lead Member of Technical Staff. His interests include building massive data stream systems, building massive data warehouses, and building silly and useless electromechanical gadgets.