Indranil Gupta

University of Illinois at Urbana-Champaign

Wizards and Fruitflies --

Using Eternal and Ephemeral Overlays for Monitoring Distributed Systems



Many distributed applications running over emerging large-scale distributed infrastructures, such as p2p systems, PlanetLabs, data centers and Grids, require the capability to monitor and manage a large distributed set of nodes at run-time.  While solutions exist for network and infrastructure-level monitoring, this talk will focus on monitoring solutions that  run across large populations of end nodes with large amounts of data,  i.e., at the application level. We will touch on a series of  lightweight solutions we have designed, implemented, deployed  and evaluated, for fully-distributed monitoring in such settings.  Our systems (MON, AVMON, peerCounter, IPTV overlay crawlers) monitor  system-wide statistics (e.g., system or application metrics,  number of online nodes) as well as per-host metrics  (e.g., availability). They consume low bandwidth, computation and memory at each host (even with hundreds or thousands of hosts),  yet provide response times within seconds. Our systems are available openly, have been deployed atop PlanetLab, and are being downloaded and used by researchers.



Indranil Gupta is an assistant professor in the Department of Computer Science at the University of Illinois at Urbana-Champaign. He received his PhD in Computer Science from Cornell University in 2004. He is a recipient of the NSF CAREER award in 2005 and the Xerox Award for Faculty Research (UIUC) in 2008.  Indranil is involved in the Cloud Computing Testbed at UIUC, with funding from NSF, Yahoo!, HP and Intel. Indranil's research group DPRG works on distributed protocols and systems, with applications to large-scale distributed systems.  DPRG research is funded by several NSF grants, including multi-disciplinary ones. For more information on DPRG, visit


B17 Upson Hall

Thursday, September 25, 2008

Refreshments at 3:45pm in the Upson 4th Floor Atrium

Computer Science


Fall 2008