Chi-Chao Chang
Committee in charge:
Thorsten von Eicken, Chair
Keshav Pingali
Peter Carr
September 1999
Abstract
This thesis presents a framework for using explicit memory management to improve the communication performance of JavaTM cluster applications. The framework allows programmers to explicitly manage Java communication buffers, called jbufs, which are directly accessed by the DMA engines of high-performance network interfaces and by Java programs as primitive-typed arrays. The central idea is to remove the hard separation between Java’s garbage-collected heap and the non-collected memory region in which DMA buffers must normally be allocated. The programmer controls when a jbuf is part of the garbage-collected heap so that the garbage collector can ensure it is safely re-used or de-allocated, and when it is not so it can be used for DMA transfers. Unlike other techniques, jbufs preserve Java’s storage- and type-safety and do not depend on a particular garbage collection scheme.
The safety, efficiency, and programmability of jbufs are demonstrated throughout this thesis with implementations of an interface to the Virtual Interface Architecture, of an Active Messages communication layer, and of Java Remote Method Invocation (RMI). The impact on applications is also evaluated using an implementation of cluster matrix multiplication as well as a publicly available RMI benchmark suite.
The thesis proposes in-place object de-serialization—de-serialization without allocation and copying of objects—to further enhance the performance of RMI on homogeneous clusters. This optimization takes advantage of the zero-copy capabilities of network devices to reduce the per-object de-serialization costs to a constant irrespective of object size, which is particularly beneficial for large objects such as arrays. In-place de-serialization is realized using jstreams, an extension of jbufs with object I/O streams. Jstreams use the explicit memory management offered by jbufs to incorporate de-serialized objects into the receiving Java virtual machine without compromising its integrity, without restricting the usage of those objects, and without making assumptions about the underlying garbage collection scheme. The performance impact of jstreams on Java RMI and the benchmark suite is evaluated.
Copyright (C) Chi-Chao Chang 2000 ALL RIGHTS RESERVED
Table of Contents, List of Tables and Figures [ps] [pdf]
Chapter 1 Introduction [ps][pdf]
Chapter 2 Interfacing Java to Network Interfaces [ps][pdf]
Chapter 3 Safe and Explicit Memory Management [ps][pdf]
Chapter 4 Object Serialization: A Case for Specialization [ps][pdf]
Chapter 5 Optimizing Object Serialization [ps][pdf]