Search   |   Back Issues   |   Author Index   |   Title Index   |   Contents

Articles

spacer

D-Lib Magazine
January 2003

Volume 9 Number 1

ISSN 1082-9873

Building Safety Systems with Dynamic Disseminations of Multimedia Digital Objects

 

José H. Canós
Javier Jaén
Juan C. Lorente
Jennifer Pérez
Department of Computer Science
Polytechnic University of Valencia
Camí de Vera s/n E-46022 Valencia (Spain)
(jhcanos | fjaen | jclorente | jeperez @dsic.upv.es)

Red Line

spacer

Abstract

Safety Oriented Systems (SOS) are emerging as a new kind of decision-support system aimed at improving personnel protection in large organizations. An SOS makes extensive use of hypermedia technology and information fusion to provide users with all the information needed to correctly handle emergency situations. An essential requirement for this kind of system is dynamic delivery of information to avoid situations in which the information presented is inaccurate with respect to the real world. In this article, we extend the classical Digital Library Architecture and define an architectural framework for a flexible safety system. We separate multimedia content from domain-related properties to enable dynamic disseminations of digital objects. An implementation of the framework using Enterprise Java Beans™ is also presented.

1. Introduction

Increasingly, domains in addition to those of document and information management are successfully using Digital Library (DL) concepts and techniques. Specifically, crucial decision-support systems in many areas benefit enormously from the use of DL technology, especially when combined with multimedia information fusion techniques to provide better information to decision makers. In this article, we target a new class of decision support systems called Safety Oriented Systems (SOS). These systems integrate various kinds of multimedia information to improve emergency handling, in general, and mass protection of people, in particular (e.g., see Goldbaum [1]).

One example of an SOS is the Hypermedia Emergency Plan (HEP) that we developed between 1998 and 1999 for the city of Valencia's underground transportation system (Metro Valencia). In operation since 2000, the HEP was developed to reduce response time in the case of an emergency. To this end, the HEP combines multimedia information—video, sound, 3D models, text, and graphics—coming from various sources and makes the information available to Safety Managers so they can make the right decisions in moments of stress.

We conducted simulation exercises using the HEP that showed a marked reduction in emergency response time. However, with the aim of improving response time even more, we also critically reviewed the original HEP and found that it lacked desired flexibility due to its inability to deal with exceptional emergency scenarios. A typical example involved delivery of inaccurate information when work was being performed in an escape route that made the route temporarily unavailable. In a case such as this, regular presentation of the escape route must be automatically replaced to indicate the anomaly and prevent passengers from taking the blocked route.

In this article, we show how DL technology helped us add the desired flexibility to the HEP, enabling it to deal with such situations. The article defines the architectural framework we developed, which is based on previous work published in the field of DL architectures (see Arms, et al. [2] and Kahn and Wilensky [3]) providing flexibility through the notion of dynamic dissemination. Dynamic dissemination is the process of dynamically selecting the proper dissemination of digital objects by inspecting the run-time state of domain-related objects acting as proxies between the SOS front-end/client application and the repository where the digital objects are stored. The framework we developed for the HEP can be used in the development of any SOS, as well as in any other domain where dynamic disseminations are needed.

We also present an implementation of the framework we developed. In our framework we use Enterprise Java Beans in order to benefit from the middleware services provided by this server-class platform. We used the framework to build a new, more flexible version of the HEP. Related to the implementation, we describe the use of Enterprise Java Beans as integrators of distributed information and show that the technology is appropriate for building complex server-side digital library services. Finally, this article describes the application of this DL architecture to a field where, to the best of our knowledge, it has not been used before.

The article is structured as follows: Section 2 describes basic HEP functionality, illustrated with its application to an emergency situation, such as a fire in a tunnel; Section 3 describes the limitations of the HEP we found during our evaluation process; we present the new HEP architecture in Section 4; the HEP architecture implementation is presented in Section 5; a discussion of our proposed framework appears in Section 6; and Section 7 provides our conclusions.

2. Assisted Emergency Handling in Underground Transportation

Passenger safety is one of the strictest requirements for any public transportation system, especially in metropolitan areas where the number of passengers is very high every day and transportation vehicles are fully occupied during rush hours. This is even more significant in the case of underground transportation, where emergency handling procedures are far more complicated, as many factors (darkness and smoke in the case of fire being the most critical ones) can impede the quick evacuation of passengers.

There are several ways to improve passenger safety. The three most important ways include:

  1. Investing large amounts of money to have the latest technological advances in preventive safety;
  1. Preparing an Emergency Plan (EP) that contains all the information needed to deal with an emergency (e.g., maps of installations, and procedures to apply in the case of emergency); and
  1. Training staff responsible for using the EP to respond to an emergency.

In 1998, the Metro Valencia Safety Office (MVSO) and the authors of this article started a joint project with the aim of using hypermedia technology to improve the current Metro Valencia EP [4] in two major ways. First, we introduced new types of information to the EP, in particular video and 3D animations, to give a much-improved view of the transportation network and its safety equipment. Second, we replaced the text-based, sequential EP with a hypermedia EP document, as well as improved navigational capabilities for the EP in order to find information faster and remarkably reduce emergency response time.

Currently, the new HEP is installed and running on a special-purpose server located at the Metro Valencia's Traffic Control Office (MVTCO). Its users are Safety Managers who decide what actions to perform in the case of an emergency from the information they receive from the server's 21-inch touchscreen. In the remainder of this section, we show how the HEP would work if a fire broke out in a train running through a tunnel.

As soon as the fire is detected, the train's driver must stop the vehicle and notify the Safety Manager on duty regarding the train identifier and its location. To locate a train, the driver has to look for the nearest safety box. (There is one box every 75 meters.) From the touch screen located in the safety box, the Safety Manager selects the HEP's main screen and indicates the type of emergency occurring and the location, getting a screen like the one shown in Figure 1.

screen shot from HEP

Figure 1. Selecting the evacuation route in a tunnel

The upper part of the screen displays a street map of the area where the train is stopped; the numbered circles represent the different safety boxes, and the red rectangles represent stations. The bottom left and central parts of Figure 1 include text containing the actions to be performed by the Safety Manager and the train driver. The middle right is reserved for an image of the panel identifying the safety box and its distance to the nearest stations both forward and backward. Once the Safety Manager has decided which evacuation route is the best, he or she selects the left or right arrows and, as a result of the choice, a video of the evacuation path is shown. When the video stops at the destination station, a configuration such as the one shown in Figure 2 appears on the screen. Note that the surface map displayed in Figure 1 has been replaced by a 3D model of the station showing all the emergency evacuation routes.

screen shot from HEP

Figure 2. Selecting the evacuation route from the station

The HEP was implemented using versions 5.0 to 8.0 of Macromedia Director™ [5] and runs on a Windows NT 4.0 server, with dual hard disk, multimedia hardware and a 21-inch touch screen from Elo TouchSystems™ [6]. Some statistics related to the HEP are shown in the following table:

3D models 32 Graphical and sound objects 6,700
Video movies 136 Size of the .exe. file 137 MB
Dynamic surgace maps 42 Size of the video storage 3.6 GB
Interactive screens 160 Size of the other HEP's elements 100 Mb

3. Limitations of the HEP

Besides the HEP's usefulness, we need to stress its static nature. All the HEP elements have to be created in advance and then assembled. In the original HEP, this produced a large, rigid hypermedia document in which the response to every occurrence of a given user event consisted of loading and showing the same object (or set of objects), and this led to situations in which the information contained in the HEP was inaccurate with respect to the real world. Let us suppose, for instance, that work being done inside a tunnel makes it temporarily unusable. In such cases, the HEP needed to be updated and regenerated to take into account the new state of the tunnel, showing a closed way icon instead of the tunnel's video record. Otherwise, a Safety Manager could unintentionally make the wrong decision and drive the passengers to a closed exit route.

The lack of flexibility with regard to the original HEP was partly due to the architecture derived from the implementation strategy used (see Figure 3).

screen shot from HEP

Figure 3. Architecture of the HEP

The front-end was developed using an authoring tool, and it comprised the user interface and part of the logic of the application, specifically the navigational model plus the scripts implementing the system's workflow. The tool imposed a flat hypermedia model containing only hypermedia objects (links, videos, maps, pictures, even texts), with the absence of any element conceptually related to the application domain (like tunnels, stations, etc.). This meant there was no way to include conditional reproductions of multimedia objects. The connection between the front-end and the multimedia objects was one-to-one, that is, any area on the screen was assigned a given multimedia object. Another factor limiting flexibility was how multimedia objects were stored and accessed. Each object was stored in a file, for which the file name was the "identifier" of the object. Working at the operating system level reduced the possible actions on multimedia objects for loading the files into the system and playing back their content.

To avoid this situation, more flexible approaches were needed. Flexibility means providing accurate information to the Safety Manager in the case of an emergency. Accuracy is actually granted only if, on the one hand, the system is able to perform adequately the fusion of information from different sources (in the case of Figure 1, the information includes some text files and a surface map stored in a repository, plus real-time video captured by cameras placed at different locations in the tunnel) and, on the other hand, using domain-related information to dynamically select the right sources. If the location in the map must be synchronized with the traversal of the tunnel (for instance through a progress bar appearing over the railway), then more complex operations should be performed. (These complex operations are out of the scope of this article.)

4. A Flexible Architecture for the HEP

In the remainder of this article, we show how introducing domain objects associated to multimedia objects stored in a Digital Library permits building more flexible SOSs. We start with the Digital Library architecture presented in Arms et al. [2], which builds upon the Kahn-Wilensky Framework (KWF) for distributed object services [3].

Summarizing, a Digital Object (DO) is an entity defined by its type of content and characterized by the content itself, plus its properties expressed as different kinds of metadata (e.g., structural, administrative, etc.). The DO's key metadata is a unique and persistent identifier called handle (see, the Handle System® [7]). DOs are stored in a repository for later access, and the services that the repository offers its clients are specified by means of a particular protocol. In the KWF, the Repository Access Protocol (RAP) is defined as a set of core services every repository must offer and on top of which more sophisticated services (like the ones described in Lagoze and Ely [8] and those presented here) can be defined. When a repository receives an access request to a DO, it returns a dissemination of the DO, consisting of the expected result of the request (e.g., a video playback) plus additional (meta) data associated with the DO.

We are interested in including special types of disseminations in our framework, namely dynamic disseminations, which are resolved at runtime, normally using some domain-related information. To some extent, these disseminations can be considered as meta-disseminations, as they use domain business rules to choose the right information to show the user. A detailed description of our architecture for dynamic disseminations follows.

4.1 Introducing State via Domain Objects

Figure 4 shows the KWF-based architecture of the HEP. At the core of the system, a repository [Note 1] implements the persistence layer of the system, which contains the multimedia DOs (MDOs). An API implements the RAP services invoked by Domain-Related Objects (DROs). DROs represent real entities, like tunnels or stations, and are instances—in the sense of object-oriented programming—of the classes defined in the conceptual model of the domain [9].

Image showing new HEP architecture

Figure 4. Architecture of the new HEP

The MDO type hierarchy is domain-independent and is defined by the authoring tool. Specifically, Macromedia Director™ is able to deal with a large diversity of multimedia objects (an enumeration is out of the scope of this article). As illustrated in Table 1, the MDO types used in the HEP include videos, pictures in different formats, texts, 3D models, 3D animations, and sounds.

With respect to the DROs, a simplified version of the HEP domain conceptual model appears in Figure 5 showing a railway line composed of stations and tunnels. Between the stations and tunnels, there are relationships like "a tunnel connects two stations" or, more correctly stated, "tunnel T leads from station A to station B"—which is different from " tunnel T leads from station B to station A", as tunnels can obviously be traversed in two directions. A tunnel is composed of a number of sections, connected by safety boxes.

Having DROs with state and behaviour is the key to enabling dynamic disseminations; that is, we use the functional aspect of DROs (changes of state through method invocations as response to messages) to set the MDO to be disseminated. For instance, "viewing a tunnel" means different things depending on the tunnel's state. If the tunnel provides a safe escape route, a video playback is disseminated; otherwise, the dessemination provided is the closed way icon. This means there are use relationships between DROs and MROs that must be defined to ensure correctness of the system.

Chart showing domain model

Figure 5. Simplified domain conceptual model of the HEP

4.2 Accessing the Repository from the User Interface

As one might expect, viewing a DRO consists of getting from the repository a dynamic dissemination of the corresponding MDO. To this end, the functional aspect of a DRO is complemented with a visualization aspect including the services the front-end must invoke in a DRO to get the dissemination of its associated MDO. In the domain classes related to MDOs, there is a method, show(), invoked by the front-end whenever a visualization of a DRO is required. The DRO, in response to this message, will use the handle of the MDO to which it is linked at that moment and will send the ACCESS_DO request to the repository that will return the dissemination of the MDO. In the next section, we provide a detailed description of a particular implementation of this architecture.

5. Implementation of the New HEP

We have just discussed the architectural components that allow dynamic disseminations of digital objects, namely a repository containing MDOs plus a RAP-based access mechanism, and a repository containing DROs with a mechanism to access their methods. Moreover, MDOs and DROs can exist in different repositories; therefore, a fully distributed architecture should be supported by any implementation we might propose. It is not our goal to implement RAP repositories but rather to make use of existing implementations; consequently, our implementation efforts concentrate on building an infrastructure to host DROs and allow remote clients to access their services.

From an architectural standpoint, DROs can be seen as software components (i.e., manageable discrete pieces of code). This idea is quite powerful because it allows for reusability in different application domains and promotes rapid application development. Furthermore, there is a growing marketplace of software components and the middleware (e.g., application servers like BEA's WebLogic™, Oracle's Oracle 9i™, IBM's WebSphere™, Macromedia's JRun™, HP's BlueStone™, and Borland's AppServer™) needed to deploy them. These middleware infrastructures already implement most of the requirements that DROs impose—including: remote method invocation, dynamic redeployment, logging, security, resource pooling, and persistence—making our implementation effort just a matter of defining the interfaces client parties will use to both obtain disseminations and trigger state changes.

We have implemented DROs as Enterprise Java Beans (EJBs) [10], which can be deployed in any compliant J2EE [Note 2] Application Server. A detailed description of EJBs is out of the scope of this article, but the idea behind EJBs is that they implement standard server-side interfaces (defined in the J2EE specification) so that all of them look the same. As a result, any J2EE Application Server can manage the interfaces and provide valuable services, such as the ones listed above, without additional implementation effort.

Every DRO is an entity EJB, which means that any instance will have the characteristic of persistence managed by the middleware where the Java Bean has been deployed. Therefore, the following interfaces must be defined:

  • javax.ejb.EntityBean - sets a context, loads, stores, activates and deactivates instances;
  • javax.ejb.EJBLocalObject or javax.ejb.EJBObject - invokes domain-dependent methods (from local and remote objects respectively);
  • javax.ejb.EJBHome or javax.ejb.EJBLocalHome - creates, destroys and gets references to instances (remotely and locally).

As an example, our entity bean implementing tunnels looks as follows (we have omitted the details of each method and the remaining interfaces because of space limitations):

code for entity-bean tunnel

The EJB TunnelBean first implements all the required methods for the bean to be managed by a J2EE container. (We have left out of our discussion these methods because they are J2EE specific.) Second, the domain-specific methods to retrieve and change the state of our bean (visibility and accessibility) are implemented, and third, a dissemination method is implemented that returns an InputStream (e.g., an input stream of bytes that contains the current dissemination of the bean). Our bean associates dissemination states with MDO handles using an associative map. Dissemination states (e.g., logical states having different MDO disseminations) are represented as aliases that are exported in a descriptor XML file. In our case, the aliases are "safe-escape-way" and "unsafe-escape-way", representing, respectively, that the tunnel is or is not a safe escape route in case of emergency. The MDO handles associated with each alias are set at deployment time when this bean is deployed in a concrete Application Server.

The life cycle of the java bean can be summarised as follows:

  1. Upon creation, the container invokes the ejbLoad and ejbActivate methods so that the instance of TunnelBean can populate its hash table by accessing (via JDBC) the bean's underlying relational repository where aliases are mapped to MDO handles;
  1. Domain-specific methods (setVisibility, setAccessibility, etc.) can be invoked and, as a result, the state that determines the current dissemination (currentDisseminationStateAlias) is affected;
  1. If the show() method is invoked, the instance obtains an MDO handle from its associative map and provides a dissemination by accessing a remote RAP-compliant repository.

Since RAP can be implemented over many different infrastructures/protocols (Java Server Pages [11], XSQL pages [12], TCP sockets, etc.), eventually domain beans would need to speak all these different protocols. To avoid this, session beans [10] can be implemented (JSPRAPAccessorBean, XSQLRAPAccessorBean, TCPRAPAccessorBean). In our case, we have RAP repositories over JSP (Java server pages) and, consequently, a JSPRAPAccessorBean was implemented (see Figure 6). All these beans implement the IRAPAccessor interface consisting of three methods corresponding to the three basic RAP services defined in [3].

code for accessor bean

Chart showing domain model

Figure 6. J2EE architectural view

Our implementation uses the Oracle 9i application server and JDeveloper 9i, but any other deployment platform may be used, since our beans comply with the J2EE standard.

6. Discussion

The architecture described in this article is driven, in part, by the domain to which we have applied it, namely the SOS domain. From this point of view, only the basic RAP services were needed, as no other features were required for the repository. Nevertheless, more sophisticated services like the ones proposed in Payette and Lagoze [13] and Lagoze and Ely [8] might be needed when implementing other application domains. In this case, our implementation can be extended with new accessor beans to cope with the more sophisticated services.

The separation between DROs and MDOs is deliberate. Though it is widely accepted that—following the KWF—a DO might contain metadata plus all its possible disseminations, we have preferred to keep different disseminations as separate MDOs because the separation enhances flexibility in the presence of dynamic disseminations. To illustrate this problem, let us imagine we create in our repository a tunnel DO including the video stream and the closed way icon plus some metadata holding its state. If we wanted to build a slightly different version of the HEP to be used by fire fighters, in which the video associated with the tunnel had to represent just the opposite traversal of the tunnel, then a different DO should be created to represent exactly the same tunnel with different disseminations. However, in our implementation, we solve this by having just three MDOs in the repository (the two videos plus the icon) and associating a different handle to the corresponding state in the underlying bean repository. Everything else remains unchanged.

Another advantage of our implementation is that it enables MDO sharing among DROs. It is likely that, following standard style recommendations, the same icon can represent any closed tunnel, although they have different videos associated with them for those times when the tunnels are open. In terms of the KWF, every DO representing a tunnel should contain a copy of the data stream representing the icon [Note 3] . However, in our approach, only one MDO is needed to hold the icon, which can be associated with an arbitrary number of tunnel DROs.

Several important considerations guided our choice of J2EE for implementing our system. J2EE provides a platform-independent, secure, portable, multi-user and standard enterprise-class platform for server-side deployments, and J2EE also offers a robust suite of middleware services:

  • Remote method invocations. DROs offer their methods to remote entities (e.g., Macromedia Director™, Flash™, or any other type of client)
  • Load Balancing. An architecture consisting of several application servers with replicated DROs can be easily implemented and clients can be redirected to the server with the lightest load.
  • Transparent Fail-over. If a server crashes, clients can be rerouted to other servers without interruption of MDO delivery. This is critical for SOS when handling emergencies.
  • Security. This is necessary to make sure that application servers and databases containing DROs are not accessed by malicious users.
  • Resource Pooling. Database connections and bean instances can be reused within a server, which results in shorter response times.

7. Conclusions and further work

In this article, we have introduced an architectural framework in which the notion of dynamic dissemination permits building more flexible hypermedia systems. The framework has been used in the development of the new version of the Metro Valencia's Hypermedia Emergency Plan (HEP), which has improved the original version by attaching domain-related information to the presentation of multimedia objects.

Our approach has other advantages as well. First, using DROs as the bridge between the hypertext front-end and the MDOs allows changes in the content of the MDOs without needing to modify the underlying application. Separating digital content from domain-related information makes it easier to share DOs and simplifies change processes in hypermedia applications. Only at the time of deployment are beans logical states mapped to handles, allowing for sharing of MDOs among many DROs.

We have illustrated the application of our architecture to the development of a new version of a hypermedia SOS, namely the HEP of Metro Valencia. The very same concept developed for the HEP can be applied to other domains (e.g., theaters, stadiums, etc.) or even to the same domain but from a different perspective. For instance, there is a plan for developing a version of the HEP for fire fighters in which instead of evacuation routes, entry routes will be shown. This kind of system could use virtual reality to provide orientation in the presence of smoke.

8. Acknowledgements

The work described in this article is supported in part by the Spanish Government Research Agency CICYT under Grant No. TIC2000-1673-C06-01 and by the Generalitat Valenciana under Grant No. GV01-227.

9. Notes

[Note 1] In principle, the number of repositories in the architecture can be greater than one. We use one repository just for simplicity (see Section 5).

[Note 2] To learn more about J2EE, see Introduction to the J2EE Platform by Monica Pawlan at <http://developer.java.sun.com/developer/technicalArticles/J2EE/Intro>.

[Note 3] We are aware that the KWF has some elements like meta-objects that could give a solution to the object sharing problem similar to ours. However, we are not aware of implementations of the KWF including meta-objects.

10 References

[1] Goldbaum, E. "Researchers Apply Information Fusion To Disasters". <http://unisci.com/stories/20014/1114013.htm>.

[2] Arms, W.Y., C. Blanchi, and E. A. Overly, "An Architecture for Information in Digital Libraries," D-Lib Magazine, February 1997, <doi:10.1045/february97-arms>.

[3] Kahn, R. and R. Wilensky, "A Framework for Distributed Digital Object Services," 1995, <http://www.cnri.reston.va.us/k-w.html>.

[4] Metro Valencia Safety Office. "Emergency Plan". Internal Document. Valencia, 1998. (In Spanish)

[5] Macromedia Director™ home page, <http://www.macromedia.com/software/director/>.

[6] Elo TouchSystems™ home page, <http://www.elotouch.com>.

[7] The Handle System® home page, <http://www.handle.net>.

[8] Lagoze, C. and David Ely. Implementation Issues in an Open Architectural Framework for Digital Object Services. Technical Report TR95-1540. Computer Science Department. Cornell University, 1995.

[9] Schwabe, D., G. Rossi and S. Barbosa. "Systematic Hypermedia Application Design with OOHDM". Proceedings of the ACM International Conference on Hypertext (Hypertext'96), Washington, March 1996.

[10] Rodman, E., Ambler, S., Jewel, T. Mastering Enterprise Java Beans. John Wiley & Sons, 2002

[11] Java Server Pages™. <http://java.sun.com/products/jsp>.

[12] Muench, S. Building Oracle XML Applications O'Reilly & Associates. 2000

[13] Payette, S. and C. Lagoze, "Flexible and Extensible Digital Object and Repository Architecture (FEDORA)," Second European Conference on Research and Advanced Technology for Digital Libraries, Heraklion, Crete, Greece, September 21- 23, 1998, Springer, 1998, (Lecture notes in computer science; Vol. 1513).

(On January 18, 2003 a correction was made to the the authors' email addresss.)

Copyright © José H. Canós, Javier Jaén, Juan C. Lorente, and Jennifer Pérez
spacer
spacer

Top | Contents
Search | Author Index | Title Index | Back Issues
Previous Article | Next Article
Home | E-mail the Editor

spacer
spacer

D-Lib Magazine Access Terms and Conditions

DOI: 10.1045/january2003-canos