Printable View

Extending Mashups to Visualize Patterns in Temporal Data

Stephen G. Eick, Andrew Eick, Jesse Fugitt, James E. Heath, Mark Ross

2 June 07

{steve.eick, andrew.eick, jesse.fugitt, jeheath , mark.ross}@gmail.com

Printable View

ABSTRACT — Many datasets are now published as streams of time-stamped, geo-encoded events using GeoRSS. To understand patterns within this class of data, we have taken ideas from mashups and extended them to develop new visual components that present live geospatial data in novel ways. The components are interactive, live, linked and contain many novel features for understanding temporal and geospatial patterns in event data. The components are light-weight, thin client, Web 2.0 AJAX technology and are suitable for analyzing both on-line streaming and off-line static datasets. Our work expands traditional geospatial mashups to include timeline, time wheel, and graph mashups for real-time time streaming data.

1. Introduction

A mashup is a website that combines content from more than one source and displays the information on a map (Wikipedia_Mashups, 2007). Mashups have been phenomenally successful. The number of mashup applications has grown dramatically and there are literally hundreds of thousands of mashup sites (googlemapsmania.blogspot.com, 2007). There are even websites devoted to both tracking (www.mashups.com, 2007) and creating (www.mashupbuilder.net, www.wayfaring.com) mashups.

Our focus is on mashup sites for displaying time-stamped, live geo-encoded data. This type of data is quite common and includes, for example, streams of news articles where the events in the articles are geo-located, the sequence of observed positions of a delivery vehicle as recorded by an onboard GPS, the positions of emergency personnel with active RFID badges in a hospital, and even the times and locations of Avian Flu Pandemic as reported by the government (Department_of_Health_&_Human_Services_U.S., 2007).

Data of this type is commonly published using GeoRSS (GeoRSS, 2007). GeoRSS is a rather simple extension of RSS, an XML specification for publishing information best described as sequences of items in a channel. GeoRSS extends RSS by including geographical encodings to describe the location of the event items. Location information may be specified in either of two ways in GeoRSS. First, the most basic way specifies a point location for each item using longitude and latitude:

<georss:point>45.256 -71.92</georss:point>

Second, the more complex way includes support for richer geospatial features using GML (4):

<georss:where>

<gml:Point>

<gml:pos>45.256 -71.92</gml:pos>

</gml:Point>

</georss:where>

Using GML in GeoRSS allows the geographical attributes to be described using squares, circles, and other complex polygons. Using GML it is possible to specify rich spatial attributes that are associated with the event.

Most mashup sites are built using either Google Maps (Google, 2007) or Microsoft Virtual Earth (Microsoft, 2007). These platforms provide a rich and powerful environment for building geospatial applications. In contrast to traditional desktop GIS (http://en.wikipedia.org/wiki/GIS ) systems, Google and Microsoft have shown that it is possible to do live interactive maps that are completely browser-based. The advantage of this new approach is that the technology is usable by anyone with access to a browser. Google and Microsoft are competing fiercely to develop technology to support location-aware services and local search. Location aware devices will become more common and, as Google has demonstrated, will support a lucrative advertising based business model. As a result, both companies have developed extremely complex and compelling technology that is now widely available on the Internet.

More...

Stephen G. Eick, M. Andrew Eick, Jesse Fugitt, Brian Horst, Maxim Khailo, Russell A. Lankenau

SSS Research, Inc

600 S. Washington, Suite 100

Naperville, IL 60540

Printable View

Abstract—We have developed a Web 2.0 thin client visualization framework called GeoBoost™. Our framework focuses on geospatial visualization and using Scalable Vector Graphics (SVG), AJAX, RSS and GeoRSS we have built a complete thin client component set. Our component set provides a rich user experience that is completely browser based. It includes maps, standard business charts, graphs, and time-oriented components. The components are live, interactive, linked, and support real time collaboration.

Table of Contents

1. Introduction    1

2. Technology Background    2

3. GeoBoost System Architecture    3

4. GeoBoost Visual Components    4

5. thinc Interface JavaScript Framework    5

5. GeoBoost Mobile Client    7

6. Summary and Conclusions    8

7. References    8

1. Introduction

GeoBoost™ is a thin client collaborative visualization framework for building Web 2.0 browser-based geospatial applications. GeoBoost runs in both J2EE and .NET environments and leverages new programming techniques such as AJAX (Asynchronous JavaScript and XML) and browser-based graphics standards such SVG (Scalable Vector Graphics) to enable developers to build rich, interactive thin-client geospatial applications that support collaboration. The advantage of this approach to building applications is that thin client applications run natively within a browser without the need to install any client software, applets, or plug-ins. This advantage translates into low-cost deployment to many users and the ability to support many devices for real-time operational decision-making.

One of the surprising aspects of our GeoBoost framework is its performance. GeoBoost visual components support interaction, tooltips, dynamic queries, filtering, selection, panning, and zooming. The interactive performance GeoBoost obtains as thin client is comparable to some of the best implementations of desktop visualization software.

The GeoBoost system consists of three components. First, GeoBoost visualization components are built using a JavaScript Visualization Framework that we call thinc Interface™. thinc Interface is a thin client AJAX visualization framework we built that uses Scalable Vector Graphics as its rending API. thinc Interface ingests live RSS and RSS extensions and renders the information in browser-based visual components. Using thinc Interface we have built a set of a set of reusable visual components including:

• Interactive Maps that display image, feature, and live GeoRSS data from multiple sources
• Business Charts including Bar, Pie, and Line Charts
• Network and Graph Displays
• Hierarchical, Tree, and Tree Map Displays
• Time Lines and Time Wheel

These components are interesting because they have the capability to connect to live RSS streams, ingest the real-time data, and display the resulting information. The end-user programming model for GeoBoost visual components is also interesting and involves JSP custom tags and .NET Web controls. As a result it is easy for programmers to include GeoBoost components in their web applications using standard HTML tags.

The GeoBoost map component is particularly interesting. It is an OGC^® (Open Geospatial Consortium) WMS (Web Mapping Service) and WFS (Web Feature Server) -compatible client that supports rich interactivity such as panning, scrolling, and zooming. For dynamic interactive operations raster data is asynchronously requested from WMS servers using AJAX requests. Feature data is rendered on top of the raster data using SVG layers. It is also a collaborative geospatial wiki. Users may mark, annotate, edit, and draw arbitrary shapes onto the map. The polygons corresponding to these shapes and annotations can be propagated to other connected users to allow collaboration over the marked area of interest.

Secondly, GeoBoost provides a series of servers to stream imagery, feature data, and RSS for consumption by GeoBoost visual components. Thin clients have limited processing power and systems built around thin client architectures need more server support than equivalent desktop systems. Thus GeoBoost server components enable flexible data ingestion, image and feature data tiling, tile caching, performance optimization, and provide built-in support for tracking and collaboration features. These server components are necessary to support thin client interfaces and applications.

GeoBoost uses an open extensible architecture and supports relevant standards. GeoBoost is built around open standards such as GML (Geography Markup Language), RSS, GeoRSS and other RSS extensions. GeoBoost consumes imagery and feature data from both OGC compliant sources such as WMS (Web Mapping Service) and other native formats such as NGA's [3] RPF and LizardTech's [4] MrSID.

The third interesting component of GeoBoost is the GeoBoost AJAX portal. This portal provides a live framework for content, e.g. web pages, to be integrated in, customized, and tailored to specific use cases. Users with different job functions may customize GeoBoost content for their specific needs and thereby incorporate task-specific workflow.

The benefits of the GeoBoost platform include:

• Provides the user with rich desktop user interface functionality in a browser
• Includes visual components that are ready for use and may be incorporated into web applications
• Supports real-time collaboration without proprietary client software
• Enables inexpensive and large deployments since no client software is required to be installed
• Provides web developers with a platform for rapidly building geospatial and thin client applications
• Supports the relevant open standards including OGC WMS, WFS, GML, RSS, GeoRSS

2. Technology Background

Applications built using the GeoBoost™ platform are described as Rich Internet Applications [5] (RIAs). Although Macromedia coined the term, a RIA today is understood to be an application that runs in a web browser and provides an interactive and responsive user interface that has traditionally been found in desktop applications. Until recently, the only software applications that could provide this level of responsiveness desired were the standard "fat client" applications that require client-side installation and run as a native client applications. Recently, a new class of RIAs has emerged that run completely within a web browser. These applications offer many benefits over traditional fat client applications. In this section we will describe some of these benefits and discuss other attempts to provide this functionality.

More...

Printable version

Authors: Stephen G. Eick, M. Andrew Eick, Jesse Fugitt, Brian Horst, Maxim Khailo, Russell A. Lankenau

Abstract—We have developed a Web 2.0 thin client visualization framework called GeoBoost™. Our framework focuses on geospatial visualization and using Scalable Vector Graphics (SVG), AJAX, RSS and GeoRSS we have built a complete thin client component set. Our component set provides a rich user experience that is completely browser based. It includes maps, standard business charts, graphs, and time-oriented components. The components are live, interactive, linked, and support real time collaboration.

1. Introduction

GeoBoost™ is a thin client collaborative visualization framework for building Web 2.0 browser-based geospatial applications. GeoBoost runs in both J2EE and .NET environments and leverages new programming techniques such as AJAX (Asynchronous JavaScript and XML) and browser-based graphics standards such SVG (Scalable Vector Graphics) to enable developers to build rich, interactive thin-client geospatial applications that support collaboration. The advantage of this approach to building applications is that thin client applications run natively within a browser without the need to install any client software, applets, or plug-ins. This advantage translates into low-cost deployment to many users and the ability to support many devices for real-time operational decision-making.

One of the surprising aspects of our GeoBoost framework is its performance. GeoBoost visual components support interaction, tooltips, dynamic queries, filtering, selection, panning, and zooming. The interactive performance GeoBoost obtains as thin client is comparable to some of the best implementations of desktop visualization software.

The GeoBoost system consists of three components. First, GeoBoost visualization components are built using a JavaScript Visualization Framework that we call thinc Interface™. thinc Interface is a thin client AJAX visualization framework we built that uses Scalable Vector Graphics as its rending API. thinc Interface ingests live RSS and RSS extensions and renders the information in browser-based visual components. Using thinc Interface we have built a set of a set of reusable visual components including:

• Interactive Maps that display image, feature, and live GeoRSS data from multiple sources
• Business Charts including Bar, Pie, and Line Charts
• Network and Graph Displays
• Hierarchical, Tree, and Tree Map Displays
• Time Lines and Time Wheel

These components are interesting because they have the capability to connect to live RSS streams, ingest the real-time data, and display the resulting information. The end-user programming model for GeoBoost visual components is also interesting and involves JSP custom tags and .NET Web controls. As a result it is easy for programmers to include GeoBoost components in their web applications using standard HTML tags.

The GeoBoost map component is particularly interesting. It is an OGC^® (Open Geospatial Consortium) WMS (Web Mapping Service) and WFS (Web Feature Server) -compatible client that supports rich interactivity such as panning, scrolling, and zooming. For dynamic interactive operations raster data is asynchronously requested from WMS servers using AJAX requests. Feature data is rendered on top of the raster data using SVG layers. It is also a collaborative geospatial wiki. Users may mark, annotate, edit, and draw arbitrary shapes onto the map. The polygons corresponding to these shapes and annotations can be propagated to other connected users to allow collaboration over the marked area of interest.

Secondly, GeoBoost provides a series of servers to stream imagery, feature data, and RSS for consumption by GeoBoost visual components. Thin clients have limited processing power and systems built around thin client architectures need more server support than equivalent desktop systems. Thus GeoBoost server components enable flexible data ingestion, image and feature data tiling, tile caching, performance optimization, and provide built-in support for tracking and collaboration features. These server components are necessary to support thin client interfaces and applications.

GeoBoost uses an open extensible architecture and supports relevant standards. GeoBoost is built around open standards such as GML (Geography Markup Language), RSS, GeoRSS and other RSS extensions. GeoBoost consumes imagery and feature data from both OGC compliant sources such as WMS (Web Mapping Service) and other native formats such as NGA’s [3] RPF and LizardTech’s [4] MrSID.

The third interesting component of GeoBoost is the GeoBoost AJAX portal. This portal provides a live framework for content, e.g. web pages, to be integrated in, customized, and tailored to specific use cases. Users with different job functions may customize GeoBoost content for their specific needs and thereby incorporate task-specific workflow.

The benefits of the GeoBoost platform include:

• Provides the user with rich desktop user interface functionality in a browser
• Includes visual components that are ready for use and may be incorporated into web applications
• Supports real-time collaboration without proprietary client software
• Enables inexpensive and large deployments since no client software is required to be installed
• Provides web developers with a platform for rapidly building geospatial and thin client applications
• Supports the relevant open standards including OGC WMS, WFS, GML, RSS, GeoRSS

More...

Abstract – With increasing deployments of Global Positioning System (GPS) devices, Radio Frequency Identification (RFID) tags, and other location-aware devices, it is now possible to capture time-varying object information. In addition, existing systems such as Enterprise Resource Planning (ERP) systems emit ancillary object metadata (e.g., inventory levels in a warehouse). The challenge is how to leverage these information assets for demanding field operations scenarios such as Crisis Management, given the size and real-time nature of the data. To address the challenge, we have built a Web 2.0 framework for real-time spatial intelligence and collaboration. Our framework includes an extensible architecture for ingesting and combining spatial data across multiple formats; a fusion server for merging spatial and bespoke business data; support for spatial transformations tied to configurable business rules; and a publishing engine that pushes the combined information out for consumption in a visual, collaborative presentation layer running in standard Web browsers and on mobile devices. The result is an easily deployable system with broad reach to the field through a visual, interactive interface presenting timely, meaningful information.

Introduction

Crisis Management requires fast, on-the-spot decision-making by emergency responders (ERs) addressing reported incidents. Establishing a usable Common Operating Picture, or Shared Situational Awareness, for all the involved teams and individuals, possibly cross-jurisdiction, in both crisis and routine situations is essential to successful outcomes.

Fundamental needs of ERs surrounding Shared Situational Awareness include getting critical information related to the crisis at hand in real-time in an easily digestible form for fast understanding; enabling quick, intuitive interrogation for further detail; being alerted to unusual or highly important events related to the crisis; easily and securely communicating location-based observations and information with some or all involved parties; and easily accessing the system being used from standard devices without needing to manage client software.

Systems in the past have failed to meet the challenges posed by these needs because they were too complex for the targeted user (ERs), too limited in capability, relied on the deployment of specialized software, were too expensive to license and/or maintain, or some combination of these reasons.

To address the challenges of providing Shared Situational Awareness for Crisis Management, we have developed a Web 2.0 framework for real-time spatial intelligence and collaboration. Our framework is unique for several reasons. First, the architecture is modular and built around open Web and geospatial standards. This open architecture simplifies integration, makes it easy to extend, and enables “bottleneck tuning” to support varying deployment scenarios (e.g., bandwidth constrained environments). Second, the publishing engine has the capability to generate output customized for consumption on various devices. These devices include thin client Scalable Vector Graphics (SVG) [1] and Asynchronous JavaScript and XML (AJAX) [2] enabled Web browsers and mobile devices. AJAX and SVG enable a rich client experience without the need to manage client software. Third, our framework includes a novel presentation layer with custom visual displays for geo-fencing, geo-tracking, bread crumbing, hot spot analysis, collaboration, and location prediction – all through thin client and mobile device interfaces.

In this paper we describe the system in the context of Crisis Management. Specifically, we provide an outline of ER needs surrounding Shared Situational Awareness followed by a description of our framework capabilities that address those needs. We conclude with a summary of benefits.

More...

Printable version of paper

Stephen G. Eick, M. Andrew Eick, Jesse Fugitt, Russell A. Lankenau

SSS Research, Inc

600 S. Washington, Suite 100

Naperville, IL 60565

Abstract—Recently a new class of applications has emerged that uses AJAX and other web programming techniques to provide a rich user experience in a web browser. This class of applications is being called Web 2.0 and includes Google Maps and Google Suggest. To experiment with this approach, we have developed a Web 2.0 thin client collaborative visualization framework called GeoBoost™ that uses Scalable Vector Graphics and AJAX to provide a rich user experience built around collaboration. Our framework includes geospatial maps, standard business charts, node and link displays, and custom visual displays. All of our visualization components run in standard web browsers and provide rich interaction and collaboration.

1. Introduction

GeoBoost™ is a Web 2.0 Web Mapping Platform for building thin client geospatial applications. GeoBoost runs in both J2EE and .NET environments and leverages new programming techniques such as AJAX (Asynchronous JavaScript and XML) and browser-based graphics standards such SVG (Scalable Vector Graphics) to enable developers to build rich, interactive thin-client geospatial applications that support collaboration. The advantage of this approach to building applications is that thin client applications run natively within browser without the need to install any client software, applets, or plug-ins. This advantage translates into low-cost deployment to many users and the ability to support many devices for real-time operational decision-making.

The GeoBoost system consists of three components. First, GeoBoost clients are built using a JavaScript Visualization Framework that we call thinc Interface™. thinc Interface is a thin client AJAX visualization framework built that uses Scalable Vector Graphics as its rending API and ingest live RSS and RSS namespace extensions and renders the information in browser-based visual components. thinc Interface contains a set of reusable visual components including:

• Interactive Maps that display image, feature, and live GeoRSS data from multiple sources
• Business Charts including Bar, Pie, and Line Charts
• Network and Graph Displays
• Hierarchical, Tree, and Tree Map Displays
• Time Lines, and
• Various custom components.

These components are interesting because they have the capability to connect to live RSS streams, ingest the real-time data, and display the resulting information. The programming model for thinc Interface components is also interesting and involves JSP custom tags and .NET Web controls. As a result it is easy for programmers to include thinc Interface components in their web applications using standard HTML tags. The GeoBoost map client is particularly interesting and supports rich interactivity such as panning, scrolling, zooming and the drawing of data points which define arbitrary polygons. These polygons can be propagated to other connected users to allow collaboration over the marked area of interest. Additionally, the GeoBoost environment consists of geospatial enabled applications such as geo-fencing of marked area's of interest, alerting connected and disconnected users when objects enter and exit the marked area.

Second, on the back-end, GeoBoost provides a series of servers to stream imagery, feature data, and RSS for consumption by GeoBoost thinc visual components. Thin clients have limited processing power and systems built around thin client architectures need more server support than equivalent desktop systems. Thus GeoBoost server components enable flexible data ingestion, image and feature data tiling, tile caching, performance optimization, and provide built-in support for tracking and collaboration features. These server components are necessary to support thin client interfaces and applications.

GeoBoost uses an open extensible architecture and supports relevant standards. GeoBoost is built around open standards such as GML (Geography Markup Language), RSS, GeoRSS and other RSS extensions. GeoBoost consumes imagery and feature data from both OGC^® (Open Geospatial Consortium) compliant sources such as WMS (Web Mapping Service) and other native formats such as NGA's [3] RPF and LizardTech's [4] MrSID.

Third, using our GeoBoost framework we have built two applications. The first application FUSION™ ingest air traffic, air space, restricted airspace, and weather patterns and is used by the Air Force for Air Traffic Management. The second application targets asset tracking. It is used to track the locations of employees, guests, and other assets inside a casino.

The benefits of the GeoBoost platform include:

• Provides the user with rich desktop user interface functionality in a browser
• Supports real-time collaboration without proprietary client software
• Enables inexpensive and large deployments since no client software is required to be installed
• Provides web developers with a platform for rapidly building geospatial and thin client applications
• Supports the relevant open standards including OGC WMS, WFS, GML, RSS, GeoRSS

2. Technology Background

Applications built using the GeoBoost™ platform are described as Rich Internet Applications [5] (RIAs). Although Macromedia coined the term, a RIA today is understood to be an application that runs in a web browser and provides an interactive and responsive user interface that has traditionally been found in desktop applications. Until recently, the only software applications that could provide this level of responsiveness desired were the standard "fat client" applications that require client-side installation and run as a native client applications. Recently, a new class of RIAs has emerged that run completely within a web browser. These applications offer many benefits over traditional fat client applications. In this section we will describe some of these benefits and discuss other attempts to provide this functionality.

More...

A case study using DECIDE for intelligence analysis.

Plots

Hypothesis: Political corruption is present in the Alderwood government.

Political corruption seems to be present in several forms: election tampering, unethical behavior, and deception all seem to be present in one form or another during the period of January 2002 - March 2004.

Evidence of election tampering is present in the Alderwood Voter Registry. It appears that at least two different individuals have tampered with the registry. Both made mistakes which can be used to identify which records are fraudulent.

The first individual input dates of birth in an incorrect format; all records inserted by this individual have a date of birth of 8-Apr-34, and a registration date from one to four years after this date. These records also reuse the same set of first names several times. There are 73 records of this type inserted into the registry.

The second set of records was properly formatted, but the registration dates did not seem to correspond to the dates of birth listed. In the state of Washington, an individual must be 18 by the date of the next election to register to vote. Many of the records contained registration dates which preceded the date of birth listed. Other records contained registration dates which were well before (>10 years) the date on which the individual could conceivably register.

With the exception of the aforementioned records, the majority of the records indicate that the registered individual registered when they were between the ages of 17 and 40. There was one exception: Laurel Sulfate was registered on 8/1/2002, at the age of 16. This should not have been possible, since mid-term elections took place on Nov 5, 2002, before Sulfate was eligible to vote. This leads me to believe that Laurel Sulfate was somehow connected to the first instance of election tampering, since the style of her record best matched the style of that saboteur.

Someone in the Alderwood government seems to be involved with an entity in Switzerland, as well. The City Hall conference room records show calls to entities in Berne and Kriens on several occasions in January of 2002. Bruce Rinz has his own phone line as City Attorney, so it is not likely that he made these calls, and there is no indication of activity involving the Swiss development company this early in the timeline, so it is more likely that these calls were related to the founding of Boynton Labs.

More...