About our Research - From InfoVis 1999 to Geovisual Analytics 2008
Prof Mikael Jern was invited to Linkoping University as professor in information visualization (InfoVis) in Sept 1999. He joined a new department focusing on visualization at Campus Norrköping managed by also new professor Anders Ynnerman.
Information Visualization (InfoVis) had become the hottest topic within the visualization research community in this late 90's. (see historical graphics table). The focus of this new discipline was on effective and user-validated ways of presenting and interacting with data and creates an internal representation of the information in the mind of the user. “Data” in this context was abstract, spatial, continuous, textual, multi-dimensional and often non‑spatial in the sense that there is no a priori mapping of the data into three‑dimensions. Mapping non-spatial data through to timely, quality decisions was a major challenge. InfoVis had an essential role to play, providing new powerful tools such as parallel coordinates and table lens to help us to better understand multivariate data.
- InfoVis is the use of interactive, visual representations of abstract data and to use perception to amplify cognition...
- It is the process of forming a mental model of data, thereby supporting insight into that data;
Smart Documents 1999-2013
My research group received research funding from the European Commission for two projects: CONTENTS (1999-2001) – “Components Technology exercised on NT systems” – 2.8MECU and SMARTDOC (2001-2003) – ”Collaboratories” – 1.6MECU.
SmartDoc (CONTENTS for medical visualization) is the first implementation of Storytelling and integrates interactive and collaborative visualization into reports in MS Word format. The normal contents of a report, text and images, are extended with interactive 2D/3D visualization, image, analysis and decision support. Data and bookmarks are integrated into the document structure, which make the SmartDoc just as easy to handle as a traditional document. The reader is given a more active role and can interact with the embedded data in order to gain a better understanding of the report’s contents. The author prepares visualization bookmarks, i.e. stores certain visualization parameters that can be used at any time in order to highlight a specific view that is being described in the text. SmartDoc hyperlinks are special document components that enable access to bookmarks within the embedded application component. Using hyperlinks, a SmartDoc can contain “guided reading paths.” The author uses hyperlinks to define a certain reading order and can prepare a report intended for different groups of readers.
Example of SmartDoc published papers:
Jern: “Smart Documents with ActiveX 3D Data Visualization Components”, reviewed article in “Digital Media: The Future”, Vince J. A., R. A. Earnshaw (Eds), Springer Verlag March 2000, ISBN 1-85233-246-8.
Jern: “Collaborative Visual Data Navigation on the Web”, Invited Keynote Lecture to IV 2000, Proceedings IEEE International Conference on Information Visualisation, London, IEEE Computer Science Press, July 2000. ISBN: 0-7695-0743-3
Jern: “Smart Documents for Web-Enabled Collaboration”, 140-162, Published in “Digital Content Creation”, Vince J. A. and R. A. Earnshaw (Eds) Springer Verlag, June 2001. ISBN 1-85233-379-0.
Jern: “Visual Data Navigators Collaboratories – True Interactive Visualization for the Web”, reviewed article in ”Intelligent Agents for Mobile and Virtual Media ", pages 28-46, Springer-Verlag London UK, May 2002. ISBN 1-85233-556-4
Jern, Palmberg, Ranlöf: "Visual Data Navigators - Collaboratories", Invited Paper to Computer Graphics International 2002 (CGI2002), International Conference, July 2002, Bradford, UK, Published in “Advances in Modelling, Animation, and Rendering”, Vince J. A. and R. A. Earnshaw (Eds) Springer Verlag June 2002, ISBN 1-85233-6544
Statistical Visualization and Visual Analytics 2002-2008 based on GAV .NET Framework
In 2004, we introduced our first statistical customized visualization component, GeoWizard, for interactive exploration of social science statistical data accessed via the Internet from SCB’s database. The multi-dimensional nature of statistical data calls for creative integrated InfoVis and GeoVis methods (the first era of geovisual analytics). Ensuring that dynamically resizeable multiple views does not become a mess is far from a trivial programming task. We demonstrated that a dynamically linked view model can efficiently, quickly and easily be developed using Microsoft’s Visual Studio .NET tools. The familiar Windows GUI of .NET based applications most likely represent an appropriate interaction method for the novice end user.
We also introduced and promoted our first use of a layered component-based approach to the development and engineering of applications (GAV). Customizable and scalable high-level application and functional components were designed and developed from low-level atomic components. We used the .NET Framework and OpenViz Particles, a low-level visualization component framework. We believe that using a layered component approach can potentially provide better scalability and more customizable exploratory infovis and geovis components. Interoperability with SCB’s databases is achieved through a request for statistical data in a SCB dynamic HTML form connected to the SCB server. Selected data is returned as an Excel file that is imported into GeoWizard.
A key objective was seeking to improve the communication and the dissemination of results to the authorities depending on statistical data. We have shown the possibility of deploying interactive infovis and geovis. The main barrier in using such innovative technology can be determined as an acceptance problem. Because it is not easy to convince people to change their way of thinking and working strategies, new technologies often fail to be introduced to a wide number of users (which should not be misunderstood as acceptance problems in introducing tools). For real profit in using the interactive parallel coordinates view, one has to understand the discovery process as an integral part of the analysis work.
National Center for Visual Analytics (NCVA)
National Center for Visual Analytics (NCVA) is a Swedish national resource funded 2007 through financial support from the Swedish Knowledge Foundation's (KK-Stiftelsen) Visualization Program including VINNOVA, SSF, ISA and Vårdalstiftelsen and our industrial and government research partners. NCVA will help to spread applied Geovisual Analytics technology Geovisual Analytics.png into educational and research organizations.
"Geovisual Analytics technology with integrated Storytelling applied to large statistical data" represents one of our major contribution to the world of statistics including OECD, SCB, Eurostat, European Commission, IMF etc - See this 2009 BBC acknowledgement: http://news.bbc.co.uk/2/hi/8130554.stm.
Other important research projects include "Visual Analytics for Mobile Communication Networks" ANROSS Mobile in collaboration with Ericsson Research funded by VINNOVA and a Wallenberg project (VISE) Vise related to Education in geovisual analytics represent latest research projects.
Applied research will be carried out by NCVA in the context of a number of applications, drawn from diverse areas associated with the activities of our partners, showing the generality of the underlying framework. Each of these applications can also be seen as a demonstrator of the technology. In this work, we will follow a ‘science-to-solutions’ approach to address the entire research, development and deployment process. The strong engagement by industry and public service partners that depend on state-of-the-art Geovisual Analytics tools will guarantee that users will be involved from the start and will participate in the definition of the applied research agenda. The partners will, in turn, gain access to front line research, prototypes and components for integrating new and innovative Geovisual Analytics tools.
Below are six examples of our applied research in Geovisual Analytics developed and verified in close collaboration with our partners SCB, Ericsson Research, SMHI and Göteborg Stad:
Figure: Example of recognized and published research projects at NCVA - GAV Flash Applikationer.png
The NCVA History
The original NCVA research group in August 2008.
From left Dr. Ho Van Quan, Civ. Ing. Tobias Åström, Dr. Sara Johansson, Dr. Patrik Lundblad, Dr. Jimmy Johansson and in the back Prof. Mikael Jern who is the director for NCVA. This meeting took place at our summer house in the south of Sweden close to Båstad on the west coast.
Sara's PhD was funded by Unilever Research in Port Sunlight UK, Patrik's PhD was funded by SMHI and Quan's partly by Ericsson Research.
In May 2010, a spin-off company NComVA AB was created by Prof. Jern together with Tobias Åström, Dr Patrik Lundblad and Dr Ho Van Quan.
NComVA was acquired by the business intelligence company QlikTech in May 2013. http://businessintelligence.com/bi-news/qliktech-bolsters-advanced-visualization-with-acquisition-of-ncomva/
NCVA continues its applied research and present advanced geovisual analytics and information visualization software technology for education and research usage.
Research and Commercial Background of Prof Mikael Jern 1969-1999
Ink Jet Plotter
Already 1969, I (Prof Jern) was developing novel computer graphics software in the area of raster technology using traditional line printers, overlapping characters to simulate grey scale displays. The right picture shows the two researchers Dr Lennart Bergström with myself at Technical University of Lund with the first raster printer visualization.
During 1971-1976, he worked with Professor Hertz at the Technical University of Lund. Together they invented the Color Graphics System based on the world's first Ink Jet Plotter for raster based visualization software. The first high resolution color images (200dots/inch) were produced already in 1972 using pioneer memory paging and dithering technique. The application software included basic graphics, charting, 2D, 3D and 4D shaded contouring, imaging and seismic plotting. His popular graphics software was used in the international academia.
This is the world's first computer generated colour picture in high resolution. First produced by prof Jern's COLOR software and then plotted in a high resolution with the ink jet plotter. The picture was produced from statistical data originated from the region Klostergården in Lund city showing the number of people living in houses in the area. The picture was plotted in 1,5 minutes using million of ink droplets in magenta, yellow and blue.
In 1976, Prof Jern and Prof Hertz sold the right to manufacture and distribute the Color Graphics Plotting Systems to the U.S.-based (Boston) CAD company Applicon. More than 300 large systems were installed worldwide and used extensively by, for example, major oil companies for producing color seismic display.
In 1976, Prof Jern together with Dr Kjelldahl KTH founded SIGRAD (Swedish society for computer graphics) and he remained as its chair for 25 years promoting computer graphics in the Nordic region through workshops and conferences.
The generation of a colour picture is done in two steps. First a picture entirely consisting of numbers is designed. The computer works with logical ones and zeros instead of physical droplets, where the ones correspond to droplets on the paper. The raster coded picture is stored on a magnetic tape, which in the second step is read by the Color Plotter, The raster information on the tape is then transformed into a colour picture.
In 1981 he founded UNIRAS Aps to address the industry with a more general-purpose raster graphics software approach. UNIRAS A/S, UNIRAS Ltd and UNIRAS Inc became world-leading suppliers of Visual Data Analysis and Presentation graphics software for scientists and engineers with a revenue exceeding $25 million in 1987. UNIRAS was also a supplier of raster software to IBM, Tectronix and Versatec. When Advanced Visual Systems (AVS) acquired UNIRAS in 1993, he was appointed to the position of AVS Fellow to recognize his contributions to the evolution of AVS. Prof Jern is committed to graphics standards and was the project leader in a joint UNIRAS-IBM project to develop the standard graphics software system (GKS) for IBM in Hursley UK. He has been a member in various graphics metafile committees supporting CGM, GKS etc. He has coordinated several large EC funded projects INDEX, NOVICE, CONTENTS, SmartDoc and MUSIC in the domain of knowledge-based information visualization and result in large academic and industry network. These projects developed innovative Web based visualization technology based on both VRML and downloadable Web components. CONTENTS and SmartDoc are early novel EC research projects to create dynamic visualization documents (see publications below).
Mikael with the ink jet plotter 1974
He has also consulted with the EC Commission as a technical expert in visualization. He has published more than 200 technical papers and several books in visual computing and visualization application areas and has been a frequently invited keynote speaker at international conferences. At SIGGRAPH 93, he was elected "pioneer of computer graphics" based on his ground breaking research together with professor Hertz in raster graphics. In Sept 1999, he returned to academic research and was appointed professor at Linkoping University, Sweden to continue his research now with focus on geovisual analytics and storytelling - completed a recognized EC-funded visual flood forecasting system (MUSIC) in collaboration with University of Bologna. In 2007, he founded NCVA (Swedish National Center for Visual Analytics) with financial support from the Swedish Knowledge Foundation (VINNOVA) and commercial partners Unilever Research Port Sunlight, Ericsson Research, Statistics Sweden, SMHI, SCB, etc. and in close collaboration with OECD created awareness and interest for advanced geovisual analytics in the statistics domain. This achievement resulted in an honourable invitation by OECD to become an “associate” member, domain expert and supplier of strategic Web visualization tools to OECD.
In 2010, NCVA introduced innovative technique for Statistics Publishing on the Web with an objective to deliver interactive visualization to educators and their students to get informed and at the same time participate in increasing the knowledge on how life is lived and can be improved. This project VISE was funded by the Marcus och Amalia Wallenbergs Minnesfond and today VISE2 continues to be funded through Norrköping Kommun.
Based on NCVA's successful research in geovisual analytics applied to statistics data, a spinoff company NComVA AB was established in May 2010 together with his PhD students (Patrik, Tobias and Quan see above). NComVA became a world leader in advanced statistics visualization with many international and national statistical organizations (EUROSTAT, OECD, IMF, IEA, ISTAT, SCB, SKL, Pensionsmyndigheten, Boverket, MSB, LÖF, SFI and many regional and municipality organisations) the Statistics eXplorer and Publisher products. In 2012, with financial support from VINNOVA Forska&Väx and Tillväxtverket NComVA enters the visual business intelligence market as a technology partner to QlickView. In May 2013, NComVA was acquired by Qlik.
Mikael still gives invited presentations at international conferences about Statistical Visualisation and Storytelling (Europe 2020, NTTS, Nordic Statistics, VINNOVA Big Data, iDays Open Data, etc.)
In 2007, the Swedish Museum of Science created and published his life story based on a collection of interviews available at http://www.tekniskamuseet.se/download/18.6aa228912529fe96108000123/12_Mikael+_Jern.pdf
He has long experience in “Big Data and Open Data” issues and implementations collaborating with leading edge users at OECD, EUROSTAT, SCB, IMF, Swedish government and Regional Swedish organizations.
Last updated: 2015-04-03