Human Computer Interaction in Computer Vision
Human Computer Interaction in Computer Vision
net/publication/265300846
CITATIONS READS
37 995
2 authors:
All content following this page was uploaded by Yu-Chun Huang on 04 September 2014.
1 Introduction
C. Stephanidis (Ed.): HCII 2014 Posters, Part I, CCIS 434, pp. 579–584, 2014.
© Springer International Publishing Switzerland 2014
580 Y.-C. Huang and S. Rosie Han
is cyberspace, where we communicate with others from all over the world (Wertheim,
1999). Simulation space is often used for observation and evaluation of landscape by
city planners, designers, engineers, developers, and administrators (Soubra, 2008;
Dawood et al., 2009; Yabuki et al., 2011).
In 1999, Philip Rosedale established Linden Lab. He combined these two features
of virtual space and made “Second Life (SL)” [1], which is a developing computer
hardware allowing people to immerse in a virtual world. In SL, users (called
Residents) can interact with each other through avatars. They can socialize,
participate individual and group activities and create 3D artifacts, buildings, and
social spaces where people interact [2].
Given the features of SL as a social interface allowing multi-users to participate
daily activities as well as real life, SL became popular and was used for education
(Boulos et al., 2007), science evaluation, and arts fields, such as the virtual museum
and art gallery (Urban, 2007; Zhu, 2007). On the other sides, regarding to the web
museums, visitors have become accustomed to clicking on images displayed in their
browser or retrieve pre-written textual descriptions of cultural heritage objects
(Sumption, 2006). Therefore in order to create a more accessible and convenient
virtual museum, researchers have built the virtual museum in SL, such as “The
Bayside Beach Galleria Museum of Contemporary Art [3] (Urban, 2007)”, “A Virtual
Gallery (Oberlander et al., 2008)”.
However, the art displays of those museums I mentioned above were just copied from
traditional museum and re-build it into SL. Sometimes it is not as easy as traditional
museum for user to get used to it. Users have to learn how to control the SL interface
and recognize the orientation in the virtual world and then navigate in SL. On the
other sides, in the art display of physical museum, visitors always stand in front of the
wall to appreciate 2D painting, also in virtual museum, visitors have to control their
avatars to appreciate 2D painting. It is difficult for users to perceive the same feelings
that artists would like to express. Therefore the concept of this research is to represent
a more immersive virtual museum by extending 2D painting to 3D painting via SL.
By using SL platform, visitor is able to break limitations of physical world to soar,
jump, swim or become a goliath to navigate around the museum. In this museum,
users are able to get into the paintings; it means the 2D painting can be visualized in
3D world (see Fig 1). And every individual painting can be properly connected with
each other through story telling. There are two different themes in this museum: the
European Art and the Asian Art. In this research, we are going to present Asian Art
gallery as an example of extending 2D painting to 3D painting.
An Immersive Virtual Reality Museum via Second Life 581
3 Implementation
Fig. 3. Scenario demonstration: A) User walked to the willows and appreciated painting—
“Landscape: tea sipping under willows”. And she sat down around the tea table to virtually
experience Chinese tea; B) She got into the landscape and appreciated the second Chinese
painting—“Moonlit Pavilion in the Mountains”. And then she follow the paths and climbed to
the pavilion; D) she found a Chinese table, chair, and two paintings, one is on the table and the
other is on the wall. As to the painting on the wall—“Murasaki Shikibu” which displayed a
Japanese woman lying on the riverside and enjoying the moonlight; E) Suddenly the virtual
world turned to the night time. She wanted to get into this Japanese painting; F) After clicking
the left button of the painting, she suddenly transferred herself to the riverside; G) she clicked
the left button and transferred her to the needle mountain and lava hell, H) The bridge implied,
people who have done many bad things before die, they cannot safely go across the bridge; H)
Finally she meet the Buddha painting—“Buddha Enthroned on a Mat of Kusa Grass” after
passing the bridge.
arriving to the pavilion hill, she found a Chinese table, chair, and two paintings, one is
on the table (fig 2e) and the other is on the wall (fig 3D). The painting on the wall—
“Murasaki Shikibu” (fig 2d) displayed a Japanese woman lying on the riverside and
enjoyed the moonlight (fig 3E). Suddenly the virtual world turned to the night time.
She wanted to experience the same scene from Japanese painting. After she clicked
the left button of the painting, she suddenly transferred herself to the riverside (fig
3F). The hell painting—“Hell Story: mirror of retribution” (fig 2f) which was hung on
the roof attracted the user to get into it. Hence she clicked the left button and
transferred her to the needle mountain and lava hell (fig 3G). And then she found a
bridge in front of her. She tried to keep safely going across a bridge (fig 3H). The
bridge implied, people who have done many bad things before die, they cannot safely
go across the bridge. At the same time the user safely go across the bridge, but there
are many other users who fall down the needle mountain. Finally the user met the
Buddha painting—“Buddha Enthroned on a Mat of Kusa Grass” (fig 2c, fig 3I) and a
big golden Buddha was appearing in front of her.
4 Conclusion Remarks
Through the scenario demonstration of the virtual museum, the visitors had the
chance to more profoundly experience the masterpieces. By extending 2D paintings to
3D world, users can be not only more adaptively perceive the expression of painting
but also intuitively interact with the 2D famous painting in 3D world.
This kind of art appreciation can play a profound contribution to the art education
especially for children. By using game-like navigation around the virtual art gallery,
children can receive deeper impression and be more interested in this immersive art
museum than traditional one. Although there are some contributions on the child
education, however, the interface of SL is still another problem, which people have to
learn how to use it before controlling it. Sometimes, it is not easy to use for most
beginners. On the other sides, this research just creates a new form of art display in
virtual museum via SL. In the future, if we can combine more intuitive HCI interface,
such as “body sensor” into this virtual space, it would become more accessible and
adaptable for every visitors.
References
1. Dawood, N., Benghi, C., Lorenzen, T., Pencreach, Y.: Integration of Urban Development
and 5D Planning. In: Proceedings of the 9th International Conference on Construction
Applications of Virtual Reality, Sydney, Australia, pp. 217–228 (2009)
2. Boulos, M.N.K., Hetherington, L., Wheeler, S.: Second Life: an overview of the potential
of 3 - D virtual worlds in medical and health education. Health Information & Libraries
Journal 24(4), 233–245 (2007)
3. Iovine, J.: Step into Virtual Reality. Windcrest/McGraw-Hill (1995)
4. Kalawsky, R.S.: The Science of Virtual Reality and Virtual Environments. Addison-
Wesley (1993)
584 Y.-C. Huang and S. Rosie Han
5. Kalay, Y.E.: The impact of information technology on design methods, products and
practices. Design Studies 27(3), 357–380 (2006)
6. Mitchell, W.J.: City of Bits:Space, Place and the Infobahn. The MIT Press, Cambridge
(1995)
7. Myers, B.A.: A Brief History of Human Computer Interaction Technology. ACM
Interactions 5(2), 44–54 (1998)
8. Oberlander, J., Karakatsiotis, G., Isard, A., Androutsopoulos, I.: Building an adaptive
museum gallery in Second Life. In: Proceedings of Museums and the Web, Montreal,
Quebec, Canada (2008)
9. Soubra, S.: Combining Virtual Environments and Simulations to Meet Sustainability
Challenges of the Construction Sector. In: Proceedings of the 8th International Conference
on Construction Applications of Virtual Reality, Kuala Lumpur, Malaysia, pp. 42–57
(2008)
10. Sumption, K.: Search of the Ubiquitous Museum: Reflections of Ten Years of Museums
and the Web. In: Trant, J., Bearman, D. (eds.) Museums and the Web 2006: Proceedings,
Archives & Museum Informatics, Toronto (2006), http://www.archimuse.
com/mw2006/papers/sumption/sumption.html (published March 1, 2006)
11. Urban, R.J.: A second life for your museum: 3D multi-user virtual environments and
museums. Archives & Museum Informatics (2007)
12. Wertheim, M.: The Pearly Gates of Cyberspace: A History of Space from Dante to the
Internet. W.W. Norton & Company, New York (1999)
13. Yabuki, N., Miyashita, K., Fukuda, T.: An invisible height evaluation system for building
height regulation to preserve good landscapes using augmented reality. Automation in
Construction 20, 228–235 (2011)
14. Zhu, Q., Xiang, K., Hu, S.: Design an Immersive Interactive Museum in Second Life. In:
Second Workshop on Digital Media and its Application in Museum & Heritages, pp. 264–
267 (2007)
15. Second Life, http://www.secondlife.com
16. Terms of Service | Second Life, http://secondlife.com/corporate/tos.php
17. The Bayside Beach Galleria Museum of Contemporary Art, http://wiki.
secondlife.com/wiki/Third_Party_Viewer_Directory