Competitive usability studies are employed providing empirical results in a design evaluation and review context. Populations of novice and experienced users are tested against benchmarks. Benchmark 1 is used to evaluate error identification and correction. Benchmark 2 is employed to evaluate the user’s ability to understand spatial relationships. Both benchmarks 1 and 2 compare individual performance with performance of teams. Benchmarks 3 measures quantity of errors found in a 4 min time frame. For benchmark 1, there is a statistically significant difference, but for benchmark 2, there is no statistical difference. For benchmark 3, there is a statistically significant increase in errors found. This increase is evaluated for impact as cost avoidance. It is concluded that cost avoidance by using a cave automatic virtual environment (CAVE) immersive virtual environment easily justifies the CAVE system.

Issue Section:
Technical Briefs
Keywords:
virtual environments, virtual reality, usability, cost avoidance, collaboration, design review, design evaluation
Topics:
Caves, Design, Errors, Virtual reality, Collaboration

References

1.
Bochenek
,
G.
,
Ragusa
,
J.
, and
Malone
,
L.
, 2001, “
Integrating Virtual 3D Display Systems Into Product Design Reviews
,”
Int. J. Technol Manage.
,
21
, pp.
340
–
352
.
Crossref
Search ADS
 
2.
Banerjee
,
P.
, and
Basu-Mallick
,
D.
, 2003, “
Measuring the Effectiveness of Presence and Immersive Tendencies on the Conceptual Design Review Process
,”
ASME J. Comput. Inf. Sci. Eng.
,
3
(
2
), pp.
166
–
179
.
Crossref
Search ADS
 
3.
Johansson
,
P.
, and
Yennerman
,
A.
, 2004, “
Immersive Visual Interfaces-Assessing Usability by the Effects of Learning/Results from an Empirical Study
,”
ASME J. Comput. Inf. Sci. Eng.
,
4
(
2
) pp.
124
–
131
.
Crossref
Search ADS
 
4.
Gould
,
J.
, and
Lewis
,
C.
, 1985, “
Designing for Usability: Key Principles and What Designers Think
,”
Commun. ACM
,
28
(
3
), pp.
300
–
311
.
Crossref
Search ADS
 
5.
ISO Standard 9241-11, Ergonomic Requirements for Office Work with Virtual Display Terminals (VDT’s), Part 11- “Guidance on Usability” International Standards Organization, 2003.
6.
Hix
,
D.
,
Swan
,
E.
,
Gabbard
,
J.
,
McGee
,
M.
,
Durban
,
J.
, and
King
,
T.
, 1999, “
User-Centered Design and Evaluation of Real-Time Battlefield Visualization Virtual Environment
,”
Proceedings of the IEEE Virtual Reality
, pp.
96
–
103
.
7.
Gabbard
,
J.
,
Hix
,
D.
, and
Swan
,
E.
, 1999, “
User Centered Design and Evaluation of Virtual Environments
,”
IEEE Comput. Graphics Appl.
,
19
(
6
), pp.
2
–
10
.
8.
Gabbard
,
J.
, and
Swan
,
E.
, 2008, “
Usability Engineering for Augmented Reality
,”
IEEE Trans. Vis. Comput. Graph.
,
14
(
3
), pp.
513
–
525
.
Crossref
Search ADS
PubMed
 
9.
Nielsen
,
J.
, 1993, “
Iterative User Interfaces Design
,”
IEEE Comput.
,
26
(
11
), pp.
32
–
41
.
Crossref
Search ADS
 
10.
Poupyrev
,
I.
,
Weghorst
,
S.
,
Billinghurst
,
M.
, and
Ichikawa
,
T.
, 1997, “
A Framework and Testbed for Studying Manipulation Techniques for Immersive VR
,”
Proceedings of the ACM Conference on VR Systems
, Lausanne, Switzerland, pp.
21
–
28
.
11.
Stanney
,
K.
,
Mollaghasemi
,
M.
,
Reaves
,
L.
,
Breaux
,
R.
, and
Graeber
,
D.
, 2003, “
Usability Engineering of Virtual Environments: Identifying Multiple Criteria
,”
Int. J. Hum.-Comput. Stud.
,
58
(
4
), pp.
447
–
481
.
Crossref
Search ADS
 
12.
Kotranza
,
A.
,
Lok
,
B.
,
Deladisma
,
A.
,
Carla
M.
, and
Lind
,
D.
, 2009, “
Mixed Reality Humans: Evaluating Behavior, Usability, and Acceptability
,”
IEEE Trans. Vis. Comput. Graph.
,
15
(
3
), pp.
369
–
382
.
Crossref
Search ADS
PubMed
 
13.
Disz
,
T.
,
Papka
,
M.
,
Pellegrino
,
M.
, and
Stevens
,
R.
, 1995, “
Sharing Visualization Experiences Among Remote Virtual Environments
,”
Proceedings of the International Workshop on High Performance Computing for Computer Graphics and Applications
.
14.
Sreedharan
,
S.
,
Zurita
,
E.
, and
Plimmer
,
B.
, 2007, “
3D Input for 3D Worlds
,” 251 ed., Proceedings of OZCHI.
15.
Simon
, 2005, Proceedings of the ACM Symposium on Virtual Reality, published 11/07/2005 First Person Experience and Usability of Co-Located Interaction in a Projection-Based Virtual Environment, pp.
23
–
30
.
16.
Patel
,
H.
,
Stefani
,
O.
,
Sharples
,
S.
,
Hoffman
,
H.
,
Kraseitanidis
,
I.
, and
Amditis
,
A.
, 2006, “
Human Centered Design of 3-D Interaction Devices to Control Virtual Environments
,”
Int. J. Hum.-Comput. Stud.
,
64
(
3
), pp.
207
–
220
.
Crossref
Search ADS
 
17.
Chu
,
C.
,
Dani
,
T.
, and
Gadh
,
R.
, 1998, “
Evaluation of Virtual Reality Interface for Product Shape Designs
,”
IIE Trans.
,
30
(
7
), pp.
629
–
643
.
18.
Nomura
,
J.
, and
Sawada
,
K.
, 1999, “
Virtual Reality Technology and its Applications to Industrial Use
,”
Control Eng. Pract.
,
7
(
11
), pp.
1381
–
1394
.
Crossref
Search ADS
 
19.
Ware
,
C.
,
Arthur
,
K.
, and
Booth
,
K.
, 1993, “
Fish Tank Virtual Reality
,”
Proceedings of the Conference on Human Factors in Computing Systems
,
Amsterdam
,
The Netherlands
, pp.
37
–
42
.
20.
Bolt
,
R.
, and
Herranz
,
E.
, 1992, “
Two-Handed Gesture in Multi-Modal Natural Dialog
,”
Proceedings of the ACM Symposium on User Interface, Software, and Technology
,
ACM
,
Monterey, CA
, pp.
7
–
18
.
21.
Wexelblat
,
A.
, 1995, “
An Approach to Natural Gesture in Virtual Environments
,”
ACM Trans. Comput.-Hum. Interact.
,
2
(
3
), pp.
179
–
200
.
Crossref
Search ADS
 
22.
UMI Dissertation Services from ProQuest, UMI Microform No. 3226934.
Satter
,
K.
, 2005, “
Competitive Usability Studies of Virtual Environments for Shipbuilding
.” Ph.D. Engineering Management, University of New Orleans.
23.
GraphPad Software, 2003, INSTAT, San Diego, CA.
24.
SAS Institute
, 1999,
SAS for Windows
, 00M0 ed.,
SAS Institute
,
Cary, NC
.
25.
Motulsky
,
H.
, 2003,
The INSTAT Guide to Choosing and Interpreting Statistical Tests
,
GraphPad Software
,
San Diego, CA
.
26.
Garwood
,
D.
, 2005,
UNO-Satter-112905 Fakesapce CAVE System Quotation
,
Marshalltown
,
IA
.
27.
Storch
,
R.
,
Harmon
,
C.
,
Bunch
,
H.
, and
Moore
,
R.
, 1995,
Ship Production
, 2nd ed.,
Cornell Maritime Press
.
28.
Staff Writer
, 2005,
Cost Overruns, Budget Uncertainties Hurting USN and Contractors
,
New Orleans Times-Picayune
.
29.
Shalal-Esa
,
A.
, 2005, Pentagon May Scale Back Navy DD(X) Destroyer, Reuters, Ed., DefenseTalk Andrew Shai-Esa, Reuters News, Tuesday, November 8, 2005, http://DefenseTalp.com/News Publish/Article004040.phphttp://DefenseTalp.com/News Publish/Article004040.php.
30.
Wikipedia Staff, 2005, Virginia Class Submarine http://en.wikipedia.org/wiki/Virginia_Class_Submarinehttp://en.wikipedia.org/wiki/Virginia_Class_Submarine, accessed November 12, 2005.
31.
Butler
,
A.
, January 28, 2005, “
Return on Investment (ROI) Analysis for the Implementation of a STEP AP 227 Format for Interoperable HVAC Design
,” Final Report, submitted for the Integrated Shipbuilding Environments—3 Project, sponsored by the National Shipbuilding Research Program.
Copyright © 2012
 by American Society of Mechanical Engineers
You do not currently have access to this content.