Abstract

With the availability of cloud-based software, ubiquitous internet, and advanced digital modeling capabilities, a new potential has emerged to design physical products with methods previously embraced by the software engineering community. One such example is pair programming, where two coders work together synchronously to develop one piece of code. Pair programming has been shown to lead to higher-quality code and user satisfaction. Cutting-edge collaborative computer-aided design (CAD) technology affords the possibility to apply synchronous collaborative access in mechanical design. We test the generalizability of findings from the pair programming literature to the same dyadic configuration of work in CAD, which we call pair CAD. We performed human subject experiments with 60 participants to test three working styles: individuals working by themselves, pairs sharing control of one model instance and input, and pairs able to edit the same model simultaneously from two inputs. We compare the working styles on speed and quality and propose mechanisms for our observations via interpretation of patterns of communication, satisfaction, and user cursor activity. We find that on a per-person basis, individuals were faster than pairs due to coordination and overhead inefficiencies. We find that pair work, when done with a single shared input, but not in a parallel mode, leads to higher-quality models. We conclude that it is not software capabilities alone that influence designer output; choices regarding work process have a major effect on design outcomes, and we can tailor our process to suit project requirements.

References

1.
Hoever
,
I. J.
,
Van Knippenberg
,
D.
,
Van Ginkel
,
W. P.
, and
Barkema
,
H. G.
,
2010
, “
Fostering Team Creativity: Perspective Taking as Key to Unlocking Diversity’s Potential
,”
Acad. Manag. Proc.
,
2010
(
1
), pp.
1
6
.
2.
Sosa
,
M. E.
,
2011
, “
Where Do Creative Interactions Come From? The Role of Tie Content and Social Networks
,”
Organ. Sci.
,
22
(
1
), pp.
1
21
.
3.
Hansen
,
C. A.
, and
Özkil
,
A. G.
,
2019
, “
From Idea to Production: A Retrospective and Longitudinal Case Study of Prototypes and Prototyping Strategies
,”
Volume 7: 31st International Conference on Design Theory and Methodology
,
Anaheim, CA
,
Nov. 25
, pp.
1
10
.
4.
Tiong
,
E.
,
Seow
,
O.
,
Camburn
,
B.
,
Teo
,
K.
,
Silva
,
A.
,
Wood
,
K. L.
,
Jensen
,
D. D.
, and
Yang
,
M. C.
,
2019
, “
The Economies and Dimensionality of Design Prototyping: Value, Time, Cost, and Fidelity
,”
ASME J. Mech. Des.
,
141
(
3
), p.
031105
.
5.
Sutherland
,
I. E.
,
1963
, “
Sketchpad, A Man-Machine Graphical Communication System
,”
Ph.D. thesis
,
Massachusetts Institute of Technology
.
6.
Chen
,
X.
,
Gao
,
S.
,
Yang
,
Y.
, and
Zhang
,
S.
,
2012
, “
Multi-Level Assembly Model for Top-Down Design of Mechanical Products
,”
Comput. Aided Des.
,
44
(
10
), pp.
1033
1048
.
7.
Maver
,
T. W.
,
1986
, “
Social Impacts of Computer-Aided Architectural Design
,”
Des. Stud.
,
7
(
4
), pp.
178
184
.
8.
Sonnenwald
,
D. H.
,
1996
, “
Communication Roles That Support Collaboration During the Design Process
,”
Des. Stud.
,
17
(
3
), pp.
277
301
.
9.
Nam
,
T.-J.
, and
Wright
,
D.
,
2001
, “
The Development and Evaluation of Syco3D: A Real-Time Collaborative 3D CAD System
,”
Des. Stud.
,
22
(
6
), pp.
557
582
.
10.
Tang
,
H. H.
,
Lee
,
Y. Y.
, and
Gero
,
J. S.
,
2011
, “
Comparing Collaborative Co-Located and Distributed Design Processes in Digital and Traditional Sketching Environments: A Protocol Study Using the Function–Behaviour–Structure Coding Scheme
,”
Des. Stud.
,
32
(
1
), pp.
1
29
.
11.
Kim
,
K.
, and
Lee
,
K.-P.
,
2016
, “
Collaborative Product Design Processes of Industrial Design and Engineering Design in Consumer Product Companies
,”
Des. Stud.
,
46
, pp.
226
260
.
12.
Coburn
,
J. Q.
,
Salmon
,
J. L.
, and
Freeman
,
I.
,
2018
, “
Effectiveness of an Immersive Virtual Environment for Collaboration With Gesture Support Using Low-Cost Hardware
,”
ASME J. Mech. Des.
,
140
(
4
), p.
042001
.
13.
McComb
,
C.
,
Cagan
,
J.
, and
Kotovsky
,
K.
,
2017
, “
Optimizing Design Teams Based on Problem Properties: Computational Team Simulations and an Applied Empirical Test
,”
ASME J. Mech. Des.
,
139
(
4
), p.
041101
.
14.
Ulrich
,
K. T.
,
2003
,
Product Design and Development
,
Tata McGraw-Hill Education
,
India
.
15.
Maher
,
M. L.
, and
Rutherford
,
J. H.
,
1997
, “
A Model for Synchronous Collaborative Design Using CAD and Database Management
,”
Res. Eng. Des.
,
9
(
2
), pp.
85
98
.
16.
Fuh
,
J. Y. H.
, and
Li
,
W. D.
,
2005
, “
Advances in Collaborative CAD: The-State-of-the Art
,”
Comput. Aided Des.
,
37
(
5
), pp.
571
581
.
17.
Scrivener
,
S. A. R.
,
Harris
,
D.
,
Clark
,
S. M.
,
Rockoff
,
T.
, and
Smyth
,
M.
,
1993
, “
Designing at a Distance via Real-Time Designer-to-Designer Interaction
,”
Des. Stud.
,
14
(
3
), pp.
261
282
.
18.
Shu
,
L.
, and
Flowers
,
W.
,
1992
, “
Groupware Experiences in Three-Dimensional Computer-Aided Design
,”
Proceedings of the 1992 ACM Conference on Computer-Supported Cooperative Work—CSCW ‘92
,
Toronto, Ontario, Canada
,
November
, pp.
179
186
.
19.
Patterson
,
J. F.
,
Hill
,
R. D.
,
Rohall
,
S. L.
, and
Meeks
,
S. W.
,
1990
, “
Rendezvous: An Architecture for Synchronous Multi-User Applications
,”
Proceedings of the 1990 ACM Conference on Computer-Supported Cooperative Work—CSCW ‘90
,
Los Angeles, CA
,
October
, pp.
317
328
.
20.
Chiu
,
M.-L.
,
2002
, “
An Organizational View of Design Communication in Design Collaboration
,”
Des. Stud.
,
23
(
2
), pp.
187
210
.
21.
Peng
,
C.
,
1994
, “
Exploring Communication in Collaborative Design: Co-Operative Architectural Modelling
,”
Des. Stud.
,
15
(
1
), pp.
19
44
.
22.
Shen
,
Y.
,
Ong
,
S. K.
, and
Nee
,
A. Y. C.
,
2010
, “
Augmented Reality for Collaborative Product Design and Development
,”
Des. Stud.
,
31
(
2
), pp.
118
145
.
23.
Rahimian
,
F. P.
, and
Ibrahim
,
R.
,
2011
, “
Impacts of VR 3D Sketching on Novice Designers’ Spatial Cognition in Collaborative Conceptual Architectural Design
,”
Des. Stud.
,
32
(
3
), pp.
255
291
.
24.
Koch
,
S.
,
Matveev
,
A.
,
Jiang
,
Z.
,
Williams
,
F.
,
Artemov
,
A.
,
Burnaev
,
E.
,
Alexa
,
M.
,
Zorin
,
D.
, and
Panozzo
,
D.
,
2019
, “
ABC: A Big CAD Model Dataset for Geometric Deep Learning
,”
2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR)
,
Long Beach, CA
,
June 15–20
, pp.
9593
9603
.
25.
Andreadis
,
G.
,
Fourtounis
,
G.
, and
Bouzakis
,
K.-D.
,
2015
, “
Collaborative Design in the Era of Cloud Computing
,”
Adv. Eng. Softw.
,
81
(
C
), pp.
66
72
.
26.
Rahman
,
N.
,
Cheng
,
R.
, and
Bayerl
,
P. S.
,
2013
, “
Synchronous Versus Asynchronous Manipulation of 2D-Objects in Distributed Design Collaborations: Implications for the Support of Distributed Team Processes
,”
Des. Stud.
,
34
(
3
), pp.
406
431
.
27.
Eves
,
K.
,
Salmon
,
J.
,
Olsen
,
J.
, and
Fagergren
,
F.
,
2018
, “
A Comparative Analysis of Computer-Aided Design Team Performance With Collaboration Software
,”
Comput. Aided Des. Appl.
,
15
(
4
), pp.
476
487
.
28.
Phadnis
,
V. S.
,
Leonardo
,
K. A.
,
Wallace
,
D. R.
, and
Olechowski
,
A. L.
,
2019
, “
An Exploratory Study Comparing CAD Tools and Working Styles for Implementing Design Changes
,”
Proc. Des. Soc.: Int. Conf. Eng. Des.
,
1
(
1
), pp.
1383
1392
.
29.
Zhou
,
J.
,
Phadnis
,
V.
, and
Olechowski
,
A.
,
2021
, “
Analysis of Designer Emotions in Collaborative and Traditional Computer-Aided Design
,”
ASME J. Mech. Des.
,
143
(
2
), p.
021401
.
30.
Stone
,
B.
,
Salmon
,
J.
,
Hepworth
,
A.
,
Red
,
E.
, and
Killian
,
M.
,
2017
, “
Methods for Determining the Optimal Number of Simultaneous Contributors for Multi-User CAD Parts
,”
Proceedings of CAD’16
31.
Stone
,
B.
,
Salmon
,
J.
,
Eves
,
K.
,
Killian
,
M.
,
Wright
,
L.
,
Oldroyd
,
J.
,
Gorrell
,
S.
, and
Richey
,
M. C.
,
2017
, “
A Multi-User Computer-Aided Design Competition: Experimental Findings and Analysis of Team-Member Dynamics
,”
ASME J. Comput. Inf. Sci. Eng.
,
17
(
3
), p.
031003
.
32.
Moncur
,
R. A.
,
Greg Jensen
,
C.
,
Teng
,
C.-C.
, and
Red
,
E.
,
2013
, “
Data Consistency and Conflict Avoidance in a Multi-User CAx Environment
,”
Comput. Aided Des. Appl.
,
10
(
5
), pp.
727
744
.
33.
Red
,
E.
,
Marshall
,
F.
,
Weerakoon
,
P.
, and
Greg Jensen
,
C.
,
2013
, “
Considerations for Multi-User Decomposition of Design Spaces
,”
Comput. Aided Des. Appl.
,
10
(
5
), pp.
803
815
.
34.
Holyoak
,
V. L.
,
Red
,
E.
, and
Jensen
,
G.
,
2014
, “
Effective Collaboration Through Multi User CAx by Implementing New Methods of Product Specification and Management
,”
Comput. Aided Des. Appl.
,
11
(
5
), pp.
560
567
.
35.
Beck
,
K.
, and
Gamma
,
E.
,
2000
,
Extreme Programming Explained: Embrace Change
,
Addison-Wesley Professional
,
Boston, MA
.
36.
Williams
,
L.
,
Kessler
,
R. R.
,
Cunningham
,
W.
, and
Jeffries
,
R.
,
2000
, “
Strengthening the Case for Pair Programming
,”
IEEE Softw.
,
17
(
4
), pp.
19
25
.
37.
Estácio
,
B. J. d. S.
,
da Silva Estácio
,
B. J.
, and
Prikladnicki
,
R.
,
2015
, “
Distributed Pair Programming: A Systematic Literature Review
,”
Inf. Softw. Technol.
,
63
, pp.
1
10
.
38.
Nosek
,
J. T.
,
1998
, “
The Case for Collaborative Programming
,”
Commun. ACM
,
41
(
3
), pp.
105
108
.
39.
Begel
,
A.
, and
Nagappan
,
N.
,
2008
, “
Pair Programming: What’s in It for Me?
,”
International Symposium on Empirical Software Engineering and Measurement
,
Kaiserslautern, Germany
,
October
,
Association for Computing Machinery
, pp.
120
128
.
40.
Balijepally
,
V.
,
Mahapatra
,
R.
,
Nerur
,
S.
, and
Price
,
K. H.
,
2009
, “
Are Two Heads Better Than One for Software Development? The Productivity Paradox of Pair Programming
,”
MIS Q.
33
(
1
), p.
91
.
41.
Chau
,
T.
,
Maurer
,
F.
, and
Melnik
,
G.
,
2003
, “
Knowledge Sharing: Agile Methods vs. Tayloristic Methods
,”
WET ICE 2003. Proceedings. Twelfth IEEE International Workshops on Enabling Technologies: Infrastructure for Collaborative Enterprises
,
Linz, Austria
,
June
42.
Salinger
,
S.
,
Zieris
,
F.
, and
Prechelt
,
L.
,
2013
, “
Liberating Pair Programming Research From the Oppressive Driver/Observer Regime
,”
2013 35th International Conference on Software Engineering (ICSE)
,
San Francisco, CA
,
May 22–24
.
43.
Dourish
,
P.
, and
Bellotti
,
V.
,
1992
, “
Awareness and Coordination in Shared Workspaces
,”
Proceedings of the 1992 ACM Conference on Computer-Supported Cooperative Work—CSCW ‘92
,
Toronto, Ontario, Canada
,
December
, pp.
107
114
.
44.
Stefik
,
M.
,
Bobrow
,
D. G.
,
Foster
,
G.
,
Lanning
,
S.
, and
Tatar
,
D.
,
1987
, “
WYSIWIS Revised: Early Experiences With Multiuser Interfaces
,”
ACM Trans. Inf. Syst.
,
5
(
2
), pp.
147
167
.
45.
Li
,
J.
,
Greenberg
,
S.
, and
Sharlin
,
E.
,
2017
, “
A Two-Sided Collaborative Transparent Display Supporting Workspace Awareness
,”
Int. J. Hum-Comput. Stud.
,
101
(
C
), pp.
23
44
.
46.
Phan
,
T.
,
Honig
,
W.
, and
Ayanian
,
N.
,
2018
, “
Mixed Reality Collaboration Between Human-Agent Teams
,”
2018 IEEE Conference on Virtual Reality and 3D User Interfaces (VR)
,
Tuebingen/Reutlingen, Germany
,
Mar. 18–22
.
47.
Niu
,
S.
,
Scott McCrickard
,
D.
,
Nguyen
,
J.
,
Haqq
,
D.
,
Kotut
,
L.
,
Stelter
,
T. L.
, and
Fox
,
E. A.
,
2020
, “
Investigating Paradigms of Group Territory in Multiple Display Environments
,”
Proc. ACM Hum. Comput. Interact.
,
4
(
GROUP
), pp.
1
28
.
48.
Di Bella
,
E.
,
Fronza
,
I.
,
Phaphoom
,
N.
,
Sillitti
,
A.
,
Succi
,
G.
, and
Vlasenko
,
J.
,
2013
, “
Pair Programming and Software Defects—A Large, Industrial Case Study
,”
IEEE Trans. Softw. Eng.
,
39
(
7
), pp.
930
953
.
49.
Rajpal
,
M.
,
2018
, “
Effective Distributed Pair Programming
,”
Proceedings of the 13th Conference on Global Software Engineering—ICGSE ‘18
,
Gothenburg, Sweden
,
May 27–June 3
.
50.
Goldman
,
M.
,
Little
,
G.
, and
Miller
,
R. C.
,
2011
, “
Collabode: Collaborative Coding in the Browser
,”
Proceedings of the 4th International Workshop on Cooperative and Human Aspects of Software Engineering, CHASE 2011
,
Waikiki, HI
,
May 21
, IEEE/ACM.
51.
Schenk
,
J.
,
Prechelt
,
L.
, and
Salinger
,
S.
,
2014
, “
Distributed-Pair Programming Can Work Well and Is Not Just Distributed Pair-Programming
,”
Companion Proceedings of the 36th International Conference on Software Engineering—ICSE Companion 2014
,
Hyderabad, India
,
May 31–June 7
, pp.
74
83
.
52.
Perry
,
D. E.
,
Siy
,
H. P.
, and
Votta
,
L. G.
,
1998
, “
Parallel Changes in Large Scale Software Development: An Observational Case Study
,”
Proceedings of the 20th International Conference on Software Engineering
,
Kyoto, Japan
,
April
, pp.
251
260
.
53.
Ho
,
C.-W.
,
Raha
,
S.
,
Gehringer
,
E.
, and
Williams
,
L.
,
2004
, “
Sangam
,”
Proceedings of the 2004 OOPSLA Workshop on Eclipse Technology EXchange—Eclipse ‘04
,
Vancouver, British Columbia, Canada
,
October
, pp.
73
77
.
54.
Alharbi
,
M. A.
,
2020
, “
Exploring the Potential of Google Doc in Facilitating Innovative Teaching and Learning Practices in an EFL Writing Course
,”
Innov. Lang. Learn. Teach.
,
14
(
3
), pp.
227
242
.
55.
Guay
,
R.
,
1976
,
Purdue Research Foundation, and Educational Testing Service. Test Collection, Purdue Spatial Visualization Test
.
56.
Planchard
,
D.
,
2019
,
Official Certified SOLIDWORKS Professional Certification Guide (2018, 2019, 2020)
,
SDC Publications
,
United States
.
57.
Arshad
,
H.
,
Phadnis
,
V.
, and
Olechowski
,
A.
,
2020
, “
Paired Computer-Aided Design: The Effect of Collaboration Mode on Differences in Model Quality
,”
ASME IDETC/CIE
.
58.
Blessing
,
L. T. M.
, and
Chakrabarti
,
A.
,
2009
, “
DRM, a Design Research Methodology
,” Springer-Verlag London, New York.
59.
Foschi
,
M.
,
2014
, “
Hypotheses, Operationalizations, and Manipulation Checks
,”
Lab. Exp. Soc. Sci.
, pp.
247
268
.
60.
Faludi
,
J.
,
Yiu
,
F.
,
Srour
,
O.
,
Kamareddine
,
R.
,
Ali
,
O.
, and
Mecanna
,
S.
,
2019
, “
Do Student Trials Predict What Professionals Value in Sustainable Design Practices?
,”
ASME J. Mech. Des.
,
141
(
10
), p.
102001
.
61.
Salleh
,
N.
,
Mendes
,
E.
, and
Grundy
,
J.
,
2011
, “
Empirical Studies of Pair Programming for CS/SE Teaching in Higher Education: A Systematic Literature Review
,”
IEEE Trans. Softw. Eng.
,
37
(
4
), pp.
509
525
.
62.
Nagappan
,
N.
,
Williams
,
L.
,
Ferzli
,
M.
,
Wiebe
,
E.
,
Yang
,
K.
,
Miller
,
C.
, and
Balik
,
S.
,
2003
, “
Improving the CS1 Experience With Pair Programming
,”
ACM SIGCSE Bulletin
,
35
(
1
), p.
359
.
63.
Company
,
P.
,
Contero
,
M.
,
Otey
,
J.
, and
Plumed
,
R.
,
2015
, “
Approach for Developing Coordinated Rubrics to Convey Quality Criteria in MCAD Training
,”
Comput. Aided Des.
,
63
, pp.
101
117
.
64.
McHugh
,
M. L.
,
2012
, “
Interrater Reliability: The Kappa Statistic
,”
Biochem. Med.
,
22
(
3
), pp.
276
282
.
65.
Meaghan
,
V.
, and
Phadnis
,
V.
,
2020
, “
(Forthcoming) Patterns of Silence and Communication Between Paired Designers in Collaborative Computer-Aided Design
,”
9th International Conference on Design Computing and Cognition
,
29 June–1 July
.
66.
Hill
,
G. W.
,
1982
, “
Group Versus Individual Performance: Are N+1 Heads Better Than One?
,”
Psychol. Bull.
,
91
(
3
), pp.
517
539
.
67.
Hamade
,
R. F.
,
2009
, “
Profiling the Desirable CAD Trainee: Technical Background, Personality Attributes, and Learning Preferences
,”
ASME J. Mech. Des.
,
131
(
12
), p.
121009
.
68.
Robertson
,
B. F.
,
Walther
,
J.
, and
Radcliffe
,
D. F.
,
2007
, “
Creativity and the Use of CAD Tools: Lessons for Engineering Design Education From Industry
,”
ASME J. Mech. Des.
,
129
(
7
), pp.
753
760
.
69.
Rahman
,
M. H.
,
Schimpf
,
C.
,
Xie
,
C.
, and
Sha
,
Z.
,
2019
, “
A Computer-Aided Design Based Research Platform for Design Thinking Studies
,”
ASME J. Mech. Des.
,
141
(
12
), p.
121102
.
You do not currently have access to this content.