Abstract

Improving team interactions in engineering to model gender inclusivity has been at the forefront of many initiatives in both academia and industry. However, there has been limited evidence on the impact of gender-diverse teams on psychological safety (PS). This is important because psychological safety has been shown to be a key facet for the development of innovative ideas, and has also been shown to be a cornerstone of effective teamwork. But how does the gender diversity of a team impact the development of psychological safety? The current study was developed to explore just this through an empirical study with 38 engineering design student teams over the course of an eight-week design project. These teams were designed to be half heterogeneous (either half-men and half-women, or majority men) or other half homogeneous (all men). We captured psychological safety at five time points between the homogeneous and heterogeneous teams and also explored individual dichotomous (peer-review) ratings of psychological safety at the end of the project. Results indicated that there was no difference in psychological safety between gender homogeneous and heterogeneous teams. However, women perceived themselves as more psychologically safe with other team members who identified as women in comparison to their ratings of team members that identified as men. Women also perceived themselves to be less psychologically safe with men than men felt toward team members that identify as a woman. While males did not experience any significant differences in their perceptions of psychological safety toward any gender, the results from the perspective of women still indicate a discrepancy in perceptions between genders. These results point to the need to further explore the role of minoritized groups in psychological safety research and to explore how this effect presents itself (or is covered up) at the team level, as well as investigate impacts on all-women teams.

References

1.
Peng
,
A.
,
Menold
,
J.
, and
Miller
,
S. R.
,
2020
, “
Does It Translate? A Case Study of Conceptual Design Outcomes With U.S. and Moroccan Students
,”
Proceedings of ASME 2020 International Design Engineering Technical Conferences and Computers and Information in Engineering Conference
,
Virtual, Online
,
Aug. 17–19
.
2.
Stolk
,
J. D.
,
Gross
,
M. D.
, and
Zastavker
,
Y. V.
,
2021
, “
Motivation, Pedagogy, and Gender: Examining the Multifaceted and Dynamic Situational Responses of Women and Men in College STEM Courses
,”
Int. J. STEM Educ.
,
8
(
1
), pp.
1
19
.
3.
Andrews
,
M. E.
,
Patrick
,
A. D.
, and
Borrego
,
M.
,
2021
, “
Engineering Students’ Attitudinal Beliefs by Gender and Student Division: A Methodological Comparison of Changes Over Time
,”
Int. J. STEM Educ.
,
8
(
1
), pp.
1
14
.
4.
Marra
,
R. M.
,
Rodgers
,
K. A.
,
Shen
,
D.
, and
Bogue
,
B.
,
2009
, “
Women Engineering Students and Self-Efficacy: A Multi-Year, Multi-Institution Study of Women Engineering Student Self-Efficacy
,”
J. Eng. Educ.
,
98
(
1
), pp.
27
38
.
5.
Matusovich
,
H. M.
,
Streveler
,
R. A.
, and
Miller
,
R. L.
,
2010
, “
Why Do Students Choose Engineering? A Qualitative, Longitudinal Investigation of Students’ Motivational Values
,”
J. Eng. Educ.
,
99
(
4
), pp.
289
303
.
6.
Ayre
,
M.
,
Mills
,
J.
, and
Gill
,
J.
,
2013
, “
‘Yes, I Do Belong’: The Women Who Stay in Engineering
,”
Eng. Stud.
,
5
(
3
), pp.
216
232
.
7.
Maurer
,
J. A.
,
Choi
,
D.
, and
Hur
,
H.
,
2021
, “
Building a Diverse Engineering and Construction Industry: Public and Private Sector Retention of Women in the Civil Engineering Workforce
,”
J. Manage. Eng.
,
37
(
4
), pp.
1
11
.
8.
Roberts
,
P.
, and
Ayre
,
M.
,
2002
, “
Did She Jump or Was She Pushed? A Study of Women’s Retention in the Engineering Workforce
,”
Int. J. Eng. Educ.
,
18
(
4
), pp.
415
421
.
9.
Haverkamp
,
A. E.
,
2021
,
Transgender and Gender Nonconforming Undergraduate Engineering Students: Perspectives, Resiliency, and Suggestions for Improving Engineering Education
,
Oregon State University
,
Corvallis, OR
.
10.
Haverkamp
,
A.
,
Bothwell
,
M.
,
Montfort
,
D.
, and
Driskill
,
Q.-L.
,
2021
, “
Calling for a Paradigm Shift in the Study of Gender in Engineering Education
,”
Stud. Eng. Educ.
,
1
(
2
), pp.
55
70
.
11.
Weidler-Lewis
,
J.
,
2020
, “
Transformation and Stasis: An Exploration of LGBTQA Students Prefiguring the Social Practices of Engineering for Greater Inclusivity
,”
Eng. Stud.
,
12
(
2
), pp.
127
149
.
12.
Strayhorn
,
T. L.
,
Long
,
L. L.
,
Williams
,
M. S.
,
Dorimé-Williams
,
M. L.
, and
Tillman-Kelly
,
D. L.
,
2014
, “
Measuring the Educational Benefits of Diversity in Engineering Education: A Multi-Institutional Survey Analysis of Women and Underrepresented Minorities
,”
Proceedings of 2014 ASEE Annual Conference & Exposition
,
Indianapolis, IN
,
June 15
, pp.
1
15
.
13.
Miller
,
S.
,
Marhefka
,
J.
,
Heininger
,
K.
,
Jablokow
,
K.
,
Mohammed
,
S.
, and
Ritter
,
S.
,
2019
, “
The Trajectory of Psychological Safety in Engineering Teams: A Longitudinal Exploration in Engineering Design Education
,”
Proceedings of ASME 2019 International Design Engineering Technical Conferences and Computers and Information in Engineering Conference
,
Anaheim, CA
,
Aug. 18–21
.
14.
Cole
,
C.
,
Marhefka
,
J.
,
Jablokow
,
K.
,
Mohammed
,
S.
,
Ritter
,
S.
, and
Miller
,
S.
,
2020
, “
How Engineering Design Students’ Psychological Safety Impacts Team Concept Generation and Screening Practices
,”
Proceedings of ASME 2020 International Design Engineering Technical Conferences and Computers and Information in Engineering Conference
,
Virtual, Online
,
Aug. 17–19
.
15.
Edmondson
,
A.
,
1999
, “
Psychological Safety and Learning Behavior in Work Teams
,”
Administ. Sci. Q.
,
44
(
2
), pp.
350
383
.
16.
Edmondson
,
A. C.
, and
Lei
,
Z.
,
2014
, “
Psychological Safety: The History, Renaissance, and Future of an Interpersonal Construct
,”
Annu. Rev. Organ. Psychol. Organ. Behav.
,
1
(
1
), pp.
23
43
.
17.
Mohammed
,
S.
,
Ferzandi
,
L.
, and
Hamilton
,
K.
,
2010
, “
Metaphor No More: A 15-Year Review of the Team Mental Model Construct
,”
J. Manage.
,
36
(
4
), pp.
876
910
.
18.
Kozlowski
,
S. W. J.
,
Chao
,
G. T.
,
Grand
,
J. A.
,
Braun
,
M. T.
, and
Kuljanin
,
G.
,
2013
, “
Advancing Multilevel Research Design: Capturing the Dynamics of Emergence
,”
Organ. Res. Meth.
,
16
(
4
), pp.
581
615
.
19.
Kim
,
J. E.
,
2021
, “
Paradoxical Leadership and Proactive Work Behavior: The Role of Psychological Safety in the Hotel Industry
,”
J. Asian Finan. Econ. Bus.
,
8
(
5
), pp.
167
178
.
20.
Akan
,
O. H.
,
Jack
,
E. P.
, and
Mehta
,
A.
,
2020
, “
Concrescent Conversation Environment, Psychological Safety, and Team Effectiveness
,”
Team Perform. Manage.: Int. J.
,
26
(
1/2
), pp.
29
51
.
21.
Leung
,
K.
,
Deng
,
H.
,
Wang
,
J.
, and
Zhou
,
F.
,
2015
, “
Beyond Risk-Taking: Effects of Psychological Safety on Cooperative Goal Interdependence and Prosocial Behavior
,”
Group Organ. Manage.
,
40
(
1
), pp.
88
115
.
22.
Carmeli
,
A.
, and
Gittell
,
J. H.
,
2009
, “
High-Quality Relationships, Psychological Safety, and Learning From Failures in Work Organizations
,”
J. Organ. Behav.
,
30
(
6
), pp.
709
729
.
23.
Roussin
,
C. J.
,
Larraz
,
E.
,
Jamieson
,
K.
, and
Maestre
,
J. M.
,
2018
, “
Psychological Safety, Self-Efficacy, and Speaking Up in Interprofessional Health Care Simulation
,”
Clin. Simul. Nursing
,
17
, pp.
38
46
.
24.
Chen
,
C.
,
Liao
,
J.
, and
Wen
,
P.
,
2014
, “
Why Does Formal Mentoring Matter? The Mediating Role of Psychological Safety and the Moderating Role of Power Distance Orientation in the Chinese Context
,”
Int. J. Human Resour. Manage.
,
25
(
8
), pp.
1112
1130
.
25.
Lee
,
H. W.
,
Choi
,
J. N.
, and
Kim
,
S.
,
2018
, “
Does Gender Diversity Help Teams Constructively Manage Status Conflict? An Evolutionary Perspective of Status Conflict, Team Psychological Safety, and Team Creativity
,”
Organ. Behav. Human Decis. Process.
,
144
, pp.
187
199
.
26.
Beigpourian
,
B.
,
Ferguson
,
D. M.
, and
Ohland
,
M. W.
,
2019
, “
The Influence of Percentage of Female or International Students on the Psychological Safety of Team
,”
Proceedings of FYEE Conference
,
University Park, PA
,
July 28–30
.
27.
Cole
,
C.
,
O’Connell
,
A.
,
Marhefka
,
J.
,
Jablokow
,
K.
,
Mohammed
,
S.
,
Ritter
,
S.
, and
Miller
,
S.
,
2022
, “
What Factors Impact Psychological Safety in Engineering Student Teams? A Mixed-Method Longitudinal Investigation
,”
ASME J. Mech. Des.
,
144
(
12
), p.
122302
.
28.
Cole
,
C.
,
Marhefka
,
J.
,
Jablokow
,
K.
,
Mohammed
,
S.
,
Ritter
,
S.
, and
Miller
,
S.
,
2022
, “
What is the Relationship Between Psychological Safety and Team Productivity and Effectiveness During Concept Development? An Exploration in Engineering Design Education
,”
ASME J. Mech. Des.
,
144
(
11
), p.
112301
.
29.
Tang
,
S.
,
Nadkarni
,
S.
,
Wei
,
L.-Q.
, and
Zhang
,
S. X.
,
2020
, “
Balancing the Yin and Yang: TMT Gender Diversity, Psychological Safety, and Firm Ambidextrous Strategic Orientation in Chinese High-Tech SMEs
,”
Acad. Manage. J
,
64
(
5
), pp.
1578
1604
.
30.
Porath
,
C. L.
,
Overbeck
,
J. R.
, and
Pearson
,
C. M.
,
2008
, “
Picking Up the Gauntlet: How Individuals Respond to Status Challenges
,”
J. Appl. Soc. Psychol.
,
38
(
7
), pp.
1945
1980
.
31.
Anderson
,
C.
,
John
,
O. P.
,
Keltner
,
D.
, and
Kring
,
A. M.
,
2001
, “
Who Attains Social Status? Effects of Personality and Physical Attractiveness in Social Groups
,”
J. Personal. Soc. Psychol.
,
81
(
1
), pp.
116
132
.
32.
Frazier
,
M. L.
,
Fainshmidt
,
S.
,
Klinger
,
R. L.
,
Pezeshkan
,
A.
, and
Vracheva
,
V.
,
2017
, “
Psychological Safety: A Meta-Analytic Review and Extension
,”
Personnel Psychol.
,
70
(
1
), pp.
113
165
.
33.
Hirschfeld
,
R. R.
,
Jordan
,
M. H.
,
Feild
,
H. S.
,
Giles
,
W. F.
, and
Armenakis
,
A. A.
,
2005
, “
Teams’ Female Representation and Perceived Potency as Inputs to Team Outcomes in a Predominantly Male Field Setting
,”
Personnel Psychol.
,
58
(
4
), pp.
893
924
.
34.
Bear
,
J. B.
, and
Woolley
,
A. W.
,
2011
, “
The Role of Gender in Team Collaboration and Performance
,”
Interdiscipl. Sci. Rev.
,
36
(
2
), pp.
146
153
.
35.
Campbell
,
L. G.
,
Mehtani
,
S.
,
Dozier
,
M. E.
, and
Rinehart
,
J.
,
2013
, “
Gender-Heterogeneous Working Groups Produce Higher Quality Science
,”
PLoS One
,
8
(
10
), pp.
1
6
.
36.
Wang
,
M.-T.
, and
Degol
,
J. L.
,
2017
, “
Gender Gap in Science, Technology, Engineering, and Mathematics (STEM): Current Knowledge, Implications for Practice, Policy, and Future Directions
,”
Educ. Psychol. Rev.
,
29
(
1
), pp.
119
140
.
37.
Laeser
,
M.
,
Moskal
,
B. M.
,
Knecht
,
R.
, and
Lasich
,
D.
,
2003
, “
Engineering Design: Examining the Impact of Gender and the Team’s Gender Composition
,”
J. Eng. Educ.
,
92
(
1
), pp.
49
56
.
38.
Bani-Hani
,
E.
,
Al Shalabi
,
A.
,
Alkhatib
,
F.
,
Eliaghi
,
A.
, and
Sedaghat
,
A.
,
2018
, “
Factors Affecting the Team Formation and Work in Project Based Learning (PBL) for Multidisciplinary Engineering Subjects
,”
J. Probl. Based Learn. Higher Educ.
,
6
(
2
), pp.
136
143
.
39.
Lount, Jr.
,
R. B.
,
Sheldon
,
O. J.
,
Rink
,
F.
, and
Phillips
,
W. K.
,
2015
, “
Biased Perceptions of Racially Diverse Teams and Their Consequences for Resource Support
,”
Organ. Sci.
,
26
(
5
), pp.
1351
1364
.
40.
Hatmaker
,
D. M.
,
2013
, “
Engineering Identity: Gender and Professional Identity Negotiation among Women Engineers
,”
Gender, Work Organ.
,
20
(
4
), pp.
382
396
.
41.
Dasgupta
,
N.
,
Scircle
,
M. M.
, and
Hunsinger
,
M.
,
2015
, “
Female Peers in Small Work Groups Enhance Women’s Motivation, Verbal Participation, and Career Aspirations in Engineering
,”
Proc. Natl. Acad. Sci. U. S. A.
,
112
(
16
), pp.
4988
4993
.
42.
Lorelle
,
A. M.
, and
Denise
,
S.
,
2013
, “
The Influence of Gender Stereotypes on Role Adoption in Student Teams
,”
2013 ASEE Annual Conference & Exposition, ASEE Conferences
,
Atlanta, GA
,
June 22–25
.
43.
Itani
,
M.
, and
Srour
,
I.
,
2016
, “
Engineering Students’ Perceptions of Soft Skills, Industry Expectations, and Career Aspirations
,”
J. Profess. Issues Eng. Educ. Pract.
,
142
(
1
), pp.
1
12
.
44.
Joshi
,
A.
,
2014
, “
By Whom and When Is Women’s Expertise Recognized? The Interactive Effects of Gender and Education in Science and Engineering Teams
,”
Administ. Sci. Q.
,
59
(
2
), pp.
202
239
.
45.
Hirshfield
,
L.
, and
Koretsky
,
M. D.
,
2018
, “
Gender and Participation in an Engineering Problem-Based Learning Environment
,”
Interdiscipl. J. Problem-Based Learn.
,
12
(
1
), pp.
1
18
.
46.
Walton
,
G. M.
, and
Cohen
,
G. L.
,
2007
, “
A Question of Belonging: Race, Social Fit, and Achievement
,”
J. Personal. Soc. Psychol.
,
92
(
1
), pp.
82
96
.
47.
O’Donovan
,
R.
, and
McAuliffe
,
E.
,
2020
, “
A Systematic Review of Factors That Enable Psychological Safety in Healthcare Teams
,”
Int. J. Quality Health Care
,
32
(
4
), pp.
240
250
.
48.
Foor
,
C. E.
,
Walden
,
S. E.
, and
Trytten
,
D. A.
,
2007
, “
“I Wish That I Belonged More in This Whole Engineering Group:” Achieving Individual Diversity
,”
J. Eng. Educ.
,
96
(
2
), pp.
103
115
.
49.
Lee
,
M. J.
,
Collins
,
J. D.
,
Harwood
,
S. A.
,
Mendenhall
,
R.
, and
Huntt
,
M. B.
,
2020
, “
“If You Aren’t White, Asian or Indian, You Aren’t an Engineer”: Racial Microaggressions in STEM Education
,”
Int. J. STEM Educ.
,
7
(
1
), pp.
1
16
.
50.
Camacho
,
M. M.
, and
Lord
,
S. M.
,
2011
, “
“Microaggressions” in Engineering Education: Climate for Asian, Latina and White Women
,”
Proceedings of 2011 Frontiers in Education Conference (FIE)
,
Rapid City, SD
,
Oct. 12–15
, pp.
1
6
.
51.
Scarpinella
,
S.
,
Cole
,
C.
,
Jablokow
,
K.
,
Mohammed
,
S.
,
Ritter
,
S.
, and
Miller
,
S.
,
2022
, “
Can We Get an Intervention, Please? The Utility of Teaming Interventions on Engineering Design Student Psychological Safety
,”
Proceedings of ASME 2022 International Design Engineering Technical Conferences and Computers and Information in Engineering Conference
,
Saint Louis, MO
,
Aug. 14–17
.
52.
Drum
,
A.
,
Cole
,
C.
,
Jablokow
,
K.
,
Mohammed
,
S.
,
Ritter
,
S.
, and
Miller
,
S.
,
2022
, “
Let’s Role Play! The Impact of Video Frequency and Role Play on the Utility of a Psychological Safety Team Intervention
,”
Proceedings of ASME 2022 International Design Engineering Technical Conferences and Computers and Information in Engineering Conference
,
Saint Louis, MO
,
Aug. 14–17
.
53.
Rosser
,
S. V.
,
1998
, “
Group Work in Science, Engineering, and Mathematics: Consequences of Ignoring Gender and Race
,”
College Teach.
,
46
(
3
), pp.
82
88
.
54.
Tuong
,
W.
,
Larsen
,
E. R.
, and
Armstrong
,
A. W.
,
2014
, “
Videos to Influence: A Systematic Review of Effectiveness of Video-Based Education in Modifying Health Behaviors
,”
J. Behav. Med.
,
37
(
2
), pp.
218
233
.
55.
Yousef
,
A. M. F.
,
Amine
,
M. C.
, and
Schroeder
,
U.
,
2014
, “
The State of Video-Based Learning: A Review and Future Perspectives
,”
Int. J. Adv. Life Sci.
,
6
(
3/4
), pp.
122
135
.
56.
Dym
,
C. L.
, and
Little
,
P.
,
2014
,
Engineering Design: A Project-Based Introduction
,
John Wiley and Sons
,
Hoboken, NJ
.
57.
Pugh
,
S.
,
1991
,
Total Design: Integrated Methods for Successful Product Engineering
,
Addison-Wesley
,
Reading, MA
.
58.
Berge
,
Z. L.
,
1998
, “
Differences in Teamwork Between Post-Secondary Classrooms and the Workplace
,”
Educ. Train.
,
40
(
5
), pp.
194
201
.
59.
Blumenfeld
,
P. C.
,
Marx
,
R. W.
,
Soloway
,
E.
, and
Krajcik
,
J.
,
1996
, “
Learning With Peers: From Small Group Cooperation to Collaborative Communities
,”
Educ. Res.
,
25
(
8
), pp.
37
39
.
60.
Fredrick
,
T. A.
,
2008
, “
Facilitating Better Teamwork: Analyzing the Challenges and Strategies of Classroom-Based Collaboration
,”
Business Commun. Q.
,
71
(
4
), pp.
439
455
.
61.
Kinlaw
,
D. C.
,
1991
,
Developing Superior Work Teams: Building Quality and the Competitive Edge
,
Lexington Books
,
Washington, DC
.
62.
Ericksen
,
J.
, and
Dyer
,
L.
,
2004
, “
Right From the Start: Exploring the Effects of Early Team Events on Subsequent Project Team Development and Performance
,”
Administ. Sci. Q.
,
49
(
3
), pp.
438
471
.
63.
Parsons
,
M. L.
,
Batres
,
C.
, and
Golightly-Jenkins
,
C.
,
2006
, “
Innovations in Management: Establishing Team Behavioral Norms for a Healthy Workplace
,”
Adv. Emerg. Nurs. J.
,
28
(
2
), pp.
113
119
.
64.
Taggar
,
S.
, and
Ellis
,
R.
,
2007
, “
The Role of Leaders in Shaping Formal Team Norms
,”
Leadersh. Q.
,
18
(
2
), pp.
105
120
.
65.
Kress
,
G. L.
, and
Schar
,
M.
,
2012
, “Teamology—The Art and Science of Design Team Formation,”
Design Thinking Research: Studying Co-Creation in Practice
,
H.
Plattner
,
C.
Meinel
, and
L.
Leifer
, eds.,
Springer
,
Berlin/Heidelberg
, pp.
189
209
.
66.
Mohan
,
G.
, and
Lee
,
Y.
,
2019
, “Temporal Dynamics of Collective Global Leadership and Team Psychological Safety in Multinational Teams: An Empirical Investigation,”
Advances in Leadership
,
J. S.
Osland
,
B.
Sebastian Reiche
,
B.
Szkudlarek
, and
M. E.
Mendenhall
, eds.,
Emerald Publishing Limited
,
Bingley, UK
, pp.
29
47
.
67.
Liu
,
Y.
,
Keller
,
R. T.
, and
Bartlett
,
K. R.
,
2021
, “
Initiative Climate, Psychological Safety and Knowledge Sharing as Predictors of Team Creativity: A Multilevel Study of Research and Development Project Teams
,”
Creativity Innov. Manage.
,
30
(
3
), pp.
498
510
.
68.
Zhang
,
Y.
,
Fang
,
Y.
,
Wei
,
K.-K.
, and
Chen
,
H.
,
2010
, “
Exploring the Role of Psychological Safety in Promoting the Intention to Continue Sharing Knowledge in Virtual Communities
,”
Int. J. Inform. Manage.
,
30
(
5
), pp.
425
436
.
69.
Charyton
,
C.
, and
Merrill
,
J. A.
,
2009
, “
Assessing General Creativity and Creative Engineering Design in First Year Engineering Students
,”
J. Eng. Educ.
,
98
(
2
), pp.
145
156
.
70.
Cropley
,
D. H.
,
2016
, “Creativity in Engineering,”
Multidisciplinary Contributions to the Science of Creative Thinking
,
G.E.
Corazza
, and
S.
Agnoli
, eds.,
Springer Singapore
,
Singapore
, pp.
155
173
.
71.
Cropley
,
D. H.
, and
Cropley
,
A. J.
,
2000
, “
Fostering Creativity in Engineering Undergraduates
,”
High Abil. Stud.
,
11
(
2
), pp.
207
219
.
72.
Paulus
,
P.
,
2000
, “
Groups, Teams, and Creativity: The Creative Potential of Idea-Generating Groups
,”
Appl. Psychol.
,
49
(
2
), pp.
237
262
.
73.
Thompson
,
G.
, and
Lordan
,
M.
,
1999
, “
A Review of Creativity Principles Applied to Engineering Design
,”
Proc. Inst. Mech. Eng., Part E: J. Process Mech. Eng.
,
213
(
1
), pp.
17
31
.
74.
Kessel
,
M.
,
Kratzer
,
J.
, and
Schultz
,
C.
,
2012
, “
Psychological Safety, Knowledge Sharing, and Creative Performance in Healthcare Teams
,”
Creativity Innov. Manage.
,
21
(
2
), pp.
147
157
.
75.
Edmondson
,
A. C.
,
2003
, “
Speaking Up in the Operating Room: How Team Leaders Promote Learning in Interdisciplinary Action Teams
,”
J. Manage. Stud.
,
40
(
6
), pp.
1419
1452
.
76.
Edmondson
,
A. C.
,
2002
,
Managing the Risk of Learning: Psychological Safety in Work Teams
,
Division of Research, Harvard Business School
,
Cambridge, MA
.
77.
Burningham
,
C.
, and
West
,
M. A.
,
1995
, “
Individual, Climate, and Group Interaction Processes as Predictors of Work Team Innovation
,”
Small Group Res.
,
26
(
1
), pp.
106
117
.
78.
Connelly
,
C. E.
, and
Kevin Kelloway
,
E.
,
2003
, “
Predictors of Employees’ Perceptions of Knowledge Sharing Cultures
,”
Leadersh. Organ. Develop. J.
,
24
(
5
), pp.
294
301
.
79.
Ehrlenspiel
,
K.
, and
Dylla
,
N.
,
1993
, “
Experimental Investigation of Designers’ Thinking Methods and Design Procedures
,”
J. Eng. Des.
,
4
(
3
), pp.
201
212
.
80.
Toh
,
C. A.
, and
Miller
,
S. R.
,
2016
, “
Choosing Creativity: The Role of Individual Risk and Ambiguity Aversion on Creative Concept Selection in Engineering Design
,”
Res. Eng. Des.
,
27
(
3
), pp.
195
219
.
81.
Toh
,
C. A.
, and
Miller
,
S. R.
,
2016
, “
Creativity in Design Teams: The Influence of Personality Traits and Risk Attitudes on Creative Concept Selection
,”
Res. Eng. Des.
,
27
(
1
), pp.
73
89
.
82.
Borghans
,
L.
,
Heckman
,
J. J.
,
Golsteyn
,
B. H.
, and
Meijers
,
H.
,
2009
, “
Gender Differences in Risk Aversion and Ambiguity Aversion
,”
J. Eur. Econ. Assoc.
,
7
(
2–3
), pp.
649
658
.
83.
Kolodner
,
J. L.
, and
Wills
,
L. M.
,
1996
, “
Powers of Observation in Creative Design
,”
Des. Stud.
,
17
(
4
), pp.
385
416
.
84.
Brereton
,
M.
, and
McGarry
,
B.
,
2000
, “
An Observational Study of How Objects Support Engineering Design Thinking and Communication: Implications for the Design of Tangible Media
,”
SIGCHI Conference on Human Factors in Computing Systems, Association for Computing Machinery
,
The Hague, The Netherlands
,
Apr. 1–6
, pp.
217
224
.
85.
Buchenau
,
M.
, and
Suri
,
J. F.
,
2000
, “
Experience Prototyping
,”
3rd Conference on Designing Interactive Systems: Processes, Practices, Methods, and Techniques, Association for Computing Machinery
,
New York, NY
,
Aug. 17–19
, pp.
424
433
.
86.
Yang
,
M. C.
,
2005
, “
A Study of Prototypes, Design Activity, and Design Outcome
,”
Des. Stud.
,
26
(
6
), pp.
649
669
.
87.
McCurdy
,
M.
,
Connors
,
C.
,
Pyrzak
,
G.
,
Kanefsky
,
B.
, and
Vera
,
A.
,
2006
, “
Breaking the Fidelity Barrier: An Examination of Our Current Characterization of Prototypes and An Example of a Mixed-Fidelity Success
,”
SIGCHI Conference on Human Factors in Computing Systems, Association for Computing Machinery
,
Montréal, Québec, Canada
,
Apr. 22–27
, pp.
1233
1242
.
88.
Starkey
,
E. M.
,
Menold
,
J.
, and
Miller
,
S. R.
,
2019
, “
When Are Designers Willing to Take Risks? How Concept Creativity and Prototype Fidelity Influence Perceived Risk
,”
ASME J. Mech. Des.
,
141
(
3
), p.
031104
.
89.
Wolfe
,
J.
,
Powell
,
E. A.
,
Schlisserman
,
S.
, and
Kirshon
,
A.
,
2016
, “
Teamwork in Engineering Undergraduate Classes: What Problems Do Students Experience?
2016 ASEE Annual Conference & Exposition, ASEE Conferences
,
New Orleans, LA
,
June 26–28
.
90.
Zimmerman
,
D. H.
, and
West
,
C.
,
1996
, “Sex Roles, Interruptions and Silences in Conversation”
Towards a Critical Sociolinguistics
,
R.
Singh
, ed.,
John Benjamins
,
Amsterdam, The Netherlands
, pp.
211
236
.
91.
LeBreton
,
J. M.
, and
Senter
,
J. L.
,
2008
, “
Answers to 20 Questions About Interrater Reliability and Interrater Agreement
,”
Organ. Res. Meth.
,
11
(
4
), pp.
815
852
.
92.
Fisher
,
R. A.
,
1925
, “
Theory of Statistical Estimation
,”
Math. Proc. Cambridge Philos. Soc.
,
22
(
5
), pp.
700
725
.
93.
Tavakol
,
M.
, and
Dennick
,
R.
,
2011
, “
Making Sense of Cronbach’s Alpha
,”
Int. J. Med. Educ.
,
2
, pp.
53
55
.
94.
Ito
,
P. K.
,
1980
, “7 Robustness of ANOVA and MANOVA Test Procedures,”
Handbook of Statistics
,
Elsevier
,
Amsterdam
, pp.
199
236
.
95.
Magezi
,
D. A.
,
2015
, “
Linear Mixed-Effects Models for Within-Participant Psychology Experiments: An Introductory Tutorial and Free, Graphical User Interface (LMMgui)
,”
Front. Psychol.
,
6
(
2
), pp.
1
6
.
96.
Li
,
T.
,
Castro
,
L. M. C.
,
Douglas
,
K.
, and
Brinton
,
C. G.
,
2021
, “
Relationship Between Learning Engagement Metrics and Learning Outcomes in Online Engineering Course
,”
Proceedings of 2021 IEEE Frontiers in Education Conference (FIE)
,
Lincoln, NE
,
Oct. 13–16
, pp.
1
5
.
You do not currently have access to this content.