High-Throughput Experiments on Group Dynamics

Experimental social science is moving slower and accumulating less knowledge than it could if it fully leveraged recent advances in digital technologies and crowdsourcing services. These technologies allow individual experiments to be deployed and run faster than in traditional physical labs; however, most experiments still focus on one-off results that do not generalize easily to real-world contexts, or even to other variations of the same experiment.

To achieve replicable, generalizable, scalable, and ultimately useful social science, we believe that it is necessary to rethink the fundamental “one at a time” paradigm of experimental social and behavioral science. In its place we intend to design and run “high-throughput” experiments that are radically different in scale and scope from the traditional model. This approach opens the door to new experimental insights, as well as new approaches to theory building.

Realizing the potential of high-throughput experiments in turn requires (1) significant investments in software design and participant recruitment, (2) innovations in experimental design and analysis of experimental data, (3) adoption of new models of collaboration, and (4) a new understanding of the relationship between theory and experiment. The High-Throughput Virtual Lab Project pursues this ambitious path to facilitate a new class of scientific advances in our understanding of collective social phenomena.

task space map
ABOVE: Mapping the task space

CSSLab’s research on group dynamics is generating insight into how teams collaborate, along with which factors impact their success. Rather than generalize individual conclusions to teams of different compositions working on different tasks, the lab’s high-throughput experiment design allows for more careful mapping of the task space.

Shown above is a schematic of a “task space” in which many different tasks can be mapped in relation to one another according to their defining attributes. By separating this space into distinct domains where different types of skills dominate group performance, the contextual dependencies of current theories can be precisely identified.

PEOPLE

Duncan Watts

Stevens University Professor & twenty-third Penn Integrates Knowledge Professor

James Houghton

James Houghton

Research Scientist

Mark Whiting

Mark Whiting

Research Scientist

Abdullah Almaatouq

Abdullah_Almaatouq

Affiliate Research Scientist

Linnea Gandhi

Linnea Gandhi

Ph.D. Researcher

Dodge Hill

Dodge Hill

Graduate Student Researcher

Sumant Shringari

Sumant Shringari

Graduate Student Researcher

Sarika Subramaniam

Sarika Subramaniam Headshot

Graduate Student Researcher

Joyce An-Jie Wang

Joyce An-Jie Wang

Graduate Student Researcher

Vikram Balasubramanian

Vikram Balasubramanian Headshot

Undergraduate Student Researcher

Vivian Dinh

Vivian Dinh Headshot

Undergraduate Student Researcher

Henry Ge

Henry Ge Headshot

Undergraduate Student Researcher

Karan Sampath

Karan Sampath Headshot

Undergraduate Student Researcher

Daniel Xue

Daniel Xue

Undergraduate Student Researcher

Tuti Gomoka

Research Coordinator

Volunteers
The Lab is grateful for the work of the volunteers contributing to our ongoing Nudge Cartography research:

Leads:

Anushka Bhansali
Chelsey Gonzalez
Anoushka Kiyawat
Elina Konstidinou
Joshua Kurniawan
Anna Lamb

Akriti
AJ Acacio
Kathryn Ambroze
Elizabeth Criswell
Mariela Dyer
Sydney Freedman
Grant Harris
Siena Henson
Yao Hung
Palak Jain
Irena Kaplan
Krishleen Kaur Kohli
Shloka Kumar
Andrea Lin
Sara Lopez Marin
Alison Martin
Ellis Morlock
Trisha Nagpal
Darcie Piechowski
Tianfu (Toby) Ren
Emma Ronzetti
Becky Schmid
Lisa Schreiber
Michelle She
Riya Sirdeshmukh
Brooke Spencer
Xuefei Tan (Shee-fay)
Jessie Theranato
Kwaish Vohra
Wendy Yu
Shuchen Zhang

FEATURED PUBLICATIONS

Task complexity moderates group synergy Journal Article

Almaatouq, Abdullah; Alsobay, Mohammed; Yin, Ming; Watts, Duncan J.

In: Proceedings of the National Academy of Sciences, vol. 118, no. 36, 2021.

Abstract | Links | BibTeX

Scaling up experimental social, behavioral, and economic science Technical Report

Almaatouq, Abdullah; Becker, Joshua; Bernstein, Michael S.; Botto, Robert; Bradlow, Eric T.; Damer, Ekaterina; Duckworth, Angela; Griffiths, Tom; Hartshorne, Joshua K.; Lazer, David; Law, Edith; Liu, Min; Matias, J. Nathan; Rand, David; Salganik, Matthew; Emma Satlof-Bedrick, Maurice Schweitzer; Shirado, Hirokazu; Suchow, Jordan W.; Suri, Siddharth; Tsvetkova, Milena; Watts, Duncan J.; Whiting, Mark E.; Yin., Ming

2021.

Abstract | Links | BibTeX

My Team Will Go On: Differentiating High and Low Viability Teams through Team Interaction Journal Article

Cao, Hancheng; Yang, Vivian; Chen, Victor; Lee, Yu Jin; Stone, Lydia; Diarrassouba, N'godjigui Junior; Whiting, Mark; Bernstein, Michael

In: Proceedings of the ACM Human-Computer Interaction, vol. 4, no. CSCW3, pp. 1-27, 2021.

Abstract | Links | BibTeX

Empirica: a virtual lab for high-throughput macro-level experiments Journal Article

Almaatouq, Abdullah; Becker, Joshua; Houghton, James P; Paton, Nicolas; Watts, Duncan J; Whiting, Mark E

In: Behavior Research Methods, pp. 1–14, 2021.

Abstract | Links | BibTeX

Can We Just Start Over Again? Resetting Remote Team Dynamics Journal Article

Whiting, Mark; Bernstein, Michael

In: 2020.

Abstract | Links | BibTeX

Parallel Worlds: Repeated Initializations of the Same Team To Improve Team Viability Journal Article

Whiting, Mark; Gao, Irena; Xing, Michelle; N’godjigui, Junior Diarrassouba; Nguyen, Tonya; Bernstein, Michael

In: Proceedings of the ACM Human-Computer Interaction, vol. 4, no. CSCW1, pp. 22, 2020.

Abstract | Links | BibTeX

Did It Have To End This Way? Understanding the Consistency of Team Fracture Journal Article

Whiting, Mark; Blaising, Allie; Barreau, Chloe; Fiuza, Laura; Marda, Nik; Valentine, Melissa; Bernstein, Michael

In: Proceedings of the ACM Human-Computer Interaction, vol. 3, no. 209, pp. 23, 2019.

Abstract | Links | BibTeX

Related

Behind the Scenes: The team driving Nudge Cartography

The Nudge Cartography project is building a tool to help policymakers, marketers, managers, and academics intelligently motivate behavior change. Meet some of the project leads and volunteers putting it all together.