Decision Lab by Kaan Mutlu

How do design teams explore under uncertainty?
When should they stop testing and commit?

Every test can uncover a better design, but it also costs resources. Competitors face the same trade-off. Explore a lab competition we designed to study these strategic decisions, then see whether a deep learning model predicts each player’s next move.

3 sessions • 4 sharing scenarios • 2-player teams

Loading recorded sessions...

Follow the search

Players could not see this curve or its peak.

Each test costs 10 tokens. Your team wins by finding a better-performing design than the opposing team.

What do the axes mean?

Imagine Sony and Bose testing noise-cancellation strength, or Airbus and Boeing testing wing shapes. Here, x is one design choice and y is its measured performance. Teams can share discoveries internally while seeing only part of their rivals’ progress. These are analogies for the lab experiment.

Selected player's testsNot started
Selected player's tokens left200
Selected player's best performanceNot sampled
Time since first own sampleNot started
Selected player Teammate Competitor best Model comparison Own best

Press Play or Next decision to follow the search.

Round results unlock when the visible search ends.

Can the model anticipate this player?

Reveal each prediction alongside the action it was made for.

Round complete

Further reading

What changes when teams compete, share discoveries, or stop searching? Explore our research on human decisions and the rational benchmarks used to understand them.

Published

Manuscripts

Predicting Designers’ Search Behavior and Stopping Decisions Under Competition with Sequence Learning

Mutlu, K., Javadpour, N., Sha, Z., & Bayrak, A. E. Manuscript in development.

Multi-task LSTM modeling of sequential next-action, outcome and stopping behavior.

Quantifying Bounded Rationality and Robustness in Design Decisions under Competition

Mutlu, K., Javadpour, N., Sha, Z., & Bayrak, A. E. Design Science. Revision under review.

Gaussian-process and Bayesian-optimization modeling of sequential decisions under uncertainty.