How does explicit instruction affect exploratory play and learning? We present a model that captures pedagogical assumptions (adapted from Shafto and Goodman, 2008) and test the model with a novel experiment looking at 4-year-olds exploratory play in pedagogical and non-pedagogical contexts. Our findings are consistent with the model predictions: preschool children limit their exploration in pedagogical contexts, spending most of their free play performing only the demonstrated action. By contrast, children explore broadly both at baseline and after an accidental demonstration. Thus pedagogy constrains childrens exploration for better and for worse; children learn the demonstrated causal relationship but are less likely than children in non-pedagogical contexts to discover and learn other causal relationships.