The authors explored the potential barriers for the successful adoption of the CaseMate system, a tool created to support data driven decision making (DDDM). The participants in this usability study were 42 preservice students in a masters program for teaching. The findings illustrate the barriers to implementing DDDM in actual classroom practice: a confluence of curriculum structure and policy as well as technology and teacher heuristics that result in variations in data interpretation.