Author: Nikita Soni
Both formal and informal educational venues such as classrooms and public science centers are increasingly using touchscreen interfaces for differing sizes and form factors such tablets, multi-touch flatscreen tabletops, and interactive spherical displays for learning purposes [1,2]. With this shift towards more direct-interaction-based learning comes new research opportunities for designing touch-based gestural interactions that are natural and intuitive to use for learners of all ages (i.e., both adults and children). As a graduate research assistant in the INIT lab, I have led two research projects that lie at the intersection of human-computer interaction (HCI) and learning sciences (LS) research: the TIDRC project and the TIDESS project. The overarching goal of the TIDRC project is to explore the extent to which research-based interaction design guidelines for children’s touch-based interfaces are employed in practice by app developers who build the educational apps children use regularly. In the TIDESS project, our main aim is to understand how adults and children interact with large touchscreen interfaces such as multi-touch tabletops and spherical displays in order to build effective educational technology that adapts to users’ natural interactions.
In summer 2019, we wrote a workshop paper, titled: “HCI Methodologies for Designing Natural User Interactions that Do Not Interfere with Learning” that reports what we have learned on both projects regarding the type of HCI methodologies that can be adopted to design effective educational technology. The paper was written for the Making the Learning Sciences Count: Impacting Association for Computing Machinery Communities in Human-Computer Interaction workshop. I traveled to the workshop to present our paper and participate in the discussion, in Lyon, France at the International Conference of Computer-Supported Collaborative Learning (CSCL’19). The abstract of the paper is as follows:
“As emerging touchscreen technologies continue to become more prevalent in learning environments such as science museums and schools, there is a need to understand both principles of interaction design and of learning sciences to create effective educational technology. In this paper, we describe how the HCI approaches we employ in our work can be used to design more effective learning experiences, specifically for interactive touchscreen platforms. As members of an interdisciplinary community, we are exploring the interplay between interaction design research and learning. For example, how can we make sure that users’ touch interactions with educational interfaces on these platforms are intuitive, discoverable, and do not interfere with learning outcomes? The “Making the Learning Sciences Count” workshop at CSCL is an ideal setting to share and discuss our evolving understanding at the intersection of interaction design research and learning sciences.”
Interested readers can read the workshop paper here. Participating in the workshop discussion sessions along with other researchers and students working at the juncture of HCI and LS was very helpful and informative for me. I learned about similarities and differences in the publication process followed in the HCI and LS academic communities and how to publish research in both communities. In addition, attending the workshop gave me a chance to get feedback on my thesis research idea from interdisciplinary research community members. I look forward to contributing to this interdisciplinary community and attending a similar workshop in the future.
References Tom Geller. 2006. Interactive Tabletop Exhibits in Museums and Galleries. IEEE COMPUT GRAPH 26, 5: 6–11.  Kate Haley Goldman, Cheryl Kessler, and Elizabeth Danter. 2010. Science On a Sphere®. Retrieved December 31, 2018 from https://sos.noaa.gov/What_is_SOS/ Read More
The INIT Lab, in collaboration with Dr. Pamela Wisniewski from the University of Central Florida (UCF) has been working on a project whose aim is to understand the real-world interface design practices of developers of children’s mobile touchscreen apps. We developed an evidence-based framework of Touchscreen Interaction Design Recommendations for Children (TIDRC, “tide-rock”) for children ages 2 to 11, that synthesizes research-based design recommendations for these apps based on children’s cognitive, physical, and socio-emotional needs. We are pleased to report that our paper presenting this framework and evaluation, titled “A Framework of Touchscreen Interaction Design Recommendations for Children (TIDRC): Characterizing the Gap between Research Evidence and Design Practice,” was accepted as a full paper at ACM Interaction Design and Children (IDC 2019) conference.
Here is the abstract:
“HCI researchers have established a number of evidence-based design recommendations for children’s touchscreen interfaces based on developmental appropriateness. Yet, these recommendations are scattered within the academic literature and lack a cohesive framework that makes them accessible to app designers. We created a framework of actionable Touchscreen Interaction Design Recommendations for Children (TIDRC, “tide-rock”) by conducting a comprehensive review of the relevant literature. We used our TIDRC framework as a lens to empirically evaluate whether these evidence-based design recommendations were implemented within 50 popular iPad apps designed for children. We found a significant gap between research and practice. On average, only 63% of these apps followed design recommendations for meeting children’s cognitive (51%), physical (67%), and socio-emotional (72%) needs. We characterize the nature of this gap and discuss opportunities for closing it when designing mobile touchscreen interfaces for children.”
Interested readers can find the camera-ready version (preprint) available here, and you can download the framework itself here. The IDC 2019 conference will take place in Boise, Idaho, June 12-15. My PhD advisor, Dr. Lisa Anthony will be presenting our paper at the conference. Personally, this paper will always be special since the TIDRC project was my first research project in the INIT lab when I joined as an M.S. student. Working closely under the guidance of my advisor and Dr. Wisniewski has really taught me the process involved in writing good qualitative research papers.Read More
The main purpose of the Kids Application survey project is to help generate constructive recommendations for designing touchscreen interfaces specifically tailored towards kids. In our current study, we are taking inspiration by surveying interfaces of existing kid’s applications and are trying to decipher common interface/design patterns. We are presently in the process of creating categories for different aspects like Graphics, Gestures, etc. commonly found in kid’s applications which would help us understand interface patterns. These patterns would later help in drafting the analysis that would serve as a useful tool for developers to make more relevant kids application interfaces. We will be running our study on most downloaded kid’s applications (compatible with iPad/iPod Touch/iPhone/Android) under different categories.
I am a Master’s Student at University of Florida studying computer science. This qualitative analysis process has helped me gain a good understanding in conducting research. We are targeting to collect patterns from 100 applications. The next phase of project would include coding the patterns encountered from the analyzed data.Read More