Publications

For the most updated list of publications, please refer to Google Scholar Profile.

Publications in Peer-reviewed Journals (# equal contribution; * corresponding author)

  • Qi, R.#, Zheng, Y.#, Yang, Y., Cao, C. C., & Hsiao, J. H.* (2024). Explanation strategies in humans versus current explainable artificial intelligence: Insights from image classification. British Journal of Psychology. (PDF)

  • Zheng, Y., & Hsiao, J. H.* (2023). Differential audiovisual information processing in emotion recognition: An Eye Tracking Study. Emotion, 23(4), 1028. (PDF)

  • Que, Y., Zheng, Y., Hsiao, J. H., & Hu, X.* (2023). Studying the effect of self-selected background music on reading task with eye movements. Scientific Reports, 13(1), 1704. (PDF)

  • Hsiao, J. H.* , An, J., Hui, V. K. S., Zheng, Y., & Chan, A. B. (2022). Understanding the role of eye movement consistency in face recognition and autism through integrating deep neural networks and hidden Markov models. npj Science of Learning, 7(1), 1-13. (PDF)

  • Zheng, Y., Ye, X., & Hsiao, J. H.* (2022). Does adding video and subtitles to an audio lesson facilitate its comprehension?. Learning and Instruction, 101542. (PDF)

  • Luo, X., Gu, J., Zheng, Y., & Zhou, X.* (2022). Making a saccade enhances Stroop and Simon conflict control. Attention, Perception, & Psychophysics, 84(3), 795-814. (PDF)

  • Hsiao, J. H.* , Lan H., Zheng, Y., & Chan, A. B. (2021). Eye Movement analysis with Hidden Markov Models (EMHMM) with co-clustering. Behavior Research Methods, 1-14. (PDF)

  • Hsiao, J. H.* , An, J., Zheng, Y., & Chan, A. B. (2021). Do portrait artists have enhanced face processing abilities? Evidence from hidden Markov modeling of eye movements. Cognition, 211, 104616. (PDF)

  • Turbett, K.* , Jeffery, L., Bell, J., Digges, A., Zheng, Y., Hsiao, J. H., Palermo, R. (2021). Serial Dependence of Facial Identity for Own- and Other-Race Faces. Quarterly Journal of Experimental Psychology, 17470218211059430. (PDF)

Preprints

  • Qi, R.# , Zheng, Y.# , Yang, Y., Cao, C. C., & Hsiao, J. H. (2023). Explanation Strategies for Image Classification in Humans vs. Current Explainable AI. (Link)

  • Qiu, L., Yang, Y., Cao, C. C., Liu, J., Zheng, Y., Ngai, H. H. T., Hsiao, J. H., & Chen, L. (2021). Resisting Out-of-Distribution Data Problem in Perturbation of XAI. arXiv:2107.14000 (Link)

Full-Paper Publications in Peer-Reviewed Conference Proceedings

  • Zheng, Y., Liao, W., Tso, R., Hsiao, J. H. (2024). The Impact of Mask Use on Face Recognition in Adults with Autism Spectrum Disorder: An Eye-Tracking Study. Proceedings of the 46th Annual Conference of the Cognitive Science Society. Cognitive Science Society. (PDF)

  • Xing, W.#, Zheng, Y.#, Chan, A., & Hsiao, J. H. (2024). Is Holistic Processing Associated with Face Scanning Pattern and Performance in Face Recognition? Evidence from Deep Neural Network with Hidden Markov Modeling. Proceedings of the 46th Annual Conference of the Cognitive Science Society. Cognitive Science Society. (acceptance rate: 19%) [Oral] (PDF)

  • Que, Y., Zheng, Y., Hsiao, J. H., Hu, X. (2024). Predicting Learners’ Meta-cognition Using Eye Movements during Reading with Background Music. Proceedings of the 24th IEEE International Conference on Advanced Learning Technologies (ICALT).

  • Zheng, Y., de la Harpe, S., Yang, A. Y., Hayward, W. G., Palermo, R., Hsiao, J. H. (2023). Cultural Differences in the Effect of Mask Use on Face and Facial Expression Recognition. Proceedings of the 45th Annual Conference of the Cognitive Science Society. Cognitive Science Society. (PDF)

  • Qi, R., Zheng, Y., Yang, Y., Zhang, J., & Hsiao, J. H. (2023). Individual differences in explanation strategies for image classification and implications for explainable AI. Proceedings of the 45th Annual Conference of the Cognitive Science Society. Cognitive Science Society. (PDF)

  • Zheng, Y., Que, Y., Hu, X., Hsiao, J. H.* (2022). Eye movement pattern and consistency predict passage reading performance of English as Second Language (ESL) Learners. Proceedings of the 22nd IEEE International Conference on Advanced Learning Technologies (ICALT). [Student Award Winner] [Best Full Paper Nomination][Oral] (PDF)

  • Zheng, Y., Chen, D., Hu, X., Hsiao, J. H.* (2022). The impact of mask use on social categorization. Proceedings of the 44th Annual Conference of the Cognitive Science Society, 2024-2630. Cognitive Science Society. (acceptance rate: 27%) [Oral] (PDF)

  • Yang, Y., Zheng, Y., Deng, D., Zhang, J., Huang, Y., Yang, Y., Hsiao, J. H., & Cao, C.* (2022). HSI: Human Saliency Imitator for Benchmarking Saliency-based Model Explanations. The Tenth AAAI Conference on Human Computation and Crowdsourcing (HCOMP). (acceptance rate: 29%) [Oral] (PDF)

  • Qiu, L., Yang, Y., Cao, C. C., Zheng, Y., Ngai, H. H. T., Hsiao, J. H., & Chen, L. (2022). Generating Perturbation-based Explanations with Robustness to Out-of-Distribution Data. The ACM Web Conference 2022 (under Web4Good special track). (acceptance rate: 24%) [Oral]

  • Zheng, Y., & Hsiao, J. H. (2020). Audiovisual Information Processing in Emotion Recognition: An Eye Tracking Study. In S. Denison., M. Mack, Y. Xu, & B.C. Armstrong (Eds.), Proceedings of the 42nd Annual Conference of the Cognitive Science Society, 2024-2630. Cognitive Science Society. (PDF)

  • Que, Y., Zheng, Y., Hsiao, J. H., Hu, X. (2020). Exploring the Effect of Personalized Background Music on Reading Comprehension. Proceedings of the Jointed Conference on Digital Libraries (JCDL) 2020 (pp. 57–66). Association for Computing Machinery, New York, NY, USA. (acceptance rate: 31.1%) (PDF)

  • Zheng, Y., Ye, X., & Hsiao, J. H. (2019). Does video content facilitate or impair comprehension of documentaries? The effect of cognitive abilities and eye movement strategy. In A.K. Goel, C.M. Seifert, & C. Freksa (Eds.), Proceedings of the 41st Annual Conference of the Cognitive Science Society, 1283-1289. Montreal, QB: Cognitive Science Society. (acceptance rate: 25.3%) [Student Travel Award Winner] [Oral] (PDF)

Abstract Publications in Peer-Reviewed Conference Proceedings

  • Yang, A., Zheng, Y., Hsiao, J. H., Chung, S. (2024). Eye Movement Modulates the Face Inversion Effect in Emotion Recognition. Vision Science Society.

  • Hsiao, J., Chan, K. W. S., Chan, A., Zheng, Y., Lau, K. M., Tsang, H. L. M. (2021). Eye movement consistency in global-local perceptual processing predicts schizotypy. Proceedings of the 43rd Annual Conference of the Cognitive Science Society, 3229. Montreal, QB: Cognitive Science Society.

  • Hui, T. K., Sit, H. F., Cheung, T. W., Zheng, Y., Hsiao, J. H., Li, S. X. (2023). Mediating Effect of Pre-Sleep Arousals on the Association between Sleep-related Attentional Bias and Sleep Disturbances – An Eye-tracking Study. Asian Society of Sleep Medicine (ASSM) 2023. [Young Investigator Award]