home

cv

mind

brain

design


 

 

Mind-assisting / digital phenotyping

Monitoring experience and cognition — using a platform to build your own data collection, research, assessment, and intervention apps

I created MindLogger (mindlogger.org) to enable anyone anywhere to create their own mobile/web applications for conducting end-to-end encrypted, remote data collection, assessments, cognitive tasks, and interventions. It is easy to use and rich with features (survey tools, audio/video recordings, drawing, geolocation, specialized millisecond-precision cognitive tasks, etc.). My primary use is for (1) ecological momentary assessments, to know what people are thinking, feeling, and how they are behaving in their daily lives, and (2) collecting performance task data in MindLogger alongside sensor data (EEG, EMG, electrodermal, movement, heart rate, eye tracking, pupillometry, etc.). The project has received over $10 million in funding from the State of California, NIH, MIT, Paris LPI, and Hearst, Stavros Niarchos, and Hirani foundations.

GenAI-powered language tools for research and interventions

LinguaLearn is a set of tools under development that uses deep learning models, sound morphing, LLM-based word games, and real-time visual feedback to help people improve their pronunciation and verbal fluency.

 

MediaMentor is a new project that will use an LLM to help families grapple with concerning video content by introducing an interactive avatar that detects and discusses this content with the viewer.

 

Mosaic is a database and recommendation system that will use LLMs, expert source content, and template guides to generate personalized mental health guides for use by patients, parents, educators, and clinicians.

 

 

Publications

L Chitiz, B Mckeown, B Mulholland, R Wallace, I Goodall-Halliwell, NS Ping-Ho, D Konu, GL Poerio, J Wammes, M Milham, A Klein, E Jefferies, J Smallwood. Mapping cognition across lab and daily life using Experience-Sampling. Consciousness and Cognition 131:103853 (2025). doi:10.1016/j.concog.2025.103853

B Mulholland, L Chitiz, R Wallace, B Mckeown, M Milham, A Klein, R Leech, A Turnbull, E Jefferies, G Poerio, J Wammes, J Smallwood, J Stewart. Patterns of ongoing thought in the real world and their link to mental health and well-being. Accepted by PLoS Mental Health (Apr. 2025) and on bioRxiv: doi:10.1101/2024.07.22.604681

Y Chen, D Jarecka, SA Abraham, R Gau, E Ng, DM Low, I Bevers, A Johnson, A Keshavan, A Klein, J Clucas, Z Rosli, SM Hodge, J Linkersdörfer, H Bartsch, S Das, D Fair, D Kennedy, SS Ghosh. ReproSchema: Enhancing research reproducibility through standardized survey data collection. Under review and on JMIR Preprints 21/06/2024:63343. doi:10.2196/preprints.63343

K Konishcheva, B Leventhal, M Koyama, S Panda, JT Vogelstein, M Milham, A Lindner, A Klein. Accurate and efficient data-driven psychiatric assessment using machine learning. Under review and on PsyArxiv Preprints (March 2024). doi:10.31234/osf.io/sekfw

B Mulholland, I Goodall-Halliwell, R Wallace, L Chitiz, B Mckeown, A Rastan, G Poerio, R Leech, A Turnbull, A Klein, M Milham, J Wammes, E Jefferies, J Smallwood. Patterns of ongoing thought in the real world. Consciousness and Cognition 114:103530 (2023). doi:10.1016/j.concog.2023.103530

F Schoeller, A Horowitz, P Maes, A Jain, N Reggente, LC Moore, M Trousselard, A Klein,

L Barca, G Pezzulo, M Allen, V Adrien, M Miller, R Salomon, G Riva, D DiLernia, M Tsakiris, C Verdonk, MA Chalah, G Dumas, K Friston. Interoceptive technologies for clinical neuroscience. Neuroscience & Biobehavioral Reviews 156:105478 (2023). doi:10.1016/j.neubiorev.2023.105478

L Omberg, E Chaibub Neto, TM Perumal, A Pratap, J Adams, BR Bloem, BM Bot, M Elson, SM Goldman, MR Kellen, K Kieburtz, A Klein, MA Little, R Schneider, C Suver, C Tarolli, CM Tanner, AD Trister, J Wilbanks, ER Dorsey, LM Mangravite. Remote smartphone monitoring of Parkinson's disease and individual response to therapy. Nature Biotechnology 40:480-487 (2022). doi: doi.org/10.1038/s41587-021-00974-9

Commentary: W Maetzler, A Pilotto. Digital assessment at home - mPower against Parkinson disease. Nature Reviews Neurology 17:661-662 (2021). doi:10.1038/s41582-021-00567-9

A Klein, J Clucas, A Krishnakumar, SS Ghosh, W Van Auken, B Thonet, I Sabram, N Acuna, A Keshavan, H Rossiter, Y Xiao, S Semenuta, A Badioli, K Konishcheva, SA Abraham, LM Alexander, KR Merikangas, J Swendsen, AB Lindner, MP Milham. Remote digital psychiatry for mobile mental health assessment and therapy: MindLogger platform development study. Journal of Medical Internet Research 23:e22369 (2021). doi:10.2196/22369 PMID: 34762054 PMCID: PMC8663601

E Schleimer, J Pearce, A Barnecut, W Rowles, A Lizee, A Klein, VJ Block, A Santaniello, A Renschen, R Gomez, A Keshavan, JM Gelfand, RG Henry, SL Hauser, R Bove. A precision medicine tool for patients with multiple sclerosis (the Open MS BioScreen): human-centered design and development. Journal of Medical Internet Research 22(7):e15605 (2020). doi: doi.org/10.2196/15605 PMID: 32628124

JJ Son, JC Clucas, C White, A Krishnakumar, JT Vogelstein, MP Milham, A Klein. Thermal sensors improve wrist-worn position tracking. Nature Partner Journal Digital Medicine 2: 15 (2019). doi:10.1038/s41746-019-0092-2

Patent: 10,119,807

HY Xu, J Stroud, RK Jozanovic, J Clucas, JJ Son, B Koo, J Schwarz, A Klein, R Busman, MP Milham. Clinical perspective on passive audio vocal measurement in the evaluation of selective mutism. Frontiers in Psychiatry 9:443 (2018). doi:10.3389/fpsyt.2018.00443

LM Alexander, J Escalera, L Ai, C Andreotti, K Febre, A Mangone, NV Potler, N Langer, A Alexander, M Kovacs, S Litke, B O'Hagan, B Bronstein, A Bui, M Bushey, V Castagna, N Camacho, E Chan, D Citera, J Clucas, S Cohen, M Eaves, B Fradera, N Grant-Villegas, G Green, C Gregory, E Hart, S Harris, C Lord, D Kahn, K Kabotyanski, K Kleinman, B Koo, E Kramer, A Margolis, KR Merikangas, J Milham, G Minniti, R Neuhaus, A Nussbaum, Y Osman, LC Parra, KR Pugh, A Racanello, A Restrepo, T Saltzman, B Septimus, R Tobe, R Waltz, A Williams, A Yeo, FX Castellanos, A Klein, T Paus, BL Leventhal, RC Craddock, HS Koplewicz, MP Milham. An open resource for transdiagnostic research in pediatric mental health and learning disorders. Scientific Data. 4:170181 (2017). doi:10.1038/sdata.2017.181

SS Ghosh, G Ciccarelli, TF Quatieri, A Klein. Speaking one's mind: Vocal biomarkers of depression and Parkinson disease. Journal of the Acoustical Society of America. 139:2193 (2016). doi:10.1121/1.4950530

B Bot, C Suver, EC Neto, M Kellen, A Klein, C Bare, M Doerr, A Pratap, J Wilbanks, ER Dorsey, SH Friend, AD Trister. The mPower Study, Parkinson disease mobile data collected using ResearchKit. Scientific Data 3:160011 (2016). doi:10.1038/sdata.2016.11

 

Proceedings and proposals

BL Leventhal, K Konishcheva, E Rotenberg, A Krishnakumar, N Page, L Gares, L Almaraz, B Falissard, A Klein, AB Lindner.  Functional activity, cognition, emotion and thinking scale (FACETS): Initial examination of reliability and utility. AACAP/CACAP 2022 Annual Meeting (2022). doi:10.1016/j.jaac.2022.09.226

J Clucas, J Son, MP Milham, A Klein. Discriminating groups by audio feature analysis with openSMILE. Proceedings of the 3rd Symposium on Computing and Mental Health, CHI 2018, Montreal (2018).

J Clucas, J Son, A Krishnakumar, MP Milham, A Klein. Questionnaire response correlations to improve efficiency: preliminary evidence from the Healthy Brain Network. Proceedings of the 3rd Symposium on Computing and Mental Health, CHI 2018, Montreal (2018).

J Clucas, C White, B Koo, M Milham, A Klein. Assessing actimeters for inclusion in the Healthy Brain Network. bioRxiv 183772 (2017). doi:10.1101/183772

E Chaibub Neto, BM Bot, T Perumal, L Omberg, J Guinney, M Kellen, A Klein, SH Friend, AD Trister. Personalized hypothesis tests for detecting medication response in Parkinson disease patients using iPhone sensor data. Pacific Symposium on Biocomputing. 21:273-284 (2016). PMID:26776193. doi:10.1142/9789814749411_0026

A Klein, SS Ghosh. Doctor as data scientist: a high-dimensional view of health. Medium (2016).

A Klein. Crowdsourcing voice editing and quality assessment of data collected

from the largest mobile phone-based research study of Parkinson disease (NIH proposal). Research Ideas and Outcomes. 2: e8848 (2016). doi:10.3897/rio.2.e8848

A Klein. Visual Parkinson's Disease Rating Scale: A universal iconic questionnaire for epidemiological studies in India (NIH proposal). Research Ideas and Outcomes. 2: e8834 (2016). doi:10.3897/rio.2.e8834

 

 

Invertebrate sleep and learning

I have collaborated with my identical twin brother for years, and the following studies have focused on how invertebrate sleep impacts a society, when and where bees sleep, and how it affects their ability to communicate.

 

BA Klein, M Stiegler, A Klein, Tautz J. Mapping sleeping bees within their nest: spatial and temporal analysis of worker honey bee sleep. PLoS ONE. 9(7): e102316 (2014). doi:10.1371/journal.pone.0102316

 

BA Klein, A Klein, MK Wray, UG Mueller, TD Seeley. Sleep deprivation impairs precision of waggle dance signaling in honey bees. Proceedings of the National Academy of Sciences. 107(52): 22705-22709 (2010). doi:10.1073/pnas.1009439108

BA Klein, KM Olzsowy, A Klein, KM Saunders, TD Seeley. Caste-dependent sleep of worker honey bees. Journal of Experimental Biology. 211: 3028-3040 (2008). doi:10.1242/jeb.017426