Researchers propose a privacy-preserving system that uses both recorded speech and its transcript to detect cognitive impairment. By converting audio and text into compact numerical summaries called embeddings and feeding them together into a classifier, the team reports a classification accuracy of 92.4% on benchmark tests. The work aims to make speech-based screening more reliable across different people and recording conditions while avoiding cloud services that could expose patient data.

To build the system the authors used open-source large language models (LLMs). They extract acoustic embeddings directly from raw speech with a model called Qwen2-Audio and generate linguistic embeddings from automatically transcribed speech using a model called Qwen3. The two types of embeddings are concatenated into a single feature vector and used for downstream classification. The approach was tested on two public benchmark datasets, ADReSS20 and ADReSSo21, which contain recordings of people describing the “Cookie Theft” picture and include standard clinical scores such as the Mini‑Mental State Examination (MMSE).

At a high level, the method relies on two complementary signals. Acoustic features capture how someone speaks — aspects like pauses, pitch, or sound patterns. Linguistic features capture what someone says — word choice, grammar and meaning. By combining both, the model can use signs from speech production and from language content together, which the authors say improves robustness compared with using only one modality.

This work matters because speech is an easy, non-invasive signal that can be collected remotely and often shows early signs of cognitive decline. The paper reports better cross-dataset generalization than single-modality baselines, suggesting the method could be more applicable across diverse speakers and recording setups. The authors also emphasize local, open-source deployment so the system can be used in privacy-sensitive clinical settings without sending raw patient data to external cloud services.