A program developed by a team of researchers has made it possible to decrypt a text from the sounds of typing on the keyboard. The sound of each letter of a MacBook is recorded before being analyzed by this artificial intelligence.
A study published by several British researchers on August 3, 2023, reported by the American media Bleeping Computer, relates the attempts of an AI to recognize a text from the sound of the keyboard. As a result, the program developed by the experts managed to recover data in 95% of cases with the microphone of an electronic device (computer or smartphone). When the researchers used the Zoom video conferencing app, the algorithm was able to pick up 93% of sounds; for Skype, it was 91.7%.
The team of experts began by recording the sound produced by each letter that is typed on the keyboard of a MacBook Pro computer dating from 2021. This keyboard has been standard for at least two years and should still be for a few years. Remember that Apple highlights the silent aspect of its devices. Other models are even louder. The waves emitted were then recorded on a program called “CoAtNet”, based on deep learning and operating thanks to artificial intelligence. An iPhone 13 was then placed 17 cm from the computer.
The incorrectly analyzed shift key
The recording of the “tapping” of the computer by the smartphone is analyzed by the program, which then makes it possible to transcribe each letter entered. The same test was then performed from the MacBook’s microphone during an online Zoom meeting. This assumes that the target leaves their own microphone open during the chat. In both cases, the program was able to decrypt the entries with a high level of accuracy.
The researchers note that the success of this test is also due to the optimal framework in which it was carried out. Several “tricks” prevent correct decryption of the text. The program, for example, has trouble understanding the release of the shift key to note capitals or numbers. The use of biometric recognition with the fingerprint is also undetectable.
Two methods that – beyond protecting you from great software that you will probably never encounter on a daily basis – can be useful to you on a daily basis: multiply the characters and add double authentication.
Subscribe for free to Artificials, our AI newsletter, designed by AIs, verified by Numerama!