Evaluating Acoustic Data Transmission Schemes for Ad-Hoc Communication Between Nearby Smart Devices

Acoustic data transmission offers a compelling alternative to Bluetooth and NFC by leveraging the ubiquitous speakers and microphones in smartphones and IoT devices. However, most research in this field relies on simulations or limited on-device testing, which makes the real-world reliability of proposed schemes difficult to assess. We systematically reviewed 31 acoustic communication studies for commodity devices and found that none provided accessible source code. After contacting authors and re-implementing three promising schemes, we assembled a testbed of eight representative acoustic communication systems. Using over 11000 smartphone transmissions in both realistic indoor environments and an anechoic chamber, we provide a systematic and repeatable methodology for evaluating the reliability and generalizability of these schemes under real-world conditions. Our results show that many existing schemes face challenges in practical usage, largely due to severe multipath propagation indoors and varying audio characteristics across device models. To support future research and foster more robust evaluations, we release our re-implementations alongside the first comprehensive dataset of real-world acoustic transmissions. Overall, our findings highlight the importance of rigorous on-device testing and underscore the need for robust design strategies to bridge the gap between simulation results and reliable IoT deployments.

💡 Research Summary

The paper presents a comprehensive, reproducible evaluation of acoustic data‑transmission (ADT) schemes for ad‑hoc communication between nearby smart devices such as smartphones and IoT gadgets. Recognizing that most prior work relies on simulations or limited on‑device testing, the authors first conduct a systematic literature review of 31 papers that propose ADT systems for commodity off‑the‑shelf (COTS) devices. Using a PRISMA‑style process, they discover that none of the surveyed works provide publicly available source code, creating a serious reproducibility gap.

To address this, the authors reach out to the original authors; only three respond with functional implementations, one provides a broken version, and the rest are unresponsive or have lost the code. Consequently, the team re‑implements three promising schemes themselves and combines them with five existing open‑source projects (including the widely used “ggwave” library), yielding a testbed of eight distinct acoustic communication systems.

Each system is abstracted as a black‑box with two functions: TX (bits → WAV file) and RX (WAV → bits). This uniform interface allows fair comparison across different modulation techniques (FSK, OFDM, chirp, etc.), frequency ranges (audible vs. near‑ultrasonic), and error‑correction strategies. The authors then design a large‑scale experimental campaign: over 11 900 transmissions are performed on a variety of modern Android smartphones spanning flagship, mid‑range, and low‑cost models. Experiments are carried out in two environments—a realistic indoor setting with typical furniture, walls, and background noises (quiet office, café, street‑level chatter) and an anechoic chamber that eliminates multipath reflections. Transmission distances range from 10 cm (NFC‑like) to >2 m (far‑field), and playback volume levels are varied systematically.

Key findings:

1. Environment Impact – In the anechoic chamber, most schemes achieve >95 % success rates and can sustain throughputs up to 10 kbps. In realistic indoor spaces, multipath propagation and reverberation dramatically increase bit‑error rates. High‑frequency (>18 kHz) schemes, which look attractive for inaudibility, suffer the most, dropping below 60 % success at 1 m. Low‑frequency or hybrid OFDM‑based modulations retain >80 % success at the same distance.

2. Device Heterogeneity – Even within the same model line, variations in speaker and microphone hardware cause noticeable performance differences. Flagship devices that support 22 kHz sampling can maintain 4 kbps–5 kbps with modest error rates, whereas budget phones limited to 11 kHz sampling fall to ≤1 kbps and exhibit higher packet loss.

3. Throughput vs. Reliability Trade‑off – Academic papers often report optimistic throughputs (5–10 kbps) based on ideal conditions. Commercial products (e.g., Sonos pairing, mobile‑payment systems) deliberately limit data rates to 10–200 bps to prioritize robustness. The authors’ real‑world measurements confirm that high‑throughput schemes become unreliable under typical indoor noise and multipath, suggesting that practical deployments must favor lower data rates with stronger error correction.

4. Re‑implementation Difficulty – The lack of publicly released code forced the authors to invest significant engineering effort to reconstruct three schemes. Missing details such as exact filter coefficients, synchronization thresholds, and CRC parameters were often only inferable from figures or supplemental material, highlighting a systemic reproducibility problem in the ADT community.

Based on these observations, the authors propose design guidelines for future ADT systems: (i) adopt modulation formats that are resilient to multipath (e.g., low‑frequency OFDM or chirp spread spectrum); (ii) implement adaptive parameter tuning (dynamic volume, frequency band selection) based on real‑time channel estimation; (iii) employ strong forward error correction (Reed‑Solomon, Turbo codes) to mitigate burst errors caused by reflections; and (iv) perform per‑device calibration to account for hardware variability.

Beyond analysis, the paper makes two concrete contributions to the research ecosystem: (a) an open dataset of 11 900 recorded acoustic transmissions, complete with metadata (device model, distance, noise condition, playback volume) and (b) a publicly released repository containing the eight re‑implemented ADT libraries, the standardized TX/RX interface, and the experimental scripts. This enables other researchers to replicate the study, benchmark new algorithms, and extend the evaluation to additional devices or environments.

In conclusion, the work bridges the gap between simulation‑centric acoustic communication research and real‑world applicability. By systematically quantifying how multipath, device heterogeneity, and environmental noise degrade performance, and by providing open tools and data, the authors lay a solid foundation for more robust, reproducible, and commercially viable acoustic data‑transmission technologies.