Dual-Branch CNN-MLP-Dropout Network for Multiclass Scene Recognition: Fusing Multisensor Time-Domain Inputs and Time-Frequency Representations

In the current digital age, scene recognition technology is increasingly applied in the Internet of Things (IoT) ecosystem, including transportation, smart homes, elderly care, and terrain surveying. Existing technologies have two limitations: sensors are often worn on different body parts, causing inconvenience; and limited sensor types with inadequate data processing restrict recognition accuracy. Consumer-grade smartphones, with high portability, low cost, lightweight design, and diverse sensors, offer an ideal solution and serve as crucial intelligent agents in IoT scenarios. To leverage multisensor information for effective, efficient, and trustworthy IoT scene recognition, we propose a CNN-MLP-dropout method using time-domain and time-frequency-domain features. This method synchronizes data from eight built-in heterogeneous sensors, extracts effective features via filtering and short-time Fourier transform (STFT), and then feeds them into the CNN-MLP-dropout model. The model first extracts local patterns, captures global representations, and achieves multiclass scene recognition. Test results on ten indoor/outdoor scenarios showed that multisensor data improved accuracy by 21.98%, 36.67%, and 6.09% versus limited-sensor groups. The proposed model significantly outperforms five state-of-the-art (SOTA) networks, with dropout avoiding overfitting, enabling high-precision, robust, user-friendly multiclass activity scene recognition in IoT.