COSMOS: Networked ISAC Enabled Target Recognition Towards Low-Altitude Economy

Hongliang Luo1 Chuanbin Zhao1 Boxuan Sun1 Zhonghua Chu1 Shengjie Quan1

Guangyi Liu2 Feifei Gao1

1Tsinghua University 2China Mobile Research Institute

ABSTRACT

In this paper, we propose a low-altitude target (LAT) recognition scheme based on multi-base station (BS) collaboration and multi-scale feature fusion for integrated sensing and communications (ISAC) network. We formulate the motion equations, echo channels, and echo signals for unmanned aerial vehicle (UAV), bird, vehicle, and pedestrian under multi-BS collaborative monitoring scenario. Then we extract the velocity-resolution-preferred time-frequency spectrum, time-resolution-preferred time-frequency spectrum, and velocity-transfer time-frequency spectrum observed by each BS from echo signals. We collectively refer to these three types of time-frequency spectrum as the multi-scale feature of the LAT. Next, we design a multi-BS and multi-scale feature fusion enabled LAT recognition network with Swin Transformer, which employs the visualized images of multi-scale feature to jointly recognize the target through deep feature extraction, intra-BS feature interaction, inter-BS feature interaction, and target recognition output. We generate a massive echo signal dataset comprising 1,440,000 samples for LAT recognition within ISAC network. This dataset can serve as a public benchmark to evaluate our proposed scheme and facilitate future research. Simulation results demonstrate that the proposed scheme realizes high recognition accuracy and robust unseen-subtype generalization, confirming the effectiveness of multi-scale feature fusion and the additional gains brought by multi-BS collaboration.

Multi-BS scenario

Networked ISAC sensing with three cooperative base stations.

Multi-scale features

VRP-TF, TRP-TF, and VT-TF capture complementary motion cues.

Hierarchical fusion

Shared Swin-B with intra-BS and inter-BS feature interaction.

Large-scale dataset

1,440,000 samples across 40 target subtypes and six SNR settings.

System Model

The recognition task is built on a networked ISAC sensing cell, where three BSs observe low-altitude targets from complementary geometric views.

LAT recognition scenario in an ISAC network with three base stations and four target categories
Fig. 1. LAT recognition scenario in ISAC network.
Aerial view of multi-BS cooperative sensing scenario with BS-A, BS-B, BS-C and target coordinates
Fig. 2. Aerial view of multi-BS cooperative sensing scenario.

Multi-Scale Features

VRP-TF spectrum

Velocity-Resolution-Preferred Time-Frequency Spectrum

VRP-TF is obtained by using a long STFT window, which provides high velocity resolution and better observation of LAT velocity details. The resulting spectra show class-dependent horizontal stripe patterns.

Velocity-Resolution-Preferred Time-Frequency Spectrum examples for UAV, bird, vehicle, and pedestrian
TRP-TF spectrum

Time-Resolution-Preferred Time-Frequency Spectrum

TRP-TF is obtained by using a short STFT window, which preserves high time resolution. It displays periodic envelopes caused by the periodic micro-motions of different LAT categories.

Time-Resolution-Preferred Time-Frequency Spectrum examples for UAV, bird, vehicle, and pedestrian
VT-TF spectrum

Velocity-Transfer Time-Frequency Spectrum

VT-TF replaces the velocity-FFT calculation with matched filtering and is composed of velocity component transition amounts. It reflects micro-motion periodicity while retaining more velocity distribution details.

Velocity-Transfer Time-Frequency Spectrum examples for UAV, bird, vehicle, and pedestrian

Low-Altitude Target Recognition Network

We design a multi-BS and multi-scale feature fusion enabled LAT recognition network with Swin Transformer, which employs the visualized images of multi-scale feature to jointly recognize the target through deep feature extraction, intra-BS feature interaction, inter-BS feature interaction, and target recognition output.

Swin-B based intra-BS and inter-BS fusion network

Large-Scale Dataset

4 target categories
40 target subtypes
240,000 motion models
6 SNR settings
1,440,000 echo signal samples

Experimental Results

Experimental Settings

Seen-subtype setting

Training and testing samples share the same target subtypes, evaluating recognition accuracy under matched subtype distributions.

Unseen-subtype setting

Testing samples contain target subtypes excluded from training, evaluating generalization to new low-altitude target subtypes.

Performance Summary

99.88% average accuracy on seen subtypes
97.82% average accuracy on unseen subtypes
96.08% accuracy at 3 dB on unseen subtypes

Seen-subtype recognition accuracy (%)

Scheme 3 dB 8 dB 13 dB 18 dB 23 dB No noise Avg.
BS-A: VRP94.7097.6998.7999.0099.1499.1198.07
BS-A: TRP95.5198.5099.2099.4399.3999.4498.58
BS-A: VT93.0197.6398.8899.1699.3099.3297.88
BS-A: VRP+TRP+VT96.5298.8899.4299.5799.6399.6598.94
BS-B: VRP+TRP+VT97.0098.8499.3399.5299.5099.5398.95
BS-C: VRP+TRP+VT96.7598.8199.3899.5299.5399.5598.92
BS-A/B/C: VRP+TRP+VT99.5299.9199.9599.9799.9799.9799.88

Unseen-subtype recognition accuracy (%)

Scheme 3 dB 8 dB 13 dB 18 dB 23 dB No noise Avg.
BS-A: VRP87.6490.0391.0691.5391.7492.1490.69
BS-A: TRP90.0593.5894.6795.0695.2895.4394.01
BS-A: VT87.5692.7394.3394.9595.3195.5193.40
BS-A: VRP+TRP+VT91.6594.4495.6996.1096.2496.3695.08
BS-B: VRP+TRP+VT91.5294.6595.8196.3896.7397.0395.35
BS-C: VRP+TRP+VT92.2694.6295.8396.2496.4296.4795.31
BS-A/B/C: VRP+TRP+VT96.0897.7498.1998.2698.3098.3497.82

Architecture comparison on unseen subtypes (%)

Scheme 3 dB 8 dB 13 dB 18 dB 23 dB No noise Avg.
Proposed96.0897.7498.1998.2698.3098.3497.82
Swin-B + Mean Fusion94.6096.9097.8298.0798.2398.3897.33
ConvNeXt-B + Mean Fusion93.9095.7396.6597.1497.4597.6996.43
ViT-B/16 + Mean Fusion93.6595.3995.8696.1896.2696.4195.62

Conclusion

Key Contributions

  • Formulate the motion processes, echo channels, and echo signals for UAVs, birds, vehicles and pedestrians under multi-BS collaborative sensing scenario.
  • Propose a multi-scale time-frequency feature extraction algorithm for ISAC system, which extracts the VRP-TF, TRP-TF, and VT-TF of LAT as complementary multi-scale features.
  • Design a multi-BS and multi-scale feature fusion enabled LAT recognition network with Swin Transformer, which employs the visualized images of multi-scale feature to jointly recognize the target through deep feature extraction, intra-BS feature interaction, inter-BS feature interaction, and target recognition output.
  • Generate a massive echo signal dataset comprising 1,440,000 samples for LAT recognition within ISAC network.

Key Experimental Results

99.88% average accuracy on seen subtypes
97.82% average accuracy on unseen subtypes
96.08% accuracy at 3 dB on unseen subtypes

Experimental results demonstrate that multi-scale feature fusion can enhance the accuracy of LAT recognition, and multi-base station fusion can further boost the accuracy of LAT recognition.