IEEE

Exploiting Complex-Valued Representations in Automatic Modulation Recognition: A Framework Integrating a Transformer With Relative Positional Encoding and Separable Convolution

Abstract: Automatic modulation recognition plays a critical role in military applications, particularly in electronic warfare, spectrum surveillance, and secure communication systems. The precise ...
IEEE

Lightweight Hierarchical Transformer Combining Patch-Random and Positional Encoding for Respiratory Sound Classification

Abstract: With the development of deep learning, automatic classification of respiratory sounds holds significant promise in the field of smart healthcare. However, the deployment of respiratory sound ...
GitHub

Zero-Training Context Extension for Transformer Encoders via Nonlinear Absolute Positional Embeddings Interpolation

Official implementation of "Zero-Training Context Extension for Transformer Encoders via Nonlinear Absolute Positional Embeddings Interpolation". Paper preprint is coming soon. This implementation ...
GitHub

ritwikrohan/Transformer-based-Surgical-Tool-Segmentation

Clone this repository using these command in jupyter notebook: git clone https://github.com/ritwikrohan7/ML_project_601.675_Abhay_Bhupendra_Ritwik.git %cd ML_project ...
techxplore

Flexible position encoding helps LLMs follow complex instructions and shifting states

The team tested its ability to follow the most recent "write" command despite many distracting steps and multi-step recall tests, tasks that are difficult for standard positional encoding methods like ...