Encoding/decoding apparatuses and methods for encoding/decoding vibrotactile signals
Saved in:
| Title: | Encoding/decoding apparatuses and methods for encoding/decoding vibrotactile signals |
|---|---|
| Patent Number: | 11113,934 |
| Publication Date: | September 07, 2021 |
| Appl. No: | 16/833403 |
| Application Filed: | March 27, 2020 |
| Abstract: | An encoding apparatus for encoding a vibrotactile signal includes a first transforming unit configured to perform a discrete wavelet transform of the signal, a second transforming unit configured to generate a frequency domain representation of the signal, a psychohaptic model unit configured to generate at least one quantization control signal based on the generated frequency domain representation of the sampled signal and on a predetermined perceptual model based on human haptic perception, a quantization unit configured to quantize wavelet coefficients resulting from the performed discrete wavelet transform and adapted by the quantization control signal, a compression unit configured to compress the quantized wavelet coefficients, and a bitstream generating unit configured to generate a bitstream corresponding to the encoded signal based on the compressed quantized wavelet coefficients. The subject matter described herein also includes a corresponding decoding unit, an encoding method and a decoding method. |
| Inventors: | Technische Universität München (Munich, DE) |
| Assignees: | TECHNISCHE UNIVERSITÄT MÜNCHEN (Munich, DE) |
| Claim: | 1. An encoding apparatus for encoding a vibrotactile signal, comprising: a) a first transforming unit configured to perform a discrete wavelet transform of the signal; b) a second transforming unit configured to generate a frequency domain representation of the signal; c) a psychohaptic model unit configured to generate at least one quantization control signal based on the generated frequency domain representation of the sampled signal and on a predetermined perceptual model based on human haptic perception, wherein the psychohaptic model unit is configured to identify peaks in the signal spectrum, wherein each peak corresponds to a frequency and a magnitude, and wherein psychohaptic model unit comprises a memory adapted to store the frequency and magnitude of each identified peak; d) a quantization unit configured to quantize wavelet coefficients resulting from the performed discrete wavelet transform and adapted by the quantization control signal; e) a compression unit configured to compress the quantized wavelet coefficients; and f) a bitstream generating unit configured to generate a bitstream corresponding to the encoded signal based on the compressed quantized wavelet coefficients. |
| Claim: | 2. The encoding apparatus according to claim 1 further comprising a block unit configured to split the vibrotactile signal into a plurality of consecutive blocks. |
| Claim: | 3. The encoding apparatus according to claim 1 wherein the first transforming unit is adapted to perform the discrete wavelet transform by using a biorthogonal wavelet that comprises at least one of a Cohen-Daubechies-Feauveau-wavelet and a 9/7-Cohen-Daubechies-Feauveau-wavelet. |
| Claim: | 4. The encoding apparatus according to claim 1 , wherein the second transforming unit is configured to generate the frequency domain representation by using a discrete Fourier transform, a fast Fourier transform, a discrete cosine transform or a discrete sine transform of the sampled signal. |
| Claim: | 5. A transmitter in a communication system comprising the encoding apparatus according to claim 1 . |
| Claim: | 6. The encoding apparatus according to claim 1 , wherein the psychohaptic model unit is configured to compute a masking threshold for the peaks at different frequencies based on the frequency and magnitude of each peak. |
| Claim: | 7. The encoding apparatus according to claim 1 , wherein the psychohaptic model unit is further configured to compute an absolute threshold of perception at different frequencies which corresponds to an average signal magnitude required for human at a certain frequency to be able to perceive a signal. |
| Claim: | 8. The encoding apparatus according to claim 7 , wherein the psychohaptic model unit is further configured to compute a global masking threshold based on the masking threshold and the absolute threshold. |
| Claim: | 9. The encoding apparatus according to claim 8 , wherein the psychohaptic model unit is configured to compute a signal-to-mask-ratio based on the sum of the energy of the global masking threshold at different frequencies and on the energy of the signal, in particular to compute the signal-to-mask-ratio for each frequency band of the wavelet coefficients of the discrete wavelet transform. |
| Claim: | 10. The encoding apparatus according to claim 9 , wherein the quantization unit is configured to quantize wavelet coefficients by allocating bits for each frequency band of the wavelet coefficients based on a mask-to-noise-ratio, wherein the mask-to-noise-ratio is computed based on the signal-to-mask-ratio and a signal-to-noise-ratio which is computed based on the energy of the signal and the energy of a noise introduced by the quantization. |
| Claim: | 11. The encoding apparatus according to claim 1 , wherein the compression unit is adapted to use an algorithm based on set partitioning in hierarchical trees for the compression of wavelet coefficients. |
| Claim: | 12. The encoding apparatus according to claim 1 , wherein the quantization unit is configured to be adapted by the quantization control signal such that the distortion introduced during the quantization of the sampled signal in different frequency ranges is, relative to a perception masking threshold of the perception model, not perceivable by a human. |
| Claim: | 13. The encoding apparatus according to claim 1 , wherein the quantization unit comprises an embedded deadzone quantizer. |
| Claim: | 14. A decoding apparatus for decoding a vibrotactile signal from a bitstream, comprising: a) a decompression unit configured to decompress the bitstream, wherein in particular an algorithm based on inverse set partitioning in hierarchical trees is provided for the decompression; b) a dequantization unit configured to dequantize the decompressed bitstream, wherein the decompressed bitstream is quantized using a psychohaptic model unit configured to generate at least one quantization control signal based on a frequency domain representation of a sampled signal and on a predetermined perceptual model based on human haptic perception, wherein the psychohaptic model unit is configured to identify peaks in the signal spectrum, wherein each peak corresponds to a frequency and a magnitude, and wherein psychohaptic model unit comprises a memory adapted to store the frequency and magnitude of each identified peak; and a third transforming unit configured to perform an inverse discrete wavelet transform of the dequantized bitstream. |
| Claim: | 15. A receiver in a communication system comprising the decoding apparatus according to claim 14 . |
| Claim: | 16. An encoding method for encoding a vibrotactile signal, comprising: a) performing a discrete wavelet transform of the signal; b) generating a frequency domain representation of the signal; c) generating at least one quantization control signal based on the generated frequency domain representation of the signal and on a predetermined perceptual model based on human haptic perception, wherein generating the quantization control signal includes using a psychohaptic model unit to identify peaks in the signal spectrum, wherein each peak corresponds to a frequency and a magnitude, and wherein psychohaptic model unit comprises a memory adapted to store the frequency and magnitude of each identified peak; d) quantizing wavelet coefficients resulting from the performed discrete wavelet transform and adapted by the quantization control signal; e) compressing the quantized wavelet coefficients; and f) generating a bitstream corresponding to the encoded signal based on the compressed quantized wavelet coefficients. |
| Claim: | 17. A computer program product comprising computer-executable instructions embodied in a non-transitory computer-readable medium which, when is executed by a processor of a computer, cause the computer to carry out the method of claim 16 . |
| Claim: | 18. A decoding method for decoding a vibrotactile signal from a bitstream, comprising: a) decompressing the bitstream, wherein in an algorithm based on inverse set partitioning in hierarchical trees is provided for the decompression; b) dequantizing the decompressed bitstream, wherein the decompressed bitstream is quantized using a psychohaptic model unit configured to generate at least one quantization control signal based on a frequency domain representation of a sampled signal and on a predetermined perceptual model based on human haptic perception, wherein the psychohaptic model unit is configured to identify peaks in the signal spectrum, wherein each peak corresponds to a frequency and a magnitude, and wherein psychohaptic model unit comprises a memory adapted to store the frequency and magnitude of each identified peak; and c) performing an inverse discrete wavelet transform of the dequantized bitstream. |
| Patent References Cited: | 5819215 October 1998 Dobson 5845243 December 1998 Smart 6853318 February 2005 Rabbani 7006568 February 2006 Gu 7062104 June 2006 Zeng 7733961 June 2010 O'Hara 9008451 April 2015 Lee 9681140 June 2017 Le Leannec 2004/0062448 April 2004 Zeng 2006/0238386 October 2006 Huang 2008/0131014 June 2008 Lee 2016/0173884 June 2016 Le Leannec |
| Other References: | “A Simple 9/7-TAP Wavelet Filter Based on Lifting Scheme”, pp. 249-252, IEEE, 2001. (Year: 2001). cited by examiner Office Action for German Patent Application Serial No. 10 2019 204 527.8 (dated Apr. 3, 2020). cited by applicant Examination Notice for German Application Serial No. 10 2019 204 257.8 (dated Oct. 7, 2019). cited by applicant Antonakoglou et al., “Toward Haptic Communications Over the 5G Tactile Internet,” IEEE Communications Surveys & Tutorials, vol. 20, No. 4, Fourth Quarter, pp. 3034-3059 (2018). cited by applicant Kuzu et al., “Wavelet packet transform-based compression for teleoperation,” Proc IMechE Part I: Journal of Systems and Control Engineering, vol. 229, No. 7, pp. 639-651 (2015). cited by applicant Kuschel et al., “Passive Haptic Data-Compression Methods With Perceptual Coding for Bilateral Presence Systems,” IEEE Transactions on Systems, Man, and Cybernetics—Part A: Systems And Humans, vol. 39, No. 6, pp. 1142-1151 (Nov. 2009). cited by applicant Chaudhari et al., “On the Compression and Rendering of Event-triggered Force Transients in Networked Virtual Environments,” IEEE, pp. 1-6 (2009). cited by applicant Meyer et al., “Fast Adaptive Wavelet Packet Image Compression,” IEEE Transactions on Image Processing, vol. 9, No. 5, pp. 792-800 (May 2000). cited by applicant Brandenburg, “MP3 and AAC Explained,” Audio Engineering Society Conference: 17th International Conference: High-Quality Audio Coding, Audio Engineering Society, pp. 1-12 (1999). cited by applicant “The Tactile Internet,” ITU-T Technology Watch Report, 24 pages (Aug. 2014). cited by applicant |
| Primary Examiner: | Jeanglaude, Jean B |
| Attorney, Agent or Firm: | Jenkins, Wilson, Taylor & Hunt, P.A. |
| Accession Number: | edspgr.11113934 |
| Database: | USPTO Patent Grants |
| Abstract: | An encoding apparatus for encoding a vibrotactile signal includes a first transforming unit configured to perform a discrete wavelet transform of the signal, a second transforming unit configured to generate a frequency domain representation of the signal, a psychohaptic model unit configured to generate at least one quantization control signal based on the generated frequency domain representation of the sampled signal and on a predetermined perceptual model based on human haptic perception, a quantization unit configured to quantize wavelet coefficients resulting from the performed discrete wavelet transform and adapted by the quantization control signal, a compression unit configured to compress the quantized wavelet coefficients, and a bitstream generating unit configured to generate a bitstream corresponding to the encoded signal based on the compressed quantized wavelet coefficients. The subject matter described herein also includes a corresponding decoding unit, an encoding method and a decoding method. |
|---|