Scalable coding scheme for low latency applications
Gespeichert in:
| Titel: | Scalable coding scheme for low latency applications |
|---|---|
| Patent Number: | 7,263,124 |
| Publikationsdatum: | August 28, 2007 |
| Appl. No: | 09/965213 |
| Application Filed: | September 26, 2001 |
| Abstract: | Fractional parts of quantized video coefficients are used as enhancement layers when encoding a video steam. This use of the fractional parts allows the reuse of decoding components. |
| Inventors: | Peng, Wen-Hsiao (Palo Alto, CA, US); Chen, Yen-Kuang (Sunnyvale, CA, US) |
| Assignees: | Intel Corporation (Santa Clara, CA, US) |
| Claim: | 1. A method comprising: quantizing coefficients into quantized values, each quantized value for a corresponding coefficient having an integer part and a fractional part, the integer part representing a base layer for the corresponding coefficient and the fractional part representing enhancement layers for the corresponding coefficient, the coefficients representing input data; and encoding the fractional parts into an enhancement layer bitstream. |
| Claim: | 2. The method of claim 1 further comprising: encoding the integer parts into a base layer bitstream. |
| Claim: | 3. The method of claim 1 further comprising: transforming an input into the coefficients. |
| Claim: | 4. The method of claim 3 further comprising: removing temporal redundancies exhibited by the input. |
| Claim: | 5. The method of claim 1 , wherein the enhancement layers are frequency ordered. |
| Claim: | 6. A method comprising: decoding an enhancement layer bitstream into quantized fractional values representing enhancement layers, each quantized fractional value being a fractional part of a quantization value generated from coefficients representing input data; applying an inverse quantization to the quantized fractional values to create coefficients representing the enhancement layers; applying an inverse transformation to the coefficients to create the enhancement layers; and combining the enhancement layers with a base layer. |
| Claim: | 7. The method of claim 6 further comprising: adding temporal redundancies to the base layer. |
| Claim: | 8. A method comprising: decoding an enhancement layer bitstream into quantized fractional values representing enhancement layers, each quantized fractional value being a fractional part of a quantization value generated from coefficients representing input data; applying an inverse quantization to the quantized fractional values to create coefficients representing the enhancement layers; combining the coefficients representing the enhancement layers with coefficients representing a base layer; and applying an inverse transformation to the combined coefficients. |
| Claim: | 9. The method of claim 8 further comprising: adding temporal redundancies to the coefficients representing the base layer. |
| Claim: | 10. A method comprising: decoding an enhancement layer bitstream into quantized fractional values representing enhancement layers, each quantized fractional value being a fractional part of a quantization value generated from coefficients representing input data; combining the quantized fractional values representing enhancement layers with quantized integer values representing a base layer; applying an inverse quantization to the combined quantized values to create coefficients; and applying an inverse transformation to the coefficients. |
| Claim: | 11. The method of claim 10 further comprising: adding temporal redundancies to the quantized integer values representing the base layer. |
| Claim: | 12. A computer-readable medium embodied with a computer program, which when executed by a computer, causes the computer to perform operations comprising: quantizing coefficients into quantized values, each quantized value for a corresponding coefficient having an integer part and a fractional part, the integer part representing a base layer for the corresponding coefficient and the fractional part representing enhancement layers for the corresponding coefficient, the coefficients representing input data; and encoding the fractional parts into an enhancement layer bitstream. |
| Claim: | 13. The computer-readable medium of claim 12 , wherein the operations further comprise: encoding the integer parts into a base layer bitstream. |
| Claim: | 14. The computer-readable medium of claim 12 , wherein the operations further comprise: transforming an input into the coefficients. |
| Claim: | 15. The computer-readable medium of claim 14 , wherein the operations further comprise: removing temporal redundancies exhibited by the input. |
| Claim: | 16. The computer-readable medium of claim 12 , wherein the enhancement layers are frequency ordered. |
| Claim: | 17. A computer-readable medium embodied with a computer program, which when executed by a computer, cause the computer to perform operations comprising: decoding an enhancement layer bitstream into quantized fractional values representing enhancement layers, each quantized fractional value being a fractional part of a quantization value generated from coefficients representing input data; applying an inverse quantization to the quantized fractional values to create coefficients representing the enhancement layers; applying an inverse transformation to the coefficients to create the enhancement layers; and combining the enhancement layers with a base layer. |
| Claim: | 18. The computer-readable medium of claim 17 , wherein the operations further comprise: adding temporal redundancies to the base layer. |
| Claim: | 19. A computer-readable medium embodied with executable program instructions, which when executed by a processing unit of a computer, cause the processing unit to perform operations comprising: decoding an enhancement layer bitstream into quantized fractional values representing enhancement layers, each quantized fractional value being a fractional part of a quantization value generated from coefficients representing input data; applying an inverse quantization to the quantized fractional values to create coefficients representing the enhancement layers; combining the coefficients representing the enhancement layers with coefficients representing a base layer; and applying an inverse transformation to the combined coefficients. |
| Claim: | 20. The computer-readable medium of claim 19 , wherein the operations further comprise: adding temporal redundancies to the coefficients representing the base layer. |
| Claim: | 21. A computer-readable medium providing executable program instructions, which when executed by a processing unit of a computer, cause the processing unit to perform operations comprising: decoding an enhancement layer bitstream into quantized fractional values representing enhancement layers, each quantized fractional value being a fractional part of a quantization value generated from coefficients representing input data; combining the quantized fractional values representing enhancement layers with quantized integer values representing a base layer; applying an inverse quantization to the combined quantized values to create coefficients; and applying an inverse transformation to the coefficients. |
| Claim: | 22. The computer-readable medium of claim 21 , wherein the operations further comprise: adding temporal redundancies to the quantized integer values representing the base layer. |
| Claim: | 23. A system comprising: a processor; a memory coupled to the processor though a bus; and an encoding process executed from the memory by the processor to cause the processor to quantize coefficients into quantized values, each quantized value for a corresponding coefficient having an integer part and a fractional part, the integer part representing a base layer for the corresponding coefficient and the fractional part representing enhancement layers for the corresponding coefficient, the coefficients representing input data, and to encode the fractional parts into an enhancement layer bitstream. |
| Claim: | 24. The system of claim 23 , wherein the encoding process further causes the processor to encode the integer parts into a base layer bitstream. |
| Claim: | 25. The system of claim 23 , wherein the encoding process further causes the processor to transform an input into the coefficients. |
| Claim: | 26. The system of claim 25 , wherein the encoding process further causes the processor to remove temporal redundancies exhibited by the input. |
| Claim: | 27. The system of claim 23 , wherein the enhancement layers are frequency ordered. |
| Claim: | 28. A system comprising: a processor; a memory coupled to the processor though a bus; and a decoding process executed from the memory by the processor to cause the processor to decode an enhancement layer bitstream into quantized fractional values representing enhancement layers, each quantized fractional value being a fractional part of a quantization value generated from coefficients representing input data, to apply an inverse quantization to the quantized fractional values to create coefficients representing the enhancement layers, to apply an inverse transformation to the coefficients to create the enhancement layers, and to combine the enhancement layers with a base layer. |
| Claim: | 29. The system of claim 28 , wherein the decoding process further cause the processor to add temporal redundancies to the base layer. |
| Claim: | 30. A system comprising: a processor; a memory coupled to the processor though a bus; and a decoding process executed from the memory by the processor to cause the processor to decode an enhancement layer bitstream into quantized fractional values representing enhancement layers, each quantized fractional value being a fractional part of a quantization value generated from coefficients representing input data, to apply an inverse quantization to the quantized fractional values to create coefficients representing the enhancement layers, to combine the coefficients representing the enhancement layers with coefficients representing a base layer, and to apply an inverse transformation to the combined coefficients. |
| Claim: | 31. The system of claim 30 , wherein the decoding process further cause the processor to add temporal redundancies to the coefficients representing the base layer. |
| Claim: | 32. A system comprising: a processor; a memory coupled to the processor though a bus; and an decoding process executed from the memory by the processor to cause the processor to decode an enhancement layer bitstream into quantized fractional values representing enhancement layers, each quantized fractional value being a fractional part of a quantization value generated from coefficients representing input data, to combine the quantized fractional values representing enhancement layers with quantized integer values representing a base layer, to apply an inverse quantization to the combined quantized values to create coefficients, and to apply an inverse transformation to the coefficients. |
| Claim: | 33. The system of claim 32 , wherein the decoding process further cause the processor to add temporal redundancies to the quantized integer values representing the base layer. |
| Claim: | 34. An apparatus comprising: a transformation component coupled to an input to create coefficients from the input; a quantization component coupled to the transformation component to create quantized values from the coefficients, each quantized value for a corresponding coefficient having an integer part and a fractional part, the integer part representing a base layer for the corresponding coefficient and the fractional part representing enhancement layers for the corresponding coefficient; a first encoding component coupled to the quantization component to create a base layer bitstream from the integer parts; and a second encoding component coupled to the quantization component to create a an enhancement layer bitstream from the fractional parts. |
| Claim: | 35. The apparatus of claim 34 further comprising: a reconstruction loop coupled to the quantization component and to the input to remove temporal redundancies from the input. |
| Claim: | 36. The apparatus of claim 34 further comprising: a reconstruction loop coupled to the quantization component and to the transformation component to remove temporal redundancies from the coefficients. |
| Claim: | 37. The apparatus of claim 34 further comprising: a reconstruction loop coupled between the quantization component and the first encoding component to remove temporal redundancies from the integer parts. |
| Claim: | 38. The apparatus of claim 34 , wherein the enhancement layers are frequency ordered. |
| Claim: | 39. An apparatus comprising: a decoding component coupled to an enhancement layer bitstream to create quantized fractional values representing enhancement layers from the enhancement layer bitstream, each quantized fractional value being a fractional part of a quantization value generated from coefficients representing input data; an inverse quantization component coupled to the decoding component to create coefficients from the quantized fractional values; a first inverse transformation component coupled to the inverse quantization component to create the enhancement layers from the coefficients; and an addition component coupled to the first inverse transformation component and further to a second inverse transformation component to combine the enhancement layers with a base layer from the second inverse transformation component. |
| Claim: | 40. The apparatus of claim 39 further comprising: a prediction loop coupled to the second inverse transformation component to add temporal redundancies to the base layer. |
| Claim: | 41. An apparatus comprising: a decoding component coupled to an enhancement layer bitstream to create quantized fractional values representing enhancement layers from the enhancement layer bitstream, each quantized fractional value being a fractional part of a quantization value generated from coefficients representing input data; a first inverse quantization component coupled to the decoding component to create coefficients from the quantized values; an addition component coupled to the first inverse quantization component and further to a second inverse quantization component to combine the coefficients from the first inverse quantization component with coefficients from the second inverse quantization; and an inverse transformation component coupled to the addition component to create combined enhancement and base layers from the coefficients. |
| Claim: | 42. The apparatus of claim 41 further comprising: a prediction loop coupled to the second inverse quantization component to add temporal redundancies to the coefficients from the second quantization component. |
| Claim: | 43. An apparatus comprising: a first decoding component coupled to an enhancement layer bitstream to create quantized fractional values representing enhancement layers from the enhancement layer bitstream, each quantized fractional value being a fractional part of a quantization value generated from coefficients representing input data; an addition component coupled to the first decoding component and further to a second decoding component to combine the quantized fractional values from the first decoding component with quantized integer values from the second decoding component; an inverse quantization component coupled to the addition component to create coefficients from the quantized values; and an inverse transformation component coupled to the inverse quantization component to create combined enhancement and base layers from the coefficients. |
| Claim: | 44. The apparatus of claim 43 further comprising: a prediction loop coupled to the second decoding component to add temporal redundancies to the quantized integer values. |
| Current U.S. Class: | 37524/003 |
| Patent References Cited: | 4785349 November 1988 Keith et al. 5988863 November 1999 Demos 6118817 September 2000 Wang 6275531 August 2001 Li 6510177 January 2003 De Bonet et al. 6700933 March 2004 Wu et al. 6728317 April 2004 Demos 6788740 September 2004 van der Schaar et al. |
| Other References: | H. Jiang, et al., “Experiments on Using Post-Clip Addition in MPEG-4 FGS Video Coding,” International Organisation For Standardisation, ISO/IEC JTC1/SC29/WG11 M5669, Noordwijkerhout, pp. 1-8, Mar. 2000. cited by other S. Li, et al., “Experimental Results with Progressive Fine Granularity Scalable (PFGS) Coding,” International Organisation For Standardisation, ISO/IEC JTC1/SC29/WG11 MPEG99/m5742, 14 pages Mar. 2000. cited by other “Information Technology-Coding of Audio- Visual Object-Part 2: Visual,” International Organisation For Standardisation, ISO/IEC JTC1/SC29/WG11 N3315, Proposed Draft Amendment (PDAM 4), 59 pages, Apr. 11, 2000. cited by other “FGS Core Experiments,” International Organisation For Standardisation, ISO/IEC JTC1/SC29/WG11 N3096, 20 pages, Maui, Dec. 1999. cited by other |
| Primary Examiner: | Philippe, Gims |
| Attorney, Agent or Firm: | Blakely, Sokoloff, Taylor & Zafman LLP |
| Dokumentencode: | edspgr.07263124 |
| Datenbank: | USPTO Patent Grants |
| Abstract: | Fractional parts of quantized video coefficients are used as enhancement layers when encoding a video steam. This use of the fractional parts allows the reuse of decoding components. |
|---|