Community

AES Convention Papers Forum

Optimized DSP Implementation of Non-Linear Quantization

Document Thumbnail

Non-linear quantization of the type INT(x^(M/N) + constant) is commonly used in audio compression techniques, particularly MPEG-1 and MPEG-2 layer III (MP3) and MPEG Advanced Audio Coding (AAC). Finding a suitable DSP implementation is a problem since lookup table methods are prohibitive due to excessive storage requirements, conventional series approximation methods do not give sufficient precision, and not all processors have log/exp assist functions. This paper describes a method which utilizes the property of geometric periodicity of the x^(M/N) function to first normalize the problem to a small range of input x. Subsequently one can choose to perform the x^(M/N) in this limited range based on lookup, interpolation, or series expansion, and finally re-normalize the output to obtain the overall answer. Using a hybrid scheme based on lookup and interpolation very good overall precision is achieved. Compared to direct application of any of the above techniques, there is very little additional computational burden, and the improvement in precision is very significant. Mathematically, this method is shown to be a special case of log-exp based computation where the log is quantized.

Authors:
Affiliation:
AES Convention: Paper Number:
Publication Date:
Subject:

Click to purchase paper as a non-member or you can login as an AES member to see more options.

No AES members have commented on this paper yet.

Subscribe to this discussion

RSS Feed To be notified of new comments on this paper you can subscribe to this RSS feed. Forum users should login to see additional options.

Start a discussion!

If you would like to start a discussion about this paper and are an AES member then you can login here:
Username:
Password:

If you are not yet an AES member and have something important to say about this paper then we urge you to join the AES today and make your voice heard. You can join online today by clicking here.

AES - Audio Engineering Society