TY - GEN
T1 - Approaching maximum likelihood performance of LDPC codes by stochastic resonance in noisy iterative decoders
AU - Vasić, Bane
AU - Ivaniš, Predrag
AU - Declercq, David
AU - LeTrung, Khoa
N1 - Funding Information:
This work was supported by the Seventh Framework Program of the European Union, under Grant Agreement number 309129 (i-RISC project), French ANR project NAND under grant agreement ANR-15CE25-0006-01, and in part by the NSF under Grants CCF-0963726, CCF-1314147 and ECCS- 1500170. Bane Vasic acknowledges generous support of the Fulbright Scholar Program. Long version of this paper is submitted for publication to IEEE Transactions on Communications, and part of the results will be submitted to 2016 IEEE International Symposium on Information Theory.
Publisher Copyright:
© 2016 IEEE.
PY - 2017/3/27
Y1 - 2017/3/27
N2 - In the 1960s-70s, Taylor and Kuznetsov obtained a remarkable result that information can be reliably retrieved from a noisy channel even if a decoder is made of noisy components. The results of Vasic and Chilappagari presented at the ITA Workshop ten years ago have revived the interest in decoders made of noisy hardware and since then a number of improvements of the iterative decoders have been made to bring their performance closer to that of their perfect counterparts. However, a common mantra has been that noisy decoders cannot be better than their perfect counterparts. In this talk we report an unexpected phenomenon we have recently discovered - noise can actually improve the error correction process by reducing the probability of decoding error, in some cases by more that two orders of magnitude. This new form of stochastic resonance enables us to use logic gate errors to correct channel errors. This novelty recognizes that the decoder - essentially an iterative minimization of the Bethe free energy on the code graph - can get trapped in local minima, and random perturbations help the decoder to escape from these minima and converge to a correct code-word. In the spirit of Marcus Tullius Cicero's "Clavus clavo eicitur," ("one nail drives out another") they operate on the principle: Error errore eicitur" - "one error drives out another." Crucially, such useful random perturbations require neither additional hardware nor energy, as they are built into the low-powered, noisy hardware itself.
AB - In the 1960s-70s, Taylor and Kuznetsov obtained a remarkable result that information can be reliably retrieved from a noisy channel even if a decoder is made of noisy components. The results of Vasic and Chilappagari presented at the ITA Workshop ten years ago have revived the interest in decoders made of noisy hardware and since then a number of improvements of the iterative decoders have been made to bring their performance closer to that of their perfect counterparts. However, a common mantra has been that noisy decoders cannot be better than their perfect counterparts. In this talk we report an unexpected phenomenon we have recently discovered - noise can actually improve the error correction process by reducing the probability of decoding error, in some cases by more that two orders of magnitude. This new form of stochastic resonance enables us to use logic gate errors to correct channel errors. This novelty recognizes that the decoder - essentially an iterative minimization of the Bethe free energy on the code graph - can get trapped in local minima, and random perturbations help the decoder to escape from these minima and converge to a correct code-word. In the spirit of Marcus Tullius Cicero's "Clavus clavo eicitur," ("one nail drives out another") they operate on the principle: Error errore eicitur" - "one error drives out another." Crucially, such useful random perturbations require neither additional hardware nor energy, as they are built into the low-powered, noisy hardware itself.
UR - http://www.scopus.com/inward/record.url?scp=85016870681&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=85016870681&partnerID=8YFLogxK
U2 - 10.1109/ITA.2016.7888185
DO - 10.1109/ITA.2016.7888185
M3 - Conference contribution
AN - SCOPUS:85016870681
T3 - 2016 Information Theory and Applications Workshop, ITA 2016
BT - 2016 Information Theory and Applications Workshop, ITA 2016
PB - Institute of Electrical and Electronics Engineers Inc.
T2 - 2016 Information Theory and Applications Workshop, ITA 2016
Y2 - 31 January 2016 through 5 February 2016
ER -