From: Marc-Andre Lafortune <redmine@...>
Date: 2010-06-17T13:08:33+09:00
Subject: [ruby-core:30787] [Bug #3448] broken iconv library

Bug #3448: broken iconv library
http://redmine.ruby-lang.org/issues/show/3448

Author: Marc-Andre Lafortune
Status: Open, Priority: Low
Category: lib
ruby -v: all

Texts longer than ~8160 characters can create problems with iconv on some distributions:

  require 'iconv'
  Iconv.conv("iso-8859-1//ignore", "utf-8", "\305\253" + "a"*8159).size #=> 8159
  Iconv.conv("iso-8859-1//ignore", "utf-8", "\305\253" + "a"*8160).size # => Iconv::IllegalSequence: "a"

The code above is from Debian 4 and 5 (on Heroku...), but it works as expected on OS X. As such, it affects Ruby 1.8 and 1.9

A google search reassured me I was not crazy, e.g. my_iconv_open in:
http://www.opensource.apple.com/source/vim/vim-6/vim/src/mbyte.c

I realize this is somewhat a third party issue, but I'm logging this nevertheless, as a brave soul might bypass the bug in the Ruby library and/or report this to the proper authorities.
--
Marc-Andr��


----------------------------------------
http://redmine.ruby-lang.org