Bug 1622

Summary: German "man" messages have badly formed umlauts
Product: Mageia Reporter: Michael LoÃin <mageia>
Component: RPM PackagesAssignee: QA Team <qa-bugs>
Status: RESOLVED FIXED QA Contact:
Severity: minor    
Priority: Normal CC: detlefschmidt, marja11, molch.b, oliver.bgr, p.grun, sebixmag, sigrid.carrera, sysadmin-bugs, tmb, tvl83
Version: 1Keywords: Junior_job, PATCH, validated_update
Target Milestone: ---   
Hardware: All   
OS: Linux   
Whiteboard:
Source RPM: man-1.6g-2.mga1.src.rpm CVE:
Status comment:

Description Michael LoÃin 2011-06-05 22:52:17 CEST
Description of problem:
German "man" messages show umlauts that seem to be encoded twice into UTF-8.

Version-Release number of selected component (if applicable):
man 1.6g

How reproducible:
whenever LANG is set to "de_DE.UTF-8"

Steps to Reproduce:
1. export LANG=de_DE.UTF-8
2. man does-not-exist
3. output is "Keine Handbuchseite für does-not-exist"

The umlaut in "für" yields four bytes instead of two:
> man does-not-exist 2>&1 | od -c
0000000   K   e   i   n   e       H   a   n   d   b   u   c   h   s   e
0000020   i   t   e       f 303 203 302 274   r       d   o   e   s   -
0000040   n   o   t   -   e   x   i   s   t  \n

> echo für | od -c
0000000   f 303 274   r  \n
Comment 1 Ahmad Samir 2011-06-05 23:58:51 CEST
Indeed, from the build log:
+ for src in 'msgs/mess.[a-z][a-z]'
++ sed 's/^.*codeset=//' msgs/mess.de.codeset
+ charset=iso-8859-1
+ iconv -t utf-8 -f iso-8859-1 -o msgs/mess.de.utf msgs/mess.de
+ mv msgs/mess.de.utf msgs/mess.de
+ echo '$ codeset=utf-8'

However the file is already utf-8. 

Fixed in SVN (will be submitted after the release freeze is over).
Comment 2 Ahmad Samir 2011-06-06 00:00:00 CEST
Correction, not fixed in SVN yet, SVN commit access is still blocked... I'll have to wait.
Manuel Hiebel 2011-10-04 19:12:33 CEST

Keywords: (none) => Junior_job, PATCH

Comment 3 Marja Van Waes 2011-12-04 16:56:28 CET
@ Oliver

Do you know a German padawan who could fix this?

Cauldron and 1 both have man version 1.6g-2.mga1 atm

Setting Mga release version to cauldron, it feels a bit OTT (over the top ;) ) to have two separate bug reports about this issue for cauldron and for stable.

CC: (none) => marja11, oliver.bgr
Version: 1 => Cauldron

Oliver Burger 2011-12-05 09:42:19 CET

Status: NEW => ASSIGNED
Assignee: bugsquad => oliver.bgr

Comment 4 Oliver Burger 2011-12-05 09:48:12 CET
Fixed for 1 and cauldron.
Mga1 submitted to updates_testing.

Please test on Mga1.

Assignee: oliver.bgr => qa-bugs

Comment 5 claire robinson 2011-12-05 13:03:43 CET
# urpmi locales-de

$ echo $LANG
en_GB.utf8

$ export LANG=de_DE.UTF-8
$ echo $LANG
de_DE.UTF-8

$ man does-not-exist
No manual entry for does-not-exist

I think it should be utf8, not UTF-8? It doesn't seem to make any difference though :\

$ export LANG=de_DE.utf8
$ echo $LANG
de_DE.utf8

$ man does-not-exist
No manual entry for does-not-exist

Am I missing something?
Comment 6 Oliver Burger 2011-12-05 14:00:55 CET
On i586 it's working with German locales now. I don't know, what would be needed to test on a system with other locale settings.

I can't get man to speak English.
Comment 7 claire robinson 2011-12-07 12:14:03 CET
Not sure what I'm doing wrong but I can only get it to speak English.

$ export LANG=de_DE.UTF-8
$ export LC_ALL=de_DE.UTF-8
$ locale
LANG=de_DE.UTF-8
LC_CTYPE="de_DE.UTF-8"
LC_NUMERIC="de_DE.UTF-8"
LC_TIME="de_DE.UTF-8"
LC_COLLATE="de_DE.UTF-8"
LC_MONETARY="de_DE.UTF-8"
LC_MESSAGES=de_DE.UTF-8
LC_PAPER="de_DE.UTF-8"
LC_NAME="de_DE.UTF-8"
LC_ADDRESS="de_DE.UTF-8"
LC_TELEPHONE="de_DE.UTF-8"
LC_MEASUREMENT="de_DE.UTF-8"
LC_IDENTIFICATION="de_DE.UTF-8"
LC_ALL=de_DE.UTF-8

]$ man does-not-exist
No manual entry for does-not-exist

]$ LC_ALL=c man does-not-exist
No manual entry for does-not-exist

]$ LC_ALL=de_DE.UTF-8 man does-not-exist
No manual entry for does-not-exist
Comment 8 Oliver Burger 2011-12-07 12:55:09 CET
Then we need another German tester, e.g. the original reporter.
I'm putting a few Germans in cc.

Please update the package man in Mageia 1 to the version in updates_testing and see if a "man does-not-exist" gives an answer with correct umlauts.

Thanks

CC: (none) => detlefschmidt, molch.b, p.grun, sebixmag, sigrid.carrera, tvl83

Comment 9 Thorsten vanLil 2011-12-07 13:12:53 CET
Tested yet on a up-to-date Mageia 1 i586:

$ man dawdawd
Keine Handbuchseite für dawdawd

What more information should I provide?

Regards,
TeaAge
Comment 10 Wolfgang Bornath 2011-12-07 13:25:46 CET
$ rpm -qa|grep man
man-pages-de-0.5-8.mga1
man-1.6g-2.1.mga1
----------
$ man dawdad
$ man dawdad
Keine Handbuchseite für dawdad
----------

Fixed with man-1.6g-2.1.mga1 on a 64-bit Mageia 1 after including core updates testing.
Comment 11 claire robinson 2011-12-07 13:37:49 CET
Thanks wobo!

Thorsten, the updated man package is in Core Updates Testing.

To enable it use

 drakrpm-edit-media --expert

as root.

Remember to disable it afterwards though.

Thanks
Comment 12 Oliver Burger 2011-12-07 13:42:50 CET
TeaAge, which version of man do you have installed? The one from updates_testing?
Then those wrecked  umlaut shouldn't be there any more.

Wobo, thanks.

Oliver
Comment 13 Thorsten vanLil 2011-12-07 14:00:04 CET
Testing repos are and were activated.
$ rpm -qa | grep man
man-pages-de-0.5-8.mga1
man-1.6g-2.mga1
man-pages-3.32-2.mga1

Wrecked umlaut on konsole as well as tty. As user as well as root.

Regards,
TeaAge
Comment 14 claire robinson 2011-12-07 14:05:56 CET
The updated package is man-1.6g-2.1.mga1

Try to update the testing media, it should show as an update then.

Do you have testing media set as 'update' media?
Comment 15 Thorsten vanLil 2011-12-07 14:16:05 CET
Ok, after I manually updated the repo, the new package was visible.
After updating it, the output looks fine:

"Keine Handbuchseite für dawda"

Regards,
TeaAge
Comment 16 claire robinson 2011-12-07 14:28:01 CET
Thankyou TeaAge :)

Update validated.

Advisory
------------------
This updated man package fixes as issue where umlauts were displayed incorrectly in German locales.
------------------

SRPM: man-1.6g-2.1.mga1.src.rpm

Could sysadmin please push from core/updates_testing to core/updates

Thankyou!

Keywords: (none) => validated_update
CC: (none) => sysadmin-bugs
Hardware: i586 => All
Version: Cauldron => 1

Comment 17 Oliver Burger 2011-12-07 14:53:01 CET
Thanks TeaAge :)
Comment 18 Thomas Backlund 2011-12-07 18:22:33 CET
Update pushed.

Status: ASSIGNED => RESOLVED
CC: (none) => tmb
Resolution: (none) => FIXED