#foswiki 2015-06-01,Mon

↑back Search ←Prev date Next date→ Show only urls(Click on time to select a line by its url)

WhoWhatWhen
***ChanServ sets mode: +o Lynnwood
ChanServ sets mode: +o Lynnwood
[00:38]
....... (idle for 33mn)
ChanServ sets mode: +o gac410 [01:13]
................... (idle for 1h32mn)
GithubBot[distro] gac410 pushed 1 new commit to master: http://git.io/vk6aF
distro/master d67d803 George Clark: Item12888: FormattedSearchDetails fails due to MAKETEXT
[02:45]
***GithubBot has left [02:45]
...... (idle for 28mn)
GithubBot[distro] FoswikiBot pushed 1 new commit to master: http://git.io/vk6oG
distro/master 2b4533d Lieven L. Litaer: Item13252: Translations updated using Weblate (Klingon)...
[03:13]
***GithubBot has left [03:13]
GithubBot[distro] gac410 pushed 1 new commit to master: http://git.io/vk6oB
distro/master 4ece0a2 George Clark: Item13294: String quality issues, xgettext run
[03:14]
***GithubBot has left [03:14]
........................... (idle for 2h11mn)
ChanServ sets mode: +o CDot [05:25]
.......... (idle for 49mn)
ChanServ sets mode: +o MichaelDaum [06:14]
..................................................................... (idle for 5h40mn)
ChanServ sets mode: +o Lynnwood [11:54]
..... (idle for 21mn)
ChanServ sets mode: +o gac410 [12:15]
gac410Hi CDot ... just checking in if you saw my email. Gotta run in a few minutes. [12:15]
CDotjust replying. i have done a bit more analysis.
unfortunately you have to study .txt,v as well as ,v
[12:16]
gac410Ah. I ran it from ~/gac ...
perl -I ./perllib/lib/perl5/ checkencoding.pl /home/foswiki.org/public_html/data > encoding.out
[12:16]
CDotbut bottom line, we can use CharsetConverterContrib with a minimum of hand intervention
y, you missed that off your email :-(
[12:17]
gac410CharsetConverter or bulk_copy.
yeah ... sorry about that.
[12:17]
CDotsame issues with bulk copy
there are quite a few topics with stupid encodings
[12:18]
gac410Any ideas how they got written with unusual encodings? Or is it just bytes that got manually entered, and are detected as unusual. [12:19]
CDotwell, because we store everything as bytes, if someone pastes UTF-8 into a text editor, the UTF-8 bytes get stored as "text"
example: http://foswiki.org/Main/N01Z3LeftBar
[12:20]
gac410ah okay I assume the "windows" encoding is really iso-8859-1 and is an artifact of the detect routine [12:21]
CDotno, again, some people have copy-pasted cp-1252 into the text editor [12:21]
jastwindows is cp-1252 which is almost iso-8859-1 but not quite
it's more similar to iso-8859-15 IIRC
[12:21]
gac410ah. So a lot of topics that need fixup then. [12:22]
CDothttp://www.i18nqa.com/debug/table-iso8859-1-vs-windows-1252.html
if you are curious
[12:22]
gac410will copy-paste into editor now that we have a utf8 core avoid these strange encodings going forwared? [12:22]
CDotwell, interesting question. We *could* transform *assuming* the site encoding. these already-broken topics will simply remain broken, but in a different way.
or, we could tailor CharSetConvertor to detect alien encodings more smartlyier.
I was about to look at that,
ultimately I wouldn't release it; it would be a one-shot.
[12:23]
gac410y. Unfortunately as I was reading about Encode::Detect::Detector, it appears to be difficult to install in some cases. [12:24]
CDotI installed it with CPAN, no probs. [12:24]
gac410Encode::Guess didn't guess very well at all. [12:24]
CDotjust the ports version that was missing. I know gmc prefers that we use ports.
see /home/trunk.foswiki.org/core/tools/develop/detect_encoding.pl for my working script
some heuristics on top
[12:24]
gac410gac410 has been afraid to install modules using ports, not sure if it is going to pull in a new perl, and couldn't find a simulate option in the manpage [12:25]
CDotah
just as well it didn't work, then :-)
[12:26]
gac410Otherwise I would have installed Taint::Runtime [12:26]
jastports are essentially Makefiles IIRC, so simulating is kind of not really possible [12:26]
CDotanyways, what I suggest is some time when we are both here, we take f.w down, back it up, and run the charset convertor [12:26]
gac410No, foswiki.org is using "pkg" for the precompiled binary versions [12:26]
CDottake the opportunity to clean out the trash, too [12:26]
gac410yes indeedy. [12:27]
CDotI will customise the charset convertor based on my findings [12:27]
gac410okay. Maybe we should ship CharseetConverter with 1.2 [12:27]
CDotno. bulk_copy is the way to go
if people have shot themselves on their own sites, they can always download.
[12:28]
gac410Ah. So bulk_copy unless topics have strange one-off encodings that need fixup? [12:29]
CDotright. bulk_copy *exactly* what is there, not "what we think is there"
f.o is a special case, and exception.
[12:29]
gac410I'll have to run the check program on my prod sites just to see if there are issues. Highly unlikely I suspect. [12:31]
CDotsure [12:31]
gac410interesting / informative site http://www.i18nqa.com
Thanks ... see you later
[12:35]
***gac410 has left [12:36]
..................... (idle for 1h40mn)
GithubBot[CharsetConverterContrib] cdot pushed 1 new commit to master: http://git.io/vkXk5
CharsetConverterContrib/master 6b98521 Comment: Item13442: add repair option to support detection and repair to incompatible character encodings
[14:16]
***GithubBot has left [14:16]
CDotgac410: you can install and run the CharSetConverterContrib (with -i -r options) on f.o, that would help [14:17]
........................ (idle for 1h58mn)
***ChanServ sets mode: +o MichaelDaum [16:15]
............... (idle for 1h10mn)
ChanServ sets mode: +o gac410 [17:25]
gac410Hi CDot ... saw your message. If you want I'll do that tonight. (like after 0000 UTC.).
Run the Converter first with -i -r (I assume you've done that but I'll do too to check)
Then run it for real, change trunk {Store}{Encoding} to utf-8 and f.o {Site}{CharSet} to utf-8 as well.
and restart apache. That sound like a plan?
[17:31]
.... (idle for 19mn)
CDotgac410: plan. [17:52]
gac410Just stumbled across an issue :( [17:53]
CDotI have *not* run it -i -r [17:53]
gac410I thought the .changes file were writtten in the old tab format on f.o, but Tasks and Develpoment .changes files are a mixture of xml and old style
Okay. I'll run -i -r and if the results appear reasonable I'll proceed, otherwise I'll hold off a day.
[17:53]
.... (idle for 16mn)
GuilainChi all, question close to foswiki... I'm thinking to deploy piwik, for tracking foswiki topic, If i understand well, foswiki.org use it, Does it access is limited ? or it's able to have "read" access to the foswiki tracking website in order to take a look of what this plugin do ? [18:10]
gac410hi GuilainC ... I have to look, but I think we disabled it. [18:13]
GuilainCah... [18:14]
gac410yeah ... it's disabled. [18:14]
GuilainCdysfunction ?
deprecated plugin ?
[18:14]
gac410yeah. The one on foswiki.org was "hacked in" was not released as an extension. There is an extension too that MichaelDaum maintains iirc
But that was different from what f.o was using.
[18:15]
GuilainCah ok, so foswiki doesn't use the piwikplugin [18:15]
gac410No It was installed way before my time. I can't remember what went wrong that we disabled it. [18:16]
GuilainCthe best is to ask michaelDaum, the next time where he will be here
ok gac410, thanks for your support
[18:16]
gac410yw [18:16]
GuilainCGuilainC needs to go [off] [18:17]
gac410CDot ... convert_charset writes to the log? Tried to run -i on f.o under my own id, [18:23]
CDotnah
STDERR and STDOUT only
show me your command-line
[18:23]
gac410perl -I lib tools/convert_charset.pl -i
ERROR: Could not open logfile /usr/home/foswiki.org/public_html/working/logs/error.log for write. Your admin should 'configure' now and fix the errors!
[18:24]
CDotpffft... it uses the RCS store, it must be that [18:24]
gac410I manually copied tools/convert_charset.pl and lib/Foswiki/Contrib/CharsetConverterContrib.pm into f.o [18:25]
CDotthat should suffice
did you git pull first?
[18:25]
gac410yeah that's what I figured. I can run it as www, just wanted to check
I did a pseudo-install on trunk.foswiki.org, so it was a fresh pull.
[18:25]
CDotk [18:26]
gac410So I'm going to try: sudo -u www perl -I lib tools/convert_charset.pl -i
(sticks fingers in ears)
running now with -i -q Sure is noisy without the -q
One error so far ??? Exiting subroutine via next at lib/Foswiki/Contrib/CharsetConverterContrib.pm line 139.
Seems to have crashed
splice() offset past end of array at lib/Foswiki/Store/VC/RcsLiteHandler.pm line 598. (repeated 10 times) then
Modification of non-creatable array value attempted, subscript -429 at lib/Foswiki/Store/VC/RcsLiteHandler.pm line 598.
and ended
Should I run again without -the -q, and pipe stderr/stdout to a file? maybe get an idea of which rcs file had a problem?
[18:27]
CDothmmm
y, that next is a bug, but a non-fatal one.
I would guess the splice() bug is the result of a corrupt .txt,v
what file was it working on? Can you read the history on f.o?
[18:45]
gac410http://pastebin.com/S47ahu0L
Last few lines from the run ...
Strange. The topics on either side of the failure. Both only have 1 rev.
[18:48]
CDotno idea what file it was on, but it seems to have been working on the sandbox
hold on a tick, I'll just try something....
[18:49]
gac410Unless it's threaded, I'm assuming that the filname reported before or after the error are related. But converter claims "3 changes" neither of which have history [18:50]
CDotno, it isn't threaded
the errors are printed to STDERR, but the progress to STDOUT
just modding it to print all to STDERR
[18:51]
gac410I ran it with 1>&2 [18:51]
CDoty, 1>&2 will still get out of step
it depends when the flush() happens
anyway, try it again
I changed it to print all to STDERR, so we should get a better sense of the order
[18:52]
gac410hm git pull in CharsetConvertContrib claims up to date.
Did you push?
[18:54]
CDotno, I edited on f.o [18:54]
gac410Ah... Doh.. [18:55]
CDotyou said you copied the files manually [18:55]
gac410Yes. I did.
I was going to repeat the pull / copy ... never mind.
okay running
Okay new pastebin http://pastebin.com/yAaMXCNE
[18:55]
CDotSandbox/WikiGuest.ContactList looks like the guilty party
1.1.9 doesn't see before r355
so, corrupt history, I'd say
[18:58]
gac410Sandbox ... just remove the rcs file :P
?
actually the file after MeetingMinutesTemplate seems to be what ends the run.
[19:00]
CDotsomewhere at or around r186, that contactlist topic is borked [19:02]
gac410http://foswiki.org/Sandbox/WikiGuest/MyFeaturesWidget seems to be the next in order. Maybe need a print "Starting conversion on ..."
To know for sure.
[19:02]
CDotthere are many meetingMinutesTemplate.... which one?
why do these files have such deep histories? :-/
[19:03]
gac410I have no idea Sandbox, we really don't pay much attention to.
Converted history of Sandbox/WikiGuest.MeetingMinutesTemplate (1479 changes)
Converted .txt of Sandbox/WikiGuest.MeetingMinutesTemplate
Modification of non-creatable array value attempted, subscript -429 at lib/Foswiki/Store/VC/RcsLiteHandler.pm line 598.
[19:04]
CDotthe only change between revs is the version number :-( [19:05]
gac410So I found Sandbox/WikiGuest.MeetingMinutesTemplate in the directory, and then next file is MyFeaturesWidget [19:05]
CDoterm, is there a good reason not to just clean crap like that out of the Sandbox? [19:05]
gac410We really ought to clean out the sandbox web maybe as topics get older than a few weeks.
(Great minds :D)
[19:05]
CDotthese topics seem to be modified every 10 days or so [19:06]
gac410I don't know what's reasonable, but forever sure is not. [19:06]
CDotwtf is running that does that? [19:06]
gac410Someone using sandbox as a live wiki? [19:07]
CDotalways edited using WikiGuest [19:07]
gac410We don't allow guest editing I don't think. So wtf [19:07]
CDotis there anything in the event log?
-rw-r--r-- 1 www wwwadmin 636 May 25 09:11 MyFeaturesWidget.txt
oh wait a mo, I know what's doing it
gac410:
some twit is installing an ap that doesn't have !noci in the manifest
[19:08]
gac410lets go to #fooswiki-admin [19:09]
CDotk [19:10]
.................... (idle for 1h35mn)
GithubBot[distro] FoswikiBot pushed 36 new commits to master: http://git.io/vkMb3
distro/master 53b8a6c Lieven L. Litaer: Item13252: Translations updated using Weblate (German)...
distro/master 256a7c3 Lieven L. Litaer: Item13252: Translations updated using Weblate (French)...
distro/master ddc46bf Lieven L. Litaer: Item13252: Translations updated using Weblate (German)...
[20:45]
***GithubBot has left [20:45]

↑back Search ←Prev date Next date→ Show only urls(Click on time to select a line by its url)