#foswiki 2016-10-20,Thu

↑back Search ←Prev date Next date→ Show only urls(Click on time to select a line by its url)

WhoWhatWhen
***ChanServ sets mode: +o Lynnwood [00:32]
....................... (idle for 1h50mn)
vrurggac410: I'm back here for just a minute to say that haven't got time to look into the problem. If nothing else happens then would try tomorrow.
vrurg is gone. cu!
[02:22]
gac410no prob vrurg ... I'm still confused as to whether the problem is in how the unit test creates a new App, Maybe a little of both. Can't fix one without the other. I've got other stuff to do anyway. [02:25]
.......................... (idle for 2h6mn)
***gac410 has left [04:31]
.................... (idle for 1h38mn)
ChanServ sets mode: +o CDot [06:09]
.................................. (idle for 2h49mn)
FoswikiOnSlack1<rewati.sharan> Hello [08:58]
stefan_slighthello all :-) what is the best way to copy content from my development system to my live (intranet) system? - at both locations i have a readily running fosswiki install (both same version) i only want to copy the content (webs and topics i have generated in the dev system). [08:59]
..... (idle for 21mn)
uebera||stefan_slight: If all the settings are the same and you don't need to merge contents (i.e., source web.topic and destination web.topic), you can just copy the pub/ data/ subdirectories for your webs. But have a look at http://foswiki.org/System/UpgradeGuide as well... [09:20]
............... (idle for 1h12mn)
stefan_slightuebera||: ok thanks - the settings are not the same (other installation path - also in the life version we will using ldap - on my developmentsystem i have local foswiki users)
i will look into the directory structure some more to get a better understanding..
[10:32]
................... (idle for 1h33mn)
i have a question regarding skin development -
is it possible to 'attach' the css to a Skin Topic without uploading it to the site but directly via filesystem? (i have full access to the system - its a development setup)
[12:06]
........ (idle for 35mn)
***ChanServ sets mode: +o Lynnwood [12:42]
....... (idle for 30mn)
ChanServ sets mode: +o gac410 [13:12]
ChanServ sets mode: +o CDot [13:21]
uebera||stefan_slight: You could use curl, see https://foswiki.org/System/CommandAndCGIScripts#A_61upload_61 [13:23]
gac410stefan_slight: If you don't want the css to appear as real attachments, you can indeed just copy them into the file system.
They won't show up when you view a topic attachments, but they will still be fetchable via the pub URLs
If you really want to "attach" them then look at the UpdateAttachmentsPlugin ... that's another solution.
[13:27]
.... (idle for 15mn)
vrurggac410: Good morning! Briefly investigated your commit. Looks pretty much ok. I guess better support for POST on the test engine side is needed. [13:43]
gac410vurug, found a bug. Running TestCases/TestCaseAmISane ... 2nd Attach/Upload step should attach "volcano-2" file as rev-2 of volcano-1. It does not. It uploads a new attachment. Might be my template fixes. not sure.
vrurg: the problem is that the POSTDATA seems to be ignored by jsonrpc. Actually it appears like the path is parsed with the wrong request class.
(still investigating the upload issue. ... might be my bug. :( )
[13:43]
vrurgI have changed a lot to uploads too. It is very likely that the revisioning is broken. [13:46]
gac410yeah, works fine on master. I'll add it to the todo list. Cannot update existing attachment with a different filename. ... it creates a new attachment. [13:50]
vrurgThanks! [13:53]
gac410The TestCases web is a pretty handy set of tests. various corner cases, visual rendering tests, etc. [13:54]
stefan_slightgac410: ok - thats fine for the development time..
with one of my last actions i brocken my dev foswiki install: it chrashes with AH01215: Malformed UTF-8 character (fatal) at /usr/share/perl/5.22/Carp.pm line 323.: /home/stefan/xxx/foswiki/bin/view
i played with the ldap login system but don't remember what my last task was.. i think i tried to save a topic that used the LdapNgPlugin..
[13:55]
gac410stefan_slight: Some topic now has a high-ascii character instead of a utf-8 encoded character. If it is crashing on all topics, it may be one that is included everywhere.
Unfortunately it can be hard to find. Simplest if it's just one toipic that crashes. Check it with the command line tool "isutf8" and/or use the Perl command perl -nlE 'say if /\P{Ascii}/' < /path/to/file/to/check
[14:01]
stefan_slightyeah its crashing everywere [14:03]
gac410It could also be your user topic. [14:03]
stefan_slighthm but i don't changed the usertopic in the last two days..
i try to remember which topic i changed...
can this be caused by a parameter made in the config interface?
[14:04]
gac410Unfortunately this can be a bit of a "fishing expedition" I don't think you can trigger this with configure. hm... we did find a bug just recently if you are using email validation or approvals of new user registration.
The cUID. (The user identity in the META information) might use the high ascii encoded version of certain characters - u with umlat, etc.
But again, that would be just a single topic usually
Item14199 has an example of what failed for us on foswiki.org.
[14:06]
FoswikiBothttps://foswiki.org/Tasks/Item14199 [ Item14199: Registration confirmation process corrupts utf-8 wiki names. ] [14:08]
gac410It should generally be very difficult to cause this type of issue. Editing with the Wiki should not be able to insert bad data like this. It's usually some external process, installing a new plugin, manually edited topics, copying in new topic files, etc.
CDot ... we really need some better way to debug these situations. It took a lot of digging when f.o got whacked the other day by the bad registratino.
[14:11]
stefan_slighthm - i have experimented with symlinks in the data directory...
(to symlink my skin development folder..)
i will try and delete this link..
[14:14]
gac410Symlinks shoulid not cause issues, unless you symlinked a web / skin topic that has non-utf-8 encoding. [14:15]
CDotgac410: you have to exercise to get fit. Unit tests are gym work for specific muscle groups, but still need to run a lot for general fitness. [14:16]
gac410huh.... This isn't unit testing, it's better error traceback on a live site. [14:16]
CDotsadly in perl, error spotting and traceback costs cycles - sometimes many cycles :-( [14:17]
stefan_slighti symlinked a folder that only contained some css files... but i did not specify them at any location jet - so they should not be loaded anywehre [14:17]
CDotcan enable the may FW debug features on a live site, but at a cost.
^may^many
[14:18]
gac410If store could somehow just stash the name of the file it's about to read. so if it crashes, there could be some hint somewhere.
The "Malformed UTF-8" crash is just about impossible to debug.
[14:18]
CDotw.r.t UTF-8 - you may remember my many, plaintive, rather pathetic calls for help testing.
Yes, I agree. Perl if *horrible* for UTF8.
you could certainly add a debug feature that did that. Would be rather costly, and no guarantee it would work, but you could do it.
[14:19]
gac410This is probably not a bug. Some topic / file somewhere in stefan_slight's installation has gotten a high ascii character in it, and he's down for the count. [14:20]
stefan_slightthe last two things i have done was to save the config and two save a Topic. think it was in this order - but didnt wait untill the config was saved - at the topic save i got the crash back. the topic used the LdapNgPlugin [14:20]
CDotstefan_slight: did you convert from an ISO-9959-1* encoding?
^9959^8859
[14:21]
stefan_slighti think the same way^^ somehow i got a bad character stored.. [14:21]
gac410stefan_slight: are you migrating data from another older foswiki/twiki? or is this a new Foswiki 2.x installation [14:21]
stefan_slightCDot: no - i have started with this dev setup same days ago - no migration - only new entered data..
same -> some
[14:22]
CDotif you have used UTF-8 from day one, it is unlikely to be user error. Unless you have modified topics/attachments outside of Foswiki - for example, using a text editor or script? [14:23]
gac410What was the name of the topic you saved. Was it just a plain old topic, or was it an important topic. (A WebLeftBar, WebPreferences, SitePrefereces, or some topic that is used everywhere.
stefan_slight: for your configure save. Note that when you save the config, the last good LocalSite.cfg is saved to backup file. LocalSite.cfg.<number>
[14:23]
stefan_slightplain old topic - name is LdapTests
the current LocalSite.cfg ist the one without number?
[14:24]
gac410So if highest number was LocalSite.cfg.23, copy that to LocalSite.cfg to revert the last save.
Yes.
[14:25]
stefan_slightok
i try this
[14:25]
gac410(save LocalSite.cfg first!
So you can compare them later.
"diff LocalSite.cfg LocalSite.cfg.34" would show you the latest changes.
[14:25]
stefan_slightok [14:27]
gac410(or whatever number was the latest) [14:27]
stefan_slightthat did it -
have made a diff before i copied offer..
over..
[14:27]
gac410Excellent. hm So, If the change was activating LDAP, maybe there was some non-utf8 data in the LDAP directory. I don't use LDAP so I'm not all that knowledgable [14:28]
stefan_slighti try and make the changes one after one to see when it will chrash..
could be..
the 3 changes i have in the diff are:
$Foswiki::cfg{UserMappingManager} = 'Foswiki::Users::TopicUserMapping'; --> 'Foswiki::Users::LdapUserMapping';
$Foswiki::cfg{LoginManager} = 'Foswiki::LoginManager::TemplateLogin'; --> 'Foswiki::LoginManager::LdapTemplateLogin';
[14:28]
FoswikiBothttps://trunk.foswiki.org/System/PerlDoc?module=Foswiki::Users::TopicUserMapping https://trunk.foswiki.org/System/PerlDoc?module=Foswiki::Users::LdapUserMapping
https://trunk.foswiki.org/System/PerlDoc?module=Foswiki::LoginManager::TemplateLogin https://trunk.foswiki.org/System/PerlDoc?module=Foswiki::LoginManager::LdapTemplateLogin
[14:30]
stefan_slightand [14:30]
FoswikiBotand is it accessible on the internet? Could I browse to your default page (where the links don't work) [14:30]
stefan_slight$Foswiki::cfg{Ldap}{Exclude} = 'WikiGuest, ProjectContributor, RegistrationAgent, UnknownUser, AdminGroup, NobodyGroup, AdminUser, admin, guest';
there i added my own user..
$Foswiki::cfg{Ldap}{Exclude} = 'StefanK, WikiGuest, ProjectContributor, RegistrationAgent, UnknownUser, AdminGroup, NobodyGroup, AdminUser, admin, guest';
[14:30]
gac410stefan_slight: ignore the Foswikibot [14:30]
stefan_slight;-) [14:31]
gac410FoswikiBot: forget and [14:31]
FoswikiBotgac410: I forgot about and. [14:31]
stefan_slighthe is funny - what had trigger him? [14:31]
gac410You can teach it to respond to 'single word" posts. ...sometimes by accident [14:31]
stefan_slightah ok ;-) [14:32]
gac410stefan_slight: unfortunately I really don't know much about LDAP. When you enable the mapper, it tries to load / cache the users in LDAP. My guess is that there is some data in your LDAP db that Foswiki can't handle
Our LDAP expert is away traveling. (MichaelDaum). jast ... have you run into anything like this?
CDot to address your concerns about "Storable" in pending registrations ... I've written a %PENDINGREGISTRATION% macro which dumps them in a | table | form |
Still polishing it a bit. But also for "Approval" added an Approve link. So you can look back over and approve without deailing with email
[14:33]
stefan_slightgac410: ok no problem - this is heavily possible.. in the LDAP are more Names with special characters than without... [14:36]
CDotnice! A useful admin tool [14:36]
gac410It violates our "new features" rules, but I'll probably add it to 2.1.3 ... since the but fix makes approval files non-human-readable.
I suppose I really need to light a fire and get 2.1.3 released. It's got some important fixes in it.
[14:37]
stefan_slightgac410: found it! as you sayed.. if i enable the LDAP UserMapping it chrashes..
so it seems that the Mapper cant handle the encoding that is returned by/in the LDAP data...
[14:42]
gac410Sure looks that way. I've never dealt with that issue before. Maybe one of the otehr LDAP users might know.
ping jast ... are you around?
[14:44]
***gac410 sets mode: +v WikiRingBot [14:46]
stefan_slightgac410: should i report this 'finding' somewhere? [14:51]
gac410See Item13653 - looks like it's already reported [14:52]
FoswikiBothttps://foswiki.org/Tasks/Item13653 [ Item13653: With Foswiki 2, LdapContrib chokes on non-Latin-1 data; some encoding bugs with Foswiki 1 ] [14:52]
jastgac410: regarding that item, I've had that patch in production use for a while and it seems to work fine, but it's somewhat inefficient and ugly
also @stefan_slight :)
[14:54]
gac410Trying now to see if it's actually in the released version. [14:55]
jastI don't think it is [14:55]
gac410:(
inefficient and ugly is still better than crash&burn
[14:55]
jastone of the downsides of using tie for accessing the data... if conversions need to happen, they'll get ugly
more relevantly, as I recall, DB_File doesn't properly support Unicode
[14:56]
gac410jast, MichaelDaum uploaded LDapContrib on 02 Sept 2016 ... Did he revert your patch? [14:58]
stefan_slightjast: i can try this patch later -
now i have to get something to eat.... ;-)
will be back later..
gac410: thanks for your help!
[14:58]
jastthis patch has never been in the master branch [14:59]
gac410Ah...
Is your patch always needed or could it just be that stefan_slight has the wrong encoding set for his LDAP database configuratino.
[14:59]
jastvirtually all LDAP setups I see use UTF-8 for their charset, which is the default in LdapContrib
and that also happens to be the case which is buggy
it works for UTF-8 characters whose code points happen to match the Latin-1 (ISO-8859-1) code points, and breaks for all other characters
[15:01]
gac410Ah... hm okay.
wonderful.
[15:01]
jastso, äöüß is fine, αβγ breaks [15:02]
gac410(I assume you mean the released LDAP, not your patch?) [15:02]
jastyes... at least from what I recall, it's been a while [15:02]
gac410Thanks jast. Once MichaelDaum comes back we'll have to ping him on this fix. Not good that a site goes down hard when enabling the LDAP mapper, :( [15:05]
stefan_slighti don't know what the LDAP encoding is... (i have no full access to this) with the LdapNgPlugin i got some false characters in a TestTopic shown - like Krüger
so there seems to be something not working/setup correctly...
(it should be Krüger)
[15:05]
jastif your LDAP is Windows/Active Directory, for instance, it's almost certainly UTF-8
(I've never come across an AD setup that used something different)
[15:05]
gac410Is the Krüger coming from a LDAP macro? Or is it in the topic text somehow? [15:06]
jastthough with the bug I had, I *think* there was no crash, just mangled output [15:06]
stefan_slighthm its an Univention Corporate Server - i don't know what they use - i think they will use UTF-8 [15:06]
jastUCS aims to be compatible with AD
so, in all likelihood, yes
[15:06]
stefan_slightgac410: correct its the %LDAP{....}% macro.. i used it to test if my connection works and if i get the correct fieldnames.. [15:07]
gac410Okay, I think that's supplied by the LdapNGPlugin [15:08]
stefan_slightgac410: yea - i copied it from the LdapNgPlugin examples... [15:08]
jastwhat I think I found when I debugged this (read the DB_File C source and such) was this: DB_File ignores the Unicode flag on strings when writing, so that the contents of cache.db are always UTF-8 (in Foswiki 2). when reading back in, the data is assumed to be bytes, i.e. you have UTF-8 in a byte string. if you mix that with Unicode data, it gets "upgraded" to Unicode, and for that purpose Perl assumes that the byte string contains Latin-1 encoded data. as a resul
I'm not entirely sure at this point that your issue is only the issue from Item 13653
unfortunately I have to leave now... good luck getting this fixed, I'll probably be around tomorrow
[15:09]
stefan_slightjast: our ldap setup is not working at the moment so the crash can have to doe with some other things too...
ok thanks for your help!
i will let you know what i find / if i find something..
[15:11]
gac410thanks jast [15:11]
jastbtw, German umlauts are not affected by the bug in 13653, so that's another pointer you've got a different issue
though I'm not completely sure about that. I don't fully remember the extent of what issues I was addressing with my patch...
[15:12]
gac410btw jast, for your copious free time -- Item14200 needs some feedback :D [15:13]
FoswikiBothttps://foswiki.org/Tasks/Item14200 [ Item14200: Potentially thread unsafe code in LdapContrib::refreshCache ] [15:13]
jastyeah, I'm aware that the locking in LdapContrib is... not perfect [15:14]
........................................................................ (idle for 5h59mn)
gac410gac410 has a question regarding User Registration. ... It seems to be split between core and TopicUserMappingContrib.
Are pieces of registration useful in a non-TopicUserMapping configuration? Especially Approvals and Confirmations?
The registration templates and code are part of core. But the topics - UserRegistration* and Bulk* are all part of the contrib. very confusing.
gac410 is adding a PENDINGREGISTRATIONS macro and report, that will report on the registrations awaiting email confirmation or approval. And is utterly confused about what should go where.
[21:13]
................................. (idle for 2h42mn)
IronFleahow can I force a user to re-authenticate every time they try to change a topic? [23:59]

↑back Search ←Prev date Next date→ Show only urls(Click on time to select a line by its url)