Language:
switch to room list switch to menu My folders
Go to page: First ... 8 9 10 11 [12] 13 14 15 16 ... Last
[#] Sat Nov 07 2020 15:49:00 EST from platonov

Subject: Problem with incorrect displaying of Subject: header fixed

[Reply] [ReplyQuoted] [Headers] [Print]

Well, I've got it working on my box with Subject headers. But there are 2 more headers that need to be fixed as well.

I did it mostly on intuition and with very lil understanding of code. So...

Fri Nov 06 2020 09:16:14 EST from platonov @ Uncensored Subject: Re: Is there a problem of incorrect displaying of Subject: header?

Btw, I'd like to show you the diffs between 929 and 824 in serv_rssclient.c

It looks like it is pretty clear where this problem is, when/if you compare the 824 and 929 versions of serv_rssclient.c

It seems to me that the issue is missing the call to StrBufRFC2047encode().

Two lines, just before CM_SetAsFieldSB(), are missing in 929

serv_rssclient_824.c Lines 355 - 358

    StrBufTrim(Encoded);
StrBufRFC2047encode(&QPEncoded, Encoded);
CM_SetAsFieldSB(&SaveMsg->Msg, eMsgSubject, &QPEncoded);

Compare it to:
serv_rssclient_929.c (around line 202 CM_SetField()

Lines 200 - 204

else if (!strcasecmp(el, "title")) { // item subject (rss and atom)
if ((r->msg != NULL) && (CM_IsEmpty(r->msg, eMsgSubject))) {
CM_SetField(r->msg, eMsgSubject, ChrPtr(r->CData), StrLength(r->CData));
striplt(r->msg->cm_fields[eMsgSubject]);
}
}

I'll include the c sources in attachments here.

Fri Nov 06 2020 00:19:09 EST from IGnatius T Foobar @ Uncensored Subject: Re: Is there a problem of incorrect displaying of Subject: header?
The feed is: http://tass.ru/rss/v2.xml
You'll notice there are no Subject headers in vast majority of cases and

there are very few headers that begin with Latin words.

I have subscribed to this feed here at Uncensored in a hidden room called "tass.ru"

Can you please go to that room and tell me whether you are seeing the same problems here that you are on your own system, and if so, point them out?
Unfortunately I cannot read Russian.

 



 



serv_rssclient_929.c (text/x-csrc, 15729 bytes) [ View | Download ]
serv_rssclient_824.c (text/x-csrc, 30309 bytes) [ View | Download ]
[#] Sat Nov 07 2020 20:22:18 EST from warbaby

Subject: Re: https redirection

[Reply] [ReplyQuoted] [Headers] [Print]

The package versions have an init.d script which you can edit to specify the ports for webcit http and https. 

If this is the case, just edit the webcit script in init.d, and make sure it's not starting on port 80, by commenting out a few lines. 

Then, jump down to the nginx configuration (below).

Hopeful you have used easyinstall.  There are two services for webcit that easyinstall puts in /etc/systemd/system

webcit-http.service

and

webcit-https.service

you can mv or rm webcit-http.service out of there. Just run webcit-https

service start webcit-https

If you want to redirect your http traffic to https, install nginx with one simple vhost

(delete the default virtual host in /etc/nginx/site-enabled), and add a file in site-enabled like

my-citadel.com.conf (substitute your own domain).

### NON-SSL

  {
   listen 80;
   listen [::]:80;
   server_name my-citadel.com;
   return 301 https://my-citadel.com$request_uri;
   }

 

 

Sat Nov 07 2020 12:01:28 PM EST from Smashbot @ Uncensored Subject: https redirection

Please forgive me if I am missing something obvious. I  have looked through the docs and forums. I was able to get my citadel install to successfully serve up a certificate issued by Letsencrypt. 

Would someone please tell me how to make webcit redirect plaintext requests for port 80 over to 443 so it may use the https connection? 

Thanks in advance



 



[#] Sat Nov 07 2020 23:37:54 EST from Smashbot

Subject: Re: https redirection

[Reply] [ReplyQuoted] [Headers] [Print]

This solution worked perfectly. Thank you.

Sat Nov 07 2020 20:22:18 EST from warbaby @ Uncensored Subject: Re: https redirection

The package versions have an init.d script which you can edit to specify the ports for webcit http and https. 

If this is the case, just edit the webcit script in init.d, and make sure it's not starting on port 80, by commenting out a few lines. 

Then, jump down to the nginx configuration (below).

Hopeful you have used easyinstall.  There are two services for webcit that easyinstall puts in /etc/systemd/system

webcit-http.service

and

webcit-https.service

you can mv or rm webcit-http.service out of there. Just run webcit-https

service start webcit-https

If you want to redirect your http traffic to https, install nginx with one simple vhost

(delete the default virtual host in /etc/nginx/site-enabled), and add a file in site-enabled like

my-citadel.com.conf (substitute your own domain).

### NON-SSL

  {
   listen 80;
   listen [::]:80;
   server_name my-citadel.com;
   return 301 https://my-citadel.com$request_uri;
   }

 

 

Sat Nov 07 2020 12:01:28 PM EST from Smashbot @ Uncensored Subject: https redirection

Please forgive me if I am missing something obvious. I  have looked through the docs and forums. I was able to get my citadel install to successfully serve up a certificate issued by Letsencrypt. 

Would someone please tell me how to make webcit redirect plaintext requests for port 80 over to 443 so it may use the https connection? 

Thanks in advance



 



 



[#] Sun Nov 08 2020 17:06:35 EST from IGnatius T Foobar

Subject: Re: Problem with incorrect displaying of Subject: header fixed

[Reply] [ReplyQuoted] [Headers] [Print]

Interesting. I see that you are reporting that the problem is that the current version of the RSS reader does not RFC2047-encode the subject lines, I agree that it needs to do so, and I have confirmed that the code change belongs where you say it belongs ... but I can't get it to display improperly here.

What does your reading environment look like? Linux or Windows? Text client, web, or IMAP? Can you send a marked-up screenshot?

[#] Mon Nov 09 2020 08:08:10 EST from platonov

Subject: Re: Problem with incorrect displaying of Subject: header fixed

[Reply] [ReplyQuoted] [Headers] [Print]

 I'll comment in-line.

Sun Nov 08 2020 17:06:35 EST from IGnatius T Foobar @ Uncensored Subject: Re: Problem with incorrect displaying of Subject: header fixed
Interesting. I see that you are reporting that the problem is that the current version of the RSS reader does not RFC2047-encode the subject lines, I agree that it needs to do so, and I have confirmed that the code change belongs where you say it belongs ...

The current version of RSS reader does not handle the headers at all. Basically, that code has never been written or adopted from the earlier version. Current version of XML parser and related code is a major rewrite and the XML fields are simply stored into the SMTP headers without any processing or handling.

And the problem is not only the Subject: header. The worst part of the problem is with SMTP From: header, and proper processing/handling of that one is not as simple as one might think. There are several forms of From header. Furthermore, not all the characters or tokens are to be encoded and so on... So, I think you are probably the one who has the most expertise on that code.

but I can't get it to display improperly here.

Strange... May be you need to look at the sources of serv_rssclient.c for current version compared to 8.21. It is pretty obvious that this thing can not just magically work for you unless you have a pretty old version. I'll include both version as an attachment here. Just in case...

Btw, have you seen the fix I have sent to warbaby? I left some older code commented out just to make it easier to see the differences. It only handles the Subject: issue and From header handling has not been implemented. It would probably take you not so long to wire that code in.


What does your reading environment look like? Linux or Windows?

I am reading it via Webcit under Windows. Warbaby is also having the same problem.

Text client, web, or IMAP?

Actually, I am also using Thunderbird IMAP and everything looks correct.

Can you send a marked-up screenshot?

 Not sure what exactly do you want to see. May be warbaby would understand you better...

 



serv_rssclient_824.c (text/x-csrc, 30309 bytes) [ View | Download ]
serv_rssclient_929.c (text/x-csrc, 15729 bytes) [ View | Download ]
[#] Mon Nov 09 2020 09:05:43 EST from platonov

Subject: Re: Problem with incorrect displaying of Subject: header fixed

[Reply] [ReplyQuoted] [Headers] [Print]

Well, there was a mail delivery problem with my message to warbaby that included the fix source code. So, I'll repost the attachment here to make sure you see the fix and/or try it for yourself and do a code review. I am not sure if there is some kind of problem with this post, in which case you can just remove it. I just want to make sure we're making progress on this and get the fix into the source tree.

[See serv_rssclient.c with fix in attachment]

Sun Nov 08 2020 17:06:35 EST from IGnatius T Foobar @ Uncensored Subject: Re: Problem with incorrect displaying of Subject: header fixed

Interesting. I see that you are reporting that the problem is that the current version of the RSS reader does not RFC2047-encode the subject lines, I agree that it needs to do so, and I have confirmed that the code change belongs where you say it belongs ... but I can't get it to display improperly here.

What does your reading environment look like? Linux or Windows? Text client, web, or IMAP? Can you send a marked-up screenshot?

 



serv_rssclient_fixed_01.c (text/x-csrc, 16334 bytes) [ View | Download ]
[#] Mon Nov 09 2020 09:54:19 EST from IGnatius T Foobar

Subject: Re: Problem with incorrect displaying of Subject: header fixed

[Reply] [ReplyQuoted] [Headers] [Print]

Sure thing. I understand the problem but I want to make sure I'm getting the fix correct. I have code up in the editor but if yours works I'll review that and use it instead.

You're correct in observing that serv_rssclient.c is a substantial rewrite.
A few years ago we made a decision to simplify all of the pollers by letting libcurl do all the work. This allowed us to remove thousands of lines of code and two external dependencies. RFC2047-encoding of header fields is definitely something that was overlooked, so I'm glad you have brought it to our attention.

[#] Mon Nov 09 2020 12:08:14 EST from platonov

Subject: Re: Problem with incorrect displaying of Subject: header fixed

[Reply] [ReplyQuoted] [Headers] [Print]

Mon Nov 09 2020 09:54:19 EST from IGnatius T Foobar @ Uncensored Subject: Re: Problem with incorrect displaying of Subject: header fixed
Sure thing. I understand the problem but I want to make sure I'm getting the fix correct. I have code up in the editor but if yours works I'll review that and use it instead.

You're correct in observing that serv_rssclient.c is a substantial rewrite.
A few years ago we made a decision to simplify all of the pollers by letting libcurl do all the work. This allowed us to remove thousands of lines of code and two external dependencies. RFC2047-encoding of header fields is definitely something that was overlooked, so I'm glad you have brought it to our attention.

Great to hear that. But I forgot to mention in my last post that this problem did not exist in textclient and the Subject headers looked good on it. After I wrote my msg I tried to run textclient again just to verify things.

And boom! Now all the rss messages that were received after I installed my fix no longer have Subject displayed correctly. But old messages, before the fix, looked good.

Not sure if textclient has been upgraded since this major rewrite related to libcurl.

As far as textclient issue goes, even before this fix you could not write a message in non-ASCII. If you switch the keyboard language and then start typing, it is all displayed in ASCII. So...

 

 



[#] Tue Nov 10 2020 13:34:30 EST from userT

Subject: Webct-ng and CalDAV

[Reply] [ReplyQuoted] [Headers] [Print]

Excuse me, by chance any news about Webcit-ng and CalDAV?

There are several things broken in current Webcit. Prominently, for instance, the Calendar room.
The day view always graphically displays the hour ranges wrongly.
The "Check attendee availability" button only adds a certain amount of hours to the starting hour of the event, even if user is actually free.

Also, either I don't know how to use it, or the "Chat" room has never been functional
(testing in my local Citadel installation using latest version).



[#] Wed Nov 11 2020 12:13:10 EST from platonov

Subject: Re: Problem with incorrect displaying of Subject: header fixed

[Reply] [ReplyQuoted] [Headers] [Print]

Well, this is not about the Subject header directly, but it deals with the same source file, and once we are at it, why not clean up some other things we can...

There is one not very pleasant issue with rssclient requiring a single source line change, that I'd like to ask to take care of.

The issue is: when rssclient is having a problem with some feed, it logs the message, saying:

  • "rssclient: failed to load feed: ..."

But it does not tell you WHAT is the feed's URI and which room is it in, which is a shame - to have an error that you can not take care of simply because you don't have ANY information on where and what it is.

Good logging practice is to precisely and sufficiently completely identify the key information. Simply saying: "rssclient: failed to load feed" is pretty meaningless and is a cause of unnecessary waste of time and energy.

So, I would really appreciate if we make this single source line change:

File serv_rssclient.c, Line 406:

    if (res != CURLE_OK) {
        syslog(LOG_WARNING, "rssclient: failed to load feed: %s, room %s, %s",
            url->url, url->rooms->room, curl_easy_strerror(res));
    }

Mon Nov 09 2020 09:54:19 EST from IGnatius T Foobar @ Uncensored Subject: Re: Problem with incorrect displaying of Subject: header fixed
Sure thing. I understand the problem but I want to make sure I'm getting the fix correct. I have code up in the editor but if yours works I'll review that and use it instead.

You're correct in observing that serv_rssclient.c is a substantial rewrite.
A few years ago we made a decision to simplify all of the pollers by letting libcurl do all the work. This allowed us to remove thousands of lines of code and two external dependencies. RFC2047-encoding of header fields is definitely something that was overlooked, so I'm glad you have brought it to our attention.

 



[#] Wed Nov 11 2020 21:56:18 EST from ParanoidDelusions

[Reply] [ReplyQuoted] [Headers] [Print]

Is there documentation on how to set up an RSS feed as a Room on Citadel? 




[#] Wed Nov 11 2020 22:37:11 EST from Smashbot

Subject: inetd/xinetd

[Reply] [ReplyQuoted] [Headers] [Print]

I read the FAQ to redirect incoming telnet connections to the citadel client,  but my Debian 10 stretch didnt come with inetd or xinet d and I cant figure out

what to do with 

telnet stream tcp4 nowait root /usr/sbin/tcpd /usr/sbin/in.telnetd -h -L /usr/local/citadel/citadel


[#] Wed Nov 11 2020 22:54:54 EST from Smashbot

Subject: Re: inetd/xinetd

[Reply] [ReplyQuoted] [Headers] [Print]

 

Wed Nov 11 2020 22:37:11 EST from Smashbot @ Uncensored Subject: inetd/xinetd

I read the FAQ to redirect incoming telnet connections to the citadel client,  but my Debian 10 stretch didnt come with inetd or xinet d and I cant figure out

what to do with 

telnet stream tcp4 nowait root /usr/sbin/tcpd /usr/sbin/in.telne td -h -L /usr/local/citadel/citadel

and if I paid any attention to what I typed I would have corrected stretch and typed buster instead  :-F

 



[#] Thu Nov 12 2020 12:13:09 EST from Smashbot

Subject: Re: inetd/xinetd

[Reply] [ReplyQuoted] [Headers] [Print]

I figured it out. Somehow I apt'ed both inetd and xinetd and it missed tcpd and at the end of the day I had to modify some of the syntax in inetd.conf to work. Now I just have to figure out how to do some extensive logging on the incoming connections because of the tremendous amount of scans and scripted attacks that happen on every subnet of the hosting provider I am using. :/

[#] Thu Nov 12 2020 14:54:47 EST from omatnet

Subject: In Webcit 929 (latest?) Email aliases section under user contact infor

[Reply] [ReplyQuoted] [Headers] [Print]

Hi,

Using WebCit 926, Citadel 929 (Ubuntu 20.04) "Email aliases" section under user contact information is missing! I noticed that on WebCit 925 (on this support server) the email aliases are still showing as before under "Update your contact information".

I set up a fresh install of Citadel 929 on Ubuntu 20.04 to with the intention to copy manually all settings from an older server installation. But the “Internet e-mail aliases” section at the bottom of “Update your contact information” window – is completely missing. We use many email aliases an cannot operate without them.

Any suggestions?

Alternatively, is there a way to install a pervious version of WebCit, like 925? (I tried to download the source code from the Citadel website, but download doesn't complete).

Thanks!



[#] Thu Nov 12 2020 15:01:22 EST from omatnet

Subject: Both methods of migration attempts crash within seconds

[Reply] [ReplyQuoted] [Headers] [Print]

Hi,

I'm trying to migrate our Citadel 8.15 on Ubuntu 12.04 LTS to Citadel 929 on Ubuntu 20.04 however both methods of migration attempts crash within seconds (FYI - I was able to migrate using both methods on other servers).

Explanation: I tried to migrate all data and settings, first using data export/import (sendcommand "ARTV export" > exported.dat) and then using ctdlmigrate (which I used successfully on other servers). In both cases the process crashes within seconds. I can add that 10 days ago I deleted over 130,000 spam messages that were received in the last years but were never actually deleted, and since then action the nightly auto-purge process crashes the citadel server every night, requiring me to restart the Citadel server every morning.

Is there a way to fix the purge process or repair any corrupted files to avoid crashing during a migration attempt? 

If not, is there any other way to migrate the Citadel server, data and settings?

 
Thank you so much for any ideas!


[#] Thu Nov 12 2020 16:07:25 EST from warbaby

Subject: Re: Both methods of migration attempts crash within seconds

[Reply] [ReplyQuoted] [Headers] [Print]

We just had a migration thread like this.. and you can probably save lots of time/trouble using the slacker method.  [one guy used it successfully to migrate a 50gb mail db]

Setup a client logged into both systems.. [with perhaps Thunderbird]

give your users instructions and opportunity to drag their messages between accounts into the matching folder on their new .

rooms/llists can be migrated very easily like this.  Just make sure you have a matching room on the new system, drag the messages over imap, drop them in the new folder.

That's about it really.  Line up two webcit windows, check all your system settings before you deep six the old server.

I've done it many times.  It's a good chance to sort, prune and cleanup as you go.

Works perfectly as long as you don't lose network, or power during the process.

There are some thunderbird extensions like "remove duplicate messages" which can help also.

The final step is to cut the DNS.

If you plan ahead, you can probably do this by just updating the single "mail" (mail server) A record.

 

 

Thu Nov 12 2020 03:01:22 PM EST from omatnet @ Uncensored Subject: Both methods of migration attempts crash within seconds

Hi,

I'm trying to migrate our Citadel 8.15 on Ubuntu 12.04 LTS to Citadel 929 on Ubuntu 20.04 however both methods of migration attempts crash within seconds (FYI - I was able to migrate using both methods on other servers).

Explanation: I tried to migrate all data and settings, first using data export/import (sendcommand "ARTV export" > exported.dat) and then using ctdlmigrate (which I used successfully on other servers). In both cases the process crashes within seconds. I can add that 10 days ago I deleted over 130,000 spam messages that were received in the last years but were never actually deleted, and since then action the nightly auto-purge process crashes the citadel server every night, requiring me to restart the Citadel server every morning.

Is there a way to fix the purge process or repair any corrupted files to avoid crashing during a migration attempt? 

If not, is there any other way to migrate the Citadel server, data and settings?

 
Thank you so much for any ideas!


 



[#] Thu Nov 12 2020 16:12:23 EST from warbaby

Subject: RSS Feeds in Rooms

[Reply] [ReplyQuoted] [Headers] [Print]

Create the room first. Then Advanced, Edit, and Remote Retrieval.

https://www.citadel.org/rss_aggregation.html

 

Wed Nov 11 2020 09:56:18 PM EST from ParanoidDelusions @ Uncensored

Is there documentation on how to set up an RSS feed as a Room on Citadel? 




 



[#] Thu Nov 12 2020 17:00:08 EST from ParanoidDelusions

Subject: Re: RSS Feeds in Rooms

[Reply] [ReplyQuoted] [Headers] [Print]

 

Thu Nov 12 2020 16:12:23 EST from warbaby @ Uncensored Subject: RSS Feeds in Rooms

Create the room first. Then Advanced, Edit, and Remote Retrieval.

https://www.citadel.org/rss_aggregation.html

 

 

That is way easier than I expected. :) 

 



[#] Thu Nov 12 2020 17:38:03 EST from platonov

Subject: Re: Both methods of migration attempts crash within seconds

[Reply] [ReplyQuoted] [Headers] [Print]

Well, migration might work if you do all the steps exactly. Try these steps:

(just make sure you do a backup of your citadel/data dir)

To export/import all Citadel databases do (this was done under Ubuntu 20.04):

 

  • sudo /usr/local/citadel/sendcommand "MIGR export" > ~/citadel/cit929_exported_2020_11_10_01.xml
  • sudo service citadel stop
  • su -
  • rm /usr/local/citadel/data/*
  • cd /usr/local/citadel
  • sudo service citadel start
  • ./setup
  • sudo /usr/local/citadel/sendcommand "MIGR import" < ~/citadel/cit929_exported_2020_11_10_01.xml
  • sudo service citadel restart

What is to keep in mind is that you don't do "migr import" to the citadel databases that still exist (meaning citadel/data/* are not removed). There are several reasons why you want to do the import to the virgin citadel databases.

Basically, with "MIGR import" you are rebuilding everything and in order to avoid any kinds of conflicts with the old data and possibly network activity, like RSS feeds or mail runs, causing database updates you do migr import on a virgin system.

This has been done several times and the last one was on Nov 10, 2020.

Hope it works for you.

Thu Nov 12 2020 16:07:25 EST from warbaby @ Uncensored Subject: Re: Both methods of migration attempts crash within seconds

We just had a migration thread like this.. and you can probably save lots of time/trouble using the slacker method.  [one guy used it successfully to migrate a 50gb mail db]

Setup a client logged into both systems.. [with perhaps Thunderbird]

give your users instructions and opportunity to drag their messages between accounts into the matching folder on their new .

rooms/llists can be migrated very easily like this.  Just make sure you have a matching room on the new system, drag the messages over imap, drop them in the new folder.

That's about it really.  Line up two webcit windows, check all your system settings before you deep six the old server.

I've done it many times.  It's a good chance to sort, prune and cleanup as you go.

Works perfectly as long as you don't lose network, or power during the process.

There are some thunderbird extensions like "remove duplicate messages" which can help also.

The final step is to cut the DNS.

If you plan ahead, you can probably do this by just updating the single "mail" (mail server) A record.

 

 

Thu Nov 12 2020 03:01:22 PM EST from omatnet @ Uncensored Subject: Both methods of migration attempts crash within seconds

Hi,

I'm trying to migrate our Citadel 8.15 on Ubuntu 12.04 LTS to Citadel 929 on Ubuntu 20.04 however both methods of migration attempts crash within seconds (FYI - I was able to migrate using both methods on other servers).

Explanation: I tried to migrate all data and settings, first using data export/import (sendcommand "ARTV export" > exported.dat) and then using ctdlmigrate (which I used successfully on other servers). In both cases the process crashes within seconds. I can add that 10 days ago I deleted over 130,000 spam messages that were received in the last years but were never actually deleted, and since then action the nightly auto-purge process crashes the citadel server every night, requiring me to restart the Citadel server every morning.

Is there a way to fix the purge process or repair any corrupted files to avoid crashing during a migration attempt? 

If not, is there any other way to migrate the Citadel server, data and settings?

 
Thank you so much for any ideas!


 



 



Go to page: First ... 8 9 10 11 [12] 13 14 15 16 ... Last