Language:
switch to room list switch to menu My folders
Go to page: First ... 4 5 6 7 [8] 9 10 11 12 ... Last
[#] Sun Feb 19 2017 09:25:51 EST from bennabiy @ Uncensored

Subject: Re: BugHunt

[Reply] [ReplyQuoted] [Headers] [Print]

Here is a pastebin of the latest crash ( I had to kill it to get it back to gdb)

This is the result of thread apply all bt

http://pastebin.com/r3C83Zpc

and the result of thread apply all bt full

in 2 parts

http://pastebin.com/F07caWbc

and

 http://pastebin.com/mHjRQgY0

Sun Feb 19 2017 08:39:38 AM EST from bennabiy @ Uncensored Subject: Re: BugHunt

Ok, so it is hung, but it has not crashed gdb yet. It is not responding and giving in my mail client an SSL/TLS handshake error.

It does not respond to nc localhost 504.

It is officially hung.

Fri Feb 17 2017 03:38:53 PM EST from IGnatius T Foobar @ Uncensored Subject: Re: BugHunt
I figured as much that it seemed odd that it was crashing so quickly in
the
debugger, and I noticed it referenced a source library which didn't exist.


Ok sorry about that, should have told you sooner.

Let me know when you've got a core dump from a "real" server hang, and we'll work our way through it.

 



 



[#] Tue Feb 21 2017 19:29:37 EST from IGnatius T Foobar @ Uncensored

Subject: Re: BugHunt

[Reply] [ReplyQuoted] [Headers] [Print]

Ok, it's pretty clear what's happening, so now we just have to figure out why.

You've got hundreds of threads (which is a lot) all hung up on SSL reads.
428 of them are SMTPS and 46 of them are IMAPS.

Curiously, they're all hung up in the "greeting" banner for each protocol, which means they're not even clients that have been running for a while. When your server's been running for a while (or when it's hung) can you please do a "netatat -anp | grep citserver" so we can see what's on the other end of these connections?

Is there anything that could be making connections to ports 993 and 465, and closing the connection before speaking to Citadel? Maybe a monitoring system?

[#] Tue Feb 21 2017 22:56:33 EST from bennabiy @ Uncensored

Subject: Re: BugHunt

[Reply] [ReplyQuoted] [Headers] [Print]

One of my clients had this message (probably from outlook, but the closest thing I have seen to a valid error short of SSL/TLS handshake error yet.

I will try that when it hangs again. The only things what would be polling are email clients. I noticed that Outlook 2013 is a bear to setup with citadel (at least using non standard ports and ssl).

 

I do have a script which logs in each user each hour to correct vcard issues, but that succeeds each time.

 

I do have certain users which end up with about 50 email address entries in their vcard where every other one is fine... I wonder...

Tue Feb 21 2017 07:29:37 PM EST from IGnatius T Foobar @ Uncensored Subject: Re: BugHunt
Ok, it's pretty clear what's happening, so now we just have to figure out why.

You've got hundreds of threads (which is a lot) all hung up on SSL reads.
428 of them are SMTPS and 46 of them are IMAPS.

Curiously, they're all hung up in the "greeting" banner for each protocol, which means they're not even clients that have been running for a while. When your server's been running for a while (or when it's hung) can you please do a "netatat -anp | grep citserver" so we can see what's on the other end of these connections?

Is there anything that could be making connections to ports 993 and 465, and closing the connection before speaking to Citadel? Maybe a monitoring system?

 



sslerror.jpg (image/jpeg, 40890 bytes) [ View | Download ]
[#] Wed Feb 22 2017 17:50:41 EST from bennabiy @ Uncensored

[Reply] [ReplyQuoted] [Headers] [Print]

A little update...

 

I managed to check the connections and saw that certain locations had many open connections coming from one IP (a known IP, so not worried about that) where I have many users all connecting to the server. I noticed that I had the idle timeout on my server set to 15 minutes (900 seconds) which would account for many connections building up if their clients are polling faster than that, and possibly opening new connections instead of reusing the old connection.

 

Do you think that would cause it? Running out of workers, and then the connections piling up without anyone to talk to? I still do not know why there are that many SMTPS connecitons, my userbase is only about 275.



[#] Wed Feb 22 2017 18:06:04 EST from rwb0027 @ Uncensored

Subject: debconf install automation, ports can't be binded

[Reply] [ReplyQuoted] [Headers] [Print]

I can install Citadel and it works great.  Love it.  I need to push it onto VMs using bash scripts so I install it then use debconf-get from utils to identify the configuration questions, and boom I make this to skip the installation questions:

echo $(date) " PreInstall Config for Citadel..." >> /usr/dev/log
echo "citadel-server  citadel/Password        password        SomePassword" | debconf-set-selections
echo "citadel-server  citadel/Password_again  password        SomePassword" | debconf-set-selections
echo "citadel-webcit  citadel/WebcitOfferLang select  UNLIMITED" | debconf-set-selections
echo "citadel-server  citadel/LDAPServer      string  0.0.0.0" | debconf-set-selections 
echo "citadel-server  citadel/LDAPServerPort  string  389" | debconf-set-selections
echo "citadel-server  citadel/LDAPBaseDN      string  dc=example,dc=com" | debconf-set-selections
echo "citadel-server  citadel/BadUser error" | debconf-set-selections
echo "citadel-server  citadel/Administrator   string  admin" | debconf-set-selections
echo "citadel-webcit  citadel/WebcitApacheIntegration select  Internal" | debconf-set-selections
echo "citadel-webcit  citadel/WebcitHttpsPort string  8001" | debconf-set-selections
echo "citadel-server  citadel/ServerIPAddress string  0.0.0.0" | debconf-set-selections
echo "citadel-server  citadel/LDAPBindDNPassword      string  DrewOver01" | debconf-set-selections
echo "citadel-server  citadel/LoginType       select  Internal" | debconf-set-selections
echo "citadel-webcit  citadel/WebcitHttpPort  string  8000" | debconf-set-selections

It works, kind of.  If I run through the standard installer and use these answers to answer the questions normally, Citadel comes right up at 8000 and I can log in.
But when I stuff the config into debconf, suddenly the end of the install doesn't go so well:
 


 Message from syslogd@debian at Feb 22 22:59:22 ...
 citserver[13433]: Modules: Citadel had trouble on starting up. We couldn't bind all ports you configured to be provided by citadel server.#012 This means, citadel won't be the service provider for a specific service you configured it to.#012#012If you don't want citadel to provide these services, turn them off in WebCit via: "Admin->System Preferences->Network".#012#012The failed ports and sockets are: TCP port  0.0.0.0:504: (citadel-TCP) ;TCP port  0.0.0.0:143: (IMAP) ;TCP port  0.0.0.0:993: (IMAPS) ;TCP port  0.0.0.0:2020: (ManageSieve) ;TCP port  0.0.0.0:110: (POP3) ;TCP port  0.0.0.0:995: (POP3S) ;TCP port  0.0.0.0:25: (SMTP-MTA) ;TCP port  0.0.0.0:465: (SMTPs-MTA) ;TCP port  0.0.0.0:587: (SMTP-MSA) ;TCP port  0.0.0.0:5222: (XMPP) #012#012If you want citadel to provide you with that functionality, check the output of "netstat -lnp" on linux Servers or "netstat -na" on *BSD and stop the program that binds these ports.#012 You should eventually remove  their initscripts in /etc/init.d so that you won't get this trouble once more.#012 After that goto "Administration -> Shutdown Citadel" to make Citadel restart & retry to bind this port.#012#012#012To make both ways actualy take place restart the citserver with "sendcommand down"#012#012The errors returned by the system were:#012Error binding to [ 0.0.0.0] : No such file or directory; Error binding to [ 0.0.0.0] : No such file or directory; Error binding to [ 0.0.0.0] : No such file or directory; Error binding to [ 0.0.0.0] : No such file or directory; Error binding to [ 0.0.0.0] : File exists; Error binding to [ 0.0.0.0] : File exists; Error binding to [ 0.0.0.0] : File exists; Error binding to [ 0.0.0.0] : File exists; Error binding to [ 0.0.0.0] : File exists; Error binding to [ 0.0.0.0] : No such file or directory#012#012You can recheck the above if you follow this faq item:#012http://www.citadel.org/doku.php?id=faq:mastering_your_os:net#netstat
 
Broadcast message from systemd-journald@golfoscar.com (Wed 2017-02-22 22:59:22 UTC):
 
citserver[13433]: Modules: Citadel had trouble on starting up. We couldn't bind all ports you configured to be provided by citadel server. This means, citadel won't be the service provider for a specific service you configured it to. If you don't want citadel to provide these services, turn them off in WebCit via: "Admin->System Preferences->Network".
 
The failed ports and sockets are: TCP port  0.0.0.0:504: (citadel-TCP) ;TCP port  0.0.0.0:143: (IMAP) ;TCP port  0.0.0.0:993: (IMAPS) ;TCP port  0.0.0.0:2020: (ManageSieve) ;TCP port  0.0.0.0:110: (POP3) ;TCP port  0.0.0.0:995: (POP3S) ;TCP port  0.0.0.0:25: (SMTP-MTA) ;TCP port  0.0.0.0:465: (SMTPs-MTA) ;TCP port  0.0.0.0:587: (SMTP-MSA) ;TCP port  0.0.0.0:5222: (XMPP)
 
If you want citadel to provide you with that functionality, check the output of "netstat -lnp" on linux Servers or "netstat -na" on *BSD and stop the program that binds these ports. You should eventually remove  their initscripts in /etc/init.d so that you won't get this trouble once more. After that goto "Administration -> Shutdown Citadel" to make Citadel restart & retry to bind this port.To make both ways actualy take place restart the citserver with "sendcommand down" The errors returned by the system were:
Error binding to [ 0.0.0.0] : No such file or directory;
Error binding to [ 0.0.0.0] : No such file or directory;
Error binding to [ 0.0.0.0] : No such file or directory;
Error binding to [ 0.0.0.0] : No such file or directory;
Error binding to [ 0.0.0.0] : File exists;
Error binding to [ 0.0.0.0] : File exists;
Error binding to [ 0.0.0.0] : File exists;
Error binding to [ 0.0.0.0] : File exists;
Error binding to [ 0.0.0.0] : File exists;
Error binding to [ 0.0.0.0] : No such file or directory
 
 
Anyone have a quick solution?
 
 
 


[#] Wed Feb 22 2017 18:09:16 EST from rwb0027 @ Uncensored

[Reply] [ReplyQuoted] [Headers] [Print]

And as the prompts request:

root@debian:~# netstat -lnp
Active Internet connections (only servers)
Proto Recv-Q Send-Q Local Address           Foreign Address         State       PID/Program name
tcp        0      0 0.0.0.0:22              0.0.0.0:*               LISTEN      2966/sshd
tcp        0      0 0.0.0.0:443             0.0.0.0:*               LISTEN      13783/webcit
tcp6       0      0 :::80                   :::*                    LISTEN      11747/apache2
tcp6       0      0 :::22                   :::*                    LISTEN      2966/sshd
Active UNIX domain sockets (only servers)
Proto RefCnt Flags       Type       State         I-Node   PID/Program name    Path
unix  2      [ ACC ]     STREAM     LISTENING     12287    1/init              /run/acpid.socket
unix  2      [ ACC ]     STREAM     LISTENING     27667    11913/dovecot       /var/run/dovecot/stats
unix  2      [ ACC ]     STREAM     LISTENING     27672    11913/dovecot       /var/run/dovecot/ssl-params
unix  2      [ ACC ]     STREAM     LISTENING     27674    11913/dovecot       /var/run/dovecot/login/ssl-params
unix  2      [ ACC ]     STREAM     LISTENING     27678    11913/dovecot       /var/run/dovecot/replicator
unix  2      [ ACC ]     STREAM     LISTENING     30241    13433/citserver     /var/run/citadel/citadel.socket
unix  2      [ ACC ]     STREAM     LISTENING     27682    11913/dovecot       /var/run/dovecot/replication-notify
unix  2      [ ACC ]     STREAM     LISTENING     30243    13433/citserver     /var/run/citadel/citadel-admin.socket
unix  2      [ ACC ]     STREAM     LISTENING     30245    13433/citserver     /var/run/citadel/lmtp.socket
unix  2      [ ACC ]     STREAM     LISTENING     30247    13433/citserver     /var/run/citadel/lmtp-unfiltered.socket
unix  2      [ ACC ]     STREAM     LISTENING     27687    11913/dovecot       /var/run/dovecot/log-errors
unix  2      [ ACC ]     STREAM     LISTENING     8490     1/init              /run/systemd/private
unix  2      [ ACC ]     STREAM     LISTENING     27691    11913/dovecot       /var/run/dovecot/lmtp
unix  2      [ ACC ]     STREAM     LISTENING     27695    11913/dovecot       /var/run/dovecot/ipc
unix  2      [ ACC ]     STREAM     LISTENING     27697    11913/dovecot       /var/run/dovecot/login/ipc-proxy
unix  2      [ ACC ]     STREAM     LISTENING     27701    11913/dovecot       /var/run/dovecot/indexer-worker
unix  2      [ ACC ]     STREAM     LISTENING     27705    11913/dovecot       /var/run/dovecot/indexer
unix  2      [ ACC ]     STREAM     LISTENING     27709    11913/dovecot       /var/run/dovecot/doveadm-server
unix  2      [ ACC ]     STREAM     LISTENING     27713    11913/dovecot       /var/run/dovecot/dns-client
unix  2      [ ACC ]     SEQPACKET  LISTENING     8512     1/init              /run/udev/control
unix  2      [ ACC ]     STREAM     LISTENING     8516     1/init              /run/systemd/journal/stdout
unix  2      [ ACC ]     STREAM     LISTENING     27717    11913/dovecot       /var/run/dovecot/director-admin
unix  2      [ ACC ]     STREAM     LISTENING     27721    11913/dovecot       /var/run/dovecot/director-userdb
unix  2      [ ACC ]     STREAM     LISTENING     27725    11913/dovecot       /var/run/dovecot/dict
unix  2      [ ACC ]     STREAM     LISTENING     27729    11913/dovecot       /var/run/dovecot/config
unix  2      [ ACC ]     STREAM     LISTENING     27731    11913/dovecot       /var/run/dovecot/login/login
unix  2      [ ACC ]     STREAM     LISTENING     27733    11913/dovecot       /var/run/dovecot/token-login/tokenlogin
unix  2      [ ACC ]     STREAM     LISTENING     27737    11913/dovecot       /var/run/dovecot/auth-login
unix  2      [ ACC ]     STREAM     LISTENING     20058    6676/python         /var/run/fail2ban/fail2ban.sock
unix  2      [ ACC ]     STREAM     LISTENING     27741    11913/dovecot       /var/run/dovecot/auth-client
unix  2      [ ACC ]     STREAM     LISTENING     27745    11913/dovecot       /var/run/dovecot/auth-userdb
unix  2      [ ACC ]     STREAM     LISTENING     27749    11913/dovecot       /var/run/dovecot/auth-master
unix  2      [ ACC ]     STREAM     LISTENING     27753    11913/dovecot       /var/run/dovecot/auth-worker
unix  2      [ ACC ]     STREAM     LISTENING     27757    11913/dovecot       /var/run/dovecot/anvil
unix  2      [ ACC ]     STREAM     LISTENING     27761    11913/dovecot       /var/run/dovecot/anvil-auth-penalty
unix  2      [ ACC ]     STREAM     LISTENING     12284    1/init              /var/run/dbus/system_bus_socket

 



[#] Fri Feb 24 2017 11:05:12 EST from bennabiy @ Uncensored

[Reply] [ReplyQuoted] [Headers] [Print]

I don't want to speak too soon, but it seems the error is no longer popping up after lowering the idle timeout time to 3 minutes (from 15 minutes).

 

Any chance that could have been all it was?



[#] Fri Feb 24 2017 21:45:24 EST from IGnatius T Foobar @ Uncensored

[Reply] [ReplyQuoted] [Headers] [Print]

 

Do you think that would cause it? Running out of workers, and then the connections piling up without anyone to talk to? I still do not know why there are that many SMTPS connecitons, my userbase is only about 275.

That could definitely be it ... stale connections piling up faster than the server can time them out.   And yes 15 minutes is the default timeout, but it probably doesn't need to be anywhere near that long, because SMTP connections should never go idle, and IMAP connections don't go idle as long as the client keeps polling for mail or sending keepalives or whatever.

Run it for a while with the lower timeout and let's see!

 



[#] Fri Feb 24 2017 21:47:51 EST from IGnatius T Foobar @ Uncensored

Subject: Re: debconf install automation, ports can't be binded

[Reply] [ReplyQuoted] [Headers] [Print]

It works, kind of.  If I run through the standard installer and use these answers to answer the questions normally, Citadel comes right up at 8000 and I can log in.
But when I stuff the config into debconf, suddenly the end of the install doesn't go so well:

Looks like you're feeding bad data into it, but I can't tell from that dump what exactly is happening.

If you want to run an automated setup you might want to just skip debconf altogether and just write your inputs into the setup program directly.

 



[#] Sun Feb 26 2017 10:16:44 EST from bennabiy @ Uncensored

[Reply] [ReplyQuoted] [Headers] [Print]

It seems like it is helping. The server has not crashed, but I see about 9 SMTP connections established out of 126 connections. 

Fri Feb 24 2017 09:45:24 PM EST from IGnatius T Foobar @ Uncensored

 

Do you think that would cause it? Running out of workers, and then the connections piling up without anyone to talk to? I still do not know why there are that many SMTPS connecitons, my userbase is only about 275.

That could definitely be it ... stale connections piling up faster than the server can time them out.   And yes 15 minutes is the default timeout, but it probably doesn't need to be anywhere near that long, because SMTP connections should never go idle, and IMAP connections don't go idle as long as the client keeps polling for mail or sending keepalives or whatever.

Run it for a while with the lower timeout and let's see!

 



 



[#] Mon Feb 27 2017 09:28:11 EST from rwb0027 @ Uncensored

Subject: Re: debconf install automation, ports can't be binded

[Reply] [ReplyQuoted] [Headers] [Print]

 

 

If you want to run an automated setup you might want to just skip debconf altogether and just write your inputs into the setup program directly.

I'd be happy to try that, but not sure how.  I'm running Apt-Get to install Citadel, do you mean using a parameter in the install command, or some other method of simulating the user input in the installer? Maybe you have a link that describes the method you are proposing?



[#] Mon Feb 27 2017 22:28:27 EST from IGnatius T Foobar @ Uncensored

Subject: Re: debconf install automation, ports can't be binded

[Reply] [ReplyQuoted] [Headers] [Print]

I'd be happy to try that, but not sure how.  I'm running Apt-Get to
install Citadel, do you mean using a parameter in the install
command, or some other method of simulating the user input in the
installer? Maybe you have a link that describes the method you are
proposing?

Look at what the postinst script is doing, and do that :)

Basically you're feeding inputs into the "setup" program that is included with the Citadel server. postinst runs it in a
"batch" mode, and you can too.

[#] Tue Feb 28 2017 04:07:47 EST from Cit-Main @ Uncensored

Subject: Improve Performance

[Reply] [ReplyQuoted] [Headers] [Print]

Hey folks,

do you have some hints to improve  the performance of the Citadel Server. It takes 2-4 minutes to send an Email with the webcit or with thunderbird.

 



[#] Tue Feb 28 2017 09:31:55 EST from bennabiy @ Uncensored

Subject: Re: Improve Performance

[Reply] [ReplyQuoted] [Headers] [Print]

It sounds like you might have some SpamAssassin scripts or RBL filters etc which are enabled on outgoing messages. 

Tue Feb 28 2017 04:07:47 AM EST from Cit-Main @ Uncensored Subject: Improve Performance

Hey folks,

do you have some hints to improve  the performance of the Citadel Server. It takes 2-4 minutes to send an Email with the webcit or with thunderbird.

 



 



[#] Fri Mar 03 2017 11:30:04 EST from bennabiy @ Uncensored

Subject: Address Books

[Reply] [ReplyQuoted] [Headers] [Print]

I have tried creating address books, or viewing the Global Address Book, and something is borked.

I see a whole lot of names with commas above where the addresses should be nicely formatted, and a bunch of tabs which say "(no - (no" on them...

 

 



[#] Fri Mar 03 2017 12:14:54 EST from bennabiy @ Uncensored

Subject: Sent Items room

[Reply] [ReplyQuoted] [Headers] [Print]

I noticed that the sent Items room does not display who the message was sent to at a glance. I get many complaints about it. Can it be included for that room?



[#] Sun Mar 05 2017 15:29:26 EST from bennabiy @ Uncensored

Subject: Force delete of a room

[Reply] [ReplyQuoted] [Headers] [Print]

As the admin / Aide user, how can I delete a folder / room from a personal mailbox of a user.

 

Also, how do I globally set what the _BASEROOM_ points to so all users go to the same starting room?



[#] Sun Mar 05 2017 18:04:58 EST from IGnatius T Foobar @ Uncensored

Subject: Re: Address Books

[Reply] [ReplyQuoted] [Headers] [Print]

Not sure where that crept in, but I'm fixing it now.  Stay tuned.

Fri Mar 03 2017 11:30:04 AM EST from bennabiy @ Uncensored Subject: Address Books

I have tried creating address books, or viewing the Global Address Book, and something is borked.

I see a whole lot of names with commas above where the addresses should be nicely formatted, and a bunch of tabs which say "(no - (no" on them...

 



[#] Sun Mar 05 2017 18:05:48 EST from IGnatius T Foobar @ Uncensored

Subject: Re: Sent Items room

[Reply] [ReplyQuoted] [Headers] [Print]

This is something we'll fix in webcit-ng, unless there's an urgent need?

Fri Mar 03 2017 12:14:54 PM EST from bennabiy @ Uncensored Subject: Sent Items room

I noticed that the sent Items room does not display who the message was sent to at a glance. I get many complaints about it. Can it be included for that room?

 



[#] Sun Mar 05 2017 18:07:30 EST from joe-liberty @ Uncensored

Subject: no more webcit

[Reply] [ReplyQuoted] [Headers] [Print]

I changed an option to -1 in webcit from 5222 to remove service and I can no longer log into webcit. Any help is greatly appreciated. Citserver is still running fine! Thank you!



Go to page: First ... 4 5 6 7 [8] 9 10 11 12 ... Last