Language:
switch to room list switch to menu My folders
Go to page: First ... 17 18 19 20 [21] 22 23 24 25 ... Last
[#] Sun Jul 02 2017 00:54:02 EDT from IGnatius T Foobar @ Uncensored

Subject: Re: Sync with Android phone

[Reply] [ReplyQuoted] [Headers] [Print]

So I'm trying to sync with my Android phone. Citadel ought to support
one of the CalDav sync tools per the docs, but I don't have a lot of
luck. Some tools work one way, others work another. Anywho, the one

Are you trying to make it use CalDAV? The current version doesn't support CalDAV yet. (It's being worked on as part of WebCit-NG though.)

The current version will support the idea of loading/saving the entire calendar as an .ics file over regular WebDAV. This has been tested with Android and it does work.

[#] Mon Jul 03 2017 06:28:05 EDT from Christian.Commarmond @ Uncensored

Subject: Big number of messages...

[Reply] [ReplyQuoted] [Headers] [Print]

Hi,

I installed Citadel and try to synch with my 1,500,000 messages gmail account. (OK, I receive more than 2000 per day, mostly automatized reports).

I try to do the synch with imapsync. It is super slow. I will try soon to do the initial loading from thunderbird.

 

My concern is that, when I go in a folder which contains nearly 200,000 messages, I get the good number at top of screen, but I can only see around 32000 messages (I guess, because I see only to 19th of may 2015). And worse, only the olders...

 

Questions:

Is this normal? Can I override this? Can I get to see the newest messages?

 

Thank you for your help.

 

Christian

 

 



[#] Mon Jul 03 2017 17:41:00 EDT from s3cr3to @ Uncensored to Citadel_Support <room_Citadel_Support@uncensored.citadel.org>

Subject: db->compact() on 8.17

[Reply] [ReplyQuoted] [Headers] [Print]

On 07/01/2017 10:52 PM, IGnatius T Foobar wrote:

A quick update:

I've tested db->compact() with Citadel Server, and it works as advertised.


So you can expect the next release of the server program to contain, at the
very least, a site-configurable option to enable database compaction after
the auto-purger is run. (I might make it a hidden setting, just to be able
to get it out there faster.)

I read that message, and I wonder if is possible for you to create a
tool to compact the db on Citadel 8.17.

My current version "Citadel 8.17" Debian Squeeze; currently using 67G
db.08. A few months ago, I understand and configure the "Expire by
message age/count" for the majority of my users, except the very
important ones.

I cross my fingers and hope you have a positive response :)

P.S. Or if you can point me in the right direction, so I can investigate
what libraries/language(python/bashscrip/pascal)/way to connect and run
the db.compact().

P.S.2. some months ago, I manage to read the users from the db using the
command line (bash+python?), but I don't remember how I do, need to dig
on my harddisk, maybe I can do it :O ?!

Regards

[#] Tue Jul 04 2017 16:12:15 EDT from bennabiy @ Uncensored

Subject: db->compact()

[Reply] [ReplyQuoted] [Headers] [Print]

Any noticeable performance hit?

Sun Jul 02 2017 12:52:29 AM EDT from IGnatius T Foobar @ Uncensored
Hmm. Now I'm seeing there's a function called db->compact()
https://docs.oracle.com/cd/E17275_01/html/api_reference/C/dbcompact.html


A quick update:

I've tested db->compact() with Citadel Server, and it works as advertised.

So you can expect the next release of the server program to contain, at the very least, a site-configurable option to enable database compaction after the auto-purger is run. (I might make it a hidden setting, just to be able to get it out there faster.)

 



[#] Wed Jul 05 2017 10:53:52 EDT from Freakdog @ Dog Pound BBS II

Subject: Re: db->compact() on 8.17

[Reply] [ReplyQuoted] [Headers] [Print]

 

Mon Jul 03 2017 05:41:00 PM EDT from s3cr3to @ Uncensored Subject: db->compact() on 8.17
On 07/01/2017 10:52 PM, IGnatius T Foobar wrote:

A quick update:

I've tested db->compact() with Citadel Server, and it works as advertised.


So you can expect the next release of the server program to contain, at the
very least, a site-configurable option to enable database compaction after
the auto-purger is run. (I might make it a hidden setting, just to be able
to get it out there faster.)
I read that message, and I wonder if is possible for you to create a
tool to compact the db on Citadel 8.17.

My current version "Citadel 8.17" Debian Squeeze; currently using 67G
db.08. A few months ago, I understand and configure the "Expire by
message age/count" for the majority of my users, except the very
important ones.

I cross my fingers and hope you have a positive response :)

P.S. Or if you can point me in the right direction, so I can investigate
what libraries/language(python/bashscrip/pascal)/way to connect and run
the db.compact().

P.S.2. some months ago, I manage to read the users from the db using the
command line (bash+python?), but I don't remember how I do, need to dig
on my harddisk, maybe I can do it :O ?!

Regards

It may be easier to run the easy_install option and upgrade your code...you can then move the DB and messages files over to the appropriate directories under the new directory structure, which will bring you up to current.



[#] Wed Jul 05 2017 11:42:57 EDT from jp10558 @ Uncensored

Subject: Re: Big number of messages...

[Reply] [ReplyQuoted] [Headers] [Print]

I have the same issue with a non synced, just citadel server. My messages in the Inbox stop around Jan 3rd, yet using IMAP I get messages through today... I'm not sure this is specific to a large number of messages or not, but I have 11417 messages according to webcit in my Inbox.



[#] Wed Jul 05 2017 12:30:42 EDT from Christian.Commarmond @ Uncensored

Subject: Re: Big number of messages...

[Reply] [ReplyQuoted] [Headers] [Print]

 

Wed Jul 05 2017 11:42:57 EDT from jp10558 @ Uncensored Subject: Re: Big number of messages...

I have the same issue with a non synced, just citadel server. My messages in the Inbox stop around Jan 3rd, yet using IMAP I get messages through today... I'm not sure this is specific to a large number of messages or not, but I have 11417 messages according to webcit in my Inbox.



Hi JP,

I think that may be a bug in webcit. Which cannot query all messages , but worse, read first the oldests...

Anyway, with imapsync, my synch will never finish. It seems that it tries to reread all the source each time... 

And it looks like only one people is still working on this project. He cannot do everything. I have a 12 hours plane tonight. I am downloading the C code to have a look. Who knows, maybe a miracle will show me the problem...

Don't hope too much... 

 

Christian



[#] Wed Jul 05 2017 13:55:18 EDT from s3cr3to @ Uncensored to Citadel_Support <room_Citadel_Support@uncensored.citadel.org>

Subject: Re: db->compact() on 8.17

[Reply] [ReplyQuoted] [Headers] [Print]

Easy_install/current I want to do that... but really I got a lot of work
in my hands. I don't lose my hope yet: to migrate to easy_install in
this life :)

Just that first I want to compact the DBs, that huge file I hope it has
a lot of unused space because my ignorance to manage correctly the
expired messages.

Thanks Freakdog

[#] Wed Jul 05 2017 16:16:39 EDT from s3cr3to @ Uncensored to IGnatius T Foobar <ajc@citadel.org>

Subject: Re: db->compact() on 8.17

[Reply] [ReplyQuoted] [Headers] [Print]

IG, trying to compile the source, I got this errors (solved I hope)

I only have this questions:
* The db_version_major can be 4?
* Can I run this tool on an backup directory to test it?

* In my system I got this db version:
i db4.6-util 4.6.21-16

Searching I found this:
https://stackoverflow.com/questions/2814686/what-is-the-difference-between-the-different-berkeleydb-versions-and-which-shou/2823053#2823053

"4.4: Adds Database compaction, in-memory databases, Peer-to-Peer HA"

I wonder if is ok just to change this lines:

#if DB_VERSION_MAJOR < 5
#error Citadel requires Berkeley DB v5.0 or newer. Please upgrade.
#endif

to:
#if DB_VERSION_MAJOR < 4
#error Citadel requires Berkeley DB v4.4 or newer. Please upgrade.
#endif

* using aptitude i found and install both:
Setting up libdb4.8-dev (4.8.30-2) ...
Setting up libdb-dev (4.8) ...
Setting up zlib1g-dev (1:1.2.3.4.dfsg-3) ...

* and now I can compile and got this:
# cc ctdlsqueeze.c -ldb -o ctdlsqueeze
# ls -l
total 16
-rwxr-xr-x 1 root root 9483 Jul 5 14:05 ctdlsqueeze
-rw-r--r-- 1 s3 s3 3823 Jul 5 13:50 ctdlsqueeze.c

I'm very rusted on C... I will try to create a "dummy" variant to answer
my previous questions working with backups.

Regards

[#] Mon Jul 10 2017 14:39:31 EDT from janik @ Uncensored

[Reply] [ReplyQuoted] [Headers] [Print]

Hey everyone,

 

i can send emails but not receive. error is 551 relaying denied..

what could i do?

 

 



[#] Mon Jul 10 2017 21:10:21 EDT from IGnatius T Foobar @ Uncensored

Subject: Re: Big number of messages...

[Reply] [ReplyQuoted] [Headers] [Print]

My concern is that, when I go in a folder which contains nearly
200,000 messages, I get the good number at top of screen, but I can
only see around 32000 messages (I guess, because I see only to 19th
of may 2015). And worse, only the olders...

Are you viewing the folder with an IMAP client, or with WebCit?

IMAP does not, to the best of my knowledge, have a fixed limit of how many messages it can present. WebCit does, but if you have the source code online I can point out where to change it.

WebCit-NG will not have any such limits, but that doesn't help you right now :)

[#] Mon Jul 10 2017 21:11:38 EDT from IGnatius T Foobar @ Uncensored

Subject: Re: db->compact()

[Reply] [ReplyQuoted] [Headers] [Print]

Any noticeable performance hit?

Very much so, which is why it will not be enabled by default, and even when enabled it will only run once per night, after the completion of an auto-purger run.

[#] Mon Jul 10 2017 21:13:12 EDT from IGnatius T Foobar @ Uncensored

[Reply] [ReplyQuoted] [Headers] [Print]

i can send emails but not receive. error is 551 relaying denied..

what could i do?

First make sure it's actually Citadel that's listening on port 25 of your server. Telnet to port 25, and you should see something like

220 uncensored.citadel.org ESMTP Citadel server ready.

If it doesn't say "Citadel" somewhere in the greeting, you have another mail server running, and it needs to be shut off.

[#] Mon Jul 10 2017 21:55:14 EDT from Christian.Commarmond @ Uncensored

Subject: Re: Big number of messages...

[Reply] [ReplyQuoted] [Headers] [Print]

 

Mon Jul 10 2017 21:10:21 EDT from IGnatius T Foobar @ Uncensored Subject: Re: Big number of messages...
My concern is that, when I go in a folder which contains nearly
200,000 messages, I get the good number at top of screen, but I can
only see around 32000 messages (I guess, because I see only to 19th
of may 2015). And worse, only the olders...

Are you viewing the folder with an IMAP client, or with WebCit?

IMAP does not, to the best of my knowledge, have a fixed limit of how many messages it can present. WebCit does, but if you have the source code online I can point out where to change it.

WebCit-NG will not have any such limits, but that doesn't help you right now :)

 

Hello Ignatius,

bad news... again.

In my Citadel display, under the View As:, I saw a small piece of white line... When I tried to click it, I discovered that it is a page number... For my 78000 messages list, I says 158 pages. But It does not show anything after the 23rd... After this one, only white pages.

My older message is 1/1/2015, and I just see january 2015 messages... 

I wonder if the choice of Berkeley is one of the problem? Do you need to reload all messages to memory at each time? And you are short of memory? I have a quite fast server, 2 Xeon in a Dell R720 with raid disks, and citadel is in a virtual server on it, with 8Gb of RAM, and it takes some time to get the display.

Other point of interest: most of these mails are automated reports coming from customers. Gmail groups them per source/title/day, so for some repeating emails, I see one line for 100 mails. Could you do the same thing with Citadel?

My 70000++ list would become less than 17000...

So, the problems I see now:

- Page selector is hidden because I have: "Make this my startpage", then "Logged in as...", then a search field, then "View As:" which fills the header space, So, the page selector is 90% hidden.

- Mails cannot display more than a few hundreds (or thousands), even if the count is good in the header, and the number of pages is good too.

- (Worse), we always see first the oldest mails, when we should (IMHO) see first the newest.

Point One seems easy to solve by moving a field around.

Point 2 (and 3) seems more tricky, if it is a memory problem, I still can put more memory to my server... But how much? My biggest 'floor' would contain more than 300000 messages.

Point 3? Is it easily solvable? This is a blocking point... I cannot send new reports to Citadel if I cannot see them... The full point for me is to NOT USE client software, since I move(travel) a lot and I cannot install software on most of the computers I use, and I cannot sync 15gb of emails on my phone... Reason why I need to use the web interface...

 

For your information, I am studying the source code now, I need time to know where are the things... I'd like to do an Oracle XE (free Oracle DB) interface. This would help to move some stuffs to the database. But this will take time, if I can do it, because I am very busy and it is a long time since I worked we the C (and the Pro*C Oracle interface).

Anyway, thank you for the interest you have for my problems... When would the NG version come out?

 

Best regards,

Christian COMMARMOND



[#] Mon Jul 10 2017 22:05:20 EDT from Christian.Commarmond @ Uncensored

Subject: Search not working on messages?

[Reply] [ReplyQuoted] [Headers] [Print]

Again...

I tried to do a search on messages, entering a part of header in the search field. Nothing comes back, and it is then impossible to get back the messages by clearing the search field... I had  to change room. 

Maybe the search field needs a special syntax?

 

Christian COMMARMOND



[#] Wed Jul 12 2017 02:52:33 EDT from Harq @ Uncensored

Subject: Is it possible to run Citadel on Freebsd 11.0?

[Reply] [ReplyQuoted] [Headers] [Print]



[#] Wed Jul 12 2017 03:02:03 EDT from Harq123 @ Uncensored

Subject: Is it possible to run Citadel on Freebsd 11.0?

[Reply] [ReplyQuoted] [Headers] [Print]

Hello,

I read the install doc for Freebsd, it states it takes some tweaking to get it to work.  I also understand that there is no support for Freebsd.  So I am just wondering if i could throw myself at the mercy of those on the BBS and ask if it is possible.  I am sure anything is possible.  I did all the steps that SteffenFritz listed. The install script bombed out compiling dbinc.  Again, i understand you can just say FreeBSD is not supported. I did some research and there is some patch that fixes this. 

ERROR BELOW

checking for 64-bit integral type support for sequences... yes
configure: creating ./config.status
config.status: creating Makefile
config.status: creating db_cxx.h
config.status: creating db_int.h
config.status: creating clib_port.h
config.status: creating include.tcl
config.status: creating db.h
config.status: creating db_config.h
config.status: executing libtool commands
./libtool --mode=compile cc -c -I. -I../src  -D_THREAD_SAFE -O3  ../src/mutex/mut_tas.c
libtool: compile:  cc -c -I. -I../src -D_THREAD_SAFE -O3 ../src/mutex/mut_tas.c -o mut_tas.o
In file included from ../src/mutex/mut_tas.c:11:
In file included from ./db_int.h:999:
In file included from ../src/dbinc/mutex.h:15:
In file included from ../src/dbinc/mutex_int.h:12:
../src/dbinc/atomic.h:179:19: error: definition of builtin function '__atomic_compare_exchange'
static inline int __atomic_compare_exchange(
                  ^
1 error generated.
gmake: *** [Makefile:2085: mut_tas.o] Error 1
Operating system:
:q!

Link to possible fix for OSX

https://github.com/narkoleptik/os-x-berkeleydb-patch

 

Again, thank you.  I will be falling back to Centos or something similar if this does not work.

 

Citadel looks very cool.



[#] Wed Jul 12 2017 11:09:52 EDT from athos-mn @ Uncensored

Subject: TLS Encryption

[Reply] [ReplyQuoted] [Headers] [Print]

I'm just following up on a message from last year where TLS encryption wasn't yet part of Citadel. Has that been added to the roadmap (or added and I missed it)? 



[#] Wed Jul 12 2017 12:55:45 EDT from IGnatius T Foobar @ Uncensored

Subject: Shrinking of database files on disk

[Reply] [ReplyQuoted] [Headers] [Print]

Ok, here's the "final word" (at least for now) on the ability to shrink Citadel database files on disk after data has been deleted.

I experimented with a standalone utility to do this, and it trashed my database.  So that's a non-starter.  :)

Beginning with the next release of Citadel Server, there will be a hidden configuration setting called "c_shrink_db_files".  If this setting does not exist or is set to 0, the normal behavior continues, where deleting objects in Citadel causes free space to appear in the database files, which will be used for new data.  If "c_shrink_db_files" exists and is set to 1 (or any nonzero value), the DB->compact() function will be called after THE DREADED AUTO-PURGER (tm) completes its run each night.  This will return unused space back to the underlying filesystem.

Because we have not had the opportunity to perform thorough testing on this function, it remains undocumented and unsupported.  If someone out there would like to perform thorough testing, it would be quite helpful.  The needed test would be to set up a test system, activate the shrink option, and then ... every day, enter massive amounts of data into Citadel, then delete it, observe the size of the database files, come back the next morning and see if they shrunk, and repeat for a number of days.  During the testing period, the test system should of course also be observed for any unexpected behavior.

Here at the Citadel project we are very serious about data integrity.  We don't mind the "move fast and break things" approach when it comes to functionality, but the system must never lose data.  This is why the shrink option is not being rolled out casually.



[#] Wed Jul 12 2017 12:56:17 EDT from IGnatius T Foobar @ Uncensored

Subject: Re: TLS Encryption

[Reply] [ReplyQuoted] [Headers] [Print]

 

Wed Jul 12 2017 11:09:52 AM EDT from athos-mn @ Uncensored Subject: TLS Encryption

I'm just following up on a message from last year where TLS encryption wasn't yet part of Citadel. Has that been added to the roadmap (or added and I missed it)? 



I don't remember the discussion that took place last year.  What part of the system needed encryption that didn't already have it?



Go to page: First ... 17 18 19 20 [21] 22 23 24 25 ... Last