http://hg.omfa.de/prosody-hg/ en-us plugins/mod_storage_internal.lua revision history http://hg.omfa.de/prosody-hg/log/f77911437539/plugins/mod_storage_internal.lua
This is required per XEP-0313, otherwise clients cannot tell the difference
between an empty successful query and a query where their sync point is no
longer within the archive.]]> Matthew Wild <mwild1@gmail.com> Fri, 12 Dec 2025 12:43:23 +0000 http://hg.omfa.de/prosody-hg/log/cbd234461c41/plugins/mod_storage_internal.lua
Queries with start > last item would return one item, because there's
some boundary condition in binary_search().

This is here fixed by always applying filters that omit items outside
the requested range.

See also 2374c7665d0b]]> Kim Alvefur <zash@zash.se> Mon, 14 Apr 2025 15:10:29 +0200 http://hg.omfa.de/prosody-hg/log/8f516d20d288/plugins/mod_storage_internal.lua
This matches what we use for SQL already, so provides some consistency.

Client developers prefer sortable ids.]]> Matthew Wild <mwild1@gmail.com> Mon, 10 Mar 2025 11:54:52 +0000 http://hg.omfa.de/prosody-hg/log/2374c7665d0b/plugins/mod_storage_internal.lua
Fixes a test case provided by MattJ where the very first item matched by
a 'start' timestamp was not returned.]]> Kim Alvefur <zash@zash.se> Thu, 15 Feb 2024 20:28:14 +0100 http://hg.omfa.de/prosody-hg/log/6877786d73d7/plugins/mod_storage_internal.lua Matthew Wild <mwild1@gmail.com> Tue, 12 Dec 2023 13:41:14 +0000 http://hg.omfa.de/prosody-hg/log/53c347043cb5/plugins/mod_storage_internal.lua
The previous count would be invalid at this point.

Should be possible to math out how many items are left, but this is left
as future work.]]> Kim Alvefur <zash@zash.se> Sun, 26 Nov 2023 18:02:13 +0100 http://hg.omfa.de/prosody-hg/log/958c759d3897/plugins/mod_storage_internal.lua
Should be done here too.]]> Kim Alvefur <zash@zash.se> Sun, 26 Nov 2023 14:35:26 +0100 http://hg.omfa.de/prosody-hg/log/9a9455de295d/plugins/mod_storage_internal.lua
Since datamanager can fall back to the old method of loading the whole
list, which wouldn't come with a :close method.]]> Kim Alvefur <zash@zash.se> Sun, 26 Nov 2023 14:29:08 +0100 http://hg.omfa.de/prosody-hg/log/92b7ccc76c3a/plugins/mod_storage_internal.lua
This closes the two FDs that the random access list abstraction uses,
otherwise they are left to the garbage collector.]]> Kim Alvefur <zash@zash.se> Thu, 23 Nov 2023 17:49:57 +0100 http://hg.omfa.de/prosody-hg/log/e77994e88940/plugins/mod_storage_internal.lua
Fixes "Could not delete messages for room 'x': (nil)"]]> Kim Alvefur <zash@zash.se> Sun, 08 Oct 2023 18:21:14 +0200 http://hg.omfa.de/prosody-hg/log/9a86e7cbdd79/plugins/mod_storage_internal.lua
This method would previously never delete the first (and only) item
since it works out which item should become the first item after the
trim operation, which doesn't make sense when all should be removed.

This also works as an optimization for when all the last item should be
trimmed, thus items should be removed.]]> Kim Alvefur <zash@zash.se> Sun, 24 Sep 2023 13:41:54 +0200 http://hg.omfa.de/prosody-hg/log/616c578c644f/plugins/mod_storage_internal.lua
Missed this one in previous sweep]]> Kim Alvefur <zash@zash.se> Tue, 18 Jul 2023 12:36:47 +0200 http://hg.omfa.de/prosody-hg/log/50324f66ca2a/plugins/mod_storage_internal.lua
Many of these fall into a few categories:
- util.cache size, must be >= 1
- byte or item counts that logically can't be negative
- port numbers that should be in 1..0xffff]]> Kim Alvefur <zash@zash.se> Mon, 17 Jul 2023 01:38:54 +0200 http://hg.omfa.de/prosody-hg/log/fe1229919070/plugins/mod_storage_internal.lua
Using the new shift function in datamanager, either the oldest items are
removed or all the later items are moved into a new file that replaces
the old.

Hidden behind a feature flag for now.]]> Kim Alvefur <zash@zash.se> Wed, 12 Jul 2023 15:03:24 +0200 http://hg.omfa.de/prosody-hg/log/396db0e7084f/plugins/mod_storage_internal.lua
Iterating over an entire archive to find a few items in the far end from
where iteration started is expensive, and probably more expensive with
the lazy-loading of items added in the previous commit.

Since we can now efficiently read items in random order, we can now use
a binary search to find a better starting point for iteration.]]> Kim Alvefur <zash@zash.se> Wed, 12 May 2021 01:32:03 +0200 http://hg.omfa.de/prosody-hg/log/3fd24e1945b0/plugins/mod_storage_internal.lua
Very large list files previously ran into limits of the Lua parser, or
just caused Prosody to freeze while parsing.

Using the new index we can parse individual items one at a time. This
probably won't reduce overall CPU usage, probably the opposite, but it
will reduce the number of items in memory at once and allow collection
of items after we iterated past them.]]> Kim Alvefur <zash@zash.se> Wed, 12 May 2021 01:25:44 +0200 http://hg.omfa.de/prosody-hg/log/74b9e05af71e/plugins/mod_storage_internal.lua Kim Alvefur <zash@zash.se> Fri, 24 Mar 2023 13:15:28 +0100 http://hg.omfa.de/prosody-hg/log/1cac469b18d0/plugins/mod_storage_internal.lua
Should no longer be used by anything since the conversion of mod_offline
to the archive API in 0.10.0, which was 4 years ago. The line clearing
the property is left for a bit longer in case someone has very old
offline messages or archived data.]]> Kim Alvefur <zash@zash.se> Sat, 04 Sep 2021 14:39:31 +0200 http://hg.omfa.de/prosody-hg/log/c3907f05bed4/plugins/mod_storage_internal.lua
Based on implementation in mod_storage_memory]]> Kim Alvefur <zash@zash.se> Tue, 12 Jan 2021 18:06:55 +0100 http://hg.omfa.de/prosody-hg/log/b8fada57faf0/plugins/mod_storage_internal.lua
Based on the mod_storage_memory implementation]]> Kim Alvefur <zash@zash.se> Tue, 12 Jan 2021 17:00:27 +0100 http://hg.omfa.de/prosody-hg/log/c55bd98a54f8/plugins/mod_storage_internal.lua
Previously returned all results.]]> Matthew Wild <mwild1@gmail.com> Fri, 12 Jun 2020 16:55:35 +0100 http://hg.omfa.de/prosody-hg/log/05f4386c846e/plugins/mod_storage_internal.lua Kim Alvefur <zash@zash.se> Fri, 15 May 2020 21:26:54 +0200 http://hg.omfa.de/prosody-hg/log/8fcd46ee9bf5/plugins/mod_storage_internal.lua Kim Alvefur <zash@zash.se> Fri, 15 May 2020 21:22:35 +0200 http://hg.omfa.de/prosody-hg/log/5a6ba2f38e2b/plugins/mod_storage_internal.lua
This led to a missing 'when' field on changed items, which would cause a
traceack.]]> Kim Alvefur <zash@zash.se> Fri, 15 May 2020 20:55:22 +0200 http://hg.omfa.de/prosody-hg/log/f23363380599/plugins/mod_storage_internal.lua Kim Alvefur <zash@zash.se> Mon, 11 May 2020 21:56:19 +0200 http://hg.omfa.de/prosody-hg/log/d185c4961ee0/plugins/mod_storage_internal.lua
A protocol built on this API now allows showing a list of unread
conversations with a counter, ordered by either oldest or newest
message, along with the text body itself.]]> Kim Alvefur <zash@zash.se> Fri, 23 Aug 2019 01:28:53 +0200 http://hg.omfa.de/prosody-hg/log/51f145094648/plugins/mod_storage_internal.lua
For completeness along with most recent timestamp. Might be nice to be
able to order by oldest unread message.]]> Kim Alvefur <zash@zash.se> Fri, 23 Aug 2019 01:15:44 +0200 http://hg.omfa.de/prosody-hg/log/068692cb9e78/plugins/mod_storage_internal.lua
Clients may want to show a list of conversations ordered by how
timestamp of most recent message.

The counts allow a badge with unread message counter.]]> Kim Alvefur <zash@zash.se> Fri, 23 Aug 2019 01:10:27 +0200 http://hg.omfa.de/prosody-hg/log/1e2b444acb72/plugins/mod_storage_internal.lua
Eg might want to include last message, timestamp, chat state or other info.]]> Kim Alvefur <zash@zash.se> Fri, 23 Aug 2019 01:04:00 +0200 http://hg.omfa.de/prosody-hg/log/4a0d990253a0/plugins/mod_storage_internal.lua Kim Alvefur <zash@zash.se> Sun, 05 May 2019 07:24:12 +0200 http://hg.omfa.de/prosody-hg/log/7408b9473729/plugins/mod_storage_internal.lua Kim Alvefur <zash@zash.se> Tue, 05 Mar 2019 00:12:30 +0100 http://hg.omfa.de/prosody-hg/log/55f5588d71c6/plugins/mod_storage_internal.lua
May help with writing a better migrator]]> Kim Alvefur <zash@zash.se> Sun, 05 May 2019 16:07:16 +0200 http://hg.omfa.de/prosody-hg/log/7c4631d7b6fb/plugins/mod_storage_internal.lua Kim Alvefur <zash@zash.se> Sun, 05 May 2019 08:12:16 +0200 http://hg.omfa.de/prosody-hg/log/2c5546cc5c70/plugins/mod_storage_internal.lua Kim Alvefur <zash@zash.se> Mon, 25 Feb 2019 15:48:28 +0100 http://hg.omfa.de/prosody-hg/log/6bd65bff03b5/plugins/mod_storage_internal.lua Kim Alvefur <zash@zash.se> Fri, 22 Mar 2019 02:24:48 +0100 http://hg.omfa.de/prosody-hg/log/5669bb11ac7b/plugins/mod_storage_internal.lua
Performance doesn't seem great but 10k should be far enough from limits
inherited by the Lua parser. 1000 messages seemed pretty close to what
an active user might produce in one week.]]> Kim Alvefur <zash@zash.se> Fri, 22 Mar 2019 02:04:34 +0100 http://hg.omfa.de/prosody-hg/log/64e16d1e91f6/plugins/mod_storage_internal.lua Kim Alvefur <zash@zash.se> Fri, 22 Mar 2019 18:02:27 +0100 http://hg.omfa.de/prosody-hg/log/9751c17f5281/plugins/mod_storage_internal.lua
This was planned to be added long ago but was forgotten.]]> Kim Alvefur <zash@zash.se> Fri, 22 Mar 2019 18:01:24 +0100 http://hg.omfa.de/prosody-hg/log/f76bd399267c/plugins/mod_storage_internal.lua Matthew Wild <mwild1@gmail.com> Fri, 20 Oct 2017 12:53:53 +0200 http://hg.omfa.de/prosody-hg/log/e735c9865f42/plugins/mod_storage_internal.lua Kim Alvefur <zash@zash.se> Sat, 04 Aug 2018 15:44:38 +0200 http://hg.omfa.de/prosody-hg/log/469afa02947b/plugins/mod_storage_internal.lua Kim Alvefur <zash@zash.se> Sun, 19 Nov 2017 21:00:43 +0100 http://hg.omfa.de/prosody-hg/log/4892c22403d5/plugins/mod_storage_internal.lua Kim Alvefur <zash@zash.se> Fri, 10 Nov 2017 09:44:30 +0100 http://hg.omfa.de/prosody-hg/log/b6a7b83f8d87/plugins/mod_storage_internal.lua Kim Alvefur <zash@zash.se> Thu, 09 Nov 2017 01:42:01 +0100 http://hg.omfa.de/prosody-hg/log/1759491b53db/plugins/mod_storage_internal.lua Kim Alvefur <zash@zash.se> Mon, 09 Oct 2017 01:02:17 +0200 http://hg.omfa.de/prosody-hg/log/5281c479955a/plugins/mod_storage_internal.lua Kim Alvefur <zash@zash.se> Mon, 09 Oct 2017 01:01:28 +0200 http://hg.omfa.de/prosody-hg/log/3ff99d49082f/plugins/mod_storage_internal.lua Kim Alvefur <zash@zash.se> Wed, 05 Jul 2017 05:44:56 +0200 http://hg.omfa.de/prosody-hg/log/c4c159953c72/plugins/mod_storage_internal.lua Kim Alvefur <zash@zash.se> Sun, 14 May 2017 17:31:50 +0200 http://hg.omfa.de/prosody-hg/log/13e075549cb3/plugins/mod_storage_internal.lua Kim Alvefur <zash@zash.se> Sun, 14 May 2017 17:22:33 +0200 http://hg.omfa.de/prosody-hg/log/4ba8cb75d925/plugins/mod_storage_internal.lua Kim Alvefur <zash@zash.se> Sat, 15 Apr 2017 02:27:07 +0200 http://hg.omfa.de/prosody-hg/log/5a9d491cc714/plugins/mod_storage_internal.lua Kim Alvefur <zash@zash.se> Fri, 31 Mar 2017 17:49:51 +0200 http://hg.omfa.de/prosody-hg/log/05e201468f27/plugins/mod_storage_internal.lua Kim Alvefur <zash@zash.se> Fri, 31 Mar 2017 17:48:50 +0200 http://hg.omfa.de/prosody-hg/log/83f18982bcfd/plugins/mod_storage_internal.lua Kim Alvefur <zash@zash.se> Fri, 31 Mar 2017 17:47:06 +0200 http://hg.omfa.de/prosody-hg/log/342ce07836de/plugins/mod_storage_internal.lua Kim Alvefur <zash@zash.se> Fri, 31 Mar 2017 17:39:41 +0200 http://hg.omfa.de/prosody-hg/log/925098aad268/plugins/mod_storage_internal.lua Kim Alvefur <zash@zash.se> Fri, 31 Mar 2017 17:38:46 +0200 http://hg.omfa.de/prosody-hg/log/9545d0a9401f/plugins/mod_storage_internal.lua Kim Alvefur <zash@zash.se> Fri, 31 Mar 2017 17:34:33 +0200 http://hg.omfa.de/prosody-hg/log/7cf6d3a2c855/plugins/mod_storage_internal.lua Kim Alvefur <zash@zash.se> Fri, 20 Jun 2014 16:22:23 +0200 http://hg.omfa.de/prosody-hg/log/688aeac0012a/plugins/mod_storage_internal.lua Kim Alvefur <zash@zash.se> Fri, 21 Sep 2012 17:23:08 +0200 http://hg.omfa.de/prosody-hg/log/1443d1c37c6c/plugins/mod_storage_internal.lua Matthew Wild <mwild1@gmail.com> Wed, 19 Sep 2012 12:14:08 +0100 http://hg.omfa.de/prosody-hg/log/051d352ed03c/plugins/mod_storage_internal.lua Kim Alvefur <zash@zash.se> Mon, 17 Sep 2012 05:42:10 +0200 http://hg.omfa.de/prosody-hg/log/b41c33dc7c36/plugins/mod_storage_internal.lua Waqas Hussain <waqas20@gmail.com> Wed, 12 Sep 2012 23:46:10 +0500