http://hg.omfa.de/prosody-hg/ en-us prosody-hg: util/sql.lua history util/sql.lua revision history util.sql: Add API to start an explicit write transaction http://hg.omfa.de/prosody-hg/log/e7c52d0b0e0d/util/sql.lua
This will be used in SQLite3 to BEGIN IMMEDIATE, which attempts to
acquire write locks immediately instead of when the first write
statement is started. Thus it would fail faster if the write lock is
already taken. Normally that should not occur but e.g. prosodyctl could
take it.

Investigating whether something similar is sensible in PostgreSQL, MySQL
is a future task.]]> Kim Alvefur <zash@zash.se> Mon, 19 Aug 2024 00:06:45 +0200 util.sql: Don't send SQLCipher key to Postgres or MySQL (thanks gllmhyt) http://hg.omfa.de/prosody-hg/log/edd006093533/util/sql.lua
This was copied from util.sqlite3 which only deals with SQLite3, but
here Postgres or MySQL are also possibilities, which wouldn't support
this.]]> Kim Alvefur <zash@zash.se> Sun, 16 Feb 2025 11:52:07 +0100 util.sql: SQLCipher support http://hg.omfa.de/prosody-hg/log/844e7bf7b48a/util/sql.lua
This enables use of encrypted databases if LuaDBI or LuaSQLite3 has been
linked against SQLCipher. Using `LD_PRELOAD` may work as well.

Requires SQLCipher >= 4.0.0 due to the use of UPSERT]]> Kim Alvefur <zash@zash.se> Thu, 23 Jan 2025 16:38:56 +0100 util.sql: Remove unused String() and Integer() functions http://hg.omfa.de/prosody-hg/log/a378937103cb/util/sql.lua
According to MattJ, leftovers from an earlier vision for util.sql]]> Kim Alvefur <zash@zash.se> Sat, 22 Jul 2023 14:55:27 +0200 util: Prefix module imports with prosody namespace http://hg.omfa.de/prosody-hg/log/d10957394a3c/util/sql.lua Kim Alvefur <zash@zash.se> Fri, 17 Mar 2023 16:23:16 +0100 mod_storage_sql: Record connection to database as module status http://hg.omfa.de/prosody-hg/log/a20923f7d5fd/util/sql.lua
Allows retrieving this in e.g. a health reporting module

Thanks pfak]]> Kim Alvefur <zash@zash.se> Mon, 30 Jan 2023 00:38:26 +0100 util.sql: Handle failure to detect connection encoding http://hg.omfa.de/prosody-hg/log/8a42fd6702e6/util/sql.lua
Silences a luacheck warning about an unused variable]]> Kim Alvefur <zash@zash.se> Mon, 23 Dec 2019 21:13:27 +0100 util.sql: Preserve 3rd and 4th return values from transaction (fixes #1434) (thanks mrdoctorwho) http://hg.omfa.de/prosody-hg/log/a247fa8df7df/util/sql.lua Kim Alvefur <zash@zash.se> Sat, 28 Sep 2019 18:24:28 +0200 util.sql: Remove tostring call from logging http://hg.omfa.de/prosody-hg/log/c59d384b0959/util/sql.lua
Taken care of by loggingmanager now]]> Kim Alvefur <zash@zash.se> Tue, 30 Jul 2019 02:23:44 +0200 util.sql: Ignore if tables and indices already exist on creation (fixes #1064) http://hg.omfa.de/prosody-hg/log/7dd0dddd8e02/util/sql.lua
Tested with SQLite3 3.16.2 and 3.27.2 and Postgres 11.

MySQL does not support IF NOT EXISTS for indices so not handled here.]]> Kim Alvefur <zash@zash.se> Thu, 30 May 2019 23:50:28 +0200 util.sql: Switch from hacky multi-arg xpcall implementation to util.xpcall http://hg.omfa.de/prosody-hg/log/61376a3c0c1d/util/sql.lua Kim Alvefur <zash@zash.se> Sun, 11 Nov 2018 02:26:40 +0100 vairious: Add annotation when an empty environment is set [luacheck] http://hg.omfa.de/prosody-hg/log/4f0f5b49bb03/util/sql.lua Kim Alvefur <zash@zash.se> Wed, 28 Feb 2018 20:06:26 +0100 util: Ignore some Lua 5.1 vs 5.2 compat things [luacheck] http://hg.omfa.de/prosody-hg/log/5d866eb8f18f/util/sql.lua Kim Alvefur <zash@zash.se> Fri, 10 Nov 2017 17:47:11 +0100 util: Various minor changes to please [luacheck] http://hg.omfa.de/prosody-hg/log/e5d00bf4a4d5/util/sql.lua Kim Alvefur <zash@zash.se> Fri, 10 Nov 2017 05:42:32 +0100 util.sql: Discard useless substitution count from string.gsub in SQL debug logs http://hg.omfa.de/prosody-hg/log/a597ff326758/util/sql.lua Kim Alvefur <zash@zash.se> Wed, 08 Nov 2017 10:45:58 +0100 util.sql: Return an error message when a SQL commit fails (LuaDBI doesn't) (Thanks Ge0rG) http://hg.omfa.de/prosody-hg/log/6a098961bc00/util/sql.lua Kim Alvefur <zash@zash.se> Tue, 07 Nov 2017 09:26:48 +0100 util.sql: Don't log at error level if a transaction failed and was retried ok http://hg.omfa.de/prosody-hg/log/e9ac2d93de18/util/sql.lua Matthew Wild <mwild1@gmail.com> Wed, 04 Oct 2017 10:16:42 +0100 util.sql: Greedily read all rows so we can close queries early (fixes #391) http://hg.omfa.de/prosody-hg/log/becb593ed86d/util/sql.lua Matthew Wild <mwild1@gmail.com> Fri, 04 Aug 2017 18:52:15 +0100 util.sql: Produce more SQL-standard-like debug messages http://hg.omfa.de/prosody-hg/log/655837e9eeeb/util/sql.lua Kim Alvefur <zash@zash.se> Thu, 13 Apr 2017 22:37:35 +0200 util.sql: Strip indentation from queries for debug logging http://hg.omfa.de/prosody-hg/log/29b3957db212/util/sql.lua Kim Alvefur <zash@zash.se> Wed, 12 Apr 2017 18:57:40 +0200 util.sql: Apply quote transform in engine:execute so it is applied to eg encoding checks in mod_storage_sql (thanks Martin) http://hg.omfa.de/prosody-hg/log/6e0defa19ab9/util/sql.lua Kim Alvefur <zash@zash.se> Wed, 12 Apr 2017 17:26:44 +0200 SQL: Use standard quotes for columns and other identifiers, rewrite to grave accents for MySQL only (fixes #885) http://hg.omfa.de/prosody-hg/log/7361412a9664/util/sql.lua Kim Alvefur <zash@zash.se> Mon, 10 Apr 2017 23:13:39 +0200 util.sql: remove unused one-letter loop variables [luacheck] http://hg.omfa.de/prosody-hg/log/8a6c7c4b15fb/util/sql.lua Anton Shestakov <av6@dwimlabs.net> Sat, 23 Jul 2016 18:22:05 +0800 util.sql: Import type too (fix global access) http://hg.omfa.de/prosody-hg/log/0d991d5659f0/util/sql.lua Kim Alvefur <zash@zash.se> Sun, 22 May 2016 14:37:52 +0200 util.sql: Import pcall (fixes #677) http://hg.omfa.de/prosody-hg/log/f791651ee334/util/sql.lua Matthew Wild <mwild1@gmail.com> Sun, 22 May 2016 02:16:11 +0100 util.sql: Log errors in transaction to error level with traceback but return only error message (fixes #464) http://hg.omfa.de/prosody-hg/log/a2dce746599b/util/sql.lua Kim Alvefur <zash@zash.se> Fri, 25 Mar 2016 16:09:34 +0100 util.sql: Charset should be innocent until proven guilty (initialize charset_ok to true), fixes bug introduced in 187ba2e9c012 http://hg.omfa.de/prosody-hg/log/b4e99602ae75/util/sql.lua Matthew Wild <mwild1@gmail.com> Wed, 23 Mar 2016 12:17:28 +0000 util.sql: Catch errors from LuaDBI connect (Fixes #568) http://hg.omfa.de/prosody-hg/log/98c4c3a2b536/util/sql.lua Kim Alvefur <zash@zash.se> Mon, 21 Mar 2016 09:50:52 +0100 util.sql: Remove unused arguments [luacheck] http://hg.omfa.de/prosody-hg/log/30dfaf36ea6d/util/sql.lua Kim Alvefur <zash@zash.se> Sun, 13 Mar 2016 18:35:00 +0100 util.sql: Don't break out of result retreival loops http://hg.omfa.de/prosody-hg/log/187ba2e9c012/util/sql.lua Kim Alvefur <zash@zash.se> Sun, 13 Mar 2016 18:31:53 +0100 util.sql: Move per-driver (currenly only PostgreSQL) query transform into its own method http://hg.omfa.de/prosody-hg/log/a23ca90d1984/util/sql.lua Kim Alvefur <zash@zash.se> Sun, 13 Mar 2016 17:38:49 +0100 util.sql: Localize unpack() in Lua 5.2 compatible way http://hg.omfa.de/prosody-hg/log/0d7f80263813/util/sql.lua Kim Alvefur <zash@zash.se> Mon, 22 Feb 2016 17:30:12 +0100 util.sql: Raw query debug logging (needs to be explicitly enabled by a plugin) http://hg.omfa.de/prosody-hg/log/d350e475f94e/util/sql.lua Kim Alvefur <zash@zash.se> Sun, 21 Feb 2016 19:25:01 +0100 util.sql: Export db2uri (mod_storage_sql2 command uses it) (thanks mike) http://hg.omfa.de/prosody-hg/log/f824057189ed/util/sql.lua Kim Alvefur <zash@zash.se> Wed, 02 Sep 2015 14:14:22 +0200 util.sql: Log when transactions begin http://hg.omfa.de/prosody-hg/log/c37633feaece/util/sql.lua Kim Alvefur <zash@zash.se> Sun, 30 Aug 2015 13:45:36 +0200 util.*: Remove use of module() function, make all module functions local and return them in a table at the end http://hg.omfa.de/prosody-hg/log/5de6b93d0190/util/sql.lua Kim Alvefur <zash@zash.se> Sat, 21 Feb 2015 10:36:37 +0100 util.{interpolation,prosodyctl,sql}: Trim trailing whitespace http://hg.omfa.de/prosody-hg/log/60957dd5b41b/util/sql.lua Kim Alvefur <zash@zash.se> Fri, 17 Jul 2015 12:43:04 +0200 util.sql: Add safety check to ensure our chosen connection charset is actually being used (MySQL) http://hg.omfa.de/prosody-hg/log/b38db4b634d3/util/sql.lua Matthew Wild <mwild1@gmail.com> Wed, 08 Jul 2015 15:25:42 +0100 util.sql: Fix log level of debug message http://hg.omfa.de/prosody-hg/log/0cbb09afa5c3/util/sql.lua Matthew Wild <mwild1@gmail.com> Wed, 08 Jul 2015 15:16:17 +0100 util.sql: Log debug message when connecting to database http://hg.omfa.de/prosody-hg/log/9f2b1e0bba90/util/sql.lua Matthew Wild <mwild1@gmail.com> Wed, 08 Jul 2015 15:15:32 +0100 util.sql: Make set_encoding() return failure of SET NAMES http://hg.omfa.de/prosody-hg/log/e961ac4efbb3/util/sql.lua Matthew Wild <mwild1@gmail.com> Wed, 08 Jul 2015 15:14:24 +0100 util.sql: Return failure if set_encoding() fails http://hg.omfa.de/prosody-hg/log/ea43a5af31ca/util/sql.lua Matthew Wild <mwild1@gmail.com> Wed, 08 Jul 2015 15:10:25 +0100 util.sql: Use appropriate collation for the chosen character set - fixes MySQL silently ignoring our SET NAMES command when we use utf8mb4 http://hg.omfa.de/prosody-hg/log/e45a58c72609/util/sql.lua Matthew Wild <mwild1@gmail.com> Wed, 08 Jul 2015 15:06:20 +0100 util.sql: Create table with same charset as the charset we selected for our connection, also use corresponding _bin collation http://hg.omfa.de/prosody-hg/log/fb952032f83e/util/sql.lua Matthew Wild <mwild1@gmail.com> Wed, 08 Jul 2015 15:04:23 +0100 util.sql: Allow onconnect callback to fail connection to the DB by returning false, err http://hg.omfa.de/prosody-hg/log/88b89facc3c9/util/sql.lua Matthew Wild <mwild1@gmail.com> Tue, 07 Jul 2015 17:43:14 +0100 util.sql: Call onconnect, provide noop dummy if not set http://hg.omfa.de/prosody-hg/log/ccf4fcfc2024/util/sql.lua Kim Alvefur <zash@zash.se> Thu, 02 Jul 2015 22:32:44 +0200 util.sql: Remove built-in engine caching. This is the wrong layer to do this, and unintentionally sharing connections could cause problems (e.g. when interleaving multiple queries and result fetching) http://hg.omfa.de/prosody-hg/log/b553a30620b2/util/sql.lua Matthew Wild <mwild1@gmail.com> Wed, 03 Jun 2015 15:57:46 +0100 util.sql: Expose db2uri helper function http://hg.omfa.de/prosody-hg/log/592f6112563e/util/sql.lua Matthew Wild <mwild1@gmail.com> Wed, 03 Jun 2015 15:55:43 +0100 util.sql: Rename some variable to match conventions http://hg.omfa.de/prosody-hg/log/36e2b35397b1/util/sql.lua Matthew Wild <mwild1@gmail.com> Wed, 03 Jun 2015 15:54:52 +0100 util.sql: Remove unused functions and unused commented code http://hg.omfa.de/prosody-hg/log/7889515bac86/util/sql.lua Matthew Wild <mwild1@gmail.com> Sat, 30 May 2015 22:23:19 +0100 mod_storage_sql2, util.sql: Set character encoding on every connect http://hg.omfa.de/prosody-hg/log/a966efeb6cb3/util/sql.lua Kim Alvefur <zash@zash.se> Thu, 11 Dec 2014 09:18:39 +0100 util.sql: Fix previous commit http://hg.omfa.de/prosody-hg/log/d1cc67ed0767/util/sql.lua Kim Alvefur <zash@zash.se> Tue, 12 Nov 2013 11:38:52 +0100 util.sql: Get character set info from the correct database. http://hg.omfa.de/prosody-hg/log/06106726a1f0/util/sql.lua Kim Alvefur <zash@zash.se> Tue, 12 Nov 2013 11:13:45 +0100 util.sql: Rewrite auto increment columns to SERIAL for PostgreSQL http://hg.omfa.de/prosody-hg/log/f6145e894569/util/sql.lua Kim Alvefur <zash@zash.se> Mon, 11 Nov 2013 23:09:18 +0100 util.sql: Fix to call execute on 'self' rather than 'engine' (thanks eisensheng) http://hg.omfa.de/prosody-hg/log/a19b3646d5f0/util/sql.lua Matthew Wild <mwild1@gmail.com> Sun, 10 Nov 2013 23:10:27 +0000 util.sql: Rewrite MEDIUMTEXT to TEXT for drivers other than MySQL http://hg.omfa.de/prosody-hg/log/544ca3d94596/util/sql.lua Kim Alvefur <zash@zash.se> Wed, 30 Oct 2013 10:24:35 +0100 util.sql: Check what encoding SQLite3 uses http://hg.omfa.de/prosody-hg/log/ea6a3adb6a69/util/sql.lua Kim Alvefur <zash@zash.se> Tue, 29 Oct 2013 11:43:49 +0100 util.sql: Find out if MySQL supports utf8mb4 and use that http://hg.omfa.de/prosody-hg/log/f3e408ae59a6/util/sql.lua Kim Alvefur <zash@zash.se> Tue, 29 Oct 2013 11:42:55 +0100 util.sql: Support incrementing columns http://hg.omfa.de/prosody-hg/log/1f860279b2f8/util/sql.lua Kim Alvefur <zash@zash.se> Mon, 28 Oct 2013 23:20:25 +0100 util.sql: Allow columns to be marked the primary key http://hg.omfa.de/prosody-hg/log/1237f9cc3123/util/sql.lua Kim Alvefur <zash@zash.se> Mon, 28 Oct 2013 23:19:47 +0100