saint/discourse-import_scripts
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity

Commit Graph

  • 6360e99a96 v0.52 Improve handling and look at how we can improve ActiveRecord config for PostgreSQL and avoid insufficient pool size saint 2024-08-19 22:09:38 +10:00
  • 90ee7854b8 v0.52 Improve handling and look at how we can improve ActiveRecord config for PostgreSQL and avoid insufficient pool size saint 2024-08-19 22:04:37 +10:00
  • e312a4ed12 v0.52 Improve handling and look at how we can improve ActiveRecord config for PostgreSQL and avoid insufficient pool size saint 2024-08-19 22:01:47 +10:00
  • af3c46e1cf v0.52 Improve handling and look at how we can improve ActiveRecord config for PostgreSQL and avoid insufficient pool size saint 2024-08-19 21:33:37 +10:00
  • e37ba1c8a9 v0.51 Fix mysql bug saint 2024-08-19 20:15:35 +10:00
  • f00fa9d67d v0.51 Fix mysql bug saint 2024-08-19 20:00:59 +10:00
  • 78749e28fc v0.51 Fix mysql bug saint 2024-08-19 18:50:48 +10:00
  • e9750621bc Revert "v0.48.6 40-40-40" saint 2024-08-19 18:45:05 +10:00
  • 5ef554b4e1 v0.50 Work on MySQL brokenness saint 2024-08-19 18:37:05 +10:00
  • 6b4b728751 v0.48.6 40-40-40 saint 2024-08-19 13:42:03 +10:00
  • 7fde0fa255 v0.48.6 40-40-40 saint 2024-08-19 13:38:43 +10:00
  • 915961cf51 v0.48.6 40-40-40 saint 2024-08-19 13:33:32 +10:00
  • 9d6e1a0b7c v0.48.6 48-48-48, add handling for deleted-former user as OP poster saint 2024-08-19 13:26:37 +10:00
  • a10df09d09 v0.48.5 Batch size 1000, double councurrency numbers saint 2024-08-19 13:11:16 +10:00
  • c8203b0410 v0.48.5 Batch size 1000, double councurrency numbers saint 2024-08-19 12:53:23 +10:00
  • 198401f9f3 v0.48.5 Batch size 1000, double councurrency numbers saint 2024-08-19 12:50:41 +10:00
  • fc62e223ab v0.48.5 Batch size 1000, double councurrency numbers saint 2024-08-19 12:45:01 +10:00
  • d9ae43b78b v0.48.5 Batch size 1000, double councurrency numbers saint 2024-08-19 12:35:51 +10:00
  • 74d2ee7382 v0.48.4 Batch size 1000 saint 2024-08-19 12:13:27 +10:00
  • e0fd933526 v0.48.3 Further attempts to address MariaDB challenges and make things as foolproof as possible. saint 2024-08-19 12:04:50 +10:00
  • f3c91267af v0.48.1 Further attempts to address MariaDB challenges and make things as foolproof as possible. saint 2024-08-18 20:27:36 +10:00
  • ad7a5f945c v0.48.1 Further attempts to address MariaDB challenges and make things as foolproof as possible. saint 2024-08-18 20:10:07 +10:00
  • 6cb21584f3 v0.48.1 Further attempts to address MariaDB challenges and make things as foolproof as possible. saint 2024-08-18 20:02:21 +10:00
  • 87f2733dbd v0.48.1 Further attempts to address MariaDB challenges and make things as foolproof as possible. saint 2024-08-18 19:36:56 +10:00
  • 395b2e9c49 v0.48.1 Further attempts to address MariaDB challenges and make things as foolproof as possible. saint 2024-08-18 19:24:33 +10:00
  • 1d442ece31 v0.48.1 Further attempts to address MariaDB challenges and make things as foolproof as possible. saint 2024-08-18 19:16:03 +10:00
  • b0f300bf8e v0.48.1 Further attempts to address MariaDB challenges and make things as foolproof as possible. saint 2024-08-18 18:57:22 +10:00
  • 96c2b27250 v0.48.1 Further attempts to address MariaDB challenges and make things as foolproof as possible. saint 2024-08-18 18:26:16 +10:00
  • 08f62e4288 v0.48.1 Further attempts to address MariaDB challenges and make things as foolproof as possible. saint 2024-08-18 17:09:46 +10:00
  • 702d90cd34 v0.48 More attempts to address MariaDB craziness saint 2024-08-18 16:36:18 +10:00
  • eb6ec24033 v0.47.1 Fix .id nil bug saint 2024-08-18 16:35:52 +10:00
  • 8caa2027cb v0.47.1 Fix .id nil bug saint 2024-08-18 16:16:01 +10:00
  • 2d233fdb42 v0.47.1 Fix .id nil bug saint 2024-08-18 16:13:05 +10:00
  • 3e608d599b v0.47.1 Fix .id nil bug saint 2024-08-18 16:08:14 +10:00
  • 468b8b725b v0.47 Significant tweaks and workarounds to try to improve smooth operation. saint 2024-08-18 15:56:12 +10:00
  • ddf59a09a5 v0.46 Restore use of ConnectionPool, tweak threads, mysql pool size, timeout, add full stacktraces saint 2024-08-18 15:06:30 +10:00
  • 18d81d3880 v0.45 SQLIte mutexes only wrap around updates now saint 2024-08-18 05:47:22 +10:00
  • f7db3e8991 v0.45 SQLIte mutexes only wrap around updates now saint 2024-08-18 05:30:38 +10:00
  • 0372db9cc7 v0.45 SQLIte mutexes only wrap around updates now saint 2024-08-18 05:12:42 +10:00
  • 90a2d2fa37 v0.44 Try removing connection_pool and starting MySQL within thread method and fix handle_post_attachment saint 2024-08-18 04:39:51 +10:00
  • 798153c8fc v0.43 Move to connection pooling for MySQL problem saint 2024-08-18 03:35:41 +10:00
  • 698c1b0f26 v0.43 Move to connection pooling for MySQL problem saint 2024-08-18 03:12:07 +10:00
  • 855a0a9e46 v0.43 Move to connection pooling for MySQL problem saint 2024-08-18 02:41:56 +10:00
  • 416dc9c1e0 v0.42.1 Rewrite and simplication of concurrent-ruby support saint 2024-08-18 02:01:31 +10:00
  • 7b3a9babcb v0.42.1 Rewrite and simplication of concurrent-ruby support saint 2024-08-18 01:44:29 +10:00
  • 23a65c5f5c v0.42.1 Rewrite and simplication of concurrent-ruby support saint 2024-08-18 01:23:54 +10:00
  • 5c648f97c1 v0.42.1 Rewrite and simplication of concurrent-ruby support saint 2024-08-18 01:08:13 +10:00
  • 7847784e0e v0.42.1 Rewrite and simplication of concurrent-ruby support saint 2024-08-18 01:04:30 +10:00
  • 2b95e0a89c v0.42.1 Rewrite and simplication of concurrent-ruby support saint 2024-08-18 00:17:24 +10:00
  • d8633b5b6c v0.42.1 Rewrite and simplication of concurrent-ruby support saint 2024-08-18 00:10:57 +10:00
  • b7fcb220c9 v0.42.1 Rewrite and simplication of concurrent-ruby support saint 2024-08-17 23:57:56 +10:00
  • 8e6edb2d3f v0.42.1 Rewrite and simplication of concurrent-ruby support saint 2024-08-17 23:51:42 +10:00
  • 78797c3ec1 v0.42.1 Rewrite and simplication of concurrent-ruby support saint 2024-08-17 23:08:35 +10:00
  • 5a0e8a7d2b v0.42.1 Rewrite and simplication of concurrent-ruby support saint 2024-08-17 23:05:09 +10:00
  • ef50d344c9 v0.42.1 Rewrite and simplication of concurrent-ruby support saint 2024-08-17 23:02:02 +10:00
  • 6edd8a985d v0.42.1 Rewrite and simplication of concurrent-ruby support saint 2024-08-17 22:51:02 +10:00
  • e217447a48 v0.42.1 Rewrite and simplication of concurrent-ruby support saint 2024-08-17 22:47:56 +10:00
  • ccff9b1b64 v0.42.1 Rewrite and simplication of concurrent-ruby support saint 2024-08-17 22:45:04 +10:00
  • fed7a8935e v0.42.1 Rewrite and simplication of concurrent-ruby support saint 2024-08-17 22:29:49 +10:00
  • 678012f76a v0.42.1 Rewrite and simplication of concurrent-ruby support saint 2024-08-17 22:26:07 +10:00
  • f90d0fb6ae v0.42.1 Rewrite and simplication of concurrent-ruby support saint 2024-08-17 22:23:25 +10:00
  • b44e9baf57 v0.42 Mutex addition for SQLite (which may be very important saint 2024-08-17 20:34:47 +10:00
  • d3e6dac1de v0.42 Mutex addition for SQLite (which may be very important saint 2024-08-17 20:25:48 +10:00
  • 3a1476951e v0.41.2 Several bug fixes and improvements for fully concurrent topic-post import saint 2024-08-17 19:08:38 +10:00
  • 8f80fbd19f v0.41.2 Several bug fixes and improvements for fully concurrent topic-post import saint 2024-08-17 19:04:57 +10:00
  • 7faa849198 v0.41.2 Several bug fixes and improvements for fully concurrent topic-post import saint 2024-08-17 18:56:30 +10:00
  • 29f66c1e60 v0.41.2 Several bug fixes and improvements for fully concurrent topic-post import saint 2024-08-17 18:52:51 +10:00
  • 4f608ce87f v0.41.1 Fixes for FULL concurrency support saint 2024-08-17 17:09:36 +10:00
  • 8dd8e2f72e v0.41 Further improve FULL concurrency support, for both MySQL/MariaDB _and_ importantly, the PostGreSQL Discourse DB additions and changes with ActiveRecord connection pooling and Mutex saint 2024-08-17 16:34:46 +10:00
  • 5e2d2e78e5 v0.41 Further improve FULL concurrency support, for both MySQL/MariaDB _and_ importantly, the PostGreSQL Discourse DB additions and changes with ActiveRecord connection pooling and Mutex saint 2024-08-17 16:16:53 +10:00
  • 2966e1c9f9 v0.41 Further improve FULL concurrency support, for both MySQL/MariaDB _and_ importantly, the PostGreSQL Discourse DB additions and changes with ActiveRecord connection pooling and Mutex saint 2024-08-17 16:09:57 +10:00
  • a005cda0ae v0.41 Further improve FULL concurrency support, for both MySQL/MariaDB _and_ importantly, the PostGreSQL Discourse DB additions and changes with ActiveRecord connection pooling and Mutex saint 2024-08-17 15:55:22 +10:00
  • 168dcc9db7 v0.40 Move to per thread MySQL/MariaDB connection saint 2024-08-17 04:41:53 +10:00
  • 35b97db341 v0.40 Move to per thread MySQL/MariaDB connection saint 2024-08-17 04:33:57 +10:00
  • c11055d0f4 v0.39.7 Fixes/tweaks in calculate_dynamic_pool_size saint 2024-08-17 03:27:17 +10:00
  • 1f09322207 v0.39.7 Fixes/tweaks in calculate_dynamic_pool_size saint 2024-08-17 03:09:40 +10:00
  • 524fae9283 v0.39.7 Fixes/tweaks in calculate_dynamic_pool_size saint 2024-08-17 03:06:07 +10:00
  • 77930217df v0.39.6 Fixes/tweaks in calculate_dynamic_pool_size saint 2024-08-17 02:56:46 +10:00
  • e5e6dff339 v0.39.5 Add SQLite table for tracking successful post importation; Split out user import into three separate callable methods; require sys/proctable saint 2024-08-17 02:47:22 +10:00
  • 061aaba9fe v0.39.4 Add SQLite table for tracking successful post importation; Split out user import into three separate callable methods; require sys/proctable saint 2024-08-17 02:22:25 +10:00
  • 44d673ffaa v0.39.3 Add SQLite table for tracking successful post importation; Split out user import into three separate callable methods; require sys/proctable saint 2024-08-17 02:16:15 +10:00
  • 5b6f2c3c0e v0.39.2 Add SQLite table for tracking successful post importation; Split out user import into three separate callable methods; require sys/proctable saint 2024-08-17 01:57:32 +10:00
  • ea1dae98d7 v0.39.1 Add SQLite table for tracking successful post importation; Split out user import into three separate callable methods; require sys/proctable saint 2024-08-17 01:52:45 +10:00
  • 5002b90712 v0.39 Add SQLite table for tracking successful post importation; Split out user import into three separate callable methods; require sys/proctable saint 2024-08-17 01:06:25 +10:00
  • 7b0a45cb89 v0.38 Attempt to reimplement with mutex support for interrupting and resuming during post import. This will have to be tested / validated saint 2024-08-16 22:20:52 +10:00
  • 36037ea05a v0.37.1 Huge move to threaded support for topic-post import; disable topic-post import for current user re-import 202408162130, persistence for exported files saint 2024-08-16 21:34:02 +10:00
  • 84162b1b78 v0.37 Huge move to threaded support for topic-post import; disable topic-post import for current user re-import 202408162130 saint 2024-08-16 21:30:56 +10:00
  • 3d7e5701ef Merge pull request 'ross-improvements' (#1) from ross-improvements into main David Sainty 2024-08-16 08:56:18 +00:00
  • f3b1f0416d added suggestion for thread count tweaking Ross Trottier 2024-08-15 12:58:03 -06:00
  • 16c261bede index out of range issue fixed Ross Trottier 2024-08-15 12:51:07 -06:00
  • b73be6d27f concurrency outline Ross Trottier 2024-08-15 11:49:52 -06:00
  • 0ad1482f95 optimized main query for post import Ross Trottier 2024-08-15 09:24:24 -06:00
  • 008b9d74dd added suggestion for thread count tweaking ross-improvements Ross Trottier 2024-08-15 12:58:03 -06:00
  • 1811f7f3e0 index out of range issue fixed Ross Trottier 2024-08-15 12:51:07 -06:00
  • 6c85157c28 concurrency outline Ross Trottier 2024-08-15 11:49:52 -06:00
  • 4ad23d19b7 prep for 20240816 import run saint 2024-08-16 03:17:06 +10:00
  • cace4e88ee goss-cleanup.rb and goss-delalluser-20240527.rb fixes saint 2024-08-16 02:53:45 +10:00
  • e9e5e46b43 goss-cleanup.rb and goss-delalluser-20240527.rb fixes saint 2024-08-16 02:49:02 +10:00
  • ab0449e2ef v0.36.8 Move SQLite3 DB to persistent storage /bitnami/discourse/sqlite saint 2024-08-16 02:41:35 +10:00
  • 349df7239f optimized main query for post import Ross Trottier 2024-08-15 09:24:24 -06:00