saint/discourse-import_scripts
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity

v0.42.1 Rewrite and simplication of concurrent-ruby support

Browse Source
This commit is contained in:
David Sainty 2024-08-18 00:10:57 +10:00
parent b7fcb220c9
commit d8633b5b6c
1 changed files with 7 additions and 6 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

13
gossamer_forums.rb
View File

@ -1161,16 +1161,17 @@ class GossamerForumsImporter < ImportScripts::Base
#### current_post_batch += 1 # Increment, moving to next post in the batch #### current_post_batch += 1 # Increment, moving to next post in the batch
#### break if current_post_batch >= parent_post_count #### break if current_post_batch >= parent_post_count
# Wait for all jobs in the current batch to finish before proceeding
puts "PP 33 -- Ready for shutdown"
pool.shutdown # Initiate thread pool shutdown after all jobs submitted
puts "PP 44 -- Now wait for termination"
pool.wait_for_termination # Wait for all threads to finish exec
# Check if all posts have been processed # Check if all posts have been processed
#### is_complete = true if current_post_batch >= parent_post_count #### is_complete = true if current_post_batch >= parent_post_count
is_complete = parent_post_ids.empty? is_complete = parent_post_ids.empty?
end end
# Wait for all jobs in the current batch to finish before proceeding
puts "PP 33 -- Ready for shutdown"
pool.shutdown # Initiate thread pool shutdown after all jobs submitted
puts "PP 44 -- Now wait for termination"
pool.wait_for_termination # Wait for all threads to finish exec
end end
# # Method to ensure thread-safe updates to highest_processed_post_id # # Method to ensure thread-safe updates to highest_processed_post_id