Not a member of Pastebin yet?
Sign Up,
it unlocks many cool features!
- [03/01/2012 22:13:43] Loading webserver config from: @webserver_default_mono.xml
- [03/01/2012 22:13:43] Note: running under 32-bit mode
- [03/01/2012 22:13:43] Updating database DLL libsqlite3.so.0.32bit into libsqlite3.so.0
- [03/01/2012 22:13:43] Node will use ADV_HTTP library for crawling
- [03/01/2012 22:13:43] Attempting to upgrade database...
- [03/01/2012 22:13:43] Successfully upgraded database!
- [03/01/2012 22:13:43] Data clean up run with results: Total url buckets in the database: 0
- *** URL BUCKETS ***
- Number of known buckets: 0
- Number of NOT known buckets: 0
- Number of known buckets to be deleted: 0
- *** DATA BARRELS ***
- Number of known data barrels: 0
- Number of NOT known data barrels: 0
- Number of known data barrels to be deleted: 0
- CONCLUSION:
- Files that can be deleted: 0
- Size that can be freed (KB): 0
- Note: if you have a high number of NOT known items
- then please report it on forum (see Help -> Forum)
- [03/01/2012 22:13:44] Buckets server address: http://crawl.majestic12.co.uk
- [03/01/2012 22:13:44] Mozilla/5.0 (compatible; MJ12bot/v1.4.2; http://www.majestic12.co.uk/bot.php?+ started with 15 worker(s)
- [03/01/2012 22:13:44] Activity file update period is set to 15 secs
- [03/01/2012 22:13:48] Majestic-12 WebServer v0.9.3 started on all network interfaces with port 1088
- [03/01/2012 22:13:49] Note: running under 32-bit mode
- [03/01/2012 22:13:50] Not requesting more urls because registration details appear to be missing
- [03/01/2012 22:14:50] Not requesting more urls because registration details appear to be missing
- [03/01/2012 22:15:50] Not requesting more urls because registration details appear to be missing
- [03/01/2012 22:16:50] Not requesting more urls because registration details appear to be missing
- [03/01/2012 22:17:50] Not requesting more urls because registration details appear to be missing
- [03/01/2012 22:18:27] Note: running under 32-bit mode
- [03/01/2012 22:21:38] The line above was repeated 1 more time
- [03/01/2012 22:21:38] WebCrawler: grace shutdown requested...
- [03/01/2012 22:21:38] WebCrawler: shutting down.
- [03/01/2012 22:21:38] Killing thread oURLManager (Alive=False) with state: Stopped
- [03/01/2012 22:21:38] Killing thread oCrawl (Alive=False) with state: Stopped
- [03/01/2012 22:21:38] Shutting down...
- [03/01/2012 22:21:38] Timer cleared
- [03/01/2012 22:21:38] Started clearing listener
- [03/01/2012 22:21:38] Shutdown finished.
- [03/01/2012 22:21:38] WebServer: shutting down.
- [03/01/2012 22:21:38] Shutting down....
- [03/01/2012 22:21:38] Aborting KeyPresser thread
- [03/01/2012 22:21:38] Exit code: 1
- [03/01/2012 22:21:38] Failed to read key press due to Thread was being aborted - finishing key monitoring now use Web Console or -quite command line param to avoid this message!
- Failed to write log entry for line: {0}{1}{2}{3}{4}[03/01/2012 22:21:49] MJ12node v1.7.7 starting up
- [03/01/2012 22:21:49] Loading webserver config from: /root/MJ12node/webserver.xml
- [03/01/2012 22:21:49] Majestic-12 WebServer v0.9.3 started on all network interfaces with port 1088
- [03/01/2012 22:21:49] Note: running under 32-bit mode
- [03/01/2012 22:21:49] Node will use ADV_HTTP library for crawling
- [03/01/2012 22:21:50] Attempting to upgrade database...
- [03/01/2012 22:21:50] Successfully upgraded database!
- [03/01/2012 22:21:50] Buckets server address: http://crawl.majestic12.co.uk
- [03/01/2012 22:21:50] Mozilla/5.0 (compatible; MJ12bot/v1.4.2; http://www.majestic12.co.uk/bot.php?+ started with 100 worker(s)
- [03/01/2012 22:21:50] Activity file update period is set to 15 secs
- [03/01/2012 22:21:55] Note: running under 32-bit mode
- [03/01/2012 22:24:51] The line above was repeated 2 more times
- [03/01/2012 22:24:51] WebCrawler: grace shutdown requested...
- [03/01/2012 22:24:51] Waiting for 18 active transfer(s) to end...
- [03/01/2012 22:24:53] Waiting for 4 active transfer(s) to end...
- [03/01/2012 22:24:55] Waiting for 3 active transfer(s) to end...
- [03/01/2012 22:24:57] Waiting for 2 active transfer(s) to end...
- [03/01/2012 22:25:02] Waiting for 1 active transfer(s) to end...
- [03/01/2012 22:25:11] Aborted requests in 73 worker(s)
- [03/01/2012 22:25:11] WebCrawler: shutting down.
- [03/01/2012 22:25:11] Killing thread oURLManager (Alive=False) with state: Stopped
- [03/01/2012 22:25:11] Killing thread oCrawl (Alive=False) with state: Stopped
- [03/01/2012 22:25:11] Shutting down...
- [03/01/2012 22:25:11] Timer cleared
- [03/01/2012 22:25:11] Started clearing listener
- [03/01/2012 22:25:11] Shutdown finished.
- [03/01/2012 22:25:11] WebServer: shutting down.
- [03/01/2012 22:25:11] Shutting down....
- [03/01/2012 22:25:11] Aborting KeyPresser thread
- [03/01/2012 22:25:11] Exit code: 1
- [03/01/2012 22:25:11] Failed to read key press due to Thread was being aborted - finishing key monitoring now use Web Console or -quite command line param to avoid this message!
- [03/01/2012 22:30:40] MJ12node v1.7.7 starting up
- [03/01/2012 22:30:40] Loading webserver config from: /root/MJ12node/webserver.xml
- [03/01/2012 22:30:40] Majestic-12 WebServer v0.9.3 started on all network interfaces with port 1088
- [03/01/2012 22:30:40] Note: running under 32-bit mode
- [03/01/2012 22:30:40] Node will use ADV_HTTP library for crawling
- [03/01/2012 22:30:40] Buckets server address: http://crawl.majestic12.co.uk
- [03/01/2012 22:30:40] Mozilla/5.0 (compatible; MJ12bot/v1.4.2; http://www.majestic12.co.uk/bot.php?+ started with 999 worker(s)
- [03/01/2012 22:30:40] Activity file update period is set to 15 secs
- [03/01/2012 22:30:45] Note: running under 32-bit mode
- [03/01/2012 22:30:51] The line above was repeated 2 more times
- [03/01/2012 22:30:51] Using new Mono execution style: /root/MJ12node/MJ12barMono.exe
- [03/01/2012 22:32:45] Note: running under 32-bit mode
- [03/01/2012 23:00:19] Shutting down...
- [03/01/2012 23:00:19] Timer cleared
- [03/01/2012 23:00:19] Started clearing listener
- [03/01/2012 23:00:19] Shutdown finished.
- [03/01/2012 23:00:19] WebServer: shutting down.
- [03/01/2012 23:00:19] Shutting down....
- [03/01/2012 23:13:30] Could not append new item to buffer due to: System.Exception: Uneven Keys and Values counts: 5!=6
- at Majestic12.URLDataBarrel.SaveNewItem (System.Collections.ArrayList oKeys, System.Collections.ArrayList oValues, System.Byte[] bData, Int32 iOffset, Int32 iLength, System.Byte[] bBuffer, System.Int32& iBufferPos, BarrelVersion oBarrelVersion) [0x00000] in <filename unknown>:0
- at Majestic12.URLDataBarrelWriter.AppendData (System.String p_sURL, System.Collections.ArrayList oHeadersKeys, System.Collections.ArrayList oHeadersValues, System.Byte[] bData, Int32 iDataLength, System.Byte[] bCompBuffer, System.Byte[] bScratch) [0x00000] in <filename unknown>:0
- [03/01/2012 23:24:32] Could not execute action GetURLs - Error: ConnectFailure (Connection timed out)
- [03/01/2012 23:24:32] Could not connect to server to get more urls, will retry later.
- [03/01/2012 23:26:59] Could not execute action GetURLs - Error: ConnectFailure (Connection timed out)
- [03/01/2012 23:26:59] Could not connect to server to get more urls, will retry later.
- [03/01/2012 23:29:21] Could not execute action GetURLs - Error: ConnectFailure (Connection timed out)
- [03/01/2012 23:29:21] BucketManager: Server seems to be down persistently, so we will wait for at least 60 secs
- [03/01/2012 23:31:40] Could not execute action GetUploadTarget - Error: NameResolutionFailure
- [03/01/2012 23:31:40] Failed to get upload target due to ConnectivityProblem
- [03/01/2012 23:31:40] Could not connect to server to start uploading, looks like it's down, will retry later.
- [03/01/2012 23:31:41] Could not execute action UpdateNodeStatus - Error: NameResolutionFailure
- [03/01/2012 23:31:41] Could not execute action GetUploadTarget - Error: NameResolutionFailure
- [03/01/2012 23:31:41] Failed to get upload target due to ConnectivityProblem
- [03/01/2012 23:31:41] Could not connect to server to start uploading, looks like it's down, will retry later.
- [03/01/2012 23:31:42] Could not execute action GetUploadTarget - Error: NameResolutionFailure
- [03/01/2012 23:31:42] Failed to get upload target due to ConnectivityProblem
- [03/01/2012 23:31:42] UploadManager: Server seems to be down persistently, so we will wait for at least 60 secs
- [03/01/2012 23:32:22] Could not execute action GetURLs - Error: NameResolutionFailure
- [03/01/2012 23:32:22] BucketManager: Server seems to be down persistently, so we will wait for at least 60 secs
- [03/01/2012 23:32:44] Could not execute action GetUploadTarget - Error: NameResolutionFailure
- [03/01/2012 23:32:44] Failed to get upload target due to ConnectivityProblem
- [03/01/2012 23:32:44] UploadManager: Server seems to be down persistently, so we will wait for at least 60 secs
- [03/01/2012 23:32:52] Could not execute action GetUploadTarget - Error: NameResolutionFailure
- [03/01/2012 23:32:52] Failed to get upload target due to ConnectivityProblem
- [03/01/2012 23:32:52] UploadManager: Server seems to be down persistently, so we will wait for at least 60 secs
- [03/01/2012 23:33:32] Could not execute action GetUploadTarget - Error: NameResolutionFailure
- [03/01/2012 23:33:32] Failed to get upload target due to ConnectivityProblem
- [03/01/2012 23:33:32] UploadManager: Server seems to be down persistently, so we will wait for at least 60 secs
- [03/01/2012 23:34:09] Could not execute action GetUploadTarget - Error: NameResolutionFailure
- [03/01/2012 23:34:09] Failed to get upload target due to ConnectivityProblem
- [03/01/2012 23:34:09] UploadManager: Server seems to be down persistently, so we will wait for at least 60 secs
- [03/01/2012 23:34:32] Could not execute action GetUploadTarget - Error: NameResolutionFailure
- [03/01/2012 23:34:32] Failed to get upload target due to ConnectivityProblem
- [03/01/2012 23:34:32] UploadManager: Server seems to be down persistently, so we will wait for at least 60 secs
- [03/01/2012 23:35:22] Could not execute action GetURLs - Error: NameResolutionFailure
- [03/01/2012 23:35:22] BucketManager: Server seems to be down persistently, so we will wait for at least 60 secs
- [03/01/2012 23:35:33] Could not execute action GetUploadTarget - Error: NameResolutionFailure
- [03/01/2012 23:35:33] Failed to get upload target due to ConnectivityProblem
- [03/01/2012 23:35:33] UploadManager: Server seems to be down persistently, so we will wait for at least 60 secs
- [03/01/2012 23:36:34] Could not execute action GetUploadTarget - Error: NameResolutionFailure
- [03/01/2012 23:36:34] Failed to get upload target due to ConnectivityProblem
- [03/01/2012 23:36:34] UploadManager: Server seems to be down persistently, so we will wait for at least 60 secs
- [03/01/2012 23:37:35] Could not execute action GetUploadTarget - Error: NameResolutionFailure
- [03/01/2012 23:37:35] Failed to get upload target due to ConnectivityProblem
- [03/01/2012 23:37:35] UploadManager: Server seems to be down persistently, so we will wait for at least 60 secs
Advertisement
Add Comment
Please, Sign In to add comment