En effet, pourtout la VM tourne depuis 48 jours, les ressources sont OK, et le noeud Duniter qu’il contient est à jour: https://duniter-v1-g1.axiom-team.fr/blockchain/current
Voici les logs status du serveur wotwizard en question:
axiom@duniter-v1-data:~$ sudo systemctl status wwServer -n500
* wwServer.service - wotwizard server
Loaded: loaded (/etc/systemd/system/wwServer.service; enabled; vendor preset: enabled)
Active: failed (Result: exit-code) since Sat 2023-12-09 00:40:19 CET; 2 days ago
Process: 105 ExecStart=/home/axiom/wotwizard/wwServer -du /home/axiom/.config/duniter/duniter_default/wotwizard-export.db (code=exited, status=2)
Main PID: 105 (code=exited, status=2)
CPU: 5d 16h 20min 56.802s
Oct 24 01:09:27 duniter-v1-data systemd[1]: Started wotwizard server.
Oct 24 01:09:27 duniter-v1-data wwServer[105]: WotWizard version 5.8.8
Oct 24 01:09:51 duniter-v1-data wwServer[105]: Listening on 0.0.0.0:10050 ...
Nov 29 14:14:55 duniter-v1-data wwServer[105]: 2023/11/29 14:14:55 http: panic serving 192.168.9.1:51956: 20
Nov 29 14:14:55 duniter-v1-data wwServer[105]: goroutine 111157072 [running]:
Nov 29 14:14:55 duniter-v1-data wwServer[105]: net/http.(*conn).serve.func1()
Nov 29 14:14:55 duniter-v1-data wwServer[105]: /usr/local/go/src/net/http/server.go:1825 +0xbf
Nov 29 14:14:55 duniter-v1-data wwServer[105]: panic({0x8b83a0, 0x9f8a10})
Nov 29 14:14:55 duniter-v1-data wwServer[105]: /usr/local/go/src/runtime/panic.go:844 +0x258
Nov 29 14:14:55 duniter-v1-data wwServer[105]: util/misc.haltCommon({0xc0077a3348, 0x1, 0xc0005e0600?})
Nov 29 14:14:55 duniter-v1-data wwServer[105]: /home/gerard/goPerso/src/util/misc/misc.go:222 +0x1e5
Nov 29 14:14:55 duniter-v1-data wwServer[105]: util/misc.Assert(...)
Nov 29 14:14:55 duniter-v1-data wwServer[105]: /home/gerard/goPerso/src/util/misc/misc.go:232
Nov 29 14:14:55 duniter-v1-data wwServer[105]: util/strMapping.(*Lang).Map(0xc000130090?, {0x93c0b3?, 0xa?}, {0xc0077a33a8?, 0x2?, 0xc0077a3408?})
Nov 29 14:14:55 duniter-v1-data wwServer[105]: /home/gerard/goPerso/src/util/strMapping/strMapping.go:204 +0xa8
Nov 29 14:14:55 duniter-v1-data wwServer[105]: util/graphQL.(*errorT).MappedError(0xc006aec920?, {0x93c0b3?, 0x7f48f5fde108?}, {0x0?, 0xc0077a3428?}, {0x0?, >
Nov 29 14:14:55 duniter-v1-data wwServer[105]: /home/gerard/goPerso/src/util/graphQL/graphQL.go:1320 +0x76
Nov 29 14:14:55 duniter-v1-data wwServer[105]: duniter/gqlReceiver.coerceInt64({0xa000c0?, 0xc00015a6c0?}, {0x9fb780?, 0xc008c22e08?}, {0x0?, 0x0?}, 0xc0000f>
Nov 29 14:14:55 duniter-v1-data wwServer[105]: /home/gerard/goPerso/src/duniter/gqlReceiver/gqlReceiver.go:542 +0xb5
Nov 29 14:14:55 duniter-v1-data wwServer[105]: util/graphQL.(*typeSystem).isConstInputValueCoercibleToType(0x8e5b00?, {0x9fb780?, 0xc008c22e08?}, {0x0?, 0x0?>
Nov 29 14:14:55 duniter-v1-data wwServer[105]: /home/gerard/goPerso/src/util/graphQL/graphQL.go:3367 +0x3d5
Nov 29 14:14:55 duniter-v1-data wwServer[105]: util/graphQL.(*typeSystem).validateArgumentValuesCoercion(0xc00015a6c0, {0xc005813b00, 0x2, 0xc00015a6c0?}, {0>
Nov 29 14:14:55 duniter-v1-data wwServer[105]: /home/gerard/goPerso/src/util/graphQL/graphQL.go:3476 +0x4e5
Nov 29 14:14:55 duniter-v1-data wwServer[105]: util/graphQL.(*execSystem).argumentNamesSetWalkR(0xc00015a6c0, {0xc006aec7f0?, 0x1, 0x549531?}, {0xedf688, 0x0>
Nov 29 14:14:55 duniter-v1-data wwServer[105]: /home/gerard/goPerso/src/util/graphQL/graphQL.go:3606 +0x4ba
Nov 29 14:14:55 duniter-v1-data wwServer[105]: util/graphQL.(*execSystem).validateRequiredArguments(0xc00015a6c0, 0xc006aec7e0?)
Nov 29 14:14:55 duniter-v1-data wwServer[105]: /home/gerard/goPerso/src/util/graphQL/graphQL.go:3640 +0xff
Nov 29 14:14:55 duniter-v1-data wwServer[105]: util/graphQL.(*execSystem).validateArguments(0xc00015a6c0, 0xc005813c20)
Nov 29 14:14:55 duniter-v1-data wwServer[105]: /home/gerard/goPerso/src/util/graphQL/graphQL.go:3649 +0x77
Nov 29 14:14:55 duniter-v1-data wwServer[105]: util/graphQL.(*typeSystem).ExecValidate(0xc00015f000, 0xc005813c20)
Nov 29 14:14:55 duniter-v1-data wwServer[105]: /home/gerard/goPerso/src/util/graphQL/graphQL.go:6653 +0x385
Nov 29 14:14:55 duniter-v1-data wwServer[105]: duniter/gqlReceiver.makeHandler.func1({0x9fe9d0?, 0xc007d1e000}, 0x0?)
Nov 29 14:14:55 duniter-v1-data wwServer[105]: /home/gerard/goPerso/src/duniter/gqlReceiver/gqlReceiver.go:419 +0x14e
Nov 29 14:14:55 duniter-v1-data wwServer[105]: net/http.HandlerFunc.ServeHTTP(0xc007539a88?, {0x9fe9d0?, 0xc007d1e000?}, 0xc0083db0b0?)
Nov 29 14:14:55 duniter-v1-data wwServer[105]: /usr/local/go/src/net/http/server.go:2084 +0x2f
Nov 29 14:14:55 duniter-v1-data wwServer[105]: net/http.(*ServeMux).ServeHTTP(0x0?, {0x9fe9d0, 0xc007d1e000}, 0xc0083daf00)
Nov 29 14:14:55 duniter-v1-data wwServer[105]: /usr/local/go/src/net/http/server.go:2462 +0x149
Nov 29 14:14:55 duniter-v1-data wwServer[105]: net/http.serverHandler.ServeHTTP({0x9fd510?}, {0x9fe9d0, 0xc007d1e000}, 0xc0083daf00)
Nov 29 14:14:55 duniter-v1-data wwServer[105]: /usr/local/go/src/net/http/server.go:2916 +0x43b
Nov 29 14:14:55 duniter-v1-data wwServer[105]: net/http.(*conn).serve(0xc008cc6320, {0x9fedd8, 0xc000784c30})
Nov 29 14:14:55 duniter-v1-data wwServer[105]: /usr/local/go/src/net/http/server.go:1966 +0x5d7
Nov 29 14:14:55 duniter-v1-data wwServer[105]: created by net/http.(*Server).Serve
Nov 29 14:14:55 duniter-v1-data wwServer[105]: /usr/local/go/src/net/http/server.go:3071 +0x4db
Dec 09 00:40:19 duniter-v1-data wwServer[105]: panic: 101
Dec 09 00:40:19 duniter-v1-data wwServer[105]: goroutine 1 [running]:
Dec 09 00:40:19 duniter-v1-data wwServer[105]: util/misc.haltCommon({0xc000050c88, 0x2, 0x939f64?})
Dec 09 00:40:19 duniter-v1-data wwServer[105]: /home/gerard/goPerso/src/util/misc/misc.go:222 +0x1e5
Dec 09 00:40:19 duniter-v1-data wwServer[105]: util/misc.Assert(...)
Dec 09 00:40:19 duniter-v1-data wwServer[105]: /home/gerard/goPerso/src/util/misc/misc.go:232
Dec 09 00:40:19 duniter-v1-data wwServer[105]: duniter/blockchain.readSyncTime()
Dec 09 00:40:19 duniter-v1-data wwServer[105]: /home/gerard/goPerso/src/duniter/blockchain/blockchain.go:2875 +0x19c
Dec 09 00:40:19 duniter-v1-data wwServer[105]: duniter/blockchain.updateAllUpdt(0xc000126180?, 0xc0005fc000)
Dec 09 00:40:19 duniter-v1-data wwServer[105]: /home/gerard/goPerso/src/duniter/blockchain/blockchain.go:2910 +0x2b7
Dec 09 00:40:19 duniter-v1-data wwServer[105]: duniter/blockchain.Start(0xc00018a900)
Dec 09 00:40:19 duniter-v1-data wwServer[105]: /home/gerard/goPerso/src/duniter/blockchain/blockchain.go:3101 +0x16a
Dec 09 00:40:19 duniter-v1-data wwServer[105]: duniter/gqlReceiver.Start()
Dec 09 00:40:19 duniter-v1-data wwServer[105]: /home/gerard/goPerso/src/duniter/gqlReceiver/gqlReceiver.go:654 +0x74
Dec 09 00:40:19 duniter-v1-data wwServer[105]: duniter/run.Start()
Dec 09 00:40:19 duniter-v1-data wwServer[105]: /home/gerard/goPerso/src/duniter/run/run.go:55 +0x1c5
Dec 09 00:40:19 duniter-v1-data wwServer[105]: main.main()
Dec 09 00:40:19 duniter-v1-data wwServer[105]: /home/gerard/goPerso/src/duniter/wwServer/wwServer.go:24 +0x2a
Dec 09 00:40:19 duniter-v1-data systemd[1]: wwServer.service: Main process exited, code=exited, status=2/INVALIDARGUMENT
Dec 09 00:40:19 duniter-v1-data systemd[1]: wwServer.service: Failed with result 'exit-code'.
Dec 09 00:40:19 duniter-v1-data systemd[1]: wwServer.service: Consumed 5d 16h 20min 56.802s CPU time.
En résumé:
WotWizard version 5.8.8
failed [...] 2 days ago
Dec 09 00:40:19: panic: 101
/home/gerard/goPerso/src/util/misc/misc.go:222 +0x1e5
?
code=exited, status=2/INVALIDARGUMENT
Peut être une piste de CPU overload:
Pourtant il y a 4 CPU de l’infra mmicro alloué à ce container.
Ce container ne contient que wotwizard, duniter v1 et worldwotmap et wotmap.
6h30 correspond au moment où le cron de wotmap et worldwotmap se déclenchent:
echo "Update worldwotmap..."
/usr/bin/python3 /home/axiom/worldwotmap/py/gencache.py -v -e /home/axiom/worldwotmap/www/data -r --spam
echo "Update wotmap..."
/usr/bin/python3 /home/axiom/wotmap/script/wot_json.py -v --ns --fa2rs -s --ow /home/axiom/wotmap/data/wot.json --os /home/axiom/wotmap/data/stats.json
Mais wwizard semble s’être coupé plusieurs heure avant, à 00:40, donc je ne sais pas.
Un restart et ça repart:
axiom@duniter-v1-data:~$ sudo systemctl restart wwServer
axiom@duniter-v1-data:~$ sudo systemctl status wwServer
* wwServer.service - wotwizard server
Loaded: loaded (/etc/systemd/system/wwServer.service; enabled; vendor preset: enabled)
Active: active (running) since Mon 2023-12-11 18:30:55 CET; 1s ago
Main PID: 373864 (wwServer)
Tasks: 6 (limit: 154457)
Memory: 9.9M
CPU: 1.928s
CGroup: /system.slice/wwServer.service
`-373864 /home/axiom/wotwizard/wwServer -du /home/axiom/.config/duniter/duniter_default/wotwizard-export.db
Dec 11 18:30:55 duniter-v1-data systemd[1]: Started wotwizard server.
Dec 11 18:30:55 duniter-v1-data wwServer[373864]: WotWizard version 5.8.8