opensimMULTITOOLS-II/osmtool_backup.log

[2026-04-01 10:10:40] [ERROR] ERR_TARGET_NOT_ALLOWED: profile=robust target=sim1
[2026-04-01 10:10:40] [ERROR] ERR_TARGET_NOT_ALLOWED: profile=standalone target=grid
[2026-04-01 10:10:40] [ERROR] ERR_ACTION_NOT_ALLOWED: module=backup profile=robust action=oar-backup
[2026-04-01 10:11:16] [ERROR] Target not allowed for this profile
: profile=robust target=sim1
[2026-04-01 10:12:25] [ERROR] Janus binary missing: /opt/janus/bin/janus. Run install module action compile-janus/install-janus first.
[2026-04-01 10:13:33] [INFO] Using workdir: /opt
[2026-04-01 10:13:33] [INFO] Using profile: grid-sim
[2026-04-01 10:13:33] [INFO] Janus prefix: /opt/janus
[2026-04-01 10:13:33] [INFO] Installing Janus build dependencies
[2026-04-01 10:14:42] [INFO] Cloning Janus source to /opt/janus-gateway
[2026-04-01 10:15:05] [INFO] Using workdir: /opt
[2026-04-01 10:15:05] [INFO] Using profile: grid-sim
[2026-04-01 10:15:05] [INFO] Janus prefix: /opt/janus
[2026-04-01 10:15:05] [INFO] Installing Janus build dependencies
[2026-04-01 10:15:49] [INFO] Cloning Janus source to /home/manni/janus-gateway
[2026-04-01 10:15:54] [INFO] Building Janus
[2026-04-01 10:16:20] [INFO] Janus compiled and installed to /opt/janus
[2026-04-01 10:17:02] [INFO] Using workdir: /opt
[2026-04-01 10:17:02] [INFO] Using profile: grid-sim
[2026-04-01 10:17:02] [INFO] Janus prefix: /opt/janus
[2026-04-01 10:17:41] [INFO] Using workdir: /home/manni
[2026-04-01 10:17:41] [INFO] Using profile: grid-sim
[2026-04-01 10:17:41] [INFO] Janus prefix: /opt/janus
[2026-04-01 10:18:19] [INFO] Using workdir: /opt
[2026-04-01 10:18:19] [INFO] Using profile: grid-sim
[2026-04-01 10:18:19] [INFO] Janus prefix: /opt/janus
[2026-04-01 10:18:29] [INFO] Janus configured. Marker created: /opt/janus/.osmtool_janus_ready
[2026-04-01 10:18:39] [INFO] Using profile: grid-sim
[2026-04-01 10:18:39] [ERROR] Janus control not configured. Expected system service or janus.sh helper.
[2026-04-01 10:18:40] [INFO] Using profile: grid-sim
[2026-04-01 10:18:40] [ERROR] Janus control not configured. Expected system service or janus.sh helper.
[2026-04-01 10:19:10] [INFO] Using profile: grid-sim
[2026-04-01 10:19:10] [INFO] Janus already running
[2026-04-01 10:19:11] [INFO] Using profile: grid-sim
[2026-04-01 10:19:18] [INFO] Using profile: grid-sim
[2026-04-01 10:19:43] [INFO] Using profile: grid-sim
[2026-04-01 10:19:43] [INFO] Janus already running
[2026-04-01 10:19:43] [INFO] Using profile: grid-sim
[2026-04-01 10:19:55] [INFO] Using profile: grid-sim
[2026-04-01 10:19:55] [INFO] Janus already running
[2026-04-01 10:19:55] [INFO] Using profile: grid-sim
[2026-04-01 10:20:05] [INFO] Using profile: grid-sim
[2026-04-01 10:20:41] [INFO] Using profile: grid-sim
[2026-04-01 10:24:45] [INFO] Using workdir: /opt
[2026-04-01 10:24:45] [INFO] Using profile: grid-sim
[2026-04-01 10:24:45] [INFO] Janus prefix: /opt/janus
[2026-04-01 10:24:45] [INFO] Running server readiness check
[2026-04-01 10:24:45] [INFO] Detected OS: Ubuntu 24.04.4 LTS
[2026-04-01 10:24:45] [INFO] sudo available but password will be required
[2026-04-01 10:24:45] [INFO] apt-get available
[2026-04-01 10:24:45] [INFO] Network check to github.com: OK
[2026-04-01 10:24:45] [INFO] Disk space in /opt is sufficient
[2026-04-01 10:24:45] [INFO] All required Janus build packages are installed
[2026-04-01 10:24:45] [INFO] dotnet not found (required later for OpenSim runtime)
[2026-04-01 10:24:45] [INFO] Server readiness check PASSED
[2026-04-01 10:29:20] [INFO] Using workdir: /opt
[2026-04-01 10:29:20] [INFO] Using profile: grid-sim
[2026-04-01 10:29:20] [INFO] Janus prefix: /opt/janus
[2026-04-01 10:29:20] [INFO] Running server readiness check
[2026-04-01 10:29:20] [INFO] Detected OS: Ubuntu 24.04.4 LTS
[2026-04-01 10:29:20] [INFO] sudo available but password will be required
[2026-04-01 10:29:20] [INFO] apt-get available
[2026-04-01 10:29:20] [INFO] Network check to github.com: OK
[2026-04-01 10:29:20] [INFO] Disk space in /opt is sufficient
[2026-04-01 10:29:20] [INFO] All required Janus build packages are installed
[2026-04-01 10:29:20] [ERROR] dotnet SDK 8.x missing (required for OpenSim build/runtime)
[2026-04-01 10:29:20] [ERROR] Server readiness check FAILED
[2026-04-01 10:38:11] [INFO] Using workdir: /opt
[2026-04-01 10:38:11] [INFO] Using profile: grid-sim
[2026-04-01 10:38:11] [INFO] Janus prefix: /opt/janus
[2026-04-01 10:38:11] [INFO] Running server readiness check
[2026-04-01 10:38:11] [INFO] Detected OS: Ubuntu 24.04.4 LTS
[2026-04-01 10:38:11] [INFO] sudo available but password will be required
[2026-04-01 10:38:11] [INFO] apt-get available
[2026-04-01 10:38:12] [INFO] Network check to github.com: OK
[2026-04-01 10:38:12] [INFO] Disk space in /opt is sufficient
[2026-04-01 10:38:12] [ERROR] Missing packages: zip screen libgdiplus
[2026-04-01 10:38:12] [INFO] Run: sudo apt-get update && sudo apt-get install -y zip screen libgdiplus
[2026-04-01 10:38:12] [ERROR] dotnet SDK 8.x missing (required for OpenSim build/runtime)
[2026-04-01 10:38:12] [ERROR] Server readiness check FAILED
[2026-04-01 10:39:56] [INFO] Using workdir: /opt
[2026-04-01 10:39:56] [INFO] Using profile: grid-sim
[2026-04-01 10:39:56] [INFO] Janus prefix: /opt/janus
[2026-04-01 10:39:56] [ERROR] No installable package found for token: zip
[2026-04-01 10:40:15] [INFO] Using workdir: /opt
[2026-04-01 10:40:15] [INFO] Using profile: grid-sim
[2026-04-01 10:40:15] [INFO] Janus prefix: /opt/janus
[2026-04-01 10:40:15] [INFO] Installing OpenSim dependencies: zip screen libgdiplus libssl3 liblttng-ust1
[2026-04-01 10:40:59] [INFO] Using workdir: /opt
[2026-04-01 10:40:59] [INFO] Using profile: grid-sim
[2026-04-01 10:40:59] [INFO] Janus prefix: /opt/janus
[2026-04-01 10:40:59] [INFO] Installing .NET SDK 8.0
[2026-04-01 10:41:47] [INFO] Adding Microsoft package repository for Ubuntu 24.04
[2026-04-01 10:42:05] [INFO] dotnet SDK 8.x installed successfully
[2026-04-01 10:42:11] [INFO] Using workdir: /opt
[2026-04-01 10:42:11] [INFO] Using profile: grid-sim
[2026-04-01 10:42:11] [INFO] Janus prefix: /opt/janus
[2026-04-01 10:42:11] [INFO] Running server readiness check
[2026-04-01 10:42:11] [INFO] Detected OS: Ubuntu 24.04.4 LTS
[2026-04-01 10:42:11] [INFO] sudo available but password will be required
[2026-04-01 10:42:11] [INFO] apt-get available
[2026-04-01 10:42:11] [INFO] Network check to github.com: OK
[2026-04-01 10:42:11] [INFO] Disk space in /opt is sufficient
[2026-04-01 10:42:11] [INFO] All required Janus/OpenSim dependency packages are installed
[2026-04-01 10:42:11] [INFO] dotnet SDK 8.x found
[2026-04-01 10:42:11] [INFO] Server readiness check PASSED
[2026-04-01 10:50:47] [ERROR] Server preinstallation missing. Run install action bootstrap-server first.
[2026-04-01 10:50:47] [INFO] Using workdir: /opt
[2026-04-01 10:50:47] [INFO] Using profile: grid-sim
[2026-04-01 10:50:47] [INFO] Janus prefix: /opt/janus
[2026-04-01 10:50:47] [INFO] Starting central server bootstrap
[2026-04-01 10:50:47] [INFO] Preparing Ubuntu server
[2026-04-01 10:51:13] [INFO] Ubuntu base packages installed
[2026-04-01 10:51:13] [INFO] Installing OpenSim dependencies: libssl3 liblttng-ust1
[2026-04-01 10:51:14] [INFO] dotnet SDK 8.x already installed
[2026-04-01 10:51:14] [INFO] Running server readiness check
[2026-04-01 10:51:14] [INFO] Detected OS: Ubuntu 24.04.4 LTS
[2026-04-01 10:51:14] [INFO] sudo non-interactive check: OK
[2026-04-01 10:51:14] [INFO] apt-get available
[2026-04-01 10:51:14] [INFO] Network check to github.com: OK
[2026-04-01 10:51:14] [INFO] Disk space in /opt is sufficient
[2026-04-01 10:51:15] [INFO] All required Janus/OpenSim dependency packages are installed
[2026-04-01 10:51:15] [INFO] dotnet SDK 8.x found
[2026-04-01 10:51:15] [INFO] Server readiness check PASSED
[2026-04-01 10:51:15] [INFO] Server bootstrap marker created: /opt/.osmtool_server_prepared
[2026-04-01 10:51:15] [INFO] Central server bootstrap completed
[2026-04-01 10:57:07] [INFO] Using workdir: /opt
[2026-04-01 10:57:07] [INFO] Using profile: grid-sim
[2026-04-01 10:57:07] [INFO] Repo mode: update
[2026-04-01 10:57:07] [INFO] OpenSim dir: /opt/opensim
[2026-04-01 10:57:07] [INFO] Janus prefix: /opt/janus
[2026-04-01 10:57:07] [INFO] Starting OpenSim install/build flow
[2026-04-01 10:57:07] [INFO] OpenSim repository: https://github.com/opensim/opensim.git
[2026-04-01 10:57:07] [INFO] OpenSim branch: master
[2026-04-01 10:57:07] [INFO] OpenSim directory: /opt/opensim
[2026-04-01 10:57:07] [INFO] Cloning repository https://github.com/opensim/opensim.git -> /opt/opensim
[2026-04-01 10:57:30] [INFO] Using workdir: /opt
[2026-04-01 10:57:30] [INFO] Using profile: grid-sim
[2026-04-01 10:57:30] [INFO] Repo mode: update
[2026-04-01 10:57:30] [INFO] OpenSim dir: /opt/opensim
[2026-04-01 10:57:30] [INFO] Janus prefix: /opt/janus
[2026-04-01 10:57:30] [INFO] Starting OpenSim install/build flow
[2026-04-01 10:57:30] [INFO] OpenSim repository: https://github.com/opensim/opensim.git
[2026-04-01 10:57:31] [INFO] OpenSim branch: master
[2026-04-01 10:57:31] [INFO] OpenSim directory: /opt/opensim
[2026-04-01 11:08:23] [INFO] Cloning repository https://github.com/opensim/opensim.git -> /opt/opensim
[2026-04-01 11:09:12] [INFO] Preparing support repository: opensim-tsassets
[2026-04-01 11:09:12] [INFO] Cloning repository https://github.com/ManfredAabye/opensim-tsassets.git -> /opt/opensim-tsassets
[2026-04-01 11:09:44] [INFO] Using workdir: /opt
[2026-04-01 11:09:44] [INFO] Using profile: grid-sim
[2026-04-01 11:09:44] [INFO] Repo mode: update
[2026-04-01 11:09:44] [INFO] OpenSim dir: /opt/opensim
[2026-04-01 11:09:44] [INFO] Janus prefix: /opt/janus
[2026-04-01 11:09:44] [INFO] Starting OpenSim install/build flow
[2026-04-01 11:09:44] [INFO] OpenSim repository: https://github.com/opensim/opensim.git
[2026-04-01 11:09:44] [INFO] OpenSim branch: master
[2026-04-01 11:09:44] [INFO] OpenSim directory: /opt/opensim
[2026-04-01 11:09:44] [INFO] Updating repository: /opt/opensim
[2026-04-01 11:09:46] [INFO] Preparing support repository: opensim-tsassets
[2026-04-01 11:12:10] [INFO] Cloning repository https://github.com/ManfredAabye/opensim-tsassets.git -> /opt/opensim-tsassets
[2026-04-01 11:12:10] [INFO] Preparing support repository: opensimcurrencyserver
[2026-04-01 11:12:10] [INFO] Cloning repository https://github.com/ManfredAabye/opensimcurrencyserver-dotnet.git -> /opt/opensimcurrencyserver
[2026-04-01 11:12:11] [INFO] Preparing support repository: os-data-backup
[2026-04-01 11:12:11] [INFO] Cloning repository https://github.com/ManfredAabye/os-data-backup.git -> /opt/os-data-backup
[2026-04-01 11:12:12] [INFO] Copied tsassets bin content: /opt/opensim-tsassets/bin -> /opt/opensim/bin
[2026-04-01 11:12:12] [INFO] Copied tsassets OpenSim content: /opt/opensim-tsassets/OpenSim -> /opt/opensim/OpenSim
[2026-04-01 11:12:12] [INFO] Copied currency addon modules: /opt/opensimcurrencyserver/addon-modules -> /opt/opensim/addon-modules
[2026-04-01 11:12:12] [INFO] Copied currency bin content: /opt/opensimcurrencyserver/bin -> /opt/opensim/bin
[2026-04-01 11:12:12] [INFO] Copied os-data-backup content: /opt/os-data-backup -> /opt/opensim/addon-modules/os-data-backup
[2026-04-01 11:12:12] [INFO] Running OpenSim prebuild
[2026-04-01 11:12:32] [INFO] Binary deployment skipped by configuration
[2026-04-01 11:12:32] [INFO] OpenSim install/build flow completed
[2026-04-01 11:53:03] [INFO] Using workdir: /opt
[2026-04-01 11:53:03] [INFO] Using profile: grid-sim
[2026-04-01 11:53:03] [INFO] Repo mode: update
[2026-04-01 11:53:03] [INFO] OpenSim dir: /opt/opensim
[2026-04-01 11:53:03] [INFO] Janus prefix: /opt/janus
[2026-04-01 11:53:03] [INFO] Starting OpenSim install/build flow
[2026-04-01 11:53:03] [INFO] OpenSim repository: https://github.com/opensim/opensim.git
[2026-04-01 11:53:03] [INFO] OpenSim branch: master
[2026-04-01 11:53:03] [INFO] OpenSim directory: /opt/opensim
[2026-04-01 11:53:03] [INFO] Updating repository: /opt/opensim
[2026-04-01 11:53:04] [INFO] Preparing support repository: opensim-tsassets
[2026-04-01 11:53:04] [INFO] Updating repository: /opt/opensim-tsassets
[2026-04-01 11:53:05] [INFO] Preparing support repository: opensimcurrencyserver
[2026-04-01 11:53:05] [INFO] Updating repository: /opt/opensimcurrencyserver
[2026-04-01 11:53:06] [INFO] Preparing support repository: os-data-backup
[2026-04-01 11:53:06] [INFO] Updating repository: /opt/os-data-backup
[2026-04-01 11:53:07] [INFO] Copied tsassets bin content: /opt/opensim-tsassets/bin -> /opt/opensim/bin
[2026-04-01 11:53:07] [INFO] Copied tsassets OpenSim content: /opt/opensim-tsassets/OpenSim -> /opt/opensim/OpenSim
[2026-04-01 11:53:07] [INFO] Copied currency addon modules: /opt/opensimcurrencyserver/addon-modules -> /opt/opensim/addon-modules
[2026-04-01 11:53:07] [INFO] Copied currency bin content: /opt/opensimcurrencyserver/bin -> /opt/opensim/bin
[2026-04-01 11:55:36] [INFO] Using workdir: /opt
[2026-04-01 11:55:36] [INFO] Using profile: grid-sim
[2026-04-01 11:55:36] [INFO] Repo mode: update
[2026-04-01 11:55:36] [INFO] OpenSim dir: /opt/opensim
[2026-04-01 11:55:36] [INFO] Janus prefix: /opt/janus
[2026-04-01 11:55:36] [INFO] Starting OpenSim install/build flow
[2026-04-01 11:55:36] [INFO] OpenSim repository: https://github.com/opensim/opensim.git
[2026-04-01 11:55:36] [INFO] OpenSim branch: master
[2026-04-01 11:55:36] [INFO] OpenSim directory: /opt/opensim
[2026-04-01 11:55:36] [INFO] Updating repository: /opt/opensim
[2026-04-01 11:55:37] [INFO] Preparing support repository: opensim-tsassets
[2026-04-01 11:55:37] [INFO] Updating repository: /opt/opensim-tsassets
[2026-04-01 11:55:38] [INFO] Preparing support repository: opensimcurrencyserver
[2026-04-01 11:55:38] [INFO] Updating repository: /opt/opensimcurrencyserver
[2026-04-01 11:55:38] [INFO] Preparing support repository: os-data-backup
[2026-04-01 11:55:38] [INFO] Updating repository: /opt/os-data-backup
[2026-04-01 11:55:39] [INFO] Copied tsassets bin content: /opt/opensim-tsassets/bin -> /opt/opensim/bin
[2026-04-01 11:55:39] [INFO] Copied tsassets OpenSim content: /opt/opensim-tsassets/OpenSim -> /opt/opensim/OpenSim
[2026-04-01 11:55:39] [INFO] Copied currency addon modules: /opt/opensimcurrencyserver/addon-modules -> /opt/opensim/addon-modules
[2026-04-01 11:55:39] [INFO] Copied currency bin content: /opt/opensimcurrencyserver/bin -> /opt/opensim/bin
[2026-04-01 11:55:39] [INFO] Copied os-data-backup content: /opt/os-data-backup -> /opt/opensim/addon-modules/os-data-backup
[2026-04-01 11:55:39] [INFO] Running OpenSim prebuild
[2026-04-01 11:55:59] [INFO] Copied robust binaries: /opt/opensim/bin -> /opt/robust/bin
[2026-04-01 11:55:59] [INFO] Copied region binaries: /opt/opensim/bin -> /opt/sim1/bin
[2026-04-01 11:55:59] [INFO] Copied region binaries: /opt/opensim/bin -> /opt/sim2/bin
[2026-04-01 11:55:59] [INFO] OpenSim binaries deployed to available runtime directories
[2026-04-01 11:55:59] [INFO] OpenSim install/build flow completed
[2026-04-01 12:07:30] [INFO] Using profile: grid-sim
[2026-04-01 12:07:32] [INFO] Using profile: grid-sim
[2026-04-01 12:13:24] [INFO] Using profile: grid-sim
[2026-04-01 12:28:52] [INFO] Using profile: grid-sim
[2026-04-01 12:28:52] [ERROR] RobustServer cannot start: missing /opt/robust/bin/Robust.ini — run the config action first
[2026-04-01 12:28:52] [INFO] Using profile: grid-sim
[2026-04-01 12:28:52] [ERROR] sim1 cannot start: missing /opt/sim1/bin/OpenSim.ini — run the config action first
[2026-04-01 12:29:05] [INFO] Using profile: grid-sim
[2026-04-01 12:29:05] [INFO] Starting robustserver from /opt/robust/bin
[2026-04-01 12:29:06] [INFO] Screen session 'robustserver' started successfully
[2026-04-01 12:29:08] [INFO] Using profile: grid-sim
[2026-04-01 12:30:22] [INFO] Using profile: grid-sim
[2026-04-01 12:30:22] [INFO] Starting robustserver from /opt/robust/bin
[2026-04-01 12:30:22] [INFO] Screen session 'robustserver' started successfully
[2026-04-01 12:30:23] [INFO] Using profile: grid-sim
[2026-04-01 12:30:23] [INFO] Sent shutdown to robustserver
[2026-04-01 12:30:24] [INFO] Using profile: grid-sim
[2026-04-01 12:30:24] [INFO] Sent shutdown to robustserver
[2026-04-01 12:30:24] [INFO] Using profile: grid-sim
[2026-04-01 12:30:24] [ERROR] sim1 cannot start: missing /opt/sim1/bin/OpenSim.ini — run the config action first
[2026-04-01 12:49:19] [INFO] Using profile: grid-sim
[2026-04-01 12:49:19] [ERROR] Missing required command: mysqldump
[2026-04-01 12:49:31] [INFO] Using profile: grid-sim
[2026-04-01 12:49:31] [INFO] No OSMTool cron block configured
[2026-04-01 12:49:32] [INFO] OSMTool cron jobs installed/updated
[2026-04-01 12:49:32] [INFO] OSMTool cron block removed
[2026-04-01 12:49:32] [INFO] No OSMTool cron block configured
[2026-04-01 12:49:58] [INFO] Using profile: grid-sim
[2026-04-01 12:50:34] [INFO] Using profile: grid-sim
[2026-04-01 12:50:34] [INFO] Sending OAR export command to screen session 'sim1': save oar /opt/backup/sim1_20260401_125034.oar
[2026-04-01 12:50:34] [INFO] OAR export command sent. Validate completion in the session log/output.
[2026-04-01 12:52:12] [INFO] OSMTool cron jobs installed/updated
[2026-04-01 12:52:13] [INFO] OSMTool cron block removed
[2026-04-01 12:52:14] [INFO] Using profile: grid-sim
[2026-04-01 12:52:14] [INFO] Sending OAR export command to screen session 'sim1': save oar /opt/backup/sim1_20260401_125214.oar
[2026-04-01 12:52:14] [INFO] OAR export command sent. Validate completion in the session log/output.
[2026-04-01 13:01:08] [INFO] OSMTool cron jobs installed/updated
[2026-04-01 13:01:08] [INFO] OSMTool cron block removed
[2026-04-01 13:01:09] [INFO] Using workdir: /opt
[2026-04-01 13:01:09] [INFO] Using profile: grid-sim
[2026-04-01 13:01:09] [INFO] Repo mode: update
[2026-04-01 13:01:09] [INFO] OpenSim dir: /opt/opensim
[2026-04-01 13:01:09] [INFO] Janus prefix: /opt/janus
[2026-04-01 13:01:09] [INFO] Running server readiness check
[2026-04-01 13:01:09] [INFO] Detected OS: Ubuntu 24.04.4 LTS
[2026-04-01 13:01:09] [INFO] sudo available but password will be required
[2026-04-01 13:01:09] [INFO] apt-get available
[2026-04-01 13:01:09] [INFO] Network check to github.com: OK
[2026-04-01 13:01:09] [INFO] Disk space in /opt is sufficient
[2026-04-01 13:01:09] [INFO] All required Janus/OpenSim dependency packages are installed
[2026-04-01 13:01:09] [INFO] dotnet SDK 8.x found
[2026-04-01 13:01:09] [ERROR] mysqldump missing (MariaDB client tools are required)
[2026-04-01 13:01:09] [ERROR] Server readiness check FAILED
[2026-04-01 13:01:41] [INFO] Using workdir: /opt
[2026-04-01 13:01:41] [INFO] Using profile: grid-sim
[2026-04-01 13:01:41] [INFO] Repo mode: update
[2026-04-01 13:01:41] [INFO] OpenSim dir: /opt/opensim
[2026-04-01 13:01:41] [INFO] Janus prefix: /opt/janus
[2026-04-01 13:01:41] [INFO] Running server readiness check
[2026-04-01 13:01:41] [INFO] Detected OS: Ubuntu 24.04.4 LTS
[2026-04-01 13:01:41] [INFO] sudo available but password will be required
[2026-04-01 13:01:41] [INFO] apt-get available
[2026-04-01 13:01:41] [INFO] Network check to github.com: OK
[2026-04-01 13:01:41] [INFO] Disk space in /opt is sufficient
[2026-04-01 13:01:41] [INFO] All required Janus/OpenSim dependency packages are installed
[2026-04-01 13:01:41] [INFO] dotnet SDK 8.x found
[2026-04-01 13:01:41] [INFO] mysqldump found (MariaDB backup tooling ready)
[2026-04-01 13:01:41] [INFO] Server readiness check PASSED
[2026-04-01 13:04:31] [INFO] Using workdir: /opt
[2026-04-01 13:04:31] [INFO] Using profile: grid-sim
[2026-04-01 13:04:31] [INFO] Repo mode: update
[2026-04-01 13:04:31] [INFO] OpenSim dir: /opt/opensim
[2026-04-01 13:04:31] [INFO] Janus prefix: /opt/janus
[2026-04-01 13:04:31] [INFO] Configuring OpenSim runtime ini files
[2026-04-01 13:04:31] [INFO] Keeping existing config: /opt/robust/bin/Robust.ini
[2026-04-01 13:04:31] [INFO] Keeping existing config: /opt/robust/bin/Robust.ini
[2026-04-01 13:04:31] [INFO] Created config from template: /opt/robust/bin/MoneyServer.ini
[2026-04-01 13:04:31] [INFO] Created config from template: /opt/sim1/bin/OpenSim.ini
[2026-04-01 13:04:31] [INFO] Created config from template: /opt/sim2/bin/OpenSim.ini
[2026-04-01 13:04:31] [INFO] OpenSim runtime ini configuration completed
[2026-04-01 13:04:37] [INFO] Using workdir: /opt
[2026-04-01 13:04:37] [INFO] Using profile: grid-sim
[2026-04-01 13:04:37] [INFO] Repo mode: update
[2026-04-01 13:04:37] [INFO] OpenSim dir: /opt/opensim
[2026-04-01 13:04:37] [INFO] Janus prefix: /opt/janus
[2026-04-01 13:04:37] [INFO] Starting central server bootstrap
[2026-04-01 13:04:37] [INFO] Preparing Ubuntu server
[2026-04-01 13:07:46] [INFO] Using workdir: /opt
[2026-04-01 13:07:46] [INFO] Using profile: grid-sim
[2026-04-01 13:07:46] [INFO] Repo mode: update
[2026-04-01 13:07:46] [INFO] OpenSim dir: /opt/opensim
[2026-04-01 13:07:46] [INFO] Janus prefix: /opt/janus
[2026-04-01 13:07:46] [INFO] Starting central server bootstrap
[2026-04-01 13:07:46] [INFO] Preparing Ubuntu server
[2026-04-01 13:07:50] [INFO] Ubuntu base packages installed
[2026-04-01 13:07:51] [INFO] Installing OpenSim dependencies: mariadb-server libssl3 liblttng-ust1
[2026-04-01 13:07:59] [INFO] dotnet SDK 8.x already installed
[2026-04-01 13:07:59] [INFO] No controllable MariaDB service unit detected; skipping service activation
[2026-04-01 13:07:59] [INFO] Running server readiness check
[2026-04-01 13:07:59] [INFO] Detected OS: Ubuntu 24.04.4 LTS
[2026-04-01 13:07:59] [INFO] sudo non-interactive check: OK
[2026-04-01 13:07:59] [INFO] apt-get available
[2026-04-01 13:08:00] [INFO] Network check to github.com: OK
[2026-04-01 13:08:00] [INFO] Disk space in /opt is sufficient
[2026-04-01 13:08:00] [INFO] All required Janus/OpenSim dependency packages are installed
[2026-04-01 13:08:00] [INFO] dotnet SDK 8.x found
[2026-04-01 13:08:00] [INFO] mysqldump found (MariaDB backup tooling ready)
[2026-04-01 13:08:00] [INFO] Server readiness check PASSED
[2026-04-01 13:08:00] [INFO] Server bootstrap marker created: /opt/.osmtool_server_prepared
[2026-04-01 13:08:00] [INFO] Central server bootstrap completed
[2026-04-01 15:41:57] [INFO] Using workdir: /opt
[2026-04-01 15:41:57] [INFO] Using profile: grid-sim
[2026-04-01 15:41:57] [INFO] Repo mode: update
[2026-04-01 15:41:57] [INFO] OpenSim dir: /opt/opensim
[2026-04-01 15:41:57] [INFO] Janus prefix: /opt/janus
[2026-04-01 15:41:57] [INFO] No controllable MariaDB service unit detected; skipping service activation
[2026-04-01 15:41:57] [INFO] Configuring MariaDB databases and grants
[2026-04-01 15:41:57] [INFO] Ensured database: robust
[2026-04-01 15:41:57] [INFO] Ensured database: sim1
[2026-04-01 15:41:57] [INFO] Ensured database: sim2
[2026-04-01 15:41:57] [INFO] Database credentials written: /opt/UserInfo.ini
[2026-04-01 15:41:57] [INFO] MariaDB database setup completed
[2026-04-01 15:46:48] [INFO] Running health checks for profile: grid-sim
[2026-04-01 15:46:48] [INFO] Using workdir: /opt
[2026-04-01 15:46:48] [ERROR] [FAIL] Screen session missing: robustserver
[2026-04-01 15:46:48] [ERROR] [FAIL] Screen session missing: sim1
[2026-04-01 15:46:48] [ERROR] [FAIL] Port not listening: 8002
[2026-04-01 15:46:48] [ERROR] [FAIL] Port not listening: 9000
[2026-04-01 15:46:48] [ERROR] [FAIL] Port not listening: 9001
[2026-04-01 15:46:48] [ERROR] [FAIL] Port not listening: 8088
[2026-04-01 15:46:48] [INFO] [OK] Database reachable: robust
[2026-04-01 15:46:48] [INFO] [OK] Log scan: /mnt/d/OpenSimBash/opensimMULTITOOLS-II/osmtool_backup.log -> 26 matches
[2026-04-01 15:46:48] [INFO] [WARN] Log file not found, skipped: /opt/robust/bin/OpenSim.log
[2026-04-01 15:46:48] [INFO] [OK] Log warning threshold OK: 26 <= 200
[2026-04-01 15:46:48] [ERROR] [FAIL] Healthcheck FAILED with 2 failing check group(s)
[2026-04-01 15:47:31] [INFO] Running health checks for profile: grid-sim
[2026-04-01 15:47:31] [INFO] Using workdir: /opt
[2026-04-01 15:47:31] [INFO] [WARN] Screen check skipped (no expected screens configured)
[2026-04-01 15:47:31] [INFO] [WARN] Port check skipped (no ports configured)
[2026-04-01 15:47:31] [INFO] [OK] Database reachable: robust
[2026-04-01 15:47:31] [INFO] [OK] Log scan: /mnt/d/OpenSimBash/opensimMULTITOOLS-II/osmtool_backup.log -> 31 matches
[2026-04-01 15:47:31] [INFO] [WARN] Log file not found, skipped: /opt/robust/bin/OpenSim.log
[2026-04-01 15:47:31] [INFO] [OK] Log warning threshold OK: 31 <= 200
[2026-04-01 15:47:31] [INFO] [OK] Healthcheck PASSED
[2026-04-01 15:47:56] [INFO] Using profile: grid-sim
[2026-04-01 15:47:56] [INFO] Dry-run mode: true
[2026-04-01 15:47:56] [INFO] Cleaning log files under /opt/opensim
[2026-04-01 15:48:14] [ERROR] Refusing cleanup on /opt root; choose a dedicated OpenSim workdir
[2026-04-01 16:31:39] [ERROR] Unknown option: --module
[2026-04-01 16:31:45] [INFO] Using profile: grid-sim
[2026-04-01 16:31:45] [INFO] SQL Backups:
[2026-04-01 16:31:45] [INFO] OAR Backups:
[2026-04-01 16:31:50] [INFO] Using profile: grid-sim
[2026-04-01 16:31:50] [INFO] SQL Backups:
[2026-04-01 16:31:50] [INFO] OAR Backups:
[2026-04-01 16:31:55] [INFO] Using profile: grid-sim
[2026-04-01 16:31:55] [ERROR] SQL backup file not found: /tmp/test.sql
[2026-04-01 16:32:02] [INFO] Using profile: grid-sim
[2026-04-01 16:32:02] [INFO] Database restore command:
[2026-04-01 16:32:02] [INFO] mysql -u'root' -p'test' 'robust' < '/tmp/test.sql'
[2026-04-01 16:32:02] [INFO] [DRY-RUN] Not executing database restore
[2026-04-01 16:32:09] [ERROR] Aktion fuer dieses Profil nicht erlaubt
: module=restore profile=robust action=oar-restore
[2026-04-01 16:57:43] [INFO] Using profile: grid-sim
[2026-04-01 16:57:43] [INFO] Creating rollback archive: /tmp/osm_update_test/rollback/opensim_20260401_165743_smoke.tar.gz
[2026-04-01 16:57:43] [INFO] [DRY-RUN] Would archive paths listed in: /tmp/osm_update_test/rollback/opensim_20260401_165743_smoke.manifest
[2026-04-01 16:57:43] [INFO] Creating rollback archive: /tmp/osm_update_test/rollback/janus_20260401_165743_smoke.tar.gz
[2026-04-01 16:57:43] [INFO] [DRY-RUN] Would archive paths listed in: /tmp/osm_update_test/rollback/janus_20260401_165743_smoke.manifest
[2026-04-01 16:57:43] [INFO] Using profile: grid-sim
[2026-04-01 16:57:43] [INFO] Validating INI file: /tmp/osm_update_test/robust/bin/Robust.ini
[2026-04-01 16:57:43] [INFO] Validating INI file: /tmp/osm_update_test/sim1/bin/OpenSim.ini
[2026-04-01 16:57:43] [INFO] Configuration validation passed
[2026-04-01 16:57:53] [INFO] Using profile: grid-sim
[2026-04-01 16:57:53] [INFO] Creating rollback archive: /tmp/osm_update_test/rollback/opensim_20260401_165753_smoke.tar.gz
[2026-04-01 16:57:53] [INFO] [DRY-RUN] Would archive paths listed in: /tmp/osm_update_test/rollback/opensim_20260401_165753_smoke.manifest
[2026-04-01 16:57:53] [INFO] Delegating update to install action: install-opensim
[2026-04-01 16:57:53] [INFO] [DRY-RUN] /mnt/d/OpenSimBash/opensimMULTITOOLS-II/modular/osmtool_install.sh --profile grid-sim --workdir /tmp/osm_update_test --action install-opensim --opensim-dir /tmp/osm_update_test/opensim --repo-mode update --deploy-binaries true --janus-prefix /opt/janus --janus-src /tmp/osm_update_test/janus-gateway 
[2026-04-01 16:57:54] [INFO] Using profile: grid-sim
[2026-04-01 16:57:54] [INFO] Validating INI file: /tmp/test_invalid.ini
[2026-04-01 16:57:54] [ERROR] Invalid INI syntax in /tmp/test_invalid.ini:2 -> this is broken
[2026-04-01 16:57:54] [ERROR] Configuration validation failed with 1 issue(s)
[2026-04-01 16:58:09] [INFO] Using profile: grid-sim
[2026-04-01 16:58:09] [INFO] Validating JSON file: /tmp/test_valid.json
[2026-04-01 16:58:09] [INFO] Configuration validation passed
[2026-04-01 16:58:09] [INFO] Using profile: grid-sim
[2026-04-01 16:58:46] [INFO] Using profile: grid-sim
[2026-04-01 16:58:46] [INFO] Validating INI file: /tmp/osm_config_missing/robust/bin/Robust.ini
[2026-04-01 16:58:46] [ERROR] No region runtime configs found under /tmp/osm_config_missing/sim*/bin/OpenSim.ini
[2026-04-01 16:58:46] [ERROR] Configuration validation failed with 1 issue(s)
[2026-04-01 16:58:47] [INFO] Using profile: grid-sim
[2026-04-01 16:58:47] [ERROR] Missing config file: /tmp/osm_update_test/robust/bin/Robust.ini
[2026-04-01 16:59:00] [INFO] Using profile: grid-sim
[2026-04-01 16:59:00] [INFO] Validating INI file: /tmp/osm_update_test/robust/bin/Robust.ini
[2026-04-01 16:59:00] [INFO] Validating INI file: /tmp/osm_update_test/sim1/bin/OpenSim.ini
[2026-04-01 16:59:00] [INFO] Configuration validation passed
[2026-04-01 17:17:00] [INFO] Using profile: grid-sim
[2026-04-01 17:17:18] [INFO] Using profile: grid-sim
[2026-04-01 17:17:38] [INFO] Using profile: grid-sim
[2026-04-01 17:17:38] [INFO] Validating INI file: /opt/robust/bin/Robust.ini
[2026-04-01 17:17:39] [INFO] Validating INI file: /opt/sim1/bin/OpenSim.ini
[2026-04-01 17:17:39] [INFO] Validating INI file: /opt/sim2/bin/OpenSim.ini
[2026-04-01 17:17:40] [INFO] Configuration validation passed
[2026-04-01 17:18:14] [INFO] Using profile: grid-sim
[2026-04-01 17:18:15] [INFO] Creating rollback archive: /opt/rollback/opensim_20260401_171814_realcheck.tar.gz
[2026-04-01 17:18:15] [INFO] [DRY-RUN] Would archive paths listed in: /opt/rollback/opensim_20260401_171814_realcheck.manifest
[2026-04-01 17:18:15] [INFO] Creating rollback archive: /opt/rollback/janus_20260401_171815_realcheck.tar.gz
[2026-04-01 17:18:15] [INFO] [DRY-RUN] Would archive paths listed in: /opt/rollback/janus_20260401_171815_realcheck.manifest
[2026-04-01 17:18:15] [INFO] Using profile: grid-sim
[2026-04-01 17:18:15] [INFO] Creating rollback archive: /opt/rollback/opensim_20260401_171815_realcheck.tar.gz
[2026-04-01 17:18:15] [INFO] [DRY-RUN] Would archive paths listed in: /opt/rollback/opensim_20260401_171815_realcheck.manifest
[2026-04-01 17:18:15] [INFO] Delegating update to install action: install-opensim
[2026-04-01 17:18:15] [INFO] [DRY-RUN] /mnt/d/OpenSimBash/opensimMULTITOOLS-II/modular/osmtool_install.sh --profile grid-sim --workdir /opt --action install-opensim --opensim-dir /opt/opensim --repo-mode update --deploy-binaries true --janus-prefix /opt/janus --janus-src /opt/janus-gateway 
[2026-04-01 17:18:15] [INFO] Using profile: grid-sim
[2026-04-01 17:18:15] [INFO] Creating rollback archive: /opt/rollback/janus_20260401_171815_realcheck.tar.gz
[2026-04-01 17:18:15] [INFO] [DRY-RUN] Would archive paths listed in: /opt/rollback/janus_20260401_171815_realcheck.manifest
[2026-04-01 17:18:15] [INFO] Delegating update to install action: install-janus
[2026-04-01 17:18:15] [INFO] [DRY-RUN] /mnt/d/OpenSimBash/opensimMULTITOOLS-II/modular/osmtool_install.sh --profile grid-sim --workdir /opt --action install-janus --opensim-dir /opt/opensim --repo-mode update --deploy-binaries true --janus-prefix /opt/janus --janus-src /opt/janus-gateway 
[2026-04-01 17:18:22] [INFO] Using profile: grid-sim
[2026-04-01 17:22:54] [INFO] Using profile: grid-sim
[2026-04-01 17:22:54] [INFO] Report generated: /opt/reports/osm_report_20260401_172254.txt
[2026-04-01 17:25:10] [INFO] OSMTool cron jobs installed/updated
[2026-04-01 17:25:10] [INFO] OSMTool cron block removed
[2026-04-01 17:25:59] [INFO] OSMTool cron jobs installed/updated
[2026-04-01 17:26:06] [INFO] OSMTool cron block removed
[2026-04-01 17:27:28] [INFO] Using profile: grid-sim
[2026-04-01 17:27:28] [INFO] Starting grid from /opt
[2026-04-01 17:27:28] [INFO] Starting robustserver from /opt/robust/bin
[2026-04-01 17:27:28] [INFO] Screen session 'robustserver' started successfully
[2026-04-01 17:27:28] [INFO] Starting moneyserver from /opt/robust/bin
[2026-04-01 17:27:29] [INFO] Screen session 'moneyserver' started successfully
[2026-04-01 17:27:29] [INFO] Starting sim1 from /opt/sim1/bin
[2026-04-01 17:27:30] [ERROR] Screen session 'sim1' did not stay alive — check logs or missing config
[2026-04-01 17:27:32] [INFO] Using profile: grid-sim
[2026-04-01 17:27:32] [INFO] Stopping grid
[2026-04-01 17:27:32] [INFO] Sent shutdown to robustserver
[2026-04-01 17:27:37] [INFO] Starting grid from /opt
[2026-04-01 17:27:37] [INFO] Starting robustserver from /opt/robust/bin
[2026-04-01 17:27:38] [INFO] Screen session 'robustserver' started successfully
[2026-04-01 17:27:38] [INFO] Starting moneyserver from /opt/robust/bin
[2026-04-01 17:27:38] [ERROR] Screen session 'moneyserver' did not stay alive — check logs or missing config
[2026-04-01 17:27:38] [INFO] Starting sim1 from /opt/sim1/bin
[2026-04-01 17:27:39] [ERROR] Screen session 'sim1' did not stay alive — check logs or missing config
[2026-04-01 17:27:41] [INFO] Using profile: grid-sim
[2026-04-01 17:27:41] [INFO] Stopping grid
[2026-04-01 17:27:41] [INFO] Sent shutdown to robustserver
[2026-04-01 17:27:55] [INFO] Using profile: robust
[2026-04-01 17:27:55] [INFO] Starting robustserver from /opt/robust/bin
[2026-04-01 17:27:56] [INFO] Screen session 'robustserver' started successfully
[2026-04-01 17:27:58] [INFO] Using profile: robust
[2026-04-01 17:27:58] [INFO] Sent shutdown to robustserver
[2026-04-01 17:28:00] [ERROR] Ziel fuer dieses Profil nicht erlaubt
: profile=robust target=sim1
[2026-04-01 17:28:32] [INFO] Using profile: standalone
[2026-04-01 17:28:32] [ERROR] standalone cannot start: missing /opt/standalone/bin/OpenSim.ini — run the config action first
[2026-04-01 17:28:32] [INFO] Using profile: standalone
[2026-04-01 17:28:32] [INFO] standalone is not running
[2026-04-01 17:28:33] [INFO] Using profile: grid-sim
[2026-04-01 17:28:33] [INFO] Using profile: grid-sim
[2026-04-01 17:29:46] [INFO] Using profile: standalone
[2026-04-01 17:29:46] [ERROR] standalone cannot start: missing /opt/standalone/bin/OpenSim.ini — run the config action first
[2026-04-01 17:29:46] [ERROR] Ziel fuer dieses Profil nicht erlaubt
: profile=robust target=sim1
[2026-04-01 17:30:35] [INFO] Using profile: grid-sim
[2026-04-01 17:30:35] [INFO] Starting grid from /opt
[2026-04-01 17:30:35] [INFO] Starting robustserver from /opt/robust/bin
[2026-04-01 17:30:35] [INFO] Screen session 'robustserver' started successfully
[2026-04-01 17:30:35] [INFO] Starting moneyserver from /opt/robust/bin
[2026-04-01 17:30:36] [INFO] Screen session 'moneyserver' started successfully
[2026-04-01 17:30:36] [INFO] Starting sim1 from /opt/sim1/bin
[2026-04-01 17:30:36] [ERROR] Screen session 'sim1' did not stay alive — check logs or missing config
[2026-04-01 17:31:16] [INFO] Using profile: grid-sim
[2026-04-01 17:31:16] [INFO] Starting grid from /opt
[2026-04-01 17:31:16] [INFO] Screen session 'robustserver' already running — skipping start
[2026-04-01 17:31:16] [INFO] Screen session 'moneyserver' already running — skipping start
[2026-04-01 17:31:16] [INFO] Starting sim1 from /opt/sim1/bin
[2026-04-01 17:31:16] [INFO] Screen session 'sim1' started successfully
[2026-04-01 17:31:20] [INFO] Using profile: grid-sim
[2026-04-01 17:31:20] [INFO] Stopping grid
[2026-04-01 17:31:20] [INFO] Sent shutdown to sim1
[2026-04-01 17:31:20] [INFO] Sent shutdown to moneyserver
[2026-04-01 17:31:20] [INFO] Sent shutdown to robustserver
[2026-04-01 17:32:50] [INFO] Using profile: grid-sim
[2026-04-01 17:32:50] [INFO] Starting grid from /opt
[2026-04-01 17:32:50] [INFO] Starting robustserver from /opt/robust/bin
[2026-04-01 17:32:50] [INFO] Screen session 'robustserver' started successfully
[2026-04-01 17:32:50] [INFO] Starting moneyserver from /opt/robust/bin
[2026-04-01 17:32:51] [INFO] Screen session 'moneyserver' started successfully
[2026-04-01 17:32:51] [INFO] Screen session 'sim1' already running — skipping start
[2026-04-01 17:32:54] [INFO] Using profile: grid-sim
[2026-04-01 17:32:54] [INFO] Stopping grid
[2026-04-01 17:32:54] [INFO] Sent shutdown to sim1
[2026-04-01 17:33:00] [INFO] Session 'sim1' still running after shutdown; forcing screen quit
[2026-04-01 17:33:01] [INFO] Screen session 'sim1' stopped
[2026-04-01 17:33:01] [INFO] Sent shutdown to moneyserver
[2026-04-01 17:33:07] [INFO] Screen session 'moneyserver' stopped
[2026-04-01 17:33:07] [INFO] Sent shutdown to robustserver
[2026-04-01 17:33:13] [INFO] Screen session 'robustserver' stopped
[2026-04-01 17:33:28] [INFO] Using profile: grid-sim
[2026-04-01 17:33:28] [INFO] Janus already running
[2026-04-01 17:33:30] [INFO] Using profile: grid-sim
[2026-04-01 17:33:40] [INFO] Using profile: grid-sim
[2026-04-01 17:33:40] [INFO] Using profile: grid-sim
[2026-04-01 17:34:46] [INFO] Using workdir: /opt
[2026-04-01 17:34:46] [INFO] Using profile: grid-sim
[2026-04-01 17:34:46] [INFO] Repo mode: update
[2026-04-01 17:34:46] [INFO] OpenSim dir: /opt/opensim
[2026-04-01 17:34:46] [INFO] Janus prefix: /opt/janus
[2026-04-01 17:34:46] [INFO] Configuring OpenSim runtime ini files
[2026-04-01 17:34:46] [INFO] Keeping existing config: /opt/robust/bin/Robust.ini
[2026-04-01 17:34:46] [INFO] Keeping existing config: /opt/robust/bin/Robust.ini
[2026-04-01 17:34:46] [INFO] Keeping existing config: /opt/robust/bin/MoneyServer.ini
[2026-04-01 17:34:46] [INFO] Keeping existing config: /opt/robust/bin/config-include/GridCommon.ini
[2026-04-01 17:34:46] [INFO] Keeping existing config: /opt/robust/bin/config-include/osslEnable.ini
[2026-04-01 17:34:46] [INFO] Keeping existing config: /opt/sim1/bin/OpenSim.ini
[2026-04-01 17:34:46] [INFO] Keeping existing config: /opt/sim1/bin/config-include/GridCommon.ini
[2026-04-01 17:34:46] [INFO] Keeping existing config: /opt/sim1/bin/config-include/osslEnable.ini
[2026-04-01 17:34:46] [INFO] Keeping existing config: /opt/sim2/bin/OpenSim.ini
[2026-04-01 17:34:46] [INFO] Keeping existing config: /opt/sim2/bin/config-include/GridCommon.ini
[2026-04-01 17:34:46] [INFO] Keeping existing config: /opt/sim2/bin/config-include/osslEnable.ini
[2026-04-01 17:34:47] [INFO] Updated MoneyServer.ini database credentials from configured values
[2026-04-01 17:34:47] [INFO] OpenSim runtime ini configuration completed
[2026-04-01 17:38:33] [INFO] [SMOKE] profile=grid-sim target=grid workdir=/opt
[2026-04-01 17:38:33] [INFO] [SMOKE] expected_screens=robustserver,sim1
[2026-04-01 17:38:33] [INFO] Using profile: grid-sim
[2026-04-01 17:38:33] [INFO] Starting grid from /opt
[2026-04-01 17:38:33] [INFO] Starting robustserver from /opt/robust/bin
[2026-04-01 17:38:34] [INFO] Screen session 'robustserver' started successfully
[2026-04-01 17:38:34] [INFO] Starting moneyserver from /opt/robust/bin
[2026-04-01 17:38:34] [INFO] Screen session 'moneyserver' started successfully
[2026-04-01 17:38:34] [INFO] Starting sim1 from /opt/sim1/bin
[2026-04-01 17:38:35] [INFO] Screen session 'sim1' started successfully
[2026-04-01 17:38:38] [INFO] [SMOKE][OK] screen up: robustserver
[2026-04-01 17:38:38] [INFO] [SMOKE][OK] screen up: sim1
[2026-04-01 17:38:38] [INFO] Using profile: grid-sim
[2026-04-01 17:38:38] [INFO] Stopping grid
[2026-04-01 17:38:38] [INFO] Sent shutdown to sim1
[2026-04-01 17:38:44] [INFO] Session 'sim1' still running after shutdown; forcing screen quit
[2026-04-01 17:38:45] [INFO] Screen session 'sim1' stopped
[2026-04-01 17:38:45] [INFO] Sent shutdown to moneyserver
[2026-04-01 17:38:51] [INFO] Screen session 'moneyserver' stopped
[2026-04-01 17:38:51] [INFO] Sent shutdown to robustserver
[2026-04-01 17:38:57] [INFO] Screen session 'robustserver' stopped
[2026-04-01 17:39:02] [INFO] Starting grid from /opt
[2026-04-01 17:39:02] [INFO] Starting robustserver from /opt/robust/bin
[2026-04-01 17:39:03] [INFO] Screen session 'robustserver' started successfully
[2026-04-01 17:39:03] [INFO] Starting moneyserver from /opt/robust/bin
[2026-04-01 17:39:03] [INFO] Screen session 'moneyserver' started successfully
[2026-04-01 17:39:03] [INFO] Starting sim1 from /opt/sim1/bin
[2026-04-01 17:39:04] [INFO] Screen session 'sim1' started successfully
[2026-04-01 17:39:07] [INFO] [SMOKE][OK] screen up: robustserver
[2026-04-01 17:39:07] [INFO] [SMOKE][OK] screen up: sim1
[2026-04-01 17:39:07] [INFO] Using profile: grid-sim
[2026-04-01 17:39:07] [INFO] Stopping grid
[2026-04-01 17:39:07] [INFO] Sent shutdown to sim1
[2026-04-01 17:39:13] [INFO] Session 'sim1' still running after shutdown; forcing screen quit
[2026-04-01 17:39:14] [INFO] Screen session 'sim1' stopped
[2026-04-01 17:39:14] [INFO] Sent shutdown to moneyserver
[2026-04-01 17:39:20] [INFO] Screen session 'moneyserver' stopped
[2026-04-01 17:39:20] [INFO] Sent shutdown to robustserver
[2026-04-01 17:39:26] [INFO] Screen session 'robustserver' stopped
[2026-04-01 17:39:34] [INFO] [SMOKE][OK] screen down: robustserver
[2026-04-01 17:39:34] [INFO] [SMOKE][OK] screen down: sim1
[2026-04-01 17:39:34] [INFO] [SMOKE][PASS] Start/Restart/Stop smoke test successful
[2026-04-01 17:39:35] [INFO] [SMOKE] profile=robust target=robust workdir=/opt
[2026-04-01 17:39:35] [INFO] [SMOKE] expected_screens=robustserver
[2026-04-01 17:39:35] [INFO] Using profile: robust
[2026-04-01 17:39:35] [INFO] Starting robustserver from /opt/robust/bin
[2026-04-01 17:39:35] [INFO] Screen session 'robustserver' started successfully
[2026-04-01 17:39:37] [INFO] [SMOKE][OK] screen up: robustserver
[2026-04-01 17:39:37] [INFO] Using profile: robust
[2026-04-01 17:39:37] [INFO] Sent shutdown to robustserver
[2026-04-01 17:39:43] [INFO] Screen session 'robustserver' stopped
[2026-04-01 17:39:46] [INFO] Starting robustserver from /opt/robust/bin
[2026-04-01 17:39:47] [INFO] Screen session 'robustserver' started successfully
[2026-04-01 17:39:49] [INFO] [SMOKE][OK] screen up: robustserver
[2026-04-01 17:39:49] [INFO] Using profile: robust
[2026-04-01 17:39:49] [INFO] Sent shutdown to robustserver
[2026-04-01 17:39:57] [INFO] Screen session 'robustserver' stopped
[2026-04-01 17:40:03] [INFO] [SMOKE][OK] screen down: robustserver
[2026-04-01 17:40:03] [INFO] [SMOKE][PASS] Start/Restart/Stop smoke test successful
[2026-04-01 17:43:37] [INFO] OSMTool cron jobs installed/updated
[2026-04-01 17:43:37] [INFO] OSMTool cron block removed
[2026-04-01 17:47:28] [INFO] Using profile: grid-sim
[2026-04-01 17:47:28] [INFO] [SMOKE] profile=robust target=robust workdir=/opt
[2026-04-01 17:47:28] [INFO] [SMOKE] expected_screens=robustserver
[2026-04-01 17:47:29] [INFO] Using profile: robust
[2026-04-01 17:47:29] [INFO] Starting robustserver from /opt/robust/bin
[2026-04-01 17:47:29] [INFO] Screen session 'robustserver' started successfully
[2026-04-01 17:47:32] [INFO] [SMOKE][OK] screen up: robustserver
[2026-04-01 17:47:32] [INFO] Using profile: robust
[2026-04-01 17:47:32] [INFO] Sent shutdown to robustserver
[2026-04-01 17:47:38] [INFO] Screen session 'robustserver' stopped
[2026-04-01 17:47:41] [INFO] Starting robustserver from /opt/robust/bin
[2026-04-01 17:47:42] [INFO] Screen session 'robustserver' started successfully
[2026-04-01 17:47:45] [INFO] [SMOKE][OK] screen up: robustserver
[2026-04-01 17:47:45] [INFO] Using profile: robust
[2026-04-01 17:47:45] [INFO] Sent shutdown to robustserver
[2026-04-01 17:47:51] [INFO] Screen session 'robustserver' stopped
[2026-04-01 17:47:59] [INFO] [SMOKE][OK] screen down: robustserver
[2026-04-01 17:47:59] [INFO] [SMOKE][PASS] Start/Restart/Stop smoke test successful
[2026-04-01 17:47:59] [INFO] Running health checks for profile: grid-sim
[2026-04-01 17:47:59] [INFO] Using workdir: /opt
[2026-04-01 17:47:59] [INFO] [WARN] Screen check skipped (no expected screens configured)
[2026-04-01 17:47:59] [INFO] [WARN] Port check skipped (no ports configured)
[2026-04-01 17:47:59] [INFO] [OK] Database reachable: robust
[2026-04-01 17:47:59] [INFO] [OK] Log scan: /mnt/d/OpenSimBash/opensimMULTITOOLS-II/osmtool_backup.log -> 52 matches
[2026-04-01 17:47:59] [INFO] [WARN] Log file not found, skipped: /opt/robust/bin/OpenSim.log
[2026-04-01 17:47:59] [ERROR] [FAIL] Log warning threshold exceeded: 52 > 50
[2026-04-01 17:47:59] [ERROR] [FAIL] Healthcheck FAILED with 1 failing check group(s)
[2026-04-01 17:47:59] [INFO] Using profile: grid-sim
[2026-04-01 17:47:59] [INFO] Validating INI file: /opt/robust/bin/Robust.ini
[2026-04-01 17:48:00] [INFO] Validating INI file: /opt/sim1/bin/OpenSim.ini
[2026-04-01 17:48:00] [INFO] Validating INI file: /opt/sim2/bin/OpenSim.ini
[2026-04-01 17:48:01] [INFO] Configuration validation passed
[2026-04-01 17:56:29] [INFO] OSMTool cron jobs installed/updated
[2026-04-01 17:56:37] [INFO] OSMTool cron jobs installed/updated