implement ZFS-backed rsnapshot backup #1325

singingtelegram · 2022-10-19T09:40:30Z

ocfjenkins · 2022-10-19T09:46:58Z

Errored hosts (0)

Changed hosts (1)

Unaffected hosts (77)

Changed hosts

diff for hal.ocf.berkeley.edu

*******************************************
  Cron[rsnapshot-daily] =>
   parameters =>
     command =>
      - rsnapshot -c /opt/share/backups/rsnapshot.conf sync && rsnapshot -c /opt/share/backups/rsnapshot.conf daily
      + /usr/local/sbin/backup-zfs.sh
*******************************************
- Cron[rsnapshot-monthly]
*******************************************
- Cron[rsnapshot-weekly]
*******************************************
+ File[/opt/share/backups/offsite-host] =>
   parameters =>
     "backup": "main",
     "content": "dummyhost",
     "group": "root",
     "mode": "0400",
     "owner": "root"
*******************************************
+ File[/opt/share/backups/rsnapshot-zfs-git.conf] =>
   parameters =>
     "backup": "main",
     "content": "#################################################\n# rsnapshot.c...
     "group": "root",
     "mode": "0644",
     "owner": "root"
*******************************************
+ File[/opt/share/backups/rsnapshot-zfs-mysql.conf] =>
   parameters =>
     "backup": "main",
     "content": "#################################################\n# rsnapshot.c...
     "group": "root",
     "mode": "0644",
     "owner": "root"
*******************************************
+ File[/opt/share/backups/rsnapshot-zfs-pgsql.conf] =>
   parameters =>
     "backup": "main",
     "content": "#################################################\n# rsnapshot.c...
     "group": "root",
     "mode": "0644",
     "owner": "root"
*******************************************
+ File[/opt/share/backups/rsnapshot-zfs.conf] =>
   parameters =>
     "backup": "main",
     "content": "#################################################\n# rsnapshot.c...
     "group": "root",
     "mode": "0644",
     "owner": "root"
*******************************************
+ File[/usr/local/sbin/backup-zfs.sh] =>
   parameters =>
     "backup": "main",
     "content": "#!/bin/bash\n\nCURRENT_SNAPSHOT_FILE=/opt/share/backups/current-...
     "group": "root",
     "mode": "0755",
     "owner": "root"
*******************************************

Unaffected hosts

acid.ocf.berkeley.edu
afterhours.ocf.berkeley.edu
anthrax.ocf.berkeley.edu
arsenic.ocf.berkeley.edu
asteroid.ocf.berkeley.edu
autocrat.ocf.berkeley.edu
avalanche.ocf.berkeley.edu
bedbugs.ocf.berkeley.edu
bigbang.ocf.berkeley.edu
bigrip.ocf.berkeley.edu
biohazard.ocf.berkeley.edu
blackout.ocf.berkeley.edu
blight.ocf.berkeley.edu
blizzard.ocf.berkeley.edu
chaos.ocf.berkeley.edu
corruption.ocf.berkeley.edu
coup.ocf.berkeley.edu
cyanide.ocf.berkeley.edu
cyclone.ocf.berkeley.edu
dataloss.ocf.berkeley.edu
deadlock.ocf.berkeley.edu
death.ocf.berkeley.edu
dementors.ocf.berkeley.edu
democracy.ocf.berkeley.edu
destruction.ocf.berkeley.edu
drought.ocf.berkeley.edu
eruption.ocf.berkeley.edu
fallingrocks.ocf.berkeley.edu
falsevacuum.ocf.berkeley.edu
famine.ocf.berkeley.edu
fire.ocf.berkeley.edu
firestorm.ocf.berkeley.edu
firewhirl.ocf.berkeley.edu
flood.ocf.berkeley.edu
fraud.ocf.berkeley.edu
fukushima.ocf.berkeley.edu
gridlock.ocf.berkeley.edu
hailstorm.ocf.berkeley.edu
headcrash.ocf.berkeley.edu
heatwave.ocf.berkeley.edu
hellfire.ocf.berkeley.edu
hozer-74.ocf.berkeley.edu
hurricane.ocf.berkeley.edu
invasion.ocf.berkeley.edu
jaws.ocf.berkeley.edu
lethe.ocf.berkeley.edu
lightning.ocf.berkeley.edu
lockdown.ocf.berkeley.edu
maelstrom.ocf.berkeley.edu
meteorstorm.ocf.berkeley.edu
mutation.ocf.berkeley.edu
nuke.ocf.berkeley.edu
outbreak.ocf.berkeley.edu
pestilence.ocf.berkeley.edu
plague.ocf.berkeley.edu
pox.ocf.berkeley.edu
quarantine.ocf.berkeley.edu
reaper.ocf.berkeley.edu
riptide.ocf.berkeley.edu
scurvy.ocf.berkeley.edu
segfault.ocf.berkeley.edu
shipwreck.ocf.berkeley.edu
sinkhole.ocf.berkeley.edu
solarflare.ocf.berkeley.edu
supernova.ocf.berkeley.edu
surge.ocf.berkeley.edu
thunder.ocf.berkeley.edu
tornado.ocf.berkeley.edu
tsunami.ocf.berkeley.edu
typhoon.ocf.berkeley.edu
vampires.ocf.berkeley.edu
venom.ocf.berkeley.edu
volcano.ocf.berkeley.edu
war.ocf.berkeley.edu
wildfire.ocf.berkeley.edu
windshear.ocf.berkeley.edu
worm.ocf.berkeley.edu

Jenkins

ocfjenkins · 2022-10-24T07:47:19Z

Errored hosts (0)

Changed hosts (1)

Unaffected hosts (77)

Changed hosts

diff for hal.ocf.berkeley.edu

*******************************************
  Cron[rsnapshot-daily] =>
   parameters =>
     command =>
      - rsnapshot -c /opt/share/backups/rsnapshot.conf sync && rsnapshot -c /opt/share/backups/rsnapshot.conf daily
      + /usr/local/sbin/backup-zfs.sh
*******************************************
- Cron[rsnapshot-monthly]
*******************************************
- Cron[rsnapshot-weekly]
*******************************************
+ File[/opt/share/backups/offsite-host] =>
   parameters =>
     "backup": "main",
     "content": "dummyhost",
     "group": "root",
     "mode": "0400",
     "owner": "root"
*******************************************
+ File[/opt/share/backups/rsnapshot-zfs-git.conf] =>
   parameters =>
     "backup": "main",
     "content": "#################################################\n# rsnapshot.c...
     "group": "root",
     "mode": "0644",
     "owner": "root"
*******************************************
+ File[/opt/share/backups/rsnapshot-zfs-mysql.conf] =>
   parameters =>
     "backup": "main",
     "content": "#################################################\n# rsnapshot.c...
     "group": "root",
     "mode": "0644",
     "owner": "root"
*******************************************
+ File[/opt/share/backups/rsnapshot-zfs-pgsql.conf] =>
   parameters =>
     "backup": "main",
     "content": "#################################################\n# rsnapshot.c...
     "group": "root",
     "mode": "0644",
     "owner": "root"
*******************************************
+ File[/opt/share/backups/rsnapshot-zfs.conf] =>
   parameters =>
     "backup": "main",
     "content": "#################################################\n# rsnapshot.c...
     "group": "root",
     "mode": "0644",
     "owner": "root"
*******************************************
+ File[/usr/local/sbin/backup-zfs.sh] =>
   parameters =>
     "backup": "main",
     "content": "#!/bin/bash\n\nCURRENT_SNAPSHOT_FILE=/opt/share/backups/current-...
     "group": "root",
     "mode": "0755",
     "owner": "root"
*******************************************

Unaffected hosts

acid.ocf.berkeley.edu
afterhours.ocf.berkeley.edu
anthrax.ocf.berkeley.edu
arsenic.ocf.berkeley.edu
asteroid.ocf.berkeley.edu
autocrat.ocf.berkeley.edu
avalanche.ocf.berkeley.edu
bedbugs.ocf.berkeley.edu
bigbang.ocf.berkeley.edu
bigrip.ocf.berkeley.edu
biohazard.ocf.berkeley.edu
blackout.ocf.berkeley.edu
blight.ocf.berkeley.edu
blizzard.ocf.berkeley.edu
chaos.ocf.berkeley.edu
corruption.ocf.berkeley.edu
coup.ocf.berkeley.edu
cyanide.ocf.berkeley.edu
cyclone.ocf.berkeley.edu
dataloss.ocf.berkeley.edu
deadlock.ocf.berkeley.edu
death.ocf.berkeley.edu
dementors.ocf.berkeley.edu
democracy.ocf.berkeley.edu
destruction.ocf.berkeley.edu
drought.ocf.berkeley.edu
eruption.ocf.berkeley.edu
fallingrocks.ocf.berkeley.edu
falsevacuum.ocf.berkeley.edu
famine.ocf.berkeley.edu
fire.ocf.berkeley.edu
firestorm.ocf.berkeley.edu
firewhirl.ocf.berkeley.edu
flood.ocf.berkeley.edu
fraud.ocf.berkeley.edu
fukushima.ocf.berkeley.edu
gridlock.ocf.berkeley.edu
hailstorm.ocf.berkeley.edu
headcrash.ocf.berkeley.edu
heatwave.ocf.berkeley.edu
hellfire.ocf.berkeley.edu
hozer-74.ocf.berkeley.edu
hurricane.ocf.berkeley.edu
invasion.ocf.berkeley.edu
jaws.ocf.berkeley.edu
lethe.ocf.berkeley.edu
lightning.ocf.berkeley.edu
lockdown.ocf.berkeley.edu
maelstrom.ocf.berkeley.edu
meteorstorm.ocf.berkeley.edu
mutation.ocf.berkeley.edu
nuke.ocf.berkeley.edu
outbreak.ocf.berkeley.edu
pestilence.ocf.berkeley.edu
plague.ocf.berkeley.edu
pox.ocf.berkeley.edu
quarantine.ocf.berkeley.edu
reaper.ocf.berkeley.edu
riptide.ocf.berkeley.edu
scurvy.ocf.berkeley.edu
segfault.ocf.berkeley.edu
shipwreck.ocf.berkeley.edu
sinkhole.ocf.berkeley.edu
solarflare.ocf.berkeley.edu
supernova.ocf.berkeley.edu
surge.ocf.berkeley.edu
thunder.ocf.berkeley.edu
tornado.ocf.berkeley.edu
tsunami.ocf.berkeley.edu
typhoon.ocf.berkeley.edu
vampires.ocf.berkeley.edu
venom.ocf.berkeley.edu
volcano.ocf.berkeley.edu
war.ocf.berkeley.edu
wildfire.ocf.berkeley.edu
windshear.ocf.berkeley.edu
worm.ocf.berkeley.edu

Jenkins

This reverts commit be1b32c.

ocfjenkins · 2022-10-24T10:16:44Z

Errored hosts (0)

Changed hosts (1)

Unaffected hosts (77)

Changed hosts

diff for hal.ocf.berkeley.edu

*******************************************
  Cron[rsnapshot-daily] =>
   parameters =>
     command =>
      - rsnapshot -c /opt/share/backups/rsnapshot.conf sync && rsnapshot -c /opt/share/backups/rsnapshot.conf daily
      + /usr/local/sbin/backup-zfs.sh
*******************************************
- Cron[rsnapshot-monthly]
*******************************************
- Cron[rsnapshot-weekly]
*******************************************
+ File[/opt/share/backups/offsite-host] =>
   parameters =>
     "backup": "main",
     "content": "dummyhost",
     "group": "root",
     "mode": "0400",
     "owner": "root"
*******************************************
+ File[/opt/share/backups/rsnapshot-zfs-git.conf] =>
   parameters =>
     "backup": "main",
     "content": "#################################################\n# rsnapshot.c...
     "group": "root",
     "mode": "0644",
     "owner": "root"
*******************************************
+ File[/opt/share/backups/rsnapshot-zfs-mysql.conf] =>
   parameters =>
     "backup": "main",
     "content": "#################################################\n# rsnapshot.c...
     "group": "root",
     "mode": "0644",
     "owner": "root"
*******************************************
+ File[/opt/share/backups/rsnapshot-zfs-pgsql.conf] =>
   parameters =>
     "backup": "main",
     "content": "#################################################\n# rsnapshot.c...
     "group": "root",
     "mode": "0644",
     "owner": "root"
*******************************************
+ File[/opt/share/backups/rsnapshot-zfs.conf] =>
   parameters =>
     "backup": "main",
     "content": "#################################################\n# rsnapshot.c...
     "group": "root",
     "mode": "0644",
     "owner": "root"
*******************************************
+ File[/usr/local/sbin/backup-zfs.sh] =>
   parameters =>
     "backup": "main",
     "content": "#!/bin/bash\n\nCURRENT_SNAPSHOT_FILE=/opt/share/backups/current-...
     "group": "root",
     "mode": "0755",
     "owner": "root"
*******************************************

Unaffected hosts

acid.ocf.berkeley.edu
afterhours.ocf.berkeley.edu
anthrax.ocf.berkeley.edu
arsenic.ocf.berkeley.edu
asteroid.ocf.berkeley.edu
autocrat.ocf.berkeley.edu
avalanche.ocf.berkeley.edu
bedbugs.ocf.berkeley.edu
bigbang.ocf.berkeley.edu
bigrip.ocf.berkeley.edu
biohazard.ocf.berkeley.edu
blackout.ocf.berkeley.edu
blight.ocf.berkeley.edu
blizzard.ocf.berkeley.edu
chaos.ocf.berkeley.edu
corruption.ocf.berkeley.edu
coup.ocf.berkeley.edu
cyanide.ocf.berkeley.edu
cyclone.ocf.berkeley.edu
dataloss.ocf.berkeley.edu
deadlock.ocf.berkeley.edu
death.ocf.berkeley.edu
dementors.ocf.berkeley.edu
democracy.ocf.berkeley.edu
destruction.ocf.berkeley.edu
drought.ocf.berkeley.edu
eruption.ocf.berkeley.edu
fallingrocks.ocf.berkeley.edu
falsevacuum.ocf.berkeley.edu
famine.ocf.berkeley.edu
fire.ocf.berkeley.edu
firestorm.ocf.berkeley.edu
firewhirl.ocf.berkeley.edu
flood.ocf.berkeley.edu
fraud.ocf.berkeley.edu
fukushima.ocf.berkeley.edu
gridlock.ocf.berkeley.edu
hailstorm.ocf.berkeley.edu
headcrash.ocf.berkeley.edu
heatwave.ocf.berkeley.edu
hellfire.ocf.berkeley.edu
hozer-74.ocf.berkeley.edu
hurricane.ocf.berkeley.edu
invasion.ocf.berkeley.edu
jaws.ocf.berkeley.edu
lethe.ocf.berkeley.edu
lightning.ocf.berkeley.edu
lockdown.ocf.berkeley.edu
maelstrom.ocf.berkeley.edu
meteorstorm.ocf.berkeley.edu
mutation.ocf.berkeley.edu
nuke.ocf.berkeley.edu
outbreak.ocf.berkeley.edu
pestilence.ocf.berkeley.edu
plague.ocf.berkeley.edu
pox.ocf.berkeley.edu
quarantine.ocf.berkeley.edu
reaper.ocf.berkeley.edu
riptide.ocf.berkeley.edu
scurvy.ocf.berkeley.edu
segfault.ocf.berkeley.edu
shipwreck.ocf.berkeley.edu
sinkhole.ocf.berkeley.edu
solarflare.ocf.berkeley.edu
supernova.ocf.berkeley.edu
surge.ocf.berkeley.edu
thunder.ocf.berkeley.edu
tornado.ocf.berkeley.edu
tsunami.ocf.berkeley.edu
typhoon.ocf.berkeley.edu
vampires.ocf.berkeley.edu
venom.ocf.berkeley.edu
volcano.ocf.berkeley.edu
war.ocf.berkeley.edu
wildfire.ocf.berkeley.edu
windshear.ocf.berkeley.edu
worm.ocf.berkeley.edu

Jenkins

ocfjenkins · 2022-10-25T05:41:04Z

Errored hosts (0)

Changed hosts (1)

Unaffected hosts (77)

Changed hosts

diff for hal.ocf.berkeley.edu

*******************************************
  Cron[rsnapshot-daily] =>
   parameters =>
     command =>
      - rsnapshot -c /opt/share/backups/rsnapshot.conf sync && rsnapshot -c /opt/share/backups/rsnapshot.conf daily
      + /usr/local/sbin/backup-zfs.sh
*******************************************
- Cron[rsnapshot-monthly]
*******************************************
- Cron[rsnapshot-weekly]
*******************************************
+ File[/opt/share/backups/offsite-host] =>
   parameters =>
     "backup": "main",
     "content": "dummyhost",
     "group": "root",
     "mode": "0400",
     "owner": "root"
*******************************************
+ File[/opt/share/backups/rsnapshot-zfs-git.conf] =>
   parameters =>
     "backup": "main",
     "content": "#################################################\n# rsnapshot.c...
     "group": "root",
     "mode": "0644",
     "owner": "root"
*******************************************
+ File[/opt/share/backups/rsnapshot-zfs-mysql.conf] =>
   parameters =>
     "backup": "main",
     "content": "#################################################\n# rsnapshot.c...
     "group": "root",
     "mode": "0644",
     "owner": "root"
*******************************************
+ File[/opt/share/backups/rsnapshot-zfs-pgsql.conf] =>
   parameters =>
     "backup": "main",
     "content": "#################################################\n# rsnapshot.c...
     "group": "root",
     "mode": "0644",
     "owner": "root"
*******************************************
+ File[/opt/share/backups/rsnapshot-zfs.conf] =>
   parameters =>
     "backup": "main",
     "content": "#################################################\n# rsnapshot.c...
     "group": "root",
     "mode": "0644",
     "owner": "root"
*******************************************
+ File[/usr/local/sbin/backup-zfs.sh] =>
   parameters =>
     "backup": "main",
     "content": "#!/bin/bash\n\nCURRENT_SNAPSHOT_FILE=/opt/share/backups/current-...
     "group": "root",
     "mode": "0755",
     "owner": "root"
*******************************************

Unaffected hosts

acid.ocf.berkeley.edu
afterhours.ocf.berkeley.edu
anthrax.ocf.berkeley.edu
arsenic.ocf.berkeley.edu
asteroid.ocf.berkeley.edu
autocrat.ocf.berkeley.edu
avalanche.ocf.berkeley.edu
bedbugs.ocf.berkeley.edu
bigbang.ocf.berkeley.edu
bigrip.ocf.berkeley.edu
biohazard.ocf.berkeley.edu
blackout.ocf.berkeley.edu
blight.ocf.berkeley.edu
blizzard.ocf.berkeley.edu
chaos.ocf.berkeley.edu
corruption.ocf.berkeley.edu
coup.ocf.berkeley.edu
cyanide.ocf.berkeley.edu
cyclone.ocf.berkeley.edu
dataloss.ocf.berkeley.edu
deadlock.ocf.berkeley.edu
death.ocf.berkeley.edu
dementors.ocf.berkeley.edu
democracy.ocf.berkeley.edu
destruction.ocf.berkeley.edu
drought.ocf.berkeley.edu
eruption.ocf.berkeley.edu
fallingrocks.ocf.berkeley.edu
falsevacuum.ocf.berkeley.edu
famine.ocf.berkeley.edu
fire.ocf.berkeley.edu
firestorm.ocf.berkeley.edu
firewhirl.ocf.berkeley.edu
flood.ocf.berkeley.edu
fraud.ocf.berkeley.edu
fukushima.ocf.berkeley.edu
gridlock.ocf.berkeley.edu
hailstorm.ocf.berkeley.edu
headcrash.ocf.berkeley.edu
heatwave.ocf.berkeley.edu
hellfire.ocf.berkeley.edu
hozer-74.ocf.berkeley.edu
hurricane.ocf.berkeley.edu
invasion.ocf.berkeley.edu
jaws.ocf.berkeley.edu
lethe.ocf.berkeley.edu
lightning.ocf.berkeley.edu
lockdown.ocf.berkeley.edu
maelstrom.ocf.berkeley.edu
meteorstorm.ocf.berkeley.edu
mutation.ocf.berkeley.edu
nuke.ocf.berkeley.edu
outbreak.ocf.berkeley.edu
pestilence.ocf.berkeley.edu
plague.ocf.berkeley.edu
pox.ocf.berkeley.edu
quarantine.ocf.berkeley.edu
reaper.ocf.berkeley.edu
riptide.ocf.berkeley.edu
scurvy.ocf.berkeley.edu
segfault.ocf.berkeley.edu
shipwreck.ocf.berkeley.edu
sinkhole.ocf.berkeley.edu
solarflare.ocf.berkeley.edu
supernova.ocf.berkeley.edu
surge.ocf.berkeley.edu
thunder.ocf.berkeley.edu
tornado.ocf.berkeley.edu
tsunami.ocf.berkeley.edu
typhoon.ocf.berkeley.edu
vampires.ocf.berkeley.edu
venom.ocf.berkeley.edu
volcano.ocf.berkeley.edu
war.ocf.berkeley.edu
wildfire.ocf.berkeley.edu
windshear.ocf.berkeley.edu
worm.ocf.berkeley.edu

Jenkins

ocfjenkins · 2022-10-25T05:46:37Z

Errored hosts (0)

Changed hosts (1)

Unaffected hosts (77)

Changed hosts

diff for hal.ocf.berkeley.edu

*******************************************
- Cron[check-rsnapshot-backups]
*******************************************
  Cron[rsnapshot-daily] =>
   parameters =>
     command =>
      - rsnapshot -c /opt/share/backups/rsnapshot.conf sync && rsnapshot -c /opt/share/backups/rsnapshot.conf daily
      + /usr/local/sbin/backup-zfs.sh
     hour =>
      - 2
      + 23
*******************************************
- Cron[rsnapshot-monthly]
*******************************************
- Cron[rsnapshot-weekly]
*******************************************
+ File[/opt/share/backups/offsite-host] =>
   parameters =>
     "backup": "main",
     "content": "dummyhost",
     "group": "root",
     "mode": "0400",
     "owner": "root"
*******************************************
+ File[/opt/share/backups/rsnapshot-zfs-git.conf] =>
   parameters =>
     "backup": "main",
     "content": "#################################################\n# rsnapshot.c...
     "group": "root",
     "mode": "0644",
     "owner": "root"
*******************************************
+ File[/opt/share/backups/rsnapshot-zfs-mysql.conf] =>
   parameters =>
     "backup": "main",
     "content": "#################################################\n# rsnapshot.c...
     "group": "root",
     "mode": "0644",
     "owner": "root"
*******************************************
+ File[/opt/share/backups/rsnapshot-zfs-pgsql.conf] =>
   parameters =>
     "backup": "main",
     "content": "#################################################\n# rsnapshot.c...
     "group": "root",
     "mode": "0644",
     "owner": "root"
*******************************************
+ File[/opt/share/backups/rsnapshot-zfs.conf] =>
   parameters =>
     "backup": "main",
     "content": "#################################################\n# rsnapshot.c...
     "group": "root",
     "mode": "0644",
     "owner": "root"
*******************************************
+ File[/usr/local/sbin/backup-zfs.sh] =>
   parameters =>
     "backup": "main",
     "content": "#!/bin/bash\n\nCURRENT_SNAPSHOT_FILE=/opt/share/backups/current-...
     "group": "root",
     "mode": "0755",
     "owner": "root"
*******************************************

Unaffected hosts

acid.ocf.berkeley.edu
afterhours.ocf.berkeley.edu
anthrax.ocf.berkeley.edu
arsenic.ocf.berkeley.edu
asteroid.ocf.berkeley.edu
autocrat.ocf.berkeley.edu
avalanche.ocf.berkeley.edu
bedbugs.ocf.berkeley.edu
bigbang.ocf.berkeley.edu
bigrip.ocf.berkeley.edu
biohazard.ocf.berkeley.edu
blackout.ocf.berkeley.edu
blight.ocf.berkeley.edu
blizzard.ocf.berkeley.edu
chaos.ocf.berkeley.edu
corruption.ocf.berkeley.edu
coup.ocf.berkeley.edu
cyanide.ocf.berkeley.edu
cyclone.ocf.berkeley.edu
dataloss.ocf.berkeley.edu
deadlock.ocf.berkeley.edu
death.ocf.berkeley.edu
dementors.ocf.berkeley.edu
democracy.ocf.berkeley.edu
destruction.ocf.berkeley.edu
drought.ocf.berkeley.edu
eruption.ocf.berkeley.edu
fallingrocks.ocf.berkeley.edu
falsevacuum.ocf.berkeley.edu
famine.ocf.berkeley.edu
fire.ocf.berkeley.edu
firestorm.ocf.berkeley.edu
firewhirl.ocf.berkeley.edu
flood.ocf.berkeley.edu
fraud.ocf.berkeley.edu
fukushima.ocf.berkeley.edu
gridlock.ocf.berkeley.edu
hailstorm.ocf.berkeley.edu
headcrash.ocf.berkeley.edu
heatwave.ocf.berkeley.edu
hellfire.ocf.berkeley.edu
hozer-74.ocf.berkeley.edu
hurricane.ocf.berkeley.edu
invasion.ocf.berkeley.edu
jaws.ocf.berkeley.edu
lethe.ocf.berkeley.edu
lightning.ocf.berkeley.edu
lockdown.ocf.berkeley.edu
maelstrom.ocf.berkeley.edu
meteorstorm.ocf.berkeley.edu
mutation.ocf.berkeley.edu
nuke.ocf.berkeley.edu
outbreak.ocf.berkeley.edu
pestilence.ocf.berkeley.edu
plague.ocf.berkeley.edu
pox.ocf.berkeley.edu
quarantine.ocf.berkeley.edu
reaper.ocf.berkeley.edu
riptide.ocf.berkeley.edu
scurvy.ocf.berkeley.edu
segfault.ocf.berkeley.edu
shipwreck.ocf.berkeley.edu
sinkhole.ocf.berkeley.edu
solarflare.ocf.berkeley.edu
supernova.ocf.berkeley.edu
surge.ocf.berkeley.edu
thunder.ocf.berkeley.edu
tornado.ocf.berkeley.edu
tsunami.ocf.berkeley.edu
typhoon.ocf.berkeley.edu
vampires.ocf.berkeley.edu
venom.ocf.berkeley.edu
volcano.ocf.berkeley.edu
war.ocf.berkeley.edu
wildfire.ocf.berkeley.edu
windshear.ocf.berkeley.edu
worm.ocf.berkeley.edu

Jenkins

ocfjenkins · 2022-10-26T05:16:15Z

Errored hosts (0)

Changed hosts (1)

Unaffected hosts (77)

Changed hosts

diff for hal.ocf.berkeley.edu

*******************************************
- Cron[check-rsnapshot-backups]
*******************************************
  Cron[rsnapshot-daily] =>
   parameters =>
     command =>
      - rsnapshot -c /opt/share/backups/rsnapshot.conf sync && rsnapshot -c /opt/share/backups/rsnapshot.conf daily
      + /usr/local/sbin/backup-zfs.sh
     hour =>
      - 2
      + 22
     minute =>
      - 0
      + 15
*******************************************
- Cron[rsnapshot-monthly]
*******************************************
- Cron[rsnapshot-weekly]
*******************************************
+ File[/opt/share/backups/offsite-host] =>
   parameters =>
     "backup": "main",
     "content": "dummyhost",
     "group": "root",
     "mode": "0400",
     "owner": "root"
*******************************************
+ File[/opt/share/backups/rsnapshot-zfs-git.conf] =>
   parameters =>
     "backup": "main",
     "content": "#################################################\n# rsnapshot.c...
     "group": "root",
     "mode": "0644",
     "owner": "root"
*******************************************
+ File[/opt/share/backups/rsnapshot-zfs-mysql.conf] =>
   parameters =>
     "backup": "main",
     "content": "#################################################\n# rsnapshot.c...
     "group": "root",
     "mode": "0644",
     "owner": "root"
*******************************************
+ File[/opt/share/backups/rsnapshot-zfs-pgsql.conf] =>
   parameters =>
     "backup": "main",
     "content": "#################################################\n# rsnapshot.c...
     "group": "root",
     "mode": "0644",
     "owner": "root"
*******************************************
+ File[/opt/share/backups/rsnapshot-zfs.conf] =>
   parameters =>
     "backup": "main",
     "content": "#################################################\n# rsnapshot.c...
     "group": "root",
     "mode": "0644",
     "owner": "root"
*******************************************
+ File[/usr/local/sbin/backup-zfs.sh] =>
   parameters =>
     "backup": "main",
     "content": "#!/bin/bash\n\nCURRENT_SNAPSHOT_FILE=/opt/share/backups/current-...
     "group": "root",
     "mode": "0755",
     "owner": "root"
*******************************************

Unaffected hosts

acid.ocf.berkeley.edu
afterhours.ocf.berkeley.edu
anthrax.ocf.berkeley.edu
arsenic.ocf.berkeley.edu
asteroid.ocf.berkeley.edu
autocrat.ocf.berkeley.edu
avalanche.ocf.berkeley.edu
bedbugs.ocf.berkeley.edu
bigbang.ocf.berkeley.edu
bigrip.ocf.berkeley.edu
biohazard.ocf.berkeley.edu
blackout.ocf.berkeley.edu
blight.ocf.berkeley.edu
blizzard.ocf.berkeley.edu
chaos.ocf.berkeley.edu
corruption.ocf.berkeley.edu
coup.ocf.berkeley.edu
cyanide.ocf.berkeley.edu
cyclone.ocf.berkeley.edu
dataloss.ocf.berkeley.edu
deadlock.ocf.berkeley.edu
death.ocf.berkeley.edu
dementors.ocf.berkeley.edu
democracy.ocf.berkeley.edu
destruction.ocf.berkeley.edu
drought.ocf.berkeley.edu
eruption.ocf.berkeley.edu
fallingrocks.ocf.berkeley.edu
falsevacuum.ocf.berkeley.edu
famine.ocf.berkeley.edu
fire.ocf.berkeley.edu
firestorm.ocf.berkeley.edu
firewhirl.ocf.berkeley.edu
flood.ocf.berkeley.edu
fraud.ocf.berkeley.edu
fukushima.ocf.berkeley.edu
gridlock.ocf.berkeley.edu
hailstorm.ocf.berkeley.edu
headcrash.ocf.berkeley.edu
heatwave.ocf.berkeley.edu
hellfire.ocf.berkeley.edu
hozer-74.ocf.berkeley.edu
hurricane.ocf.berkeley.edu
invasion.ocf.berkeley.edu
jaws.ocf.berkeley.edu
lethe.ocf.berkeley.edu
lightning.ocf.berkeley.edu
lockdown.ocf.berkeley.edu
maelstrom.ocf.berkeley.edu
meteorstorm.ocf.berkeley.edu
mutation.ocf.berkeley.edu
nuke.ocf.berkeley.edu
outbreak.ocf.berkeley.edu
pestilence.ocf.berkeley.edu
plague.ocf.berkeley.edu
pox.ocf.berkeley.edu
quarantine.ocf.berkeley.edu
reaper.ocf.berkeley.edu
riptide.ocf.berkeley.edu
scurvy.ocf.berkeley.edu
segfault.ocf.berkeley.edu
shipwreck.ocf.berkeley.edu
sinkhole.ocf.berkeley.edu
solarflare.ocf.berkeley.edu
supernova.ocf.berkeley.edu
surge.ocf.berkeley.edu
thunder.ocf.berkeley.edu
tornado.ocf.berkeley.edu
tsunami.ocf.berkeley.edu
typhoon.ocf.berkeley.edu
vampires.ocf.berkeley.edu
venom.ocf.berkeley.edu
volcano.ocf.berkeley.edu
war.ocf.berkeley.edu
wildfire.ocf.berkeley.edu
windshear.ocf.berkeley.edu
worm.ocf.berkeley.edu

Jenkins

ocfjenkins · 2022-10-26T05:18:22Z

Errored hosts (0)

Changed hosts (1)

Unaffected hosts (77)

Changed hosts

diff for hal.ocf.berkeley.edu

*******************************************
- Cron[check-rsnapshot-backups]
*******************************************
  Cron[rsnapshot-daily] =>
   parameters =>
     command =>
      - rsnapshot -c /opt/share/backups/rsnapshot.conf sync && rsnapshot -c /opt/share/backups/rsnapshot.conf daily
      + /usr/local/sbin/backup-zfs.sh
     hour =>
      - 2
      + 22
     minute =>
      - 0
      + 20
*******************************************
- Cron[rsnapshot-monthly]
*******************************************
- Cron[rsnapshot-weekly]
*******************************************
+ File[/opt/share/backups/offsite-host] =>
   parameters =>
     "backup": "main",
     "content": "dummyhost",
     "group": "root",
     "mode": "0400",
     "owner": "root"
*******************************************
+ File[/opt/share/backups/rsnapshot-zfs-git.conf] =>
   parameters =>
     "backup": "main",
     "content": "#################################################\n# rsnapshot.c...
     "group": "root",
     "mode": "0644",
     "owner": "root"
*******************************************
+ File[/opt/share/backups/rsnapshot-zfs-mysql.conf] =>
   parameters =>
     "backup": "main",
     "content": "#################################################\n# rsnapshot.c...
     "group": "root",
     "mode": "0644",
     "owner": "root"
*******************************************
+ File[/opt/share/backups/rsnapshot-zfs-pgsql.conf] =>
   parameters =>
     "backup": "main",
     "content": "#################################################\n# rsnapshot.c...
     "group": "root",
     "mode": "0644",
     "owner": "root"
*******************************************
+ File[/opt/share/backups/rsnapshot-zfs.conf] =>
   parameters =>
     "backup": "main",
     "content": "#################################################\n# rsnapshot.c...
     "group": "root",
     "mode": "0644",
     "owner": "root"
*******************************************
+ File[/usr/local/sbin/backup-zfs.sh] =>
   parameters =>
     "backup": "main",
     "content": "#!/bin/bash\n\nCURRENT_SNAPSHOT_FILE=/opt/share/backups/current-...
     "group": "root",
     "mode": "0755",
     "owner": "root"
*******************************************

Unaffected hosts

acid.ocf.berkeley.edu
afterhours.ocf.berkeley.edu
anthrax.ocf.berkeley.edu
arsenic.ocf.berkeley.edu
asteroid.ocf.berkeley.edu
autocrat.ocf.berkeley.edu
avalanche.ocf.berkeley.edu
bedbugs.ocf.berkeley.edu
bigbang.ocf.berkeley.edu
bigrip.ocf.berkeley.edu
biohazard.ocf.berkeley.edu
blackout.ocf.berkeley.edu
blight.ocf.berkeley.edu
blizzard.ocf.berkeley.edu
chaos.ocf.berkeley.edu
corruption.ocf.berkeley.edu
coup.ocf.berkeley.edu
cyanide.ocf.berkeley.edu
cyclone.ocf.berkeley.edu
dataloss.ocf.berkeley.edu
deadlock.ocf.berkeley.edu
death.ocf.berkeley.edu
dementors.ocf.berkeley.edu
democracy.ocf.berkeley.edu
destruction.ocf.berkeley.edu
drought.ocf.berkeley.edu
eruption.ocf.berkeley.edu
fallingrocks.ocf.berkeley.edu
falsevacuum.ocf.berkeley.edu
famine.ocf.berkeley.edu
fire.ocf.berkeley.edu
firestorm.ocf.berkeley.edu
firewhirl.ocf.berkeley.edu
flood.ocf.berkeley.edu
fraud.ocf.berkeley.edu
fukushima.ocf.berkeley.edu
gridlock.ocf.berkeley.edu
hailstorm.ocf.berkeley.edu
headcrash.ocf.berkeley.edu
heatwave.ocf.berkeley.edu
hellfire.ocf.berkeley.edu
hozer-74.ocf.berkeley.edu
hurricane.ocf.berkeley.edu
invasion.ocf.berkeley.edu
jaws.ocf.berkeley.edu
lethe.ocf.berkeley.edu
lightning.ocf.berkeley.edu
lockdown.ocf.berkeley.edu
maelstrom.ocf.berkeley.edu
meteorstorm.ocf.berkeley.edu
mutation.ocf.berkeley.edu
nuke.ocf.berkeley.edu
outbreak.ocf.berkeley.edu
pestilence.ocf.berkeley.edu
plague.ocf.berkeley.edu
pox.ocf.berkeley.edu
quarantine.ocf.berkeley.edu
reaper.ocf.berkeley.edu
riptide.ocf.berkeley.edu
scurvy.ocf.berkeley.edu
segfault.ocf.berkeley.edu
shipwreck.ocf.berkeley.edu
sinkhole.ocf.berkeley.edu
solarflare.ocf.berkeley.edu
supernova.ocf.berkeley.edu
surge.ocf.berkeley.edu
thunder.ocf.berkeley.edu
tornado.ocf.berkeley.edu
tsunami.ocf.berkeley.edu
typhoon.ocf.berkeley.edu
vampires.ocf.berkeley.edu
venom.ocf.berkeley.edu
volcano.ocf.berkeley.edu
war.ocf.berkeley.edu
wildfire.ocf.berkeley.edu
windshear.ocf.berkeley.edu
worm.ocf.berkeley.edu

Jenkins

ocfjenkins · 2022-10-29T21:21:51Z

Errored hosts (1)

Changed hosts (1)

Unaffected hosts (77)

Errored hosts

error for newton.ocf.berkeley.edu

W, [2022-10-29T14:21:31.858360 #11268]  WARN -- : Puppet command failed: STDOUT:
STDERR:
  Warning: The function 'hiera_include' is deprecated in favor of using 'lookup'. See https://puppet.com/docs/puppet/7.20/deprecated_language.html
     (file & line not available)
  Warning: Unrecognized escape sequence '\/' (file: /tmp/ocd-ipc-20221029-11226-1n9jljr/ocd-builddir-20221029-11268-2vyspp/environments/production/modules/ocf_desktop/manifests/packages.pp, line: 112, column: 75)
  Warning: Unrecognized escape sequence '\/' (file: /tmp/ocd-ipc-20221029-11226-1n9jljr/ocd-builddir-20221029-11268-2vyspp/environments/production/modules/ocf_desktop/manifests/packages.pp, line: 112, column: 75)
  Warning: Unrecognized escape sequence '\/' (file: /tmp/ocd-ipc-20221029-11226-1n9jljr/ocd-builddir-20221029-11268-2vyspp/environments/production/modules/ocf_desktop/manifests/packages.pp, line: 112, column: 75)
  Warning: Unrecognized escape sequence '\1' (file: /tmp/ocd-ipc-20221029-11226-1n9jljr/ocd-builddir-20221029-11268-2vyspp/environments/production/modules/ocf_desktop/manifests/packages.pp, line: 112, column: 172)
  Warning: Unrecognized escape sequence '\2' (file: /tmp/ocd-ipc-20221029-11226-1n9jljr/ocd-builddir-20221029-11268-2vyspp/environments/production/modules/ocf_desktop/manifests/packages.pp, line: 112, column: 172)
  Error: Evaluation Error: Error while evaluating a Function Call, 'new' The string 'bookworm/sid' cannot be converted to Integer (file: /tmp/ocd-ipc-20221029-11226-1n9jljr/ocd-builddir-20221029-11268-2vyspp/environments/production/modules/ocf/manifests/packages/mysql_server.pp, line: 13, column: 8) on node newton.ocf.berkeley.edu
  Error: Evaluation Error: Error while evaluating a Function Call, 'new' The string 'bookworm/sid' cannot be converted to Integer (file: /tmp/ocd-ipc-20221029-11226-1n9jljr/ocd-builddir-20221029-11268-2vyspp/environments/production/modules/ocf/manifests/packages/mysql_server.pp, line: 13, column: 8) on node newton.ocf.berkeley.edu
  Error: Could not call 'find' on 'catalog': Evaluation Error: Error while evaluating a Function Call, 'new' The string 'bookworm/sid' cannot be converted to Integer (file: /tmp/ocd-ipc-20221029-11226-1n9jljr/ocd-builddir-20221029-11268-2vyspp/environments/production/modules/ocf/manifests/packages/mysql_server.pp, line: 13, column: 8) on node newton.ocf.berkeley.edu
  Error: Could not call 'find' on 'catalog': Evaluation Error: Error while evaluating a Function Call, 'new' The string 'bookworm/sid' cannot be converted to Integer (file: /tmp/ocd-ipc-20221029-11226-1n9jljr/ocd-builddir-20221029-11268-2vyspp/environments/production/modules/ocf/manifests/packages/mysql_server.pp, line: 13, column: 8) on node newton.ocf.berkeley.edu
  Error: Try 'puppet help catalog compile' for usage
W, [2022-10-29T14:21:31.858823 #11268]  WARN -- : Failed build_catalog for . validation: OctocatalogDiff::Errors::CatalogError Catalog failed: Warning: The function 'hiera_include' is deprecated in favor of using 'lookup'. See https://puppet.com/docs/puppet/7.20/deprecated_language.html
   (file & line not available)
Warning: Unrecognized escape sequence '\/' (file: /tmp/ocd-ipc-20221029-11226-1n9jljr/ocd-builddir-20221029-11268-2vyspp/environments/production/modules/ocf_desktop/manifests/packages.pp, line: 112, column: 75)
Warning: Unrecognized escape sequence '\/' (file: /tmp/ocd-ipc-20221029-11226-1n9jljr/ocd-builddir-20221029-11268-2vyspp/environments/production/modules/ocf_desktop/manifests/packages.pp, line: 112, column: 75)
Warning: Unrecognized escape sequence '\/' (file: /tmp/ocd-ipc-20221029-11226-1n9jljr/ocd-builddir-20221029-11268-2vyspp/environments/production/modules/ocf_desktop/manifests/packages.pp, line: 112, column: 75)
Warning: Unrecognized escape sequence '\1' (file: /tmp/ocd-ipc-20221029-11226-1n9jljr/ocd-builddir-20221029-11268-2vyspp/environments/production/modules/ocf_desktop/manifests/packages.pp, line: 112, column: 172)
Warning: Unrecognized escape sequence '\2' (file: /tmp/ocd-ipc-20221029-11226-1n9jljr/ocd-builddir-20221029-11268-2vyspp/environments/production/modules/ocf_desktop/manifests/packages.pp, line: 112, column: 172)
Error: Evaluation Error: Error while evaluating a Function Call, 'new' The string 'bookworm/sid' cannot be converted to Integer (file: /tmp/ocd-ipc-20221029-11226-1n9jljr/ocd-builddir-20221029-11268-2vyspp/environments/production/modules/ocf/manifests/packages/mysql_server.pp, line: 13, column: 8) on node newton.ocf.berkeley.edu
Error: Evaluation Error: Error while evaluating a Function Call, 'new' The string 'bookworm/sid' cannot be converted to Integer (file: /tmp/ocd-ipc-20221029-11226-1n9jljr/ocd-builddir-20221029-11268-2vyspp/environments/production/modules/ocf/manifests/packages/mysql_server.pp, line: 13, column: 8) on node newton.ocf.berkeley.edu
Error: Could not call 'find' on 'catalog': Evaluation Error: Error while evaluating a Function Call, 'new' The string 'bookworm/sid' cannot be converted to Integer (file: /tmp/ocd-ipc-20221029-11226-1n9jljr/ocd-builddir-20221029-11268-2vyspp/environments/production/modules/ocf/manifests/packages/mysql_server.pp, line: 13, column: 8) on node newton.ocf.berkeley.edu
Error: Could not call 'find' on 'catalog': Evaluation Error: Error while evaluating a Function Call, 'new' The string 'bookworm/sid' cannot be converted to Integer (file: /tmp/ocd-ipc-20221029-11226-1n9jljr/ocd-builddir-20221029-11268-2vyspp/environments/production/modules/ocf/manifests/packages/mysql_server.pp, line: 13, column: 8) on node newton.ocf.berkeley.edu
Error: Try 'puppet help catalog compile' for usage

#<Thread:0x00005619af886f20@/usr/lib/ruby/2.5.0/open3.rb:264 run> terminated with exception (report_on_exception is true):
/usr/lib/ruby/2.5.0/open3.rb:264:in `read': stream closed in another thread (IOError)
	from /usr/lib/ruby/2.5.0/open3.rb:264:in `block (2 levels) in capture3'
#<Thread:0x00005619af886de0@/usr/lib/ruby/2.5.0/open3.rb:265 run> terminated with exception (report_on_exception is true):
/usr/lib/ruby/2.5.0/open3.rb:265:in `read': stream closed in another thread (IOError)
	from /usr/lib/ruby/2.5.0/open3.rb:265:in `block (2 levels) in capture3'
/usr/lib/ruby/vendor_ruby/octocatalog-diff/util/catalogs.rb:259:in `catalog_validator': Catalog failed: Warning: The function 'hiera_include' is deprecated in favor of using 'lookup'. See https://puppet.com/docs/puppet/7.20/deprecated_language.html (OctocatalogDiff::Errors::CatalogError)
   (file & line not available)
Warning: Unrecognized escape sequence '\/' (file: /tmp/ocd-ipc-20221029-11226-1n9jljr/ocd-builddir-20221029-11268-2vyspp/environments/production/modules/ocf_desktop/manifests/packages.pp, line: 112, column: 75)
Warning: Unrecognized escape sequence '\/' (file: /tmp/ocd-ipc-20221029-11226-1n9jljr/ocd-builddir-20221029-11268-2vyspp/environments/production/modules/ocf_desktop/manifests/packages.pp, line: 112, column: 75)
Warning: Unrecognized escape sequence '\/' (file: /tmp/ocd-ipc-20221029-11226-1n9jljr/ocd-builddir-20221029-11268-2vyspp/environments/production/modules/ocf_desktop/manifests/packages.pp, line: 112, column: 75)
Warning: Unrecognized escape sequence '\1' (file: /tmp/ocd-ipc-20221029-11226-1n9jljr/ocd-builddir-20221029-11268-2vyspp/environments/production/modules/ocf_desktop/manifests/packages.pp, line: 112, column: 172)
Warning: Unrecognized escape sequence '\2' (file: /tmp/ocd-ipc-20221029-11226-1n9jljr/ocd-builddir-20221029-11268-2vyspp/environments/production/modules/ocf_desktop/manifests/packages.pp, line: 112, column: 172)
Error: Evaluation Error: Error while evaluating a Function Call, 'new' The string 'bookworm/sid' cannot be converted to Integer (file: /tmp/ocd-ipc-20221029-11226-1n9jljr/ocd-builddir-20221029-11268-2vyspp/environments/production/modules/ocf/manifests/packages/mysql_server.pp, line: 13, column: 8) on node newton.ocf.berkeley.edu
Error: Evaluation Error: Error while evaluating a Function Call, 'new' The string 'bookworm/sid' cannot be converted to Integer (file: /tmp/ocd-ipc-20221029-11226-1n9jljr/ocd-builddir-20221029-11268-2vyspp/environments/production/modules/ocf/manifests/packages/mysql_server.pp, line: 13, column: 8) on node newton.ocf.berkeley.edu
Error: Could not call 'find' on 'catalog': Evaluation Error: Error while evaluating a Function Call, 'new' The string 'bookworm/sid' cannot be converted to Integer (file: /tmp/ocd-ipc-20221029-11226-1n9jljr/ocd-builddir-20221029-11268-2vyspp/environments/production/modules/ocf/manifests/packages/mysql_server.pp, line: 13, column: 8) on node newton.ocf.berkeley.edu
Error: Could not call 'find' on 'catalog': Evaluation Error: Error while evaluating a Function Call, 'new' The string 'bookworm/sid' cannot be converted to Integer (file: /tmp/ocd-ipc-20221029-11226-1n9jljr/ocd-builddir-20221029-11268-2vyspp/environments/production/modules/ocf/manifests/packages/mysql_server.pp, line: 13, column: 8) on node newton.ocf.berkeley.edu
Error: Try 'puppet help catalog compile' for usage
	from /usr/lib/ruby/vendor_ruby/octocatalog-diff/util/parallel.rb:39:in `call'
	from /usr/lib/ruby/vendor_ruby/octocatalog-diff/util/parallel.rb:39:in `validate'
	from /usr/lib/ruby/vendor_ruby/octocatalog-diff/util/parallel.rb:202:in `execute_task'
	from /usr/lib/ruby/vendor_ruby/octocatalog-diff/util/parallel.rb:119:in `block (2 levels) in run_tasks_parallel'
	from /usr/lib/ruby/vendor_ruby/octocatalog-diff/util/parallel.rb:117:in `fork'
	from /usr/lib/ruby/vendor_ruby/octocatalog-diff/util/parallel.rb:117:in `block in run_tasks_parallel'
	from /usr/lib/ruby/vendor_ruby/octocatalog-diff/util/parallel.rb:114:in `each'
	from /usr/lib/ruby/vendor_ruby/octocatalog-diff/util/parallel.rb:114:in `each_with_index'
	from /usr/lib/ruby/vendor_ruby/octocatalog-diff/util/parallel.rb:114:in `run_tasks_parallel'
	from /usr/lib/ruby/vendor_ruby/octocatalog-diff/util/parallel.rb:94:in `run_tasks'
	from /usr/lib/ruby/vendor_ruby/octocatalog-diff/util/catalogs.rb:92:in `build_catalog_parallelizer'
	from /usr/lib/ruby/vendor_ruby/octocatalog-diff/util/catalogs.rb:29:in `catalogs'
	from /usr/lib/ruby/vendor_ruby/octocatalog-diff/api/v1/catalog-diff.rb:34:in `catalog_diff'
	from /usr/lib/ruby/vendor_ruby/octocatalog-diff/api/v1.rb:19:in `catalog_diff'
	from /usr/lib/ruby/vendor_ruby/octocatalog-diff/cli.rb:151:in `run_octocatalog_diff'
	from /usr/lib/ruby/vendor_ruby/octocatalog-diff/cli.rb:125:in `cli'
	from /usr/bin/octocatalog-diff:34:in `<main>'

Changed hosts

diff for hal.ocf.berkeley.edu

*******************************************
- Cron[check-rsnapshot-backups]
*******************************************
  Cron[rsnapshot-daily] =>
   parameters =>
     command =>
      - rsnapshot -c /opt/share/backups/rsnapshot.conf sync && rsnapshot -c /opt/share/backups/rsnapshot.conf daily
      + /usr/local/sbin/backup-zfs.sh
     hour =>
      - 2
      + 22
     minute =>
      - 0
      + 20
*******************************************
- Cron[rsnapshot-monthly]
*******************************************
- Cron[rsnapshot-weekly]
*******************************************
+ File[/opt/share/backups/offsite-host] =>
   parameters =>
     "backup": "main",
     "content": "dummyhost",
     "group": "root",
     "mode": "0400",
     "owner": "root"
*******************************************
+ File[/opt/share/backups/rsnapshot-zfs-git.conf] =>
   parameters =>
     "backup": "main",
     "content": "#################################################\n# rsnapshot.c...
     "group": "root",
     "mode": "0644",
     "owner": "root"
*******************************************
+ File[/opt/share/backups/rsnapshot-zfs-mysql.conf] =>
   parameters =>
     "backup": "main",
     "content": "#################################################\n# rsnapshot.c...
     "group": "root",
     "mode": "0644",
     "owner": "root"
*******************************************
+ File[/opt/share/backups/rsnapshot-zfs-pgsql.conf] =>
   parameters =>
     "backup": "main",
     "content": "#################################################\n# rsnapshot.c...
     "group": "root",
     "mode": "0644",
     "owner": "root"
*******************************************
+ File[/opt/share/backups/rsnapshot-zfs.conf] =>
   parameters =>
     "backup": "main",
     "content": "#################################################\n# rsnapshot.c...
     "group": "root",
     "mode": "0644",
     "owner": "root"
*******************************************
+ File[/usr/local/sbin/backup-zfs.sh] =>
   parameters =>
     "backup": "main",
     "content": "#!/bin/bash\n\nCURRENT_SNAPSHOT_FILE=/opt/share/backups/current-...
     "group": "root",
     "mode": "0755",
     "owner": "root"
*******************************************

Unaffected hosts

acid.ocf.berkeley.edu
afterhours.ocf.berkeley.edu
anthrax.ocf.berkeley.edu
arsenic.ocf.berkeley.edu
asteroid.ocf.berkeley.edu
autocrat.ocf.berkeley.edu
avalanche.ocf.berkeley.edu
bedbugs.ocf.berkeley.edu
bigbang.ocf.berkeley.edu
bigrip.ocf.berkeley.edu
biohazard.ocf.berkeley.edu
blackout.ocf.berkeley.edu
blight.ocf.berkeley.edu
blizzard.ocf.berkeley.edu
chaos.ocf.berkeley.edu
corruption.ocf.berkeley.edu
coup.ocf.berkeley.edu
cyanide.ocf.berkeley.edu
cyclone.ocf.berkeley.edu
dataloss.ocf.berkeley.edu
deadlock.ocf.berkeley.edu
death.ocf.berkeley.edu
dementors.ocf.berkeley.edu
democracy.ocf.berkeley.edu
destruction.ocf.berkeley.edu
drought.ocf.berkeley.edu
eruption.ocf.berkeley.edu
fallingrocks.ocf.berkeley.edu
falsevacuum.ocf.berkeley.edu
famine.ocf.berkeley.edu
fire.ocf.berkeley.edu
firestorm.ocf.berkeley.edu
firewhirl.ocf.berkeley.edu
flood.ocf.berkeley.edu
fraud.ocf.berkeley.edu
fukushima.ocf.berkeley.edu
gridlock.ocf.berkeley.edu
hailstorm.ocf.berkeley.edu
headcrash.ocf.berkeley.edu
heatwave.ocf.berkeley.edu
hellfire.ocf.berkeley.edu
hozer-74.ocf.berkeley.edu
hurricane.ocf.berkeley.edu
invasion.ocf.berkeley.edu
jaws.ocf.berkeley.edu
lethe.ocf.berkeley.edu
lightning.ocf.berkeley.edu
lockdown.ocf.berkeley.edu
madcow.ocf.berkeley.edu
maelstrom.ocf.berkeley.edu
meteorstorm.ocf.berkeley.edu
nuke.ocf.berkeley.edu
outbreak.ocf.berkeley.edu
pestilence.ocf.berkeley.edu
plague.ocf.berkeley.edu
pox.ocf.berkeley.edu
quarantine.ocf.berkeley.edu
reaper.ocf.berkeley.edu
riptide.ocf.berkeley.edu
scurvy.ocf.berkeley.edu
segfault.ocf.berkeley.edu
shipwreck.ocf.berkeley.edu
sinkhole.ocf.berkeley.edu
solarflare.ocf.berkeley.edu
supernova.ocf.berkeley.edu
surge.ocf.berkeley.edu
thunder.ocf.berkeley.edu
tornado.ocf.berkeley.edu
tsunami.ocf.berkeley.edu
typhoon.ocf.berkeley.edu
vampires.ocf.berkeley.edu
venom.ocf.berkeley.edu
volcano.ocf.berkeley.edu
war.ocf.berkeley.edu
wildfire.ocf.berkeley.edu
windshear.ocf.berkeley.edu
worm.ocf.berkeley.edu

Jenkins

ocfjenkins · 2022-10-29T21:23:10Z

Errored hosts (1)

Changed hosts (1)

Unaffected hosts (77)

Errored hosts

error for newton.ocf.berkeley.edu

W, [2022-10-29T14:22:56.708855 #21384]  WARN -- : Puppet command failed: STDOUT:
STDERR:
  Warning: The function 'hiera_include' is deprecated in favor of using 'lookup'. See https://puppet.com/docs/puppet/7.20/deprecated_language.html
     (file & line not available)
  Warning: Unrecognized escape sequence '\/' (file: /tmp/ocd-ipc-20221029-21342-ca926x/ocd-builddir-20221029-21384-1lm0uod/environments/production/modules/ocf_desktop/manifests/packages.pp, line: 112, column: 75)
  Warning: Unrecognized escape sequence '\/' (file: /tmp/ocd-ipc-20221029-21342-ca926x/ocd-builddir-20221029-21384-1lm0uod/environments/production/modules/ocf_desktop/manifests/packages.pp, line: 112, column: 75)
  Warning: Unrecognized escape sequence '\/' (file: /tmp/ocd-ipc-20221029-21342-ca926x/ocd-builddir-20221029-21384-1lm0uod/environments/production/modules/ocf_desktop/manifests/packages.pp, line: 112, column: 75)
  Warning: Unrecognized escape sequence '\1' (file: /tmp/ocd-ipc-20221029-21342-ca926x/ocd-builddir-20221029-21384-1lm0uod/environments/production/modules/ocf_desktop/manifests/packages.pp, line: 112, column: 172)
  Warning: Unrecognized escape sequence '\2' (file: /tmp/ocd-ipc-20221029-21342-ca926x/ocd-builddir-20221029-21384-1lm0uod/environments/production/modules/ocf_desktop/manifests/packages.pp, line: 112, column: 172)
  Error: Evaluation Error: Error while evaluating a Function Call, 'new' The string 'bookworm/sid' cannot be converted to Integer (file: /tmp/ocd-ipc-20221029-21342-ca926x/ocd-builddir-20221029-21384-1lm0uod/environments/production/modules/ocf/manifests/packages/mysql_server.pp, line: 13, column: 8) on node newton.ocf.berkeley.edu
  Error: Evaluation Error: Error while evaluating a Function Call, 'new' The string 'bookworm/sid' cannot be converted to Integer (file: /tmp/ocd-ipc-20221029-21342-ca926x/ocd-builddir-20221029-21384-1lm0uod/environments/production/modules/ocf/manifests/packages/mysql_server.pp, line: 13, column: 8) on node newton.ocf.berkeley.edu
  Error: Could not call 'find' on 'catalog': Evaluation Error: Error while evaluating a Function Call, 'new' The string 'bookworm/sid' cannot be converted to Integer (file: /tmp/ocd-ipc-20221029-21342-ca926x/ocd-builddir-20221029-21384-1lm0uod/environments/production/modules/ocf/manifests/packages/mysql_server.pp, line: 13, column: 8) on node newton.ocf.berkeley.edu
  Error: Could not call 'find' on 'catalog': Evaluation Error: Error while evaluating a Function Call, 'new' The string 'bookworm/sid' cannot be converted to Integer (file: /tmp/ocd-ipc-20221029-21342-ca926x/ocd-builddir-20221029-21384-1lm0uod/environments/production/modules/ocf/manifests/packages/mysql_server.pp, line: 13, column: 8) on node newton.ocf.berkeley.edu
  Error: Try 'puppet help catalog compile' for usage
W, [2022-10-29T14:22:56.709243 #21384]  WARN -- : Failed build_catalog for origin/master validation: OctocatalogDiff::Errors::CatalogError Catalog failed: Warning: The function 'hiera_include' is deprecated in favor of using 'lookup'. See https://puppet.com/docs/puppet/7.20/deprecated_language.html
   (file & line not available)
Warning: Unrecognized escape sequence '\/' (file: /tmp/ocd-ipc-20221029-21342-ca926x/ocd-builddir-20221029-21384-1lm0uod/environments/production/modules/ocf_desktop/manifests/packages.pp, line: 112, column: 75)
Warning: Unrecognized escape sequence '\/' (file: /tmp/ocd-ipc-20221029-21342-ca926x/ocd-builddir-20221029-21384-1lm0uod/environments/production/modules/ocf_desktop/manifests/packages.pp, line: 112, column: 75)
Warning: Unrecognized escape sequence '\/' (file: /tmp/ocd-ipc-20221029-21342-ca926x/ocd-builddir-20221029-21384-1lm0uod/environments/production/modules/ocf_desktop/manifests/packages.pp, line: 112, column: 75)
Warning: Unrecognized escape sequence '\1' (file: /tmp/ocd-ipc-20221029-21342-ca926x/ocd-builddir-20221029-21384-1lm0uod/environments/production/modules/ocf_desktop/manifests/packages.pp, line: 112, column: 172)
Warning: Unrecognized escape sequence '\2' (file: /tmp/ocd-ipc-20221029-21342-ca926x/ocd-builddir-20221029-21384-1lm0uod/environments/production/modules/ocf_desktop/manifests/packages.pp, line: 112, column: 172)
Error: Evaluation Error: Error while evaluating a Function Call, 'new' The string 'bookworm/sid' cannot be converted to Integer (file: /tmp/ocd-ipc-20221029-21342-ca926x/ocd-builddir-20221029-21384-1lm0uod/environments/production/modules/ocf/manifests/packages/mysql_server.pp, line: 13, column: 8) on node newton.ocf.berkeley.edu
Error: Evaluation Error: Error while evaluating a Function Call, 'new' The string 'bookworm/sid' cannot be converted to Integer (file: /tmp/ocd-ipc-20221029-21342-ca926x/ocd-builddir-20221029-21384-1lm0uod/environments/production/modules/ocf/manifests/packages/mysql_server.pp, line: 13, column: 8) on node newton.ocf.berkeley.edu
Error: Could not call 'find' on 'catalog': Evaluation Error: Error while evaluating a Function Call, 'new' The string 'bookworm/sid' cannot be converted to Integer (file: /tmp/ocd-ipc-20221029-21342-ca926x/ocd-builddir-20221029-21384-1lm0uod/environments/production/modules/ocf/manifests/packages/mysql_server.pp, line: 13, column: 8) on node newton.ocf.berkeley.edu
Error: Could not call 'find' on 'catalog': Evaluation Error: Error while evaluating a Function Call, 'new' The string 'bookworm/sid' cannot be converted to Integer (file: /tmp/ocd-ipc-20221029-21342-ca926x/ocd-builddir-20221029-21384-1lm0uod/environments/production/modules/ocf/manifests/packages/mysql_server.pp, line: 13, column: 8) on node newton.ocf.berkeley.edu
Error: Try 'puppet help catalog compile' for usage

#<Thread:0x0000555ae6c4cd40@/usr/lib/ruby/2.5.0/open3.rb:264 run> terminated with exception (report_on_exception is true):
/usr/lib/ruby/2.5.0/open3.rb:264:in `read': stream closed in another thread (IOError)
	from /usr/lib/ruby/2.5.0/open3.rb:264:in `block (2 levels) in capture3'
#<Thread:0x0000555ae6c4cc00@/usr/lib/ruby/2.5.0/open3.rb:265 run> terminated with exception (report_on_exception is true):
/usr/lib/ruby/2.5.0/open3.rb:265:in `read': stream closed in another thread (IOError)
	from /usr/lib/ruby/2.5.0/open3.rb:265:in `block (2 levels) in capture3'
/usr/lib/ruby/vendor_ruby/octocatalog-diff/util/catalogs.rb:259:in `catalog_validator': Catalog failed: Warning: The function 'hiera_include' is deprecated in favor of using 'lookup'. See https://puppet.com/docs/puppet/7.20/deprecated_language.html (OctocatalogDiff::Errors::CatalogError)
   (file & line not available)
Warning: Unrecognized escape sequence '\/' (file: /tmp/ocd-ipc-20221029-21342-ca926x/ocd-builddir-20221029-21384-1lm0uod/environments/production/modules/ocf_desktop/manifests/packages.pp, line: 112, column: 75)
Warning: Unrecognized escape sequence '\/' (file: /tmp/ocd-ipc-20221029-21342-ca926x/ocd-builddir-20221029-21384-1lm0uod/environments/production/modules/ocf_desktop/manifests/packages.pp, line: 112, column: 75)
Warning: Unrecognized escape sequence '\/' (file: /tmp/ocd-ipc-20221029-21342-ca926x/ocd-builddir-20221029-21384-1lm0uod/environments/production/modules/ocf_desktop/manifests/packages.pp, line: 112, column: 75)
Warning: Unrecognized escape sequence '\1' (file: /tmp/ocd-ipc-20221029-21342-ca926x/ocd-builddir-20221029-21384-1lm0uod/environments/production/modules/ocf_desktop/manifests/packages.pp, line: 112, column: 172)
Warning: Unrecognized escape sequence '\2' (file: /tmp/ocd-ipc-20221029-21342-ca926x/ocd-builddir-20221029-21384-1lm0uod/environments/production/modules/ocf_desktop/manifests/packages.pp, line: 112, column: 172)
Error: Evaluation Error: Error while evaluating a Function Call, 'new' The string 'bookworm/sid' cannot be converted to Integer (file: /tmp/ocd-ipc-20221029-21342-ca926x/ocd-builddir-20221029-21384-1lm0uod/environments/production/modules/ocf/manifests/packages/mysql_server.pp, line: 13, column: 8) on node newton.ocf.berkeley.edu
Error: Evaluation Error: Error while evaluating a Function Call, 'new' The string 'bookworm/sid' cannot be converted to Integer (file: /tmp/ocd-ipc-20221029-21342-ca926x/ocd-builddir-20221029-21384-1lm0uod/environments/production/modules/ocf/manifests/packages/mysql_server.pp, line: 13, column: 8) on node newton.ocf.berkeley.edu
Error: Could not call 'find' on 'catalog': Evaluation Error: Error while evaluating a Function Call, 'new' The string 'bookworm/sid' cannot be converted to Integer (file: /tmp/ocd-ipc-20221029-21342-ca926x/ocd-builddir-20221029-21384-1lm0uod/environments/production/modules/ocf/manifests/packages/mysql_server.pp, line: 13, column: 8) on node newton.ocf.berkeley.edu
Error: Could not call 'find' on 'catalog': Evaluation Error: Error while evaluating a Function Call, 'new' The string 'bookworm/sid' cannot be converted to Integer (file: /tmp/ocd-ipc-20221029-21342-ca926x/ocd-builddir-20221029-21384-1lm0uod/environments/production/modules/ocf/manifests/packages/mysql_server.pp, line: 13, column: 8) on node newton.ocf.berkeley.edu
Error: Try 'puppet help catalog compile' for usage
	from /usr/lib/ruby/vendor_ruby/octocatalog-diff/util/parallel.rb:39:in `call'
	from /usr/lib/ruby/vendor_ruby/octocatalog-diff/util/parallel.rb:39:in `validate'
	from /usr/lib/ruby/vendor_ruby/octocatalog-diff/util/parallel.rb:202:in `execute_task'
	from /usr/lib/ruby/vendor_ruby/octocatalog-diff/util/parallel.rb:119:in `block (2 levels) in run_tasks_parallel'
	from /usr/lib/ruby/vendor_ruby/octocatalog-diff/util/parallel.rb:117:in `fork'
	from /usr/lib/ruby/vendor_ruby/octocatalog-diff/util/parallel.rb:117:in `block in run_tasks_parallel'
	from /usr/lib/ruby/vendor_ruby/octocatalog-diff/util/parallel.rb:114:in `each'
	from /usr/lib/ruby/vendor_ruby/octocatalog-diff/util/parallel.rb:114:in `each_with_index'
	from /usr/lib/ruby/vendor_ruby/octocatalog-diff/util/parallel.rb:114:in `run_tasks_parallel'
	from /usr/lib/ruby/vendor_ruby/octocatalog-diff/util/parallel.rb:94:in `run_tasks'
	from /usr/lib/ruby/vendor_ruby/octocatalog-diff/util/catalogs.rb:92:in `build_catalog_parallelizer'
	from /usr/lib/ruby/vendor_ruby/octocatalog-diff/util/catalogs.rb:29:in `catalogs'
	from /usr/lib/ruby/vendor_ruby/octocatalog-diff/api/v1/catalog-diff.rb:34:in `catalog_diff'
	from /usr/lib/ruby/vendor_ruby/octocatalog-diff/api/v1.rb:19:in `catalog_diff'
	from /usr/lib/ruby/vendor_ruby/octocatalog-diff/cli.rb:151:in `run_octocatalog_diff'
	from /usr/lib/ruby/vendor_ruby/octocatalog-diff/cli.rb:125:in `cli'
	from /usr/bin/octocatalog-diff:34:in `<main>'

Changed hosts

diff for hal.ocf.berkeley.edu

*******************************************
- Cron[check-rsnapshot-backups]
*******************************************
  Cron[rsnapshot-daily] =>
   parameters =>
     command =>
      - rsnapshot -c /opt/share/backups/rsnapshot.conf sync && rsnapshot -c /opt/share/backups/rsnapshot.conf daily
      + /usr/local/sbin/backup-zfs.sh
     hour =>
      - 2
      + 22
     minute =>
      - 0
      + 20
*******************************************
- Cron[rsnapshot-monthly]
*******************************************
- Cron[rsnapshot-weekly]
*******************************************
  File[/opt/share/backups/backup-mysql] =>
   parameters =>
     content =>
      @@ -19,3 +19,3 @@
                    --routines \
                    --single-transaction \
      -             --databases {} | pigz > "mysql-{}-$(date +%F).sql.gz"' -- $databases
      +             --databases {} > "mysql-{}-$(date +%F).sql"' -- $databases
*******************************************
  File[/opt/share/backups/backup-pgsql] =>
   parameters =>
     content =>
      @@ -4,3 +4,3 @@
       # Dumps the entire PostgreSQL instance to one .sql file.
       # Requires that a valid ~/.pgpass file be available on the PostgreSQL host
      -ssh -K ocfbackups@postgres 'pg_dumpall -U postgres -h localhost | pigz' > "pgsql-all-$(date +%F).sql.gz"
      +ssh -K ocfbackups@postgres 'pg_dumpall -U postgres -h localhost' > "pgsql-all-$(date +%F).sql"
*******************************************
+ File[/opt/share/backups/offsite-host] =>
   parameters =>
     "backup": "main",
     "content": "dummyhost",
     "group": "root",
     "mode": "0400",
     "owner": "root"
*******************************************
+ File[/opt/share/backups/rsnapshot-zfs-git.conf] =>
   parameters =>
     "backup": "main",
     "content": "#################################################\n# rsnapshot.c...
     "group": "root",
     "mode": "0644",
     "owner": "root"
*******************************************
+ File[/opt/share/backups/rsnapshot-zfs-mysql.conf] =>
   parameters =>
     "backup": "main",
     "content": "#################################################\n# rsnapshot.c...
     "group": "root",
     "mode": "0644",
     "owner": "root"
*******************************************
+ File[/opt/share/backups/rsnapshot-zfs-pgsql.conf] =>
   parameters =>
     "backup": "main",
     "content": "#################################################\n# rsnapshot.c...
     "group": "root",
     "mode": "0644",
     "owner": "root"
*******************************************
+ File[/opt/share/backups/rsnapshot-zfs.conf] =>
   parameters =>
     "backup": "main",
     "content": "#################################################\n# rsnapshot.c...
     "group": "root",
     "mode": "0644",
     "owner": "root"
*******************************************
+ File[/usr/local/sbin/backup-zfs.sh] =>
   parameters =>
     "backup": "main",
     "content": "#!/bin/bash\n\nCURRENT_SNAPSHOT_FILE=/opt/share/backups/current-...
     "group": "root",
     "mode": "0755",
     "owner": "root"
*******************************************

Unaffected hosts

acid.ocf.berkeley.edu
afterhours.ocf.berkeley.edu
anthrax.ocf.berkeley.edu
arsenic.ocf.berkeley.edu
asteroid.ocf.berkeley.edu
autocrat.ocf.berkeley.edu
avalanche.ocf.berkeley.edu
bedbugs.ocf.berkeley.edu
bigbang.ocf.berkeley.edu
bigrip.ocf.berkeley.edu
biohazard.ocf.berkeley.edu
blackout.ocf.berkeley.edu
blight.ocf.berkeley.edu
blizzard.ocf.berkeley.edu
chaos.ocf.berkeley.edu
corruption.ocf.berkeley.edu
coup.ocf.berkeley.edu
cyanide.ocf.berkeley.edu
cyclone.ocf.berkeley.edu
dataloss.ocf.berkeley.edu
deadlock.ocf.berkeley.edu
death.ocf.berkeley.edu
dementors.ocf.berkeley.edu
democracy.ocf.berkeley.edu
destruction.ocf.berkeley.edu
drought.ocf.berkeley.edu
eruption.ocf.berkeley.edu
fallingrocks.ocf.berkeley.edu
falsevacuum.ocf.berkeley.edu
famine.ocf.berkeley.edu
fire.ocf.berkeley.edu
firestorm.ocf.berkeley.edu
firewhirl.ocf.berkeley.edu
flood.ocf.berkeley.edu
fraud.ocf.berkeley.edu
fukushima.ocf.berkeley.edu
gridlock.ocf.berkeley.edu
hailstorm.ocf.berkeley.edu
headcrash.ocf.berkeley.edu
heatwave.ocf.berkeley.edu
hellfire.ocf.berkeley.edu
hozer-74.ocf.berkeley.edu
hurricane.ocf.berkeley.edu
invasion.ocf.berkeley.edu
jaws.ocf.berkeley.edu
lethe.ocf.berkeley.edu
lightning.ocf.berkeley.edu
lockdown.ocf.berkeley.edu
madcow.ocf.berkeley.edu
maelstrom.ocf.berkeley.edu
meteorstorm.ocf.berkeley.edu
nuke.ocf.berkeley.edu
outbreak.ocf.berkeley.edu
pestilence.ocf.berkeley.edu
plague.ocf.berkeley.edu
pox.ocf.berkeley.edu
quarantine.ocf.berkeley.edu
reaper.ocf.berkeley.edu
riptide.ocf.berkeley.edu
scurvy.ocf.berkeley.edu
segfault.ocf.berkeley.edu
shipwreck.ocf.berkeley.edu
sinkhole.ocf.berkeley.edu
solarflare.ocf.berkeley.edu
supernova.ocf.berkeley.edu
surge.ocf.berkeley.edu
thunder.ocf.berkeley.edu
tornado.ocf.berkeley.edu
tsunami.ocf.berkeley.edu
typhoon.ocf.berkeley.edu
vampires.ocf.berkeley.edu
venom.ocf.berkeley.edu
volcano.ocf.berkeley.edu
war.ocf.berkeley.edu
wildfire.ocf.berkeley.edu
windshear.ocf.berkeley.edu
worm.ocf.berkeley.edu

Jenkins

ocfjenkins · 2022-11-06T03:12:01Z

Errored hosts (2)

Changed hosts (1)

Unaffected hosts (79)

Errored hosts

error for jaws.ocf.berkeley.edu

E, [2022-11-05T20:11:24.571780 #24476] ERROR -- : ENC failed - Status 1
#<Thread:0x000055a8219db498@/usr/lib/ruby/2.5.0/open3.rb:264 run> terminated with exception (report_on_exception is true):
/usr/lib/ruby/2.5.0/open3.rb:264:in `read': stream closed in another thread (IOError)
	from /usr/lib/ruby/2.5.0/open3.rb:264:in `block (2 levels) in capture3'
#<Thread:0x000055a8219db358@/usr/lib/ruby/2.5.0/open3.rb:265 run> terminated with exception (report_on_exception is true):
/usr/lib/ruby/2.5.0/open3.rb:265:in `read': stream closed in another thread (IOError)
	from /usr/lib/ruby/2.5.0/open3.rb:265:in `block (2 levels) in capture3'
/usr/lib/ruby/2.5.0/psych.rb:402:in `parse': no implicit conversion of nil into String (TypeError)
	from /usr/lib/ruby/2.5.0/psych.rb:402:in `parse_stream'
	from /usr/lib/ruby/2.5.0/psych.rb:350:in `parse'
	from /usr/lib/ruby/2.5.0/psych.rb:263:in `load'
	from /usr/lib/ruby/vendor_ruby/octocatalog-diff/catalog-util/enc.rb:66:in `override_enc_parameters'
	from /usr/lib/ruby/vendor_ruby/octocatalog-diff/catalog-util/enc.rb:56:in `execute'
	from /usr/lib/ruby/vendor_ruby/octocatalog-diff/catalog-util/builddir.rb:204:in `install_enc'
	from /usr/lib/ruby/vendor_ruby/octocatalog-diff/catalog-util/builddir.rb:60:in `initialize'
	from /usr/lib/ruby/vendor_ruby/octocatalog-diff/catalog/computed.rb:100:in `new'
	from /usr/lib/ruby/vendor_ruby/octocatalog-diff/catalog/computed.rb:100:in `bootstrap'
	from /usr/lib/ruby/vendor_ruby/octocatalog-diff/catalog/computed.rb:113:in `build_catalog'
	from /usr/lib/ruby/vendor_ruby/octocatalog-diff/catalog.rb:96:in `build'
	from /usr/lib/ruby/vendor_ruby/octocatalog-diff/util/catalogs.rb:241:in `build_catalog'
	from /usr/lib/ruby/vendor_ruby/octocatalog-diff/util/parallel.rb:34:in `call'
	from /usr/lib/ruby/vendor_ruby/octocatalog-diff/util/parallel.rb:34:in `execute'
	from /usr/lib/ruby/vendor_ruby/octocatalog-diff/util/parallel.rb:193:in `execute_task'
	from /usr/lib/ruby/vendor_ruby/octocatalog-diff/util/parallel.rb:119:in `block (2 levels) in run_tasks_parallel'
	from /usr/lib/ruby/vendor_ruby/octocatalog-diff/util/parallel.rb:117:in `fork'
	from /usr/lib/ruby/vendor_ruby/octocatalog-diff/util/parallel.rb:117:in `block in run_tasks_parallel'
	from /usr/lib/ruby/vendor_ruby/octocatalog-diff/util/parallel.rb:114:in `each'
	from /usr/lib/ruby/vendor_ruby/octocatalog-diff/util/parallel.rb:114:in `each_with_index'
	from /usr/lib/ruby/vendor_ruby/octocatalog-diff/util/parallel.rb:114:in `run_tasks_parallel'
	from /usr/lib/ruby/vendor_ruby/octocatalog-diff/util/parallel.rb:94:in `run_tasks'
	from /usr/lib/ruby/vendor_ruby/octocatalog-diff/util/catalogs.rb:92:in `build_catalog_parallelizer'
	from /usr/lib/ruby/vendor_ruby/octocatalog-diff/util/catalogs.rb:29:in `catalogs'
	from /usr/lib/ruby/vendor_ruby/octocatalog-diff/api/v1/catalog-diff.rb:34:in `catalog_diff'
	from /usr/lib/ruby/vendor_ruby/octocatalog-diff/api/v1.rb:19:in `catalog_diff'
	from /usr/lib/ruby/vendor_ruby/octocatalog-diff/cli.rb:151:in `run_octocatalog_diff'
	from /usr/lib/ruby/vendor_ruby/octocatalog-diff/cli.rb:125:in `cli'
	from /usr/bin/octocatalog-diff:34:in `<main>'

error for newton.ocf.berkeley.edu

W, [2022-11-05T20:11:40.661826 #26034]  WARN -- : Puppet command failed: STDOUT:
STDERR:
  Warning: The function 'hiera_include' is deprecated in favor of using 'lookup'. See https://puppet.com/docs/puppet/7.20/deprecated_language.html
     (file & line not available)
  Warning: Unrecognized escape sequence '\/' (file: /tmp/ocd-ipc-20221105-25997-fcsp8e/ocd-builddir-20221105-26034-1p5evx3/environments/production/modules/ocf_desktop/manifests/packages.pp, line: 112, column: 75)
  Warning: Unrecognized escape sequence '\/' (file: /tmp/ocd-ipc-20221105-25997-fcsp8e/ocd-builddir-20221105-26034-1p5evx3/environments/production/modules/ocf_desktop/manifests/packages.pp, line: 112, column: 75)
  Warning: Unrecognized escape sequence '\/' (file: /tmp/ocd-ipc-20221105-25997-fcsp8e/ocd-builddir-20221105-26034-1p5evx3/environments/production/modules/ocf_desktop/manifests/packages.pp, line: 112, column: 75)
  Warning: Unrecognized escape sequence '\1' (file: /tmp/ocd-ipc-20221105-25997-fcsp8e/ocd-builddir-20221105-26034-1p5evx3/environments/production/modules/ocf_desktop/manifests/packages.pp, line: 112, column: 172)
  Warning: Unrecognized escape sequence '\2' (file: /tmp/ocd-ipc-20221105-25997-fcsp8e/ocd-builddir-20221105-26034-1p5evx3/environments/production/modules/ocf_desktop/manifests/packages.pp, line: 112, column: 172)
  Error: Evaluation Error: Error while evaluating a Function Call, 'new' The string 'bookworm/sid' cannot be converted to Integer (file: /tmp/ocd-ipc-20221105-25997-fcsp8e/ocd-builddir-20221105-26034-1p5evx3/environments/production/modules/ocf/manifests/packages/mysql_server.pp, line: 13, column: 8) on node newton.ocf.berkeley.edu
  Error: Evaluation Error: Error while evaluating a Function Call, 'new' The string 'bookworm/sid' cannot be converted to Integer (file: /tmp/ocd-ipc-20221105-25997-fcsp8e/ocd-builddir-20221105-26034-1p5evx3/environments/production/modules/ocf/manifests/packages/mysql_server.pp, line: 13, column: 8) on node newton.ocf.berkeley.edu
  Error: Could not call 'find' on 'catalog': Evaluation Error: Error while evaluating a Function Call, 'new' The string 'bookworm/sid' cannot be converted to Integer (file: /tmp/ocd-ipc-20221105-25997-fcsp8e/ocd-builddir-20221105-26034-1p5evx3/environments/production/modules/ocf/manifests/packages/mysql_server.pp, line: 13, column: 8) on node newton.ocf.berkeley.edu
  Error: Could not call 'find' on 'catalog': Evaluation Error: Error while evaluating a Function Call, 'new' The string 'bookworm/sid' cannot be converted to Integer (file: /tmp/ocd-ipc-20221105-25997-fcsp8e/ocd-builddir-20221105-26034-1p5evx3/environments/production/modules/ocf/manifests/packages/mysql_server.pp, line: 13, column: 8) on node newton.ocf.berkeley.edu
  Error: Try 'puppet help catalog compile' for usage
W, [2022-11-05T20:11:40.662339 #26034]  WARN -- : Failed build_catalog for origin/master validation: OctocatalogDiff::Errors::CatalogError Catalog failed: Warning: The function 'hiera_include' is deprecated in favor of using 'lookup'. See https://puppet.com/docs/puppet/7.20/deprecated_language.html
   (file & line not available)
Warning: Unrecognized escape sequence '\/' (file: /tmp/ocd-ipc-20221105-25997-fcsp8e/ocd-builddir-20221105-26034-1p5evx3/environments/production/modules/ocf_desktop/manifests/packages.pp, line: 112, column: 75)
Warning: Unrecognized escape sequence '\/' (file: /tmp/ocd-ipc-20221105-25997-fcsp8e/ocd-builddir-20221105-26034-1p5evx3/environments/production/modules/ocf_desktop/manifests/packages.pp, line: 112, column: 75)
Warning: Unrecognized escape sequence '\/' (file: /tmp/ocd-ipc-20221105-25997-fcsp8e/ocd-builddir-20221105-26034-1p5evx3/environments/production/modules/ocf_desktop/manifests/packages.pp, line: 112, column: 75)
Warning: Unrecognized escape sequence '\1' (file: /tmp/ocd-ipc-20221105-25997-fcsp8e/ocd-builddir-20221105-26034-1p5evx3/environments/production/modules/ocf_desktop/manifests/packages.pp, line: 112, column: 172)
Warning: Unrecognized escape sequence '\2' (file: /tmp/ocd-ipc-20221105-25997-fcsp8e/ocd-builddir-20221105-26034-1p5evx3/environments/production/modules/ocf_desktop/manifests/packages.pp, line: 112, column: 172)
Error: Evaluation Error: Error while evaluating a Function Call, 'new' The string 'bookworm/sid' cannot be converted to Integer (file: /tmp/ocd-ipc-20221105-25997-fcsp8e/ocd-builddir-20221105-26034-1p5evx3/environments/production/modules/ocf/manifests/packages/mysql_server.pp, line: 13, column: 8) on node newton.ocf.berkeley.edu
Error: Evaluation Error: Error while evaluating a Function Call, 'new' The string 'bookworm/sid' cannot be converted to Integer (file: /tmp/ocd-ipc-20221105-25997-fcsp8e/ocd-builddir-20221105-26034-1p5evx3/environments/production/modules/ocf/manifests/packages/mysql_server.pp, line: 13, column: 8) on node newton.ocf.berkeley.edu
Error: Could not call 'find' on 'catalog': Evaluation Error: Error while evaluating a Function Call, 'new' The string 'bookworm/sid' cannot be converted to Integer (file: /tmp/ocd-ipc-20221105-25997-fcsp8e/ocd-builddir-20221105-26034-1p5evx3/environments/production/modules/ocf/manifests/packages/mysql_server.pp, line: 13, column: 8) on node newton.ocf.berkeley.edu
Error: Could not call 'find' on 'catalog': Evaluation Error: Error while evaluating a Function Call, 'new' The string 'bookworm/sid' cannot be converted to Integer (file: /tmp/ocd-ipc-20221105-25997-fcsp8e/ocd-builddir-20221105-26034-1p5evx3/environments/production/modules/ocf/manifests/packages/mysql_server.pp, line: 13, column: 8) on node newton.ocf.berkeley.edu
Error: Try 'puppet help catalog compile' for usage

#<Thread:0x000055e631bcd190@/usr/lib/ruby/2.5.0/open3.rb:264 run> terminated with exception (report_on_exception is true):
/usr/lib/ruby/2.5.0/open3.rb:264:in `read': stream closed in another thread (IOError)
	from /usr/lib/ruby/2.5.0/open3.rb:264:in `block (2 levels) in capture3'
#<Thread:0x000055e631bcd050@/usr/lib/ruby/2.5.0/open3.rb:265 run> terminated with exception (report_on_exception is true):
/usr/lib/ruby/2.5.0/open3.rb:265:in `read': stream closed in another thread (IOError)
	from /usr/lib/ruby/2.5.0/open3.rb:265:in `block (2 levels) in capture3'
/usr/lib/ruby/vendor_ruby/octocatalog-diff/util/catalogs.rb:259:in `catalog_validator': Catalog failed: Warning: The function 'hiera_include' is deprecated in favor of using 'lookup'. See https://puppet.com/docs/puppet/7.20/deprecated_language.html (OctocatalogDiff::Errors::CatalogError)
   (file & line not available)
Warning: Unrecognized escape sequence '\/' (file: /tmp/ocd-ipc-20221105-25997-fcsp8e/ocd-builddir-20221105-26034-1p5evx3/environments/production/modules/ocf_desktop/manifests/packages.pp, line: 112, column: 75)
Warning: Unrecognized escape sequence '\/' (file: /tmp/ocd-ipc-20221105-25997-fcsp8e/ocd-builddir-20221105-26034-1p5evx3/environments/production/modules/ocf_desktop/manifests/packages.pp, line: 112, column: 75)
Warning: Unrecognized escape sequence '\/' (file: /tmp/ocd-ipc-20221105-25997-fcsp8e/ocd-builddir-20221105-26034-1p5evx3/environments/production/modules/ocf_desktop/manifests/packages.pp, line: 112, column: 75)
Warning: Unrecognized escape sequence '\1' (file: /tmp/ocd-ipc-20221105-25997-fcsp8e/ocd-builddir-20221105-26034-1p5evx3/environments/production/modules/ocf_desktop/manifests/packages.pp, line: 112, column: 172)
Warning: Unrecognized escape sequence '\2' (file: /tmp/ocd-ipc-20221105-25997-fcsp8e/ocd-builddir-20221105-26034-1p5evx3/environments/production/modules/ocf_desktop/manifests/packages.pp, line: 112, column: 172)
Error: Evaluation Error: Error while evaluating a Function Call, 'new' The string 'bookworm/sid' cannot be converted to Integer (file: /tmp/ocd-ipc-20221105-25997-fcsp8e/ocd-builddir-20221105-26034-1p5evx3/environments/production/modules/ocf/manifests/packages/mysql_server.pp, line: 13, column: 8) on node newton.ocf.berkeley.edu
Error: Evaluation Error: Error while evaluating a Function Call, 'new' The string 'bookworm/sid' cannot be converted to Integer (file: /tmp/ocd-ipc-20221105-25997-fcsp8e/ocd-builddir-20221105-26034-1p5evx3/environments/production/modules/ocf/manifests/packages/mysql_server.pp, line: 13, column: 8) on node newton.ocf.berkeley.edu
Error: Could not call 'find' on 'catalog': Evaluation Error: Error while evaluating a Function Call, 'new' The string 'bookworm/sid' cannot be converted to Integer (file: /tmp/ocd-ipc-20221105-25997-fcsp8e/ocd-builddir-20221105-26034-1p5evx3/environments/production/modules/ocf/manifests/packages/mysql_server.pp, line: 13, column: 8) on node newton.ocf.berkeley.edu
Error: Could not call 'find' on 'catalog': Evaluation Error: Error while evaluating a Function Call, 'new' The string 'bookworm/sid' cannot be converted to Integer (file: /tmp/ocd-ipc-20221105-25997-fcsp8e/ocd-builddir-20221105-26034-1p5evx3/environments/production/modules/ocf/manifests/packages/mysql_server.pp, line: 13, column: 8) on node newton.ocf.berkeley.edu
Error: Try 'puppet help catalog compile' for usage
	from /usr/lib/ruby/vendor_ruby/octocatalog-diff/util/parallel.rb:39:in `call'
	from /usr/lib/ruby/vendor_ruby/octocatalog-diff/util/parallel.rb:39:in `validate'
	from /usr/lib/ruby/vendor_ruby/octocatalog-diff/util/parallel.rb:202:in `execute_task'
	from /usr/lib/ruby/vendor_ruby/octocatalog-diff/util/parallel.rb:119:in `block (2 levels) in run_tasks_parallel'
	from /usr/lib/ruby/vendor_ruby/octocatalog-diff/util/parallel.rb:117:in `fork'
	from /usr/lib/ruby/vendor_ruby/octocatalog-diff/util/parallel.rb:117:in `block in run_tasks_parallel'
	from /usr/lib/ruby/vendor_ruby/octocatalog-diff/util/parallel.rb:114:in `each'
	from /usr/lib/ruby/vendor_ruby/octocatalog-diff/util/parallel.rb:114:in `each_with_index'
	from /usr/lib/ruby/vendor_ruby/octocatalog-diff/util/parallel.rb:114:in `run_tasks_parallel'
	from /usr/lib/ruby/vendor_ruby/octocatalog-diff/util/parallel.rb:94:in `run_tasks'
	from /usr/lib/ruby/vendor_ruby/octocatalog-diff/util/catalogs.rb:92:in `build_catalog_parallelizer'
	from /usr/lib/ruby/vendor_ruby/octocatalog-diff/util/catalogs.rb:29:in `catalogs'
	from /usr/lib/ruby/vendor_ruby/octocatalog-diff/api/v1/catalog-diff.rb:34:in `catalog_diff'
	from /usr/lib/ruby/vendor_ruby/octocatalog-diff/api/v1.rb:19:in `catalog_diff'
	from /usr/lib/ruby/vendor_ruby/octocatalog-diff/cli.rb:151:in `run_octocatalog_diff'
	from /usr/lib/ruby/vendor_ruby/octocatalog-diff/cli.rb:125:in `cli'
	from /usr/bin/octocatalog-diff:34:in `<main>'

Changed hosts

diff for hal.ocf.berkeley.edu

*******************************************
- Cron[check-rsnapshot-backups]
*******************************************
  Cron[rsnapshot-daily] =>
   parameters =>
     command =>
      - rsnapshot -c /opt/share/backups/rsnapshot.conf sync && rsnapshot -c /opt/share/backups/rsnapshot.conf daily
      + /usr/local/sbin/backup-zfs.sh
     hour =>
      - 2
      + 22
     minute =>
      - 0
      + 20
*******************************************
- Cron[rsnapshot-monthly]
*******************************************
- Cron[rsnapshot-weekly]
*******************************************
  File[/opt/share/backups/backup-mysql] =>
   parameters =>
     content =>
      @@ -19,3 +19,3 @@
                    --routines \
                    --single-transaction \
      -             --databases {} | pigz > "mysql-{}-$(date +%F).sql.gz"' -- $databases
      +             --databases {} > "mysql-{}-$(date +%F).sql"' -- $databases
*******************************************
  File[/opt/share/backups/backup-pgsql] =>
   parameters =>
     content =>
      @@ -4,3 +4,3 @@
       # Dumps the entire PostgreSQL instance to one .sql file.
       # Requires that a valid ~/.pgpass file be available on the PostgreSQL host
      -ssh -K ocfbackups@postgres 'pg_dumpall -U postgres -h localhost | pigz' > "pgsql-all-$(date +%F).sql.gz"
      +ssh -K ocfbackups@postgres 'pg_dumpall -U postgres -h localhost' > "pgsql-all-$(date +%F).sql"
*******************************************
+ File[/opt/share/backups/offsite-host] =>
   parameters =>
     "backup": "main",
     "content": "dummyhost",
     "group": "root",
     "mode": "0400",
     "owner": "root"
*******************************************
+ File[/opt/share/backups/rsnapshot-zfs-git.conf] =>
   parameters =>
     "backup": "main",
     "content": "#################################################\n# rsnapshot.c...
     "group": "root",
     "mode": "0644",
     "owner": "root"
*******************************************
+ File[/opt/share/backups/rsnapshot-zfs-mysql.conf] =>
   parameters =>
     "backup": "main",
     "content": "#################################################\n# rsnapshot.c...
     "group": "root",
     "mode": "0644",
     "owner": "root"
*******************************************
+ File[/opt/share/backups/rsnapshot-zfs-pgsql.conf] =>
   parameters =>
     "backup": "main",
     "content": "#################################################\n# rsnapshot.c...
     "group": "root",
     "mode": "0644",
     "owner": "root"
*******************************************
+ File[/opt/share/backups/rsnapshot-zfs.conf] =>
   parameters =>
     "backup": "main",
     "content": "#################################################\n# rsnapshot.c...
     "group": "root",
     "mode": "0644",
     "owner": "root"
*******************************************
+ File[/usr/local/sbin/backup-zfs.sh] =>
   parameters =>
     "backup": "main",
     "content": "#!/bin/bash\n\nCURRENT_SNAPSHOT_FILE=/opt/share/backups/current-...
     "group": "root",
     "mode": "0755",
     "owner": "root"
*******************************************

Unaffected hosts

acid.ocf.berkeley.edu
afterhours.ocf.berkeley.edu
anthrax.ocf.berkeley.edu
arsenic.ocf.berkeley.edu
asteroid.ocf.berkeley.edu
autocrat.ocf.berkeley.edu
avalanche.ocf.berkeley.edu
bedbugs.ocf.berkeley.edu
bigbang.ocf.berkeley.edu
bigrip.ocf.berkeley.edu
biohazard.ocf.berkeley.edu
blackout.ocf.berkeley.edu
blight.ocf.berkeley.edu
blizzard.ocf.berkeley.edu
chaos.ocf.berkeley.edu
corruption.ocf.berkeley.edu
coup.ocf.berkeley.edu
cyanide.ocf.berkeley.edu
cyclone.ocf.berkeley.edu
dataloss.ocf.berkeley.edu
deadlock.ocf.berkeley.edu
death.ocf.berkeley.edu
dementors.ocf.berkeley.edu
democracy.ocf.berkeley.edu
destruction.ocf.berkeley.edu
drought.ocf.berkeley.edu
eruption.ocf.berkeley.edu
failure.ocf.berkeley.edu
fallingrocks.ocf.berkeley.edu
falsevacuum.ocf.berkeley.edu
famine.ocf.berkeley.edu
fire.ocf.berkeley.edu
firestorm.ocf.berkeley.edu
firewhirl.ocf.berkeley.edu
flood.ocf.berkeley.edu
fraud.ocf.berkeley.edu
fukushima.ocf.berkeley.edu
gridlock.ocf.berkeley.edu
hailstorm.ocf.berkeley.edu
headcrash.ocf.berkeley.edu
heatwave.ocf.berkeley.edu
hellfire.ocf.berkeley.edu
hozer-74.ocf.berkeley.edu
hurricane.ocf.berkeley.edu
invasion.ocf.berkeley.edu
lethe.ocf.berkeley.edu
lightning.ocf.berkeley.edu
lockdown.ocf.berkeley.edu
madcow.ocf.berkeley.edu
maelstrom.ocf.berkeley.edu
meteorstorm.ocf.berkeley.edu
nuke.ocf.berkeley.edu
outbreak.ocf.berkeley.edu
pestilence.ocf.berkeley.edu
plague.ocf.berkeley.edu
pox.ocf.berkeley.edu
quarantine.ocf.berkeley.edu
radiation-mgmt.ocf.berkeley.edu
reaper.ocf.berkeley.edu
riptide.ocf.berkeley.edu
scurvy.ocf.berkeley.edu
segfault.ocf.berkeley.edu
shipwreck.ocf.berkeley.edu
singularity.ocf.berkeley.edu
sinkhole.ocf.berkeley.edu
solarflare.ocf.berkeley.edu
supernova.ocf.berkeley.edu
surge.ocf.berkeley.edu
thunder.ocf.berkeley.edu
tornado.ocf.berkeley.edu
tsunami.ocf.berkeley.edu
typhoon.ocf.berkeley.edu
vampires.ocf.berkeley.edu
venom.ocf.berkeley.edu
volcano.ocf.berkeley.edu
war.ocf.berkeley.edu
wildfire.ocf.berkeley.edu
windshear.ocf.berkeley.edu
worm.ocf.berkeley.edu

Jenkins

ocfjenkins · 2022-11-06T04:33:35Z

Errored hosts (2)

Changed hosts (1)

Unaffected hosts (79)

Errored hosts

error for jaws.ocf.berkeley.edu

E, [2022-11-05T21:32:58.642396 #8827] ERROR -- : ENC failed - Status 1
#<Thread:0x000056109465b468@/usr/lib/ruby/2.5.0/open3.rb:264 run> terminated with exception (report_on_exception is true):
/usr/lib/ruby/2.5.0/open3.rb:264:in `read': stream closed in another thread (IOError)
	from /usr/lib/ruby/2.5.0/open3.rb:264:in `block (2 levels) in capture3'
#<Thread:0x000056109465b328@/usr/lib/ruby/2.5.0/open3.rb:265 run> terminated with exception (report_on_exception is true):
/usr/lib/ruby/2.5.0/open3.rb:265:in `read': stream closed in another thread (IOError)
	from /usr/lib/ruby/2.5.0/open3.rb:265:in `block (2 levels) in capture3'
/usr/lib/ruby/2.5.0/psych.rb:402:in `parse': no implicit conversion of nil into String (TypeError)
	from /usr/lib/ruby/2.5.0/psych.rb:402:in `parse_stream'
	from /usr/lib/ruby/2.5.0/psych.rb:350:in `parse'
	from /usr/lib/ruby/2.5.0/psych.rb:263:in `load'
	from /usr/lib/ruby/vendor_ruby/octocatalog-diff/catalog-util/enc.rb:66:in `override_enc_parameters'
	from /usr/lib/ruby/vendor_ruby/octocatalog-diff/catalog-util/enc.rb:56:in `execute'
	from /usr/lib/ruby/vendor_ruby/octocatalog-diff/catalog-util/builddir.rb:204:in `install_enc'
	from /usr/lib/ruby/vendor_ruby/octocatalog-diff/catalog-util/builddir.rb:60:in `initialize'
	from /usr/lib/ruby/vendor_ruby/octocatalog-diff/catalog/computed.rb:100:in `new'
	from /usr/lib/ruby/vendor_ruby/octocatalog-diff/catalog/computed.rb:100:in `bootstrap'
	from /usr/lib/ruby/vendor_ruby/octocatalog-diff/catalog/computed.rb:113:in `build_catalog'
	from /usr/lib/ruby/vendor_ruby/octocatalog-diff/catalog.rb:96:in `build'
	from /usr/lib/ruby/vendor_ruby/octocatalog-diff/util/catalogs.rb:241:in `build_catalog'
	from /usr/lib/ruby/vendor_ruby/octocatalog-diff/util/parallel.rb:34:in `call'
	from /usr/lib/ruby/vendor_ruby/octocatalog-diff/util/parallel.rb:34:in `execute'
	from /usr/lib/ruby/vendor_ruby/octocatalog-diff/util/parallel.rb:193:in `execute_task'
	from /usr/lib/ruby/vendor_ruby/octocatalog-diff/util/parallel.rb:119:in `block (2 levels) in run_tasks_parallel'
	from /usr/lib/ruby/vendor_ruby/octocatalog-diff/util/parallel.rb:117:in `fork'
	from /usr/lib/ruby/vendor_ruby/octocatalog-diff/util/parallel.rb:117:in `block in run_tasks_parallel'
	from /usr/lib/ruby/vendor_ruby/octocatalog-diff/util/parallel.rb:114:in `each'
	from /usr/lib/ruby/vendor_ruby/octocatalog-diff/util/parallel.rb:114:in `each_with_index'
	from /usr/lib/ruby/vendor_ruby/octocatalog-diff/util/parallel.rb:114:in `run_tasks_parallel'
	from /usr/lib/ruby/vendor_ruby/octocatalog-diff/util/parallel.rb:94:in `run_tasks'
	from /usr/lib/ruby/vendor_ruby/octocatalog-diff/util/catalogs.rb:92:in `build_catalog_parallelizer'
	from /usr/lib/ruby/vendor_ruby/octocatalog-diff/util/catalogs.rb:29:in `catalogs'
	from /usr/lib/ruby/vendor_ruby/octocatalog-diff/api/v1/catalog-diff.rb:34:in `catalog_diff'
	from /usr/lib/ruby/vendor_ruby/octocatalog-diff/api/v1.rb:19:in `catalog_diff'
	from /usr/lib/ruby/vendor_ruby/octocatalog-diff/cli.rb:151:in `run_octocatalog_diff'
	from /usr/lib/ruby/vendor_ruby/octocatalog-diff/cli.rb:125:in `cli'
	from /usr/bin/octocatalog-diff:34:in `<main>'

error for newton.ocf.berkeley.edu

W, [2022-11-05T21:33:17.549341 #10592]  WARN -- : Puppet command failed: STDOUT:
STDERR:
  Warning: The function 'hiera_include' is deprecated in favor of using 'lookup'. See https://puppet.com/docs/puppet/7.20/deprecated_language.html
     (file & line not available)
  Warning: Unrecognized escape sequence '\/' (file: /tmp/ocd-ipc-20221105-10547-jjya4a/ocd-builddir-20221105-10592-4jom4o/environments/production/modules/ocf_desktop/manifests/packages.pp, line: 112, column: 75)
  Warning: Unrecognized escape sequence '\/' (file: /tmp/ocd-ipc-20221105-10547-jjya4a/ocd-builddir-20221105-10592-4jom4o/environments/production/modules/ocf_desktop/manifests/packages.pp, line: 112, column: 75)
  Warning: Unrecognized escape sequence '\/' (file: /tmp/ocd-ipc-20221105-10547-jjya4a/ocd-builddir-20221105-10592-4jom4o/environments/production/modules/ocf_desktop/manifests/packages.pp, line: 112, column: 75)
  Warning: Unrecognized escape sequence '\1' (file: /tmp/ocd-ipc-20221105-10547-jjya4a/ocd-builddir-20221105-10592-4jom4o/environments/production/modules/ocf_desktop/manifests/packages.pp, line: 112, column: 172)
  Warning: Unrecognized escape sequence '\2' (file: /tmp/ocd-ipc-20221105-10547-jjya4a/ocd-builddir-20221105-10592-4jom4o/environments/production/modules/ocf_desktop/manifests/packages.pp, line: 112, column: 172)
  Error: Evaluation Error: Error while evaluating a Function Call, 'new' The string 'bookworm/sid' cannot be converted to Integer (file: /tmp/ocd-ipc-20221105-10547-jjya4a/ocd-builddir-20221105-10592-4jom4o/environments/production/modules/ocf/manifests/packages/mysql_server.pp, line: 13, column: 8) on node newton.ocf.berkeley.edu
  Error: Evaluation Error: Error while evaluating a Function Call, 'new' The string 'bookworm/sid' cannot be converted to Integer (file: /tmp/ocd-ipc-20221105-10547-jjya4a/ocd-builddir-20221105-10592-4jom4o/environments/production/modules/ocf/manifests/packages/mysql_server.pp, line: 13, column: 8) on node newton.ocf.berkeley.edu
  Error: Could not call 'find' on 'catalog': Evaluation Error: Error while evaluating a Function Call, 'new' The string 'bookworm/sid' cannot be converted to Integer (file: /tmp/ocd-ipc-20221105-10547-jjya4a/ocd-builddir-20221105-10592-4jom4o/environments/production/modules/ocf/manifests/packages/mysql_server.pp, line: 13, column: 8) on node newton.ocf.berkeley.edu
  Error: Could not call 'find' on 'catalog': Evaluation Error: Error while evaluating a Function Call, 'new' The string 'bookworm/sid' cannot be converted to Integer (file: /tmp/ocd-ipc-20221105-10547-jjya4a/ocd-builddir-20221105-10592-4jom4o/environments/production/modules/ocf/manifests/packages/mysql_server.pp, line: 13, column: 8) on node newton.ocf.berkeley.edu
  Error: Try 'puppet help catalog compile' for usage
W, [2022-11-05T21:33:17.549821 #10592]  WARN -- : Failed build_catalog for . validation: OctocatalogDiff::Errors::CatalogError Catalog failed: Warning: The function 'hiera_include' is deprecated in favor of using 'lookup'. See https://puppet.com/docs/puppet/7.20/deprecated_language.html
   (file & line not available)
Warning: Unrecognized escape sequence '\/' (file: /tmp/ocd-ipc-20221105-10547-jjya4a/ocd-builddir-20221105-10592-4jom4o/environments/production/modules/ocf_desktop/manifests/packages.pp, line: 112, column: 75)
Warning: Unrecognized escape sequence '\/' (file: /tmp/ocd-ipc-20221105-10547-jjya4a/ocd-builddir-20221105-10592-4jom4o/environments/production/modules/ocf_desktop/manifests/packages.pp, line: 112, column: 75)
Warning: Unrecognized escape sequence '\/' (file: /tmp/ocd-ipc-20221105-10547-jjya4a/ocd-builddir-20221105-10592-4jom4o/environments/production/modules/ocf_desktop/manifests/packages.pp, line: 112, column: 75)
Warning: Unrecognized escape sequence '\1' (file: /tmp/ocd-ipc-20221105-10547-jjya4a/ocd-builddir-20221105-10592-4jom4o/environments/production/modules/ocf_desktop/manifests/packages.pp, line: 112, column: 172)
Warning: Unrecognized escape sequence '\2' (file: /tmp/ocd-ipc-20221105-10547-jjya4a/ocd-builddir-20221105-10592-4jom4o/environments/production/modules/ocf_desktop/manifests/packages.pp, line: 112, column: 172)
Error: Evaluation Error: Error while evaluating a Function Call, 'new' The string 'bookworm/sid' cannot be converted to Integer (file: /tmp/ocd-ipc-20221105-10547-jjya4a/ocd-builddir-20221105-10592-4jom4o/environments/production/modules/ocf/manifests/packages/mysql_server.pp, line: 13, column: 8) on node newton.ocf.berkeley.edu
Error: Evaluation Error: Error while evaluating a Function Call, 'new' The string 'bookworm/sid' cannot be converted to Integer (file: /tmp/ocd-ipc-20221105-10547-jjya4a/ocd-builddir-20221105-10592-4jom4o/environments/production/modules/ocf/manifests/packages/mysql_server.pp, line: 13, column: 8) on node newton.ocf.berkeley.edu
Error: Could not call 'find' on 'catalog': Evaluation Error: Error while evaluating a Function Call, 'new' The string 'bookworm/sid' cannot be converted to Integer (file: /tmp/ocd-ipc-20221105-10547-jjya4a/ocd-builddir-20221105-10592-4jom4o/environments/production/modules/ocf/manifests/packages/mysql_server.pp, line: 13, column: 8) on node newton.ocf.berkeley.edu
Error: Could not call 'find' on 'catalog': Evaluation Error: Error while evaluating a Function Call, 'new' The string 'bookworm/sid' cannot be converted to Integer (file: /tmp/ocd-ipc-20221105-10547-jjya4a/ocd-builddir-20221105-10592-4jom4o/environments/production/modules/ocf/manifests/packages/mysql_server.pp, line: 13, column: 8) on node newton.ocf.berkeley.edu
Error: Try 'puppet help catalog compile' for usage

#<Thread:0x0000559fcaf52430@/usr/lib/ruby/2.5.0/open3.rb:264 run> terminated with exception (report_on_exception is true):
/usr/lib/ruby/2.5.0/open3.rb:264:in `read': stream closed in another thread (IOError)
	from /usr/lib/ruby/2.5.0/open3.rb:264:in `block (2 levels) in capture3'
#<Thread:0x0000559fcaf522f0@/usr/lib/ruby/2.5.0/open3.rb:265 run> terminated with exception (report_on_exception is true):
/usr/lib/ruby/2.5.0/open3.rb:265:in `read': stream closed in another thread (IOError)
	from /usr/lib/ruby/2.5.0/open3.rb:265:in `block (2 levels) in capture3'
/usr/lib/ruby/vendor_ruby/octocatalog-diff/util/catalogs.rb:259:in `catalog_validator': Catalog failed: Warning: The function 'hiera_include' is deprecated in favor of using 'lookup'. See https://puppet.com/docs/puppet/7.20/deprecated_language.html (OctocatalogDiff::Errors::CatalogError)
   (file & line not available)
Warning: Unrecognized escape sequence '\/' (file: /tmp/ocd-ipc-20221105-10547-jjya4a/ocd-builddir-20221105-10592-4jom4o/environments/production/modules/ocf_desktop/manifests/packages.pp, line: 112, column: 75)
Warning: Unrecognized escape sequence '\/' (file: /tmp/ocd-ipc-20221105-10547-jjya4a/ocd-builddir-20221105-10592-4jom4o/environments/production/modules/ocf_desktop/manifests/packages.pp, line: 112, column: 75)
Warning: Unrecognized escape sequence '\/' (file: /tmp/ocd-ipc-20221105-10547-jjya4a/ocd-builddir-20221105-10592-4jom4o/environments/production/modules/ocf_desktop/manifests/packages.pp, line: 112, column: 75)
Warning: Unrecognized escape sequence '\1' (file: /tmp/ocd-ipc-20221105-10547-jjya4a/ocd-builddir-20221105-10592-4jom4o/environments/production/modules/ocf_desktop/manifests/packages.pp, line: 112, column: 172)
Warning: Unrecognized escape sequence '\2' (file: /tmp/ocd-ipc-20221105-10547-jjya4a/ocd-builddir-20221105-10592-4jom4o/environments/production/modules/ocf_desktop/manifests/packages.pp, line: 112, column: 172)
Error: Evaluation Error: Error while evaluating a Function Call, 'new' The string 'bookworm/sid' cannot be converted to Integer (file: /tmp/ocd-ipc-20221105-10547-jjya4a/ocd-builddir-20221105-10592-4jom4o/environments/production/modules/ocf/manifests/packages/mysql_server.pp, line: 13, column: 8) on node newton.ocf.berkeley.edu
Error: Evaluation Error: Error while evaluating a Function Call, 'new' The string 'bookworm/sid' cannot be converted to Integer (file: /tmp/ocd-ipc-20221105-10547-jjya4a/ocd-builddir-20221105-10592-4jom4o/environments/production/modules/ocf/manifests/packages/mysql_server.pp, line: 13, column: 8) on node newton.ocf.berkeley.edu
Error: Could not call 'find' on 'catalog': Evaluation Error: Error while evaluating a Function Call, 'new' The string 'bookworm/sid' cannot be converted to Integer (file: /tmp/ocd-ipc-20221105-10547-jjya4a/ocd-builddir-20221105-10592-4jom4o/environments/production/modules/ocf/manifests/packages/mysql_server.pp, line: 13, column: 8) on node newton.ocf.berkeley.edu
Error: Could not call 'find' on 'catalog': Evaluation Error: Error while evaluating a Function Call, 'new' The string 'bookworm/sid' cannot be converted to Integer (file: /tmp/ocd-ipc-20221105-10547-jjya4a/ocd-builddir-20221105-10592-4jom4o/environments/production/modules/ocf/manifests/packages/mysql_server.pp, line: 13, column: 8) on node newton.ocf.berkeley.edu
Error: Try 'puppet help catalog compile' for usage
	from /usr/lib/ruby/vendor_ruby/octocatalog-diff/util/parallel.rb:39:in `call'
	from /usr/lib/ruby/vendor_ruby/octocatalog-diff/util/parallel.rb:39:in `validate'
	from /usr/lib/ruby/vendor_ruby/octocatalog-diff/util/parallel.rb:202:in `execute_task'
	from /usr/lib/ruby/vendor_ruby/octocatalog-diff/util/parallel.rb:119:in `block (2 levels) in run_tasks_parallel'
	from /usr/lib/ruby/vendor_ruby/octocatalog-diff/util/parallel.rb:117:in `fork'
	from /usr/lib/ruby/vendor_ruby/octocatalog-diff/util/parallel.rb:117:in `block in run_tasks_parallel'
	from /usr/lib/ruby/vendor_ruby/octocatalog-diff/util/parallel.rb:114:in `each'
	from /usr/lib/ruby/vendor_ruby/octocatalog-diff/util/parallel.rb:114:in `each_with_index'
	from /usr/lib/ruby/vendor_ruby/octocatalog-diff/util/parallel.rb:114:in `run_tasks_parallel'
	from /usr/lib/ruby/vendor_ruby/octocatalog-diff/util/parallel.rb:94:in `run_tasks'
	from /usr/lib/ruby/vendor_ruby/octocatalog-diff/util/catalogs.rb:92:in `build_catalog_parallelizer'
	from /usr/lib/ruby/vendor_ruby/octocatalog-diff/util/catalogs.rb:29:in `catalogs'
	from /usr/lib/ruby/vendor_ruby/octocatalog-diff/api/v1/catalog-diff.rb:34:in `catalog_diff'
	from /usr/lib/ruby/vendor_ruby/octocatalog-diff/api/v1.rb:19:in `catalog_diff'
	from /usr/lib/ruby/vendor_ruby/octocatalog-diff/cli.rb:151:in `run_octocatalog_diff'
	from /usr/lib/ruby/vendor_ruby/octocatalog-diff/cli.rb:125:in `cli'
	from /usr/bin/octocatalog-diff:34:in `<main>'

Changed hosts

diff for hal.ocf.berkeley.edu

*******************************************
- Cron[check-rsnapshot-backups]
*******************************************
  Cron[rsnapshot-daily] =>
   parameters =>
     command =>
      - rsnapshot -c /opt/share/backups/rsnapshot.conf sync && rsnapshot -c /opt/share/backups/rsnapshot.conf daily
      + /usr/local/sbin/backup-zfs.sh
     hour =>
      - 2
      + 22
     minute =>
      - 0
      + 20
*******************************************
- Cron[rsnapshot-monthly]
*******************************************
- Cron[rsnapshot-weekly]
*******************************************
  File[/opt/share/backups/backup-mysql] =>
   parameters =>
     content =>
      @@ -19,3 +19,3 @@
                    --routines \
                    --single-transaction \
      -             --databases {} | pigz > "mysql-{}-$(date +%F).sql.gz"' -- $databases
      +             --databases {} > "mysql-{}-$(date +%F).sql"' -- $databases
*******************************************
  File[/opt/share/backups/backup-pgsql] =>
   parameters =>
     content =>
      @@ -4,3 +4,3 @@
       # Dumps the entire PostgreSQL instance to one .sql file.
       # Requires that a valid ~/.pgpass file be available on the PostgreSQL host
      -ssh -K ocfbackups@postgres 'pg_dumpall -U postgres -h localhost | pigz' > "pgsql-all-$(date +%F).sql.gz"
      +ssh -K ocfbackups@postgres 'pg_dumpall -U postgres -h localhost' > "pgsql-all-$(date +%F).sql"
*******************************************
+ File[/opt/share/backups/offsite-host] =>
   parameters =>
     "backup": "main",
     "content": "dummyhost",
     "group": "root",
     "mode": "0400",
     "owner": "root"
*******************************************
+ File[/opt/share/backups/rsnapshot-zfs-git.conf] =>
   parameters =>
     "backup": "main",
     "content": "#################################################\n# rsnapshot.c...
     "group": "root",
     "mode": "0644",
     "owner": "root"
*******************************************
+ File[/opt/share/backups/rsnapshot-zfs-mysql.conf] =>
   parameters =>
     "backup": "main",
     "content": "#################################################\n# rsnapshot.c...
     "group": "root",
     "mode": "0644",
     "owner": "root"
*******************************************
+ File[/opt/share/backups/rsnapshot-zfs-pgsql.conf] =>
   parameters =>
     "backup": "main",
     "content": "#################################################\n# rsnapshot.c...
     "group": "root",
     "mode": "0644",
     "owner": "root"
*******************************************
+ File[/opt/share/backups/rsnapshot-zfs.conf] =>
   parameters =>
     "backup": "main",
     "content": "#################################################\n# rsnapshot.c...
     "group": "root",
     "mode": "0644",
     "owner": "root"
*******************************************
+ File[/usr/local/sbin/backup-zfs.sh] =>
   parameters =>
     "backup": "main",
     "content": "#!/bin/bash\n\nCURRENT_SNAPSHOT_FILE=/opt/share/backups/current-...
     "group": "root",
     "mode": "0755",
     "owner": "root"
*******************************************

Unaffected hosts

acid.ocf.berkeley.edu
afterhours.ocf.berkeley.edu
anthrax.ocf.berkeley.edu
arsenic.ocf.berkeley.edu
asteroid.ocf.berkeley.edu
autocrat.ocf.berkeley.edu
avalanche.ocf.berkeley.edu
bedbugs.ocf.berkeley.edu
bigbang.ocf.berkeley.edu
bigrip.ocf.berkeley.edu
biohazard.ocf.berkeley.edu
blackout.ocf.berkeley.edu
blight.ocf.berkeley.edu
blizzard.ocf.berkeley.edu
chaos.ocf.berkeley.edu
corruption.ocf.berkeley.edu
coup.ocf.berkeley.edu
cyanide.ocf.berkeley.edu
cyclone.ocf.berkeley.edu
dataloss.ocf.berkeley.edu
deadlock.ocf.berkeley.edu
death.ocf.berkeley.edu
dementors.ocf.berkeley.edu
democracy.ocf.berkeley.edu
destruction.ocf.berkeley.edu
drought.ocf.berkeley.edu
eruption.ocf.berkeley.edu
failure.ocf.berkeley.edu
fallingrocks.ocf.berkeley.edu
falsevacuum.ocf.berkeley.edu
famine.ocf.berkeley.edu
fire.ocf.berkeley.edu
firestorm.ocf.berkeley.edu
firewhirl.ocf.berkeley.edu
flood.ocf.berkeley.edu
fraud.ocf.berkeley.edu
fukushima.ocf.berkeley.edu
gridlock.ocf.berkeley.edu
hailstorm.ocf.berkeley.edu
headcrash.ocf.berkeley.edu
heatwave.ocf.berkeley.edu
hellfire.ocf.berkeley.edu
hozer-74.ocf.berkeley.edu
hurricane.ocf.berkeley.edu
invasion.ocf.berkeley.edu
lethe.ocf.berkeley.edu
lightning.ocf.berkeley.edu
lockdown.ocf.berkeley.edu
madcow.ocf.berkeley.edu
maelstrom.ocf.berkeley.edu
meteorstorm.ocf.berkeley.edu
nuke.ocf.berkeley.edu
outbreak.ocf.berkeley.edu
pestilence.ocf.berkeley.edu
plague.ocf.berkeley.edu
pox.ocf.berkeley.edu
quarantine.ocf.berkeley.edu
radiation-mgmt.ocf.berkeley.edu
reaper.ocf.berkeley.edu
riptide.ocf.berkeley.edu
scurvy.ocf.berkeley.edu
segfault.ocf.berkeley.edu
shipwreck.ocf.berkeley.edu
singularity.ocf.berkeley.edu
sinkhole.ocf.berkeley.edu
solarflare.ocf.berkeley.edu
supernova.ocf.berkeley.edu
surge.ocf.berkeley.edu
thunder.ocf.berkeley.edu
tornado.ocf.berkeley.edu
tsunami.ocf.berkeley.edu
typhoon.ocf.berkeley.edu
vampires.ocf.berkeley.edu
venom.ocf.berkeley.edu
volcano.ocf.berkeley.edu
war.ocf.berkeley.edu
wildfire.ocf.berkeley.edu
windshear.ocf.berkeley.edu
worm.ocf.berkeley.edu

Jenkins

ocfjenkins · 2022-11-07T10:38:53Z

Errored hosts (1)

Changed hosts (1)

Unaffected hosts (79)

Errored hosts

error for jaws.ocf.berkeley.edu

E, [2022-11-07T02:38:08.491865 #10524] ERROR -- : ENC failed - Status 1
#<Thread:0x000055e5ad3bf450@/usr/lib/ruby/2.5.0/open3.rb:264 run> terminated with exception (report_on_exception is true):
/usr/lib/ruby/2.5.0/open3.rb:264:in `read': stream closed in another thread (IOError)
	from /usr/lib/ruby/2.5.0/open3.rb:264:in `block (2 levels) in capture3'
#<Thread:0x000055e5ad3bf310@/usr/lib/ruby/2.5.0/open3.rb:265 run> terminated with exception (report_on_exception is true):
/usr/lib/ruby/2.5.0/open3.rb:265:in `read': stream closed in another thread (IOError)
	from /usr/lib/ruby/2.5.0/open3.rb:265:in `block (2 levels) in capture3'
/usr/lib/ruby/2.5.0/psych.rb:402:in `parse': no implicit conversion of nil into String (TypeError)
	from /usr/lib/ruby/2.5.0/psych.rb:402:in `parse_stream'
	from /usr/lib/ruby/2.5.0/psych.rb:350:in `parse'
	from /usr/lib/ruby/2.5.0/psych.rb:263:in `load'
	from /usr/lib/ruby/vendor_ruby/octocatalog-diff/catalog-util/enc.rb:66:in `override_enc_parameters'
	from /usr/lib/ruby/vendor_ruby/octocatalog-diff/catalog-util/enc.rb:56:in `execute'
	from /usr/lib/ruby/vendor_ruby/octocatalog-diff/catalog-util/builddir.rb:204:in `install_enc'
	from /usr/lib/ruby/vendor_ruby/octocatalog-diff/catalog-util/builddir.rb:60:in `initialize'
	from /usr/lib/ruby/vendor_ruby/octocatalog-diff/catalog/computed.rb:100:in `new'
	from /usr/lib/ruby/vendor_ruby/octocatalog-diff/catalog/computed.rb:100:in `bootstrap'
	from /usr/lib/ruby/vendor_ruby/octocatalog-diff/catalog/computed.rb:113:in `build_catalog'
	from /usr/lib/ruby/vendor_ruby/octocatalog-diff/catalog.rb:96:in `build'
	from /usr/lib/ruby/vendor_ruby/octocatalog-diff/util/catalogs.rb:241:in `build_catalog'
	from /usr/lib/ruby/vendor_ruby/octocatalog-diff/util/parallel.rb:34:in `call'
	from /usr/lib/ruby/vendor_ruby/octocatalog-diff/util/parallel.rb:34:in `execute'
	from /usr/lib/ruby/vendor_ruby/octocatalog-diff/util/parallel.rb:193:in `execute_task'
	from /usr/lib/ruby/vendor_ruby/octocatalog-diff/util/parallel.rb:119:in `block (2 levels) in run_tasks_parallel'
	from /usr/lib/ruby/vendor_ruby/octocatalog-diff/util/parallel.rb:117:in `fork'
	from /usr/lib/ruby/vendor_ruby/octocatalog-diff/util/parallel.rb:117:in `block in run_tasks_parallel'
	from /usr/lib/ruby/vendor_ruby/octocatalog-diff/util/parallel.rb:114:in `each'
	from /usr/lib/ruby/vendor_ruby/octocatalog-diff/util/parallel.rb:114:in `each_with_index'
	from /usr/lib/ruby/vendor_ruby/octocatalog-diff/util/parallel.rb:114:in `run_tasks_parallel'
	from /usr/lib/ruby/vendor_ruby/octocatalog-diff/util/parallel.rb:94:in `run_tasks'
	from /usr/lib/ruby/vendor_ruby/octocatalog-diff/util/catalogs.rb:92:in `build_catalog_parallelizer'
	from /usr/lib/ruby/vendor_ruby/octocatalog-diff/util/catalogs.rb:29:in `catalogs'
	from /usr/lib/ruby/vendor_ruby/octocatalog-diff/api/v1/catalog-diff.rb:34:in `catalog_diff'
	from /usr/lib/ruby/vendor_ruby/octocatalog-diff/api/v1.rb:19:in `catalog_diff'
	from /usr/lib/ruby/vendor_ruby/octocatalog-diff/cli.rb:151:in `run_octocatalog_diff'
	from /usr/lib/ruby/vendor_ruby/octocatalog-diff/cli.rb:125:in `cli'
	from /usr/bin/octocatalog-diff:34:in `<main>'

Changed hosts

diff for hal.ocf.berkeley.edu

*******************************************
- Cron[check-rsnapshot-backups]
*******************************************
  Cron[rsnapshot-daily] =>
   parameters =>
     command =>
      - rsnapshot -c /opt/share/backups/rsnapshot.conf sync && rsnapshot -c /opt/share/backups/rsnapshot.conf daily
      + /usr/local/sbin/backup-zfs.sh | tee -a /var/log/zfs-backup.log
     hour =>
      - 2
      + 03
     minute =>
      - 0
      + 00
*******************************************
- Cron[rsnapshot-monthly]
*******************************************
- Cron[rsnapshot-weekly]
*******************************************
+ File[/etc/logrotate.d/backup-zfs] =>
   parameters =>
     "backup": "main",
     "content": "/var/log/ocf-backup-zfs.log {\n\trotate 100\n\tdaily\n\tcompress...
     "group": "root",
     "mode": "0644",
     "owner": "root"
*******************************************
  File[/opt/share/backups/backup-mysql] =>
   parameters =>
     content =>
      @@ -19,3 +19,3 @@
                    --routines \
                    --single-transaction \
      -             --databases {} | pigz > "mysql-{}-$(date +%F).sql.gz"' -- $databases
      +             --databases {} > "mysql-{}-$(date +%F).sql"' -- $databases
*******************************************
  File[/opt/share/backups/backup-pgsql] =>
   parameters =>
     content =>
      @@ -4,3 +4,3 @@
       # Dumps the entire PostgreSQL instance to one .sql file.
       # Requires that a valid ~/.pgpass file be available on the PostgreSQL host
      -ssh -K ocfbackups@postgres 'pg_dumpall -U postgres -h localhost | pigz' > "pgsql-all-$(date +%F).sql.gz"
      +ssh -K ocfbackups@postgres 'pg_dumpall -U postgres -h localhost' > "pgsql-all-$(date +%F).sql"
*******************************************
+ File[/opt/share/backups/offsite-host] =>
   parameters =>
     "backup": "main",
     "content": "dummyhost",
     "group": "root",
     "mode": "0400",
     "owner": "root"
*******************************************
+ File[/opt/share/backups/rsnapshot-zfs-git.conf] =>
   parameters =>
     "backup": "main",
     "content": "#################################################\n# rsnapshot.c...
     "group": "root",
     "mode": "0644",
     "owner": "root"
*******************************************
+ File[/opt/share/backups/rsnapshot-zfs-mysql.conf] =>
   parameters =>
     "backup": "main",
     "content": "#################################################\n# rsnapshot.c...
     "group": "root",
     "mode": "0644",
     "owner": "root"
*******************************************
+ File[/opt/share/backups/rsnapshot-zfs-pgsql.conf] =>
   parameters =>
     "backup": "main",
     "content": "#################################################\n# rsnapshot.c...
     "group": "root",
     "mode": "0644",
     "owner": "root"
*******************************************
+ File[/opt/share/backups/rsnapshot-zfs.conf] =>
   parameters =>
     "backup": "main",
     "content": "#################################################\n# rsnapshot.c...
     "group": "root",
     "mode": "0644",
     "owner": "root"
*******************************************
+ File[/usr/local/sbin/backup-zfs.sh] =>
   parameters =>
     "backup": "main",
     "content": "#!/bin/bash\n\nCURRENT_SNAPSHOT_FILE=/opt/share/backups/current-...
     "group": "root",
     "mode": "0755",
     "owner": "root"
*******************************************

Unaffected hosts

acid.ocf.berkeley.edu
afterhours.ocf.berkeley.edu
anthrax.ocf.berkeley.edu
arsenic.ocf.berkeley.edu
asteroid.ocf.berkeley.edu
autocrat.ocf.berkeley.edu
avalanche.ocf.berkeley.edu
bedbugs.ocf.berkeley.edu
bigbang.ocf.berkeley.edu
bigrip.ocf.berkeley.edu
biohazard.ocf.berkeley.edu
blackout.ocf.berkeley.edu
blight.ocf.berkeley.edu
blizzard.ocf.berkeley.edu
chaos.ocf.berkeley.edu
corruption.ocf.berkeley.edu
coup.ocf.berkeley.edu
cyanide.ocf.berkeley.edu
cyclone.ocf.berkeley.edu
dataloss.ocf.berkeley.edu
deadlock.ocf.berkeley.edu
death.ocf.berkeley.edu
dementors.ocf.berkeley.edu
democracy.ocf.berkeley.edu
destruction.ocf.berkeley.edu
drought.ocf.berkeley.edu
eruption.ocf.berkeley.edu
failure.ocf.berkeley.edu
fallingrocks.ocf.berkeley.edu
falsevacuum.ocf.berkeley.edu
famine.ocf.berkeley.edu
fire.ocf.berkeley.edu
firestorm.ocf.berkeley.edu
firewhirl.ocf.berkeley.edu
flood.ocf.berkeley.edu
fraud.ocf.berkeley.edu
fukushima.ocf.berkeley.edu
gridlock.ocf.berkeley.edu
hailstorm.ocf.berkeley.edu
headcrash.ocf.berkeley.edu
heatwave.ocf.berkeley.edu
hellfire.ocf.berkeley.edu
hozer-74.ocf.berkeley.edu
hurricane.ocf.berkeley.edu
invasion.ocf.berkeley.edu
lethe.ocf.berkeley.edu
lightning.ocf.berkeley.edu
lockdown.ocf.berkeley.edu
madcow.ocf.berkeley.edu
maelstrom.ocf.berkeley.edu
meteorstorm.ocf.berkeley.edu
nuke.ocf.berkeley.edu
outbreak.ocf.berkeley.edu
pestilence.ocf.berkeley.edu
plague.ocf.berkeley.edu
pox.ocf.berkeley.edu
quarantine.ocf.berkeley.edu
radiation-mgmt.ocf.berkeley.edu
reaper.ocf.berkeley.edu
riptide.ocf.berkeley.edu
scurvy.ocf.berkeley.edu
segfault.ocf.berkeley.edu
shipwreck.ocf.berkeley.edu
singularity.ocf.berkeley.edu
sinkhole.ocf.berkeley.edu
solarflare.ocf.berkeley.edu
supernova.ocf.berkeley.edu
surge.ocf.berkeley.edu
thunder.ocf.berkeley.edu
tornado.ocf.berkeley.edu
tsunami.ocf.berkeley.edu
typhoon.ocf.berkeley.edu
vampires.ocf.berkeley.edu
venom.ocf.berkeley.edu
volcano.ocf.berkeley.edu
war.ocf.berkeley.edu
wildfire.ocf.berkeley.edu
windshear.ocf.berkeley.edu
worm.ocf.berkeley.edu

Jenkins

timestamp file on source is empty

Co-authored-by: rmxu <[email protected]>

The people removed were notified last semester, kmo requested an extension to the end of that semester, so that was done.

* fix: don't redirect on ocf.b.e * fix: it's actually here, see if it works * fix: it works * fix: remove server cors not necessary * fix: wrong one

* Add slidingsync.matrix to load balancer * Add sliding sync to matrix/client well-known

fix SSL config to support TLS 1.2, update cipher list

emerg

* feat: smart monitoring

ocfjenkins · 2023-04-30T09:27:44Z

Errored hosts (1)

Changed hosts (1)

Unaffected hosts (64)

Errored hosts

error for segfault.ocf.berkeley.edu

W, [2023-04-30T02:27:18.147349 #18087]  WARN -- : Puppet command failed: STDOUT:
STDERR:
  Warning: The function 'hiera_include' is deprecated in favor of using 'lookup'. See https://puppet.com/docs/puppet/7.21/deprecated_language.html
     (file & line not available)
  Error: Evaluation Error: Error while evaluating a Function Call, 'new' The string 'bookworm/sid' cannot be converted to Integer (file: /tmp/ocd-ipc-20230430-18012-1et4roh/ocd-builddir-20230430-18087-1u1m0gq/environments/production/modules/ocf/manifests/packages/mysql_server.pp, line: 13, column: 8) on node segfault.ocf.berkeley.edu
  Error: Evaluation Error: Error while evaluating a Function Call, 'new' The string 'bookworm/sid' cannot be converted to Integer (file: /tmp/ocd-ipc-20230430-18012-1et4roh/ocd-builddir-20230430-18087-1u1m0gq/environments/production/modules/ocf/manifests/packages/mysql_server.pp, line: 13, column: 8) on node segfault.ocf.berkeley.edu
  Error: Could not call 'find' on 'catalog': Evaluation Error: Error while evaluating a Function Call, 'new' The string 'bookworm/sid' cannot be converted to Integer (file: /tmp/ocd-ipc-20230430-18012-1et4roh/ocd-builddir-20230430-18087-1u1m0gq/environments/production/modules/ocf/manifests/packages/mysql_server.pp, line: 13, column: 8) on node segfault.ocf.berkeley.edu
  Error: Could not call 'find' on 'catalog': Evaluation Error: Error while evaluating a Function Call, 'new' The string 'bookworm/sid' cannot be converted to Integer (file: /tmp/ocd-ipc-20230430-18012-1et4roh/ocd-builddir-20230430-18087-1u1m0gq/environments/production/modules/ocf/manifests/packages/mysql_server.pp, line: 13, column: 8) on node segfault.ocf.berkeley.edu
  Error: Try 'puppet help catalog compile' for usage
W, [2023-04-30T02:27:18.147658 #18087]  WARN -- : Failed build_catalog for origin/master validation: OctocatalogDiff::Errors::CatalogError Catalog failed: Warning: The function 'hiera_include' is deprecated in favor of using 'lookup'. See https://puppet.com/docs/puppet/7.21/deprecated_language.html
   (file & line not available)
Error: Evaluation Error: Error while evaluating a Function Call, 'new' The string 'bookworm/sid' cannot be converted to Integer (file: /tmp/ocd-ipc-20230430-18012-1et4roh/ocd-builddir-20230430-18087-1u1m0gq/environments/production/modules/ocf/manifests/packages/mysql_server.pp, line: 13, column: 8) on node segfault.ocf.berkeley.edu
Error: Evaluation Error: Error while evaluating a Function Call, 'new' The string 'bookworm/sid' cannot be converted to Integer (file: /tmp/ocd-ipc-20230430-18012-1et4roh/ocd-builddir-20230430-18087-1u1m0gq/environments/production/modules/ocf/manifests/packages/mysql_server.pp, line: 13, column: 8) on node segfault.ocf.berkeley.edu
Error: Could not call 'find' on 'catalog': Evaluation Error: Error while evaluating a Function Call, 'new' The string 'bookworm/sid' cannot be converted to Integer (file: /tmp/ocd-ipc-20230430-18012-1et4roh/ocd-builddir-20230430-18087-1u1m0gq/environments/production/modules/ocf/manifests/packages/mysql_server.pp, line: 13, column: 8) on node segfault.ocf.berkeley.edu
Error: Could not call 'find' on 'catalog': Evaluation Error: Error while evaluating a Function Call, 'new' The string 'bookworm/sid' cannot be converted to Integer (file: /tmp/ocd-ipc-20230430-18012-1et4roh/ocd-builddir-20230430-18087-1u1m0gq/environments/production/modules/ocf/manifests/packages/mysql_server.pp, line: 13, column: 8) on node segfault.ocf.berkeley.edu
Error: Try 'puppet help catalog compile' for usage

#<Thread:0x000055744b5c6df8@/usr/lib/ruby/2.5.0/open3.rb:264 run> terminated with exception (report_on_exception is true):
/usr/lib/ruby/2.5.0/open3.rb:264:in `read': stream closed in another thread (IOError)
	from /usr/lib/ruby/2.5.0/open3.rb:264:in `block (2 levels) in capture3'
#<Thread:0x000055744b5c6cb8@/usr/lib/ruby/2.5.0/open3.rb:265 run> terminated with exception (report_on_exception is true):
/usr/lib/ruby/2.5.0/open3.rb:265:in `read': stream closed in another thread (IOError)
	from /usr/lib/ruby/2.5.0/open3.rb:265:in `block (2 levels) in capture3'
/usr/lib/ruby/vendor_ruby/octocatalog-diff/util/catalogs.rb:259:in `catalog_validator': Catalog failed: Warning: The function 'hiera_include' is deprecated in favor of using 'lookup'. See https://puppet.com/docs/puppet/7.21/deprecated_language.html (OctocatalogDiff::Errors::CatalogError)
   (file & line not available)
Error: Evaluation Error: Error while evaluating a Function Call, 'new' The string 'bookworm/sid' cannot be converted to Integer (file: /tmp/ocd-ipc-20230430-18012-1et4roh/ocd-builddir-20230430-18087-1u1m0gq/environments/production/modules/ocf/manifests/packages/mysql_server.pp, line: 13, column: 8) on node segfault.ocf.berkeley.edu
Error: Evaluation Error: Error while evaluating a Function Call, 'new' The string 'bookworm/sid' cannot be converted to Integer (file: /tmp/ocd-ipc-20230430-18012-1et4roh/ocd-builddir-20230430-18087-1u1m0gq/environments/production/modules/ocf/manifests/packages/mysql_server.pp, line: 13, column: 8) on node segfault.ocf.berkeley.edu
Error: Could not call 'find' on 'catalog': Evaluation Error: Error while evaluating a Function Call, 'new' The string 'bookworm/sid' cannot be converted to Integer (file: /tmp/ocd-ipc-20230430-18012-1et4roh/ocd-builddir-20230430-18087-1u1m0gq/environments/production/modules/ocf/manifests/packages/mysql_server.pp, line: 13, column: 8) on node segfault.ocf.berkeley.edu
Error: Could not call 'find' on 'catalog': Evaluation Error: Error while evaluating a Function Call, 'new' The string 'bookworm/sid' cannot be converted to Integer (file: /tmp/ocd-ipc-20230430-18012-1et4roh/ocd-builddir-20230430-18087-1u1m0gq/environments/production/modules/ocf/manifests/packages/mysql_server.pp, line: 13, column: 8) on node segfault.ocf.berkeley.edu
Error: Try 'puppet help catalog compile' for usage
	from /usr/lib/ruby/vendor_ruby/octocatalog-diff/util/parallel.rb:39:in `call'
	from /usr/lib/ruby/vendor_ruby/octocatalog-diff/util/parallel.rb:39:in `validate'
	from /usr/lib/ruby/vendor_ruby/octocatalog-diff/util/parallel.rb:202:in `execute_task'
	from /usr/lib/ruby/vendor_ruby/octocatalog-diff/util/parallel.rb:119:in `block (2 levels) in run_tasks_parallel'
	from /usr/lib/ruby/vendor_ruby/octocatalog-diff/util/parallel.rb:117:in `fork'
	from /usr/lib/ruby/vendor_ruby/octocatalog-diff/util/parallel.rb:117:in `block in run_tasks_parallel'
	from /usr/lib/ruby/vendor_ruby/octocatalog-diff/util/parallel.rb:114:in `each'
	from /usr/lib/ruby/vendor_ruby/octocatalog-diff/util/parallel.rb:114:in `each_with_index'
	from /usr/lib/ruby/vendor_ruby/octocatalog-diff/util/parallel.rb:114:in `run_tasks_parallel'
	from /usr/lib/ruby/vendor_ruby/octocatalog-diff/util/parallel.rb:94:in `run_tasks'
	from /usr/lib/ruby/vendor_ruby/octocatalog-diff/util/catalogs.rb:92:in `build_catalog_parallelizer'
	from /usr/lib/ruby/vendor_ruby/octocatalog-diff/util/catalogs.rb:29:in `catalogs'
	from /usr/lib/ruby/vendor_ruby/octocatalog-diff/api/v1/catalog-diff.rb:34:in `catalog_diff'
	from /usr/lib/ruby/vendor_ruby/octocatalog-diff/api/v1.rb:19:in `catalog_diff'
	from /usr/lib/ruby/vendor_ruby/octocatalog-diff/cli.rb:151:in `run_octocatalog_diff'
	from /usr/lib/ruby/vendor_ruby/octocatalog-diff/cli.rb:125:in `cli'
	from /usr/bin/octocatalog-diff:34:in `<main>'

Changed hosts

diff for hal.ocf.berkeley.edu

*******************************************
- Cron[check-rsnapshot-backups]
*******************************************
  Cron[rsnapshot-daily] =>
   parameters =>
     command =>
      - rsnapshot -c /opt/share/backups/rsnapshot.conf sync && rsnapshot -c /opt/share/backups/rsnapshot.conf daily
      + /usr/local/sbin/backup-zfs.sh | tee -a /var/log/zfs-backup.log
     hour =>
      - 2
      + 03
     minute =>
      - 0
      + 00
*******************************************
- Cron[rsnapshot-monthly]
*******************************************
- Cron[rsnapshot-weekly]
*******************************************
+ File[/etc/logrotate.d/backup-zfs] =>
   parameters =>
     "backup": "main",
     "content": "/var/log/ocf-backup-zfs.log {\n\trotate 100\n\tdaily\n\tcompress...
     "group": "root",
     "mode": "0644",
     "owner": "root"
*******************************************
  File[/opt/share/backups/backup-mysql] =>
   parameters =>
     content =>
      @@ -19,3 +19,3 @@
                    --routines \
                    --single-transaction \
      -             --databases {} | pigz > "mysql-{}-$(date +%F).sql.gz"' -- $databases
      +             --databases {} > "mysql-{}-$(date +%F).sql"' -- $databases
*******************************************
  File[/opt/share/backups/backup-pgsql] =>
   parameters =>
     content =>
      @@ -4,3 +4,3 @@
       # Dumps the entire PostgreSQL instance to one .sql file.
       # Requires that a valid ~/.pgpass file be available on the PostgreSQL host
      -ssh -K ocfbackups@postgres 'pg_dumpall -U postgres -h localhost | pigz' > "pgsql-all-$(date +%F).sql.gz"
      +ssh -K ocfbackups@postgres 'pg_dumpall -U postgres -h localhost' > "pgsql-all-$(date +%F).sql"
*******************************************
+ File[/opt/share/backups/offsite-host] =>
   parameters =>
     "backup": "main",
     "content": "dummyhost",
     "group": "root",
     "mode": "0400",
     "owner": "root"
*******************************************
+ File[/opt/share/backups/rsnapshot-zfs-git.conf] =>
   parameters =>
     "backup": "main",
     "content": "#################################################\n# rsnapshot.c...
     "group": "root",
     "mode": "0644",
     "owner": "root"
*******************************************
+ File[/opt/share/backups/rsnapshot-zfs-mysql.conf] =>
   parameters =>
     "backup": "main",
     "content": "#################################################\n# rsnapshot.c...
     "group": "root",
     "mode": "0644",
     "owner": "root"
*******************************************
+ File[/opt/share/backups/rsnapshot-zfs-pgsql.conf] =>
   parameters =>
     "backup": "main",
     "content": "#################################################\n# rsnapshot.c...
     "group": "root",
     "mode": "0644",
     "owner": "root"
*******************************************
+ File[/opt/share/backups/rsnapshot-zfs.conf] =>
   parameters =>
     "backup": "main",
     "content": "#################################################\n# rsnapshot.c...
     "group": "root",
     "mode": "0644",
     "owner": "root"
*******************************************
+ File[/usr/local/sbin/backup-zfs.sh] =>
   parameters =>
     "backup": "main",
     "content": "#!/bin/bash\n\nCURRENT_SNAPSHOT_FILE=/opt/share/backups/current-...
     "group": "root",
     "mode": "0755",
     "owner": "root"
*******************************************

Unaffected hosts

acid.ocf.berkeley.edu
anthrax.ocf.berkeley.edu
arsenic.ocf.berkeley.edu
asteroid.ocf.berkeley.edu
autocrat.ocf.berkeley.edu
avalanche.ocf.berkeley.edu
bedbugs.ocf.berkeley.edu
bigbang.ocf.berkeley.edu
biohazard.ocf.berkeley.edu
blackout.ocf.berkeley.edu
blight.ocf.berkeley.edu
blizzard.ocf.berkeley.edu
chaos.ocf.berkeley.edu
corruption.ocf.berkeley.edu
coup.ocf.berkeley.edu
cyanide.ocf.berkeley.edu
cyclone.ocf.berkeley.edu
dataloss.ocf.berkeley.edu
deadlock.ocf.berkeley.edu
death.ocf.berkeley.edu
dementors.ocf.berkeley.edu
democracy.ocf.berkeley.edu
destruction.ocf.berkeley.edu
drought.ocf.berkeley.edu
fallingrocks.ocf.berkeley.edu
falsevacuum.ocf.berkeley.edu
famine.ocf.berkeley.edu
firestorm.ocf.berkeley.edu
firewhirl.ocf.berkeley.edu
flood.ocf.berkeley.edu
fraud.ocf.berkeley.edu
gridlock.ocf.berkeley.edu
hailstorm.ocf.berkeley.edu
headcrash.ocf.berkeley.edu
heatwave.ocf.berkeley.edu
hurricane.ocf.berkeley.edu
hypoxia.ocf.berkeley.edu
invasion.ocf.berkeley.edu
lethe.ocf.berkeley.edu
lightning.ocf.berkeley.edu
madcow.ocf.berkeley.edu
maelstrom.ocf.berkeley.edu
meteorstorm.ocf.berkeley.edu
outbreak.ocf.berkeley.edu
pestilence.ocf.berkeley.edu
plague.ocf.berkeley.edu
quarantine.ocf.berkeley.edu
reaper.ocf.berkeley.edu
riptide.ocf.berkeley.edu
scurvy.ocf.berkeley.edu
sinkhole.ocf.berkeley.edu
solarflare.ocf.berkeley.edu
supernova.ocf.berkeley.edu
surge.ocf.berkeley.edu
thunder.ocf.berkeley.edu
tornado.ocf.berkeley.edu
tsunami.ocf.berkeley.edu
typhoon.ocf.berkeley.edu
vampires.ocf.berkeley.edu
venom.ocf.berkeley.edu
volcano.ocf.berkeley.edu
whiteout.ocf.berkeley.edu
wildfire.ocf.berkeley.edu
windshear.ocf.berkeley.edu

Jenkins

ocfjenkins · 2023-04-30T09:28:36Z

Errored hosts (1)

Changed hosts (1)

Unaffected hosts (64)

Errored hosts

error for segfault.ocf.berkeley.edu

W, [2023-04-30T02:28:27.030433 #27428]  WARN -- : Puppet command failed: STDOUT:
STDERR:
  Warning: The function 'hiera_include' is deprecated in favor of using 'lookup'. See https://puppet.com/docs/puppet/7.21/deprecated_language.html
     (file & line not available)
  Error: Evaluation Error: Error while evaluating a Function Call, 'new' The string 'bookworm/sid' cannot be converted to Integer (file: /tmp/ocd-ipc-20230430-27336-1v7pgqn/ocd-builddir-20230430-27428-11s71tt/environments/production/modules/ocf/manifests/packages/mysql_server.pp, line: 13, column: 8) on node segfault.ocf.berkeley.edu
  Error: Evaluation Error: Error while evaluating a Function Call, 'new' The string 'bookworm/sid' cannot be converted to Integer (file: /tmp/ocd-ipc-20230430-27336-1v7pgqn/ocd-builddir-20230430-27428-11s71tt/environments/production/modules/ocf/manifests/packages/mysql_server.pp, line: 13, column: 8) on node segfault.ocf.berkeley.edu
  Error: Could not call 'find' on 'catalog': Evaluation Error: Error while evaluating a Function Call, 'new' The string 'bookworm/sid' cannot be converted to Integer (file: /tmp/ocd-ipc-20230430-27336-1v7pgqn/ocd-builddir-20230430-27428-11s71tt/environments/production/modules/ocf/manifests/packages/mysql_server.pp, line: 13, column: 8) on node segfault.ocf.berkeley.edu
  Error: Could not call 'find' on 'catalog': Evaluation Error: Error while evaluating a Function Call, 'new' The string 'bookworm/sid' cannot be converted to Integer (file: /tmp/ocd-ipc-20230430-27336-1v7pgqn/ocd-builddir-20230430-27428-11s71tt/environments/production/modules/ocf/manifests/packages/mysql_server.pp, line: 13, column: 8) on node segfault.ocf.berkeley.edu
  Error: Try 'puppet help catalog compile' for usage
W, [2023-04-30T02:28:27.030800 #27428]  WARN -- : Failed build_catalog for origin/master validation: OctocatalogDiff::Errors::CatalogError Catalog failed: Warning: The function 'hiera_include' is deprecated in favor of using 'lookup'. See https://puppet.com/docs/puppet/7.21/deprecated_language.html
   (file & line not available)
Error: Evaluation Error: Error while evaluating a Function Call, 'new' The string 'bookworm/sid' cannot be converted to Integer (file: /tmp/ocd-ipc-20230430-27336-1v7pgqn/ocd-builddir-20230430-27428-11s71tt/environments/production/modules/ocf/manifests/packages/mysql_server.pp, line: 13, column: 8) on node segfault.ocf.berkeley.edu
Error: Evaluation Error: Error while evaluating a Function Call, 'new' The string 'bookworm/sid' cannot be converted to Integer (file: /tmp/ocd-ipc-20230430-27336-1v7pgqn/ocd-builddir-20230430-27428-11s71tt/environments/production/modules/ocf/manifests/packages/mysql_server.pp, line: 13, column: 8) on node segfault.ocf.berkeley.edu
Error: Could not call 'find' on 'catalog': Evaluation Error: Error while evaluating a Function Call, 'new' The string 'bookworm/sid' cannot be converted to Integer (file: /tmp/ocd-ipc-20230430-27336-1v7pgqn/ocd-builddir-20230430-27428-11s71tt/environments/production/modules/ocf/manifests/packages/mysql_server.pp, line: 13, column: 8) on node segfault.ocf.berkeley.edu
Error: Could not call 'find' on 'catalog': Evaluation Error: Error while evaluating a Function Call, 'new' The string 'bookworm/sid' cannot be converted to Integer (file: /tmp/ocd-ipc-20230430-27336-1v7pgqn/ocd-builddir-20230430-27428-11s71tt/environments/production/modules/ocf/manifests/packages/mysql_server.pp, line: 13, column: 8) on node segfault.ocf.berkeley.edu
Error: Try 'puppet help catalog compile' for usage

#<Thread:0x0000565299a8ab28@/usr/lib/ruby/2.5.0/open3.rb:264 run> terminated with exception (report_on_exception is true):
/usr/lib/ruby/2.5.0/open3.rb:264:in `read': stream closed in another thread (IOError)
	from /usr/lib/ruby/2.5.0/open3.rb:264:in `block (2 levels) in capture3'
#<Thread:0x0000565299a8a9e8@/usr/lib/ruby/2.5.0/open3.rb:265 run> terminated with exception (report_on_exception is true):
/usr/lib/ruby/2.5.0/open3.rb:265:in `read': stream closed in another thread (IOError)
	from /usr/lib/ruby/2.5.0/open3.rb:265:in `block (2 levels) in capture3'
/usr/lib/ruby/vendor_ruby/octocatalog-diff/util/catalogs.rb:259:in `catalog_validator': Catalog failed: Warning: The function 'hiera_include' is deprecated in favor of using 'lookup'. See https://puppet.com/docs/puppet/7.21/deprecated_language.html (OctocatalogDiff::Errors::CatalogError)
   (file & line not available)
Error: Evaluation Error: Error while evaluating a Function Call, 'new' The string 'bookworm/sid' cannot be converted to Integer (file: /tmp/ocd-ipc-20230430-27336-1v7pgqn/ocd-builddir-20230430-27428-11s71tt/environments/production/modules/ocf/manifests/packages/mysql_server.pp, line: 13, column: 8) on node segfault.ocf.berkeley.edu
Error: Evaluation Error: Error while evaluating a Function Call, 'new' The string 'bookworm/sid' cannot be converted to Integer (file: /tmp/ocd-ipc-20230430-27336-1v7pgqn/ocd-builddir-20230430-27428-11s71tt/environments/production/modules/ocf/manifests/packages/mysql_server.pp, line: 13, column: 8) on node segfault.ocf.berkeley.edu
Error: Could not call 'find' on 'catalog': Evaluation Error: Error while evaluating a Function Call, 'new' The string 'bookworm/sid' cannot be converted to Integer (file: /tmp/ocd-ipc-20230430-27336-1v7pgqn/ocd-builddir-20230430-27428-11s71tt/environments/production/modules/ocf/manifests/packages/mysql_server.pp, line: 13, column: 8) on node segfault.ocf.berkeley.edu
Error: Could not call 'find' on 'catalog': Evaluation Error: Error while evaluating a Function Call, 'new' The string 'bookworm/sid' cannot be converted to Integer (file: /tmp/ocd-ipc-20230430-27336-1v7pgqn/ocd-builddir-20230430-27428-11s71tt/environments/production/modules/ocf/manifests/packages/mysql_server.pp, line: 13, column: 8) on node segfault.ocf.berkeley.edu
Error: Try 'puppet help catalog compile' for usage
	from /usr/lib/ruby/vendor_ruby/octocatalog-diff/util/parallel.rb:39:in `call'
	from /usr/lib/ruby/vendor_ruby/octocatalog-diff/util/parallel.rb:39:in `validate'
	from /usr/lib/ruby/vendor_ruby/octocatalog-diff/util/parallel.rb:202:in `execute_task'
	from /usr/lib/ruby/vendor_ruby/octocatalog-diff/util/parallel.rb:119:in `block (2 levels) in run_tasks_parallel'
	from /usr/lib/ruby/vendor_ruby/octocatalog-diff/util/parallel.rb:117:in `fork'
	from /usr/lib/ruby/vendor_ruby/octocatalog-diff/util/parallel.rb:117:in `block in run_tasks_parallel'
	from /usr/lib/ruby/vendor_ruby/octocatalog-diff/util/parallel.rb:114:in `each'
	from /usr/lib/ruby/vendor_ruby/octocatalog-diff/util/parallel.rb:114:in `each_with_index'
	from /usr/lib/ruby/vendor_ruby/octocatalog-diff/util/parallel.rb:114:in `run_tasks_parallel'
	from /usr/lib/ruby/vendor_ruby/octocatalog-diff/util/parallel.rb:94:in `run_tasks'
	from /usr/lib/ruby/vendor_ruby/octocatalog-diff/util/catalogs.rb:92:in `build_catalog_parallelizer'
	from /usr/lib/ruby/vendor_ruby/octocatalog-diff/util/catalogs.rb:29:in `catalogs'
	from /usr/lib/ruby/vendor_ruby/octocatalog-diff/api/v1/catalog-diff.rb:34:in `catalog_diff'
	from /usr/lib/ruby/vendor_ruby/octocatalog-diff/api/v1.rb:19:in `catalog_diff'
	from /usr/lib/ruby/vendor_ruby/octocatalog-diff/cli.rb:151:in `run_octocatalog_diff'
	from /usr/lib/ruby/vendor_ruby/octocatalog-diff/cli.rb:125:in `cli'
	from /usr/bin/octocatalog-diff:34:in `<main>'

Changed hosts

diff for hal.ocf.berkeley.edu

*******************************************
- Cron[check-rsnapshot-backups]
*******************************************
  Cron[rsnapshot-daily] =>
   parameters =>
     command =>
      - rsnapshot -c /opt/share/backups/rsnapshot.conf sync && rsnapshot -c /opt/share/backups/rsnapshot.conf daily
      + /usr/local/sbin/backup-zfs.sh | tee -a /var/log/zfs-backup.log
     hour =>
      - 2
      + 03
     minute =>
      - 0
      + 00
*******************************************
- Cron[rsnapshot-monthly]
*******************************************
- Cron[rsnapshot-weekly]
*******************************************
+ File[/etc/logrotate.d/backup-zfs] =>
   parameters =>
     "backup": "main",
     "content": "/var/log/ocf-backup-zfs.log {\n\trotate 100\n\tdaily\n\tcompress...
     "group": "root",
     "mode": "0644",
     "owner": "root"
*******************************************
  File[/opt/share/backups/backup-mysql] =>
   parameters =>
     content =>
      @@ -19,3 +19,3 @@
                    --routines \
                    --single-transaction \
      -             --databases {} | pigz > "mysql-{}-$(date +%F).sql.gz"' -- $databases
      +             --databases {} > "mysql-{}-$(date +%F).sql"' -- $databases
*******************************************
  File[/opt/share/backups/backup-pgsql] =>
   parameters =>
     content =>
      @@ -4,3 +4,3 @@
       # Dumps the entire PostgreSQL instance to one .sql file.
       # Requires that a valid ~/.pgpass file be available on the PostgreSQL host
      -ssh -K ocfbackups@postgres 'pg_dumpall -U postgres -h localhost | pigz' > "pgsql-all-$(date +%F).sql.gz"
      +ssh -K ocfbackups@postgres 'pg_dumpall -U postgres -h localhost' > "pgsql-all-$(date +%F).sql"
*******************************************
+ File[/opt/share/backups/offsite-host] =>
   parameters =>
     "backup": "main",
     "content": "dummyhost",
     "group": "root",
     "mode": "0400",
     "owner": "root"
*******************************************
+ File[/opt/share/backups/rsnapshot-zfs-git.conf] =>
   parameters =>
     "backup": "main",
     "content": "#################################################\n# rsnapshot.c...
     "group": "root",
     "mode": "0644",
     "owner": "root"
*******************************************
+ File[/opt/share/backups/rsnapshot-zfs-mysql.conf] =>
   parameters =>
     "backup": "main",
     "content": "#################################################\n# rsnapshot.c...
     "group": "root",
     "mode": "0644",
     "owner": "root"
*******************************************
+ File[/opt/share/backups/rsnapshot-zfs-pgsql.conf] =>
   parameters =>
     "backup": "main",
     "content": "#################################################\n# rsnapshot.c...
     "group": "root",
     "mode": "0644",
     "owner": "root"
*******************************************
+ File[/opt/share/backups/rsnapshot-zfs.conf] =>
   parameters =>
     "backup": "main",
     "content": "#################################################\n# rsnapshot.c...
     "group": "root",
     "mode": "0644",
     "owner": "root"
*******************************************
+ File[/usr/local/sbin/backup-zfs.sh] =>
   parameters =>
     "backup": "main",
     "content": "#!/bin/bash\n\nCURRENT_SNAPSHOT_FILE=/opt/share/backups/current-...
     "group": "root",
     "mode": "0755",
     "owner": "root"
*******************************************

Unaffected hosts

acid.ocf.berkeley.edu
anthrax.ocf.berkeley.edu
arsenic.ocf.berkeley.edu
asteroid.ocf.berkeley.edu
autocrat.ocf.berkeley.edu
avalanche.ocf.berkeley.edu
bedbugs.ocf.berkeley.edu
bigbang.ocf.berkeley.edu
biohazard.ocf.berkeley.edu
blackout.ocf.berkeley.edu
blight.ocf.berkeley.edu
blizzard.ocf.berkeley.edu
chaos.ocf.berkeley.edu
corruption.ocf.berkeley.edu
coup.ocf.berkeley.edu
cyanide.ocf.berkeley.edu
cyclone.ocf.berkeley.edu
dataloss.ocf.berkeley.edu
deadlock.ocf.berkeley.edu
death.ocf.berkeley.edu
dementors.ocf.berkeley.edu
democracy.ocf.berkeley.edu
destruction.ocf.berkeley.edu
drought.ocf.berkeley.edu
fallingrocks.ocf.berkeley.edu
falsevacuum.ocf.berkeley.edu
famine.ocf.berkeley.edu
firestorm.ocf.berkeley.edu
firewhirl.ocf.berkeley.edu
flood.ocf.berkeley.edu
fraud.ocf.berkeley.edu
gridlock.ocf.berkeley.edu
hailstorm.ocf.berkeley.edu
headcrash.ocf.berkeley.edu
heatwave.ocf.berkeley.edu
hurricane.ocf.berkeley.edu
hypoxia.ocf.berkeley.edu
invasion.ocf.berkeley.edu
lethe.ocf.berkeley.edu
lightning.ocf.berkeley.edu
madcow.ocf.berkeley.edu
maelstrom.ocf.berkeley.edu
meteorstorm.ocf.berkeley.edu
outbreak.ocf.berkeley.edu
pestilence.ocf.berkeley.edu
plague.ocf.berkeley.edu
quarantine.ocf.berkeley.edu
reaper.ocf.berkeley.edu
riptide.ocf.berkeley.edu
scurvy.ocf.berkeley.edu
sinkhole.ocf.berkeley.edu
solarflare.ocf.berkeley.edu
supernova.ocf.berkeley.edu
surge.ocf.berkeley.edu
thunder.ocf.berkeley.edu
tornado.ocf.berkeley.edu
tsunami.ocf.berkeley.edu
typhoon.ocf.berkeley.edu
vampires.ocf.berkeley.edu
venom.ocf.berkeley.edu
volcano.ocf.berkeley.edu
whiteout.ocf.berkeley.edu
wildfire.ocf.berkeley.edu
windshear.ocf.berkeley.edu

Jenkins

This reverts commit a2035a1.

ocfjenkins · 2023-08-04T12:32:45Z

Errored hosts (0)

Changed hosts (1)

Unaffected hosts (56)

Changed hosts

diff for hal.ocf.berkeley.edu

*******************************************
- Cron[check-rsnapshot-backups]
*******************************************
  Cron[rsnapshot-daily] =>
   parameters =>
     command =>
      - rsnapshot -c /opt/share/backups/rsnapshot.conf sync && rsnapshot -c /opt/share/backups/rsnapshot.conf daily
      + /usr/local/sbin/backup-zfs.sh | tee -a /var/log/zfs-backup.log
     hour =>
      - 2
      + 03
     minute =>
      - 0
      + 00
*******************************************
- Cron[rsnapshot-monthly]
*******************************************
- Cron[rsnapshot-weekly]
*******************************************
+ File[/etc/logrotate.d/backup-zfs] =>
   parameters =>
     "backup": "main",
     "content": "/var/log/ocf-backup-zfs.log {\n\trotate 100\n\tdaily\n\tcompress...
     "group": "root",
     "mode": "0644",
     "owner": "root"
*******************************************
  File[/opt/share/backups/backup-mysql] =>
   parameters =>
     content =>
      @@ -19,3 +19,3 @@
                    --routines \
                    --single-transaction \
      -             --databases {} | pigz > "mysql-{}-$(date +%F).sql.gz"' -- $databases
      +             --databases {} > "mysql-{}-$(date +%F).sql"' -- $databases
*******************************************
  File[/opt/share/backups/backup-pgsql] =>
   parameters =>
     content =>
      @@ -4,3 +4,3 @@
       # Dumps the entire PostgreSQL instance to one .sql file.
       # Requires that a valid ~/.pgpass file be available on the PostgreSQL host
      -ssh -K ocfbackups@postgres 'pg_dumpall -U postgres -h localhost | pigz' > "pgsql-all-$(date +%F).sql.gz"
      +ssh -K ocfbackups@postgres 'pg_dumpall -U postgres -h localhost' > "pgsql-all-$(date +%F).sql"
*******************************************
+ File[/opt/share/backups/offsite-host] =>
   parameters =>
     "backup": "main",
     "content": "dummyhost",
     "group": "root",
     "mode": "0400",
     "owner": "root"
*******************************************
+ File[/opt/share/backups/rsnapshot-zfs-git.conf] =>
   parameters =>
     "backup": "main",
     "content": "#################################################\n# rsnapshot.c...
     "group": "root",
     "mode": "0644",
     "owner": "root"
*******************************************
+ File[/opt/share/backups/rsnapshot-zfs-mysql.conf] =>
   parameters =>
     "backup": "main",
     "content": "#################################################\n# rsnapshot.c...
     "group": "root",
     "mode": "0644",
     "owner": "root"
*******************************************
+ File[/opt/share/backups/rsnapshot-zfs-pgsql.conf] =>
   parameters =>
     "backup": "main",
     "content": "#################################################\n# rsnapshot.c...
     "group": "root",
     "mode": "0644",
     "owner": "root"
*******************************************
+ File[/opt/share/backups/rsnapshot-zfs.conf] =>
   parameters =>
     "backup": "main",
     "content": "#################################################\n# rsnapshot.c...
     "group": "root",
     "mode": "0644",
     "owner": "root"
*******************************************
+ File[/usr/local/sbin/backup-zfs.sh] =>
   parameters =>
     "backup": "main",
     "content": "#!/bin/bash\n\nCURRENT_SNAPSHOT_FILE=/opt/share/backups/current-...
     "group": "root",
     "mode": "0755",
     "owner": "root"
*******************************************

Unaffected hosts

acid.ocf.berkeley.edu
anthrax.ocf.berkeley.edu
arsenic.ocf.berkeley.edu
asteroid.ocf.berkeley.edu
autocrat.ocf.berkeley.edu
avalanche.ocf.berkeley.edu
bedbugs.ocf.berkeley.edu
bigbang.ocf.berkeley.edu
biohazard.ocf.berkeley.edu
blackout.ocf.berkeley.edu
blight.ocf.berkeley.edu
blizzard.ocf.berkeley.edu
chaos.ocf.berkeley.edu
corruption.ocf.berkeley.edu
coup.ocf.berkeley.edu
cyanide.ocf.berkeley.edu
cyclone.ocf.berkeley.edu
dataloss.ocf.berkeley.edu
deadlock.ocf.berkeley.edu
death.ocf.berkeley.edu
dementors.ocf.berkeley.edu
democracy.ocf.berkeley.edu
destruction.ocf.berkeley.edu
drought.ocf.berkeley.edu
fallingrocks.ocf.berkeley.edu
famine.ocf.berkeley.edu
firestorm.ocf.berkeley.edu
firewhirl.ocf.berkeley.edu
flood.ocf.berkeley.edu
fraud.ocf.berkeley.edu
gridlock.ocf.berkeley.edu
hailstorm.ocf.berkeley.edu
headcrash.ocf.berkeley.edu
heatwave.ocf.berkeley.edu
hurricane.ocf.berkeley.edu
implosion.ocf.berkeley.edu
invasion.ocf.berkeley.edu
lethe.ocf.berkeley.edu
lightning.ocf.berkeley.edu
maelstrom.ocf.berkeley.edu
outbreak.ocf.berkeley.edu
pestilence.ocf.berkeley.edu
plague.ocf.berkeley.edu
reaper.ocf.berkeley.edu
riptide.ocf.berkeley.edu
scurvy.ocf.berkeley.edu
segfault.ocf.berkeley.edu
sinkhole.ocf.berkeley.edu
supernova.ocf.berkeley.edu
thunder.ocf.berkeley.edu
tsunami.ocf.berkeley.edu
vampires.ocf.berkeley.edu
volcano.ocf.berkeley.edu
whiteout.ocf.berkeley.edu
wildfire.ocf.berkeley.edu
windshear.ocf.berkeley.edu

Jenkins

singingtelegram added 3 commits October 19, 2022 02:31

feat: zfs-based rsnapshot backup

2466a3f

more work

db127fe

lint & shellcheck

d8bdaec

Update rsnapshot-zfs.conf

be1b32c

Revert "Update rsnapshot-zfs.conf"

3fe9d12

This reverts commit be1b32c.

Merge remote-tracking branch 'origin/master' into zfs-backup

849913a

singingtelegram added 2 commits October 24, 2022 22:43

remove old backup jobs

556f887

fix: syntax

35f8d53

singingtelegram force-pushed the zfs-backup branch from 76a66d0 to bca06eb Compare October 26, 2022 05:13

change time

cf4adcd

singingtelegram force-pushed the zfs-backup branch from bca06eb to cf4adcd Compare October 26, 2022 05:15

singingtelegram added 2 commits October 29, 2022 14:18

Merge remote-tracking branch 'origin/master' into zfs-backup

dc4f458

feat: use zfs native compression for sql

4a4fd79

fix: zfs send args

6021225

feat: syncoid instead of raw zfs send commands

823d271

feat: logging and logrotate

44e5124

singingtelegram added 2 commits November 21, 2022 01:51

feat: reduce verbosity

515e96f

fix: disable healthcheck on videolan-ftp

c8f4f51

timestamp file on source is empty

dpark00 and others added 22 commits April 30, 2023 02:23

changed apply to spring 2023 (#1348)

8140ffa

add ewdc ip

8bf7f2c

fix: update chrome and electron apps automatically (#1349)

1321235

fix: guess what they changed the codename in 11!!

bf3c305

automatically bump version to 1.5.0 (#1343)

310c0d1

remove rmxu from root staff (#1350)

dfd6e6d

Co-authored-by: rmxu <[email protected]>

sp23: trim root ACL

7994dcf

The people removed were notified last semester, kmo requested an extension to the end of that semester, so that was done.

fix: proper root principal for ncograin

62eec41

Add SSL configuration to windshear (#1354)

62ffaf2

fix: don't redirect on ocf.b.e (#1251)

9221801

* fix: don't redirect on ocf.b.e * fix: it's actually here, see if it works * fix: it works * fix: remove server cors not necessary * fix: wrong one

Add slidingsync.matrix (#1355)

41196fc

* Add slidingsync.matrix to load balancer * Add sliding sync to matrix/client well-known

Update www.pp

72a3630

Add subdomains@ RT queue (#1356)

e108471

Add subdomains shorturl (#1357)

4086720

Update opstaff hiring form link (#1358)

e871503

Add matrix client well-known authentication issuer (#1359)

7d483ee

fix: TLSv1.2

9d6bfed

fix SSL config to support TLS 1.2, update cipher list

revert

ed3adc8

emerg

Update GitHub SSH public key (#1360)

c55c47e

Fix matrix well-known typo

6e8d3f3

feat: smart monitoring (#1362)

f360be9

* feat: smart monitoring

fix: do not send intermediate snapshots

a2035a1

singingtelegram added 2 commits August 4, 2023 05:28

Revert "fix: do not send intermediate snapshots"

d66a8d1

This reverts commit a2035a1.

fix merge conflict

1037876

singingtelegram added 3 commits February 7, 2025 00:20

Merge remote-tracking branch 'origin/master' into zfs-backup

30da319

feat: take advantage of CoW

7d9ff00

fix: remove timestamp from sql backups

f9b5c79

implement ZFS-backed rsnapshot backup #1325

Are you sure you want to change the base?

implement ZFS-backed rsnapshot backup #1325

Uh oh!

Conversation

singingtelegram commented Oct 19, 2022 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

ocfjenkins bot commented Oct 19, 2022

Errored hosts (0)

Changed hosts (1)

Unaffected hosts (77)

Uh oh!

ocfjenkins bot commented Oct 24, 2022

Errored hosts (0)

Changed hosts (1)

Unaffected hosts (77)

Uh oh!

ocfjenkins bot commented Oct 24, 2022

Errored hosts (0)

Changed hosts (1)

Unaffected hosts (77)

Uh oh!

ocfjenkins bot commented Oct 25, 2022

Errored hosts (0)

Changed hosts (1)

Unaffected hosts (77)

Uh oh!

ocfjenkins bot commented Oct 25, 2022

Errored hosts (0)

Changed hosts (1)

Unaffected hosts (77)

Uh oh!

ocfjenkins bot commented Oct 26, 2022

Errored hosts (0)

Changed hosts (1)

Unaffected hosts (77)

Uh oh!

ocfjenkins bot commented Oct 26, 2022

Errored hosts (0)

Changed hosts (1)

Unaffected hosts (77)

Uh oh!

ocfjenkins bot commented Oct 29, 2022

Errored hosts (1)

Changed hosts (1)

Unaffected hosts (77)

Uh oh!

ocfjenkins bot commented Oct 29, 2022

Errored hosts (1)

Changed hosts (1)

Unaffected hosts (77)

Uh oh!

ocfjenkins bot commented Nov 6, 2022

Errored hosts (2)

Changed hosts (1)

Unaffected hosts (79)

Uh oh!

ocfjenkins bot commented Nov 6, 2022

Errored hosts (2)

Changed hosts (1)

Unaffected hosts (79)

Uh oh!

ocfjenkins bot commented Nov 7, 2022

Errored hosts (1)

Changed hosts (1)

Unaffected hosts (79)

Uh oh!

ocfjenkins bot commented Apr 30, 2023

Errored hosts (1)

Changed hosts (1)

Unaffected hosts (64)

Uh oh!

ocfjenkins bot commented Apr 30, 2023

Errored hosts (1)

Changed hosts (1)

Unaffected hosts (64)

Uh oh!

ocfjenkins bot commented Aug 4, 2023

Errored hosts (0)

singingtelegram commented Oct 19, 2022 •

edited

Loading