d33p.js<p>Strange things happend in my homelab - as always in IT 😏 .</p><p>Intel NUC with an *additional* 2,5" HDD (yes, 5400 RPM Harddisk, not an SSD). Had like 20 Docker Container running on it.</p><p>A couple of weeks ago I started see some wired things happening at one of the Docker Images (just one! Grafana, Graylog... everything works fine). A Nextcloud Instance failed. Some Files just broke?! Like I mean .php Files that suddenly had garbage in them. At least, the Nextcloud Image brings original Files (/usr/src/nextcloud) with them, so I could copy the working ones over the broken ones. Problem fixed. For now at least.</p><p>A week later. Same thing. Fixing the error (some other files with garbage in them). Done.<br>Couple of days later: Some problem again. WTF?</p><p>I tried to investigate and be sure it's not some sort of an cyber attack. But spending hours of forensics, there wasn't any artifacts of an attack.</p><p>Then I thought it might be a bug in Nextcloud. Because I found a coincidence: Every time watchtower was updating Nextcloud, it failed with creating garbage files (randomly). But no one else had any problem, so I investigated further. </p><p>After a couple of hours I made a quick S.M.A.R.T. check (although I don't entirely trust it). Nothing. Then an fsck. Some errors were found and fixed. Puh!</p><p>So I thought, that's it: After a Power Failure a couple of weeks ago, I had issues with the Filesystem. fsck fixed it. And could move on. </p><p>But, of course... this wasn't the end. With the upcoming Nextcloud updated, it failed again.</p><p>I ran the old checks again: but fsck couldn't find any errors. But I had still broken php files - just inside the Nextcloud Container.</p><p>Because the problem smelled fishy, I forced a long S.M.A.R.T. check and..... it got interrupted because of a couple of errors. </p><p>The End of the story: I'm switching to a new Drive which (probably?) fixes the problem.</p><p>The point of the Story:</p><p>1. Some things are easier than they seem. It was just a plain old hardware failure. No sophisticated cyberattack, nor an critical nextcloud bug.</p><p>2. Look at an error from different point of views. Even fsck and S.M.A.R.T. (smartctl) could point you to the wrong direction.</p><p>For the ones who like to see how to temporary fix the nextcloud issue, nextcloud community helped me: <a href="https://help.nextcloud.com/t/strange-error-class-oca-themingcontroller-does-not-exist/196455/12" rel="nofollow noopener noreferrer" translate="no" target="_blank"><span class="invisible">https://</span><span class="ellipsis">help.nextcloud.com/t/strange-e</span><span class="invisible">rror-class-oca-themingcontroller-does-not-exist/196455/12</span></a></p><p><a href="https://infosec.exchange/tags/harddrive" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>harddrive</span></a> <a href="https://infosec.exchange/tags/harddrives" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>harddrives</span></a> <a href="https://infosec.exchange/tags/hdd" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>hdd</span></a> <a href="https://infosec.exchange/tags/hdds" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>hdds</span></a> <a href="https://infosec.exchange/tags/ssd" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>ssd</span></a> <a href="https://infosec.exchange/tags/ssds" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>ssds</span></a> <a href="https://infosec.exchange/tags/storage" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>storage</span></a> <a href="https://infosec.exchange/tags/nextcloud" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>nextcloud</span></a> <a href="https://infosec.exchange/tags/failure" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>failure</span></a> <a href="https://infosec.exchange/tags/SmartMonitor" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>SmartMonitor</span></a></p>