Maintenance: Peertube Media Migration
Started december 20, 8:30p CET, videos of the tchncs PeerTube instance are moving to a new, more flexible home. At the time of writing, we are at over 5.5 TB of video storage.
Status updates
- Dec 31, 4p: The remaining issue is a compatibility problem with permissions set by PeerTube to the storage objects. A few videos are failing to be moved to remote storage (they fail at the last step but files are in fact moved successfully usually). You can play around with resolution to work around playback issues or try to reupload the video if it's urgent. Here is the bugreport to the issue. I am not sure why some videos work and some don't.
- Dec 29, 5p: A problem with the media proxy-server was identified. As a result, the machine is no longer starving of available bandwidth. This results in smoooother playback and overall better instance snappiness.
- Dec 28, 5p: First round done, re-initiated migration to catch and transfer failed videos due to flaky old storage backend
- Dec 26, 10a: 4.9 TB of 5.5+ TB
Benefits of the new location
- higher availability and overall reliability: the old network storage became unavailable from time to time over the years, sometimes outages, sometimes maintenances.
- scalability: the network storage drive has a maximum amount of storage you can rent. The new storage will not have such a restriction.
- redundancy: the storage can (easier) be replicated to a different location
Challenges / known migration issues
- hidden videos: it appears that PeerTube hides videos that are pending migration
- videos that failed to move: it appears that the network storage became even more unreliable during the migration. This in turn appears to cause video moving to fail from time to time. These videos will remain hidden. I will try to reinvoke the migration when the queue of pending videos to move is empty.
All it takes is patience
As of right now, there is no reason to worry. Everything is under control, but the process will still take a couple of days. Please be patient. 😇
How to contact me:
Follow me on Mastodon / More options on tchncs.de