Backup and Recovery - Revision history

Adj: /* Moving forward */

2026-03-18T01:00:33Z

Moving forward

← Older revision		Revision as of 01:00, 18 March 2026
Line 52:		Line 52:
	* [https://bareos.org/ Bareos], a free software backup and recovery software package that supports Linux (for both servers and clients), OSX, and Windows clients. This provides a centralized client/server backup service.		* [https://bareos.org/ Bareos], a free software backup and recovery software package that supports Linux (for both servers and clients), OSX, and Windows clients. This provides a centralized client/server backup service.
	* [https://restic.net/ restic], another free software backup and recovery package. This one is more distributed in nature, has other features that make it attractive, too. Also supports Linux, Windows, and OSX.		* [https://restic.net/ restic], another free software backup and recovery package. This one is more distributed in nature, has other features that make it attractive, too. Also supports Linux, Windows, and OSX.

			And some actual deployment here:
			* [[ Bareos ]]
			* [[ Restic ]]

Adj: /* Moving forward */

2025-06-06T22:45:21Z

Moving forward

← Older revision		Revision as of 22:45, 6 June 2025
Line 40:		Line 40:
	** Approx 7Tbytes of usable space available for spooling of backup data, in 4 disk (2+2) RAIDZ2 ZFS pool.		** Approx 7Tbytes of usable space available for spooling of backup data, in 4 disk (2+2) RAIDZ2 ZFS pool.
	* A Dell PowerVault MD3060e external disk enclosure with 60x 2Tbyte SATA disk drives installed. This device can be powered off independently of bitkeeper-0, providing a mostly offline data storage space. Depending on configuration, this will provide 60-90 Tbytes of capacity for backup space.		* A Dell PowerVault MD3060e external disk enclosure with 60x 2Tbyte SATA disk drives installed. This device can be powered off independently of bitkeeper-0, providing a mostly offline data storage space. Depending on configuration, this will provide 60-90 Tbytes of capacity for backup space.
	* One [https://ceph.com/ Ceph] cluster (<code>fnord-201802</code>) with approximately ~~12Tbytes~~ of usable space available. This storage is made available over the Amazon AWS S3 protocol, a network filesystem, and as raw block devices~~. As this is written, available space in this cluster is being increased to approximately 15Tbytes~~.		* One [https://ceph.com/ Ceph] cluster (<code>fnord-201802</code>) with approximately 15Tbytes of usable space available. This storage is made available over the Amazon AWS S3 protocol, a network filesystem, and as raw block devices.
	* One HP MSL 4048 tape library equipped with 2x LTO-5 drives. This library will hold 48 tape cartridges, each of 1.5Tbytes capacity. Tape cartridges are removable and may be taken off site for long term storage. Perhaps to a trusted friend's house, a climate controlled storage facility, or a bank safe deposit box.		* One HP MSL 4048 tape library equipped with 2x LTO-5 drives. This library will hold 48 tape cartridges, each of 1.5Tbytes capacity. Tape cartridges are removable and may be taken off site for long term storage. Perhaps to a trusted friend's house, a climate controlled storage facility, or a bank safe deposit box.
	* One IT nerd. Who likes Linux (especially Debian), UNIX in general, and doing data storage.		* One IT nerd. Who likes Linux (especially Debian), UNIX in general, and doing data storage.
Line 47:		Line 47:
	* Computer nerd friend in Aurora who likes Ceph.		* Computer nerd friend in Aurora who likes Ceph.
	* Computer nerd friend in Longmont who is not currently into Ceph, but could perhaps spin up [https://min.io/ minio].		* Computer nerd friend in Longmont who is not currently into Ceph, but could perhaps spin up [https://min.io/ minio].
			* Computer nerd friend in Fort Collins who is not into Ceph, but has expressed an interest in off-site backups for his own stuff. May be able to talk him into running [https://min.io/ minio] as well.

	Tools to be used:		Tools to be used:

Adj: /* Moving forward */

2025-06-02T01:07:45Z

Moving forward

← Older revision		Revision as of 01:07, 2 June 2025
Line 43:		Line 43:
	* One HP MSL 4048 tape library equipped with 2x LTO-5 drives. This library will hold 48 tape cartridges, each of 1.5Tbytes capacity. Tape cartridges are removable and may be taken off site for long term storage. Perhaps to a trusted friend's house, a climate controlled storage facility, or a bank safe deposit box.		* One HP MSL 4048 tape library equipped with 2x LTO-5 drives. This library will hold 48 tape cartridges, each of 1.5Tbytes capacity. Tape cartridges are removable and may be taken off site for long term storage. Perhaps to a trusted friend's house, a climate controlled storage facility, or a bank safe deposit box.
	* One IT nerd. Who likes Linux (especially Debian), UNIX in general, and doing data storage.		* One IT nerd. Who likes Linux (especially Debian), UNIX in general, and doing data storage.

			Potential future external free resources:
			* Computer nerd friend in Aurora who likes Ceph.
			* Computer nerd friend in Longmont who is not currently into Ceph, but could perhaps spin up [https://min.io/ minio].

	Tools to be used:		Tools to be used:

Adj: /* Moving forward */

2025-06-01T18:07:40Z

Moving forward

← Older revision		Revision as of 18:07, 1 June 2025
Line 40:		Line 40:
	** Approx 7Tbytes of usable space available for spooling of backup data, in 4 disk (2+2) RAIDZ2 ZFS pool.		** Approx 7Tbytes of usable space available for spooling of backup data, in 4 disk (2+2) RAIDZ2 ZFS pool.
	* A Dell PowerVault MD3060e external disk enclosure with 60x 2Tbyte SATA disk drives installed. This device can be powered off independently of bitkeeper-0, providing a mostly offline data storage space. Depending on configuration, this will provide 60-90 Tbytes of capacity for backup space.		* A Dell PowerVault MD3060e external disk enclosure with 60x 2Tbyte SATA disk drives installed. This device can be powered off independently of bitkeeper-0, providing a mostly offline data storage space. Depending on configuration, this will provide 60-90 Tbytes of capacity for backup space.
	* One [https://ceph.com/ Ceph] cluster (<code>fnord-201802</code>) with approximately 12Tbytes of usable space available. This storage is made available over the Amazon AWS S3 protocol, a network filesystem, and as raw block devices. As this is written, ~~usable~~ space in this cluster is being increased to approximately 15Tbytes.		* One [https://ceph.com/ Ceph] cluster (<code>fnord-201802</code>) with approximately 12Tbytes of usable space available. This storage is made available over the Amazon AWS S3 protocol, a network filesystem, and as raw block devices. As this is written, available space in this cluster is being increased to approximately 15Tbytes.
	* One HP MSL 4048 tape library equipped with 2x LTO-5 drives. This library will hold 48 tape cartridges, each of 1.5Tbytes capacity. Tape cartridges are removable and may be taken off site for long term storage. Perhaps to a trusted friend's house, a climate controlled storage facility, or a bank safe deposit box.		* One HP MSL 4048 tape library equipped with 2x LTO-5 drives. This library will hold 48 tape cartridges, each of 1.5Tbytes capacity. Tape cartridges are removable and may be taken off site for long term storage. Perhaps to a trusted friend's house, a climate controlled storage facility, or a bank safe deposit box.
	* One IT nerd. Who likes Linux (especially Debian), UNIX in general, and doing data storage.		* One IT nerd. Who likes Linux (especially Debian), UNIX in general, and doing data storage.

Adj: /* Moving forward */

2025-06-01T15:59:09Z

Moving forward

← Older revision		Revision as of 15:59, 1 June 2025
Line 45:		Line 45:

	Tools to be used:		Tools to be used:
	* [https://bareos.org/ Bareos], a free software backup and recovery software package that supports Linux (for both servers and clients) and Windows clients. This provides a centralized client/server backup service.		* [https://bareos.org/ Bareos], a free software backup and recovery software package that supports Linux (for both servers and clients), OSX, and Windows clients. This provides a centralized client/server backup service.
	* [https://restic.net/ restic], another free software backup and recovery package. This one is more distributed in nature, has other features that make it attractive, too.		* [https://restic.net/ restic], another free software backup and recovery package. This one is more distributed in nature, has other features that make it attractive, too. Also supports Linux, Windows, and OSX.

Adj at 15:57, 1 June 2025

2025-06-01T15:57:37Z

@@ Line 1: / Line 1: @@
 == Current state of affairs ==
 (Early June 2025)
@@ Line 11: / Line 5: @@
 A very quick survey of the Linux systems counts approximately 2615Gbytes of data being used.  Much of this is likely to be duplicated picture archives.
 == Data classification ==

Adj: /* Moving forward */

2025-06-01T15:56:43Z

Moving forward

← Older revision		Revision as of 15:56, 1 June 2025
Line 34:		Line 34:
	* Any dependencies on external data vendors (cloud backup companies, etc) be minimal in dollar expenditure.		* Any dependencies on external data vendors (cloud backup companies, etc) be minimal in dollar expenditure.
	** Some vendors are cheap for upload and storage, but charge for retrieval. These are still worth exploring.		** Some vendors are cheap for upload and storage, but charge for retrieval. These are still worth exploring.
			* External storage entities are unable to examine or retrieve the data being stored.

	Existing resources:		Existing resources:

Adj: /* Current state of affairs */

2025-06-01T15:55:11Z

Current state of affairs

← Older revision		Revision as of 15:55, 1 June 2025
Line 9:		Line 9:

	There are 30+ computers in the house, mostly Debian GNU/Linux machines both physical and virtual. 4 or so Windows machines. One OSX (MacOS, whatever) Macbook Pro. 4+ phones. And probably a few other things. There is '''no''' centralized backup happening for any of these, though individual hardware failures are well protected against with redundant storage. This does not help in the cases of a fat finger event or Windows malware infection, though.		There are 30+ computers in the house, mostly Debian GNU/Linux machines both physical and virtual. 4 or so Windows machines. One OSX (MacOS, whatever) Macbook Pro. 4+ phones. And probably a few other things. There is '''no''' centralized backup happening for any of these, though individual hardware failures are well protected against with redundant storage. This does not help in the cases of a fat finger event or Windows malware infection, though.

			A very quick survey of the Linux systems counts approximately 2615Gbytes of data being used. Much of this is likely to be duplicated picture archives.

	== Data classification ==		== Data classification ==

Adj: /* Moving forward */

2025-06-01T15:49:31Z

Moving forward

← Older revision		Revision as of 15:49, 1 June 2025
Line 39:		Line 39:
	* One [https://ceph.com/ Ceph] cluster (<code>fnord-201802</code>) with approximately 12Tbytes of usable space available. This storage is made available over the Amazon AWS S3 protocol, a network filesystem, and as raw block devices. As this is written, usable space in this cluster is being increased to approximately 15Tbytes.		* One [https://ceph.com/ Ceph] cluster (<code>fnord-201802</code>) with approximately 12Tbytes of usable space available. This storage is made available over the Amazon AWS S3 protocol, a network filesystem, and as raw block devices. As this is written, usable space in this cluster is being increased to approximately 15Tbytes.
	* One HP MSL 4048 tape library equipped with 2x LTO-5 drives. This library will hold 48 tape cartridges, each of 1.5Tbytes capacity. Tape cartridges are removable and may be taken off site for long term storage. Perhaps to a trusted friend's house, a climate controlled storage facility, or a bank safe deposit box.		* One HP MSL 4048 tape library equipped with 2x LTO-5 drives. This library will hold 48 tape cartridges, each of 1.5Tbytes capacity. Tape cartridges are removable and may be taken off site for long term storage. Perhaps to a trusted friend's house, a climate controlled storage facility, or a bank safe deposit box.
			* One IT nerd. Who likes Linux (especially Debian), UNIX in general, and doing data storage.

	Tools to be used:		Tools to be used:

Adj: /* Moving forward */

2025-06-01T15:48:00Z

Moving forward

← Older revision		Revision as of 15:48, 1 June 2025
Line 42:		Line 42:
	Tools to be used:		Tools to be used:
	* [https://bareos.org/ Bareos], a free software backup and recovery software package that supports Linux (for both servers and clients) and Windows clients. This provides a centralized client/server backup service.		* [https://bareos.org/ Bareos], a free software backup and recovery software package that supports Linux (for both servers and clients) and Windows clients. This provides a centralized client/server backup service.
	* [https://~~github~~.~~com~~/~~restic/restic~~ restic], another free software backup and recovery package. This one is more distributed in nature, has other features that make it attractive, too.		* [https://restic.net/ restic], another free software backup and recovery package. This one is more distributed in nature, has other features that make it attractive, too.