Mad Cow - Revision history

Adj: /* Equipment involved in making this happen */

2025-05-08T16:56:25Z

Equipment involved in making this happen

← Older revision		Revision as of 16:56, 8 May 2025
Line 16:		Line 16:

	== Equipment involved in making this happen ==		== Equipment involved in making this happen ==
	* tanstaafl, an HP (no 'E') 9000 rp3440, 2U PA-RISC server running the Debian (unreleased port for this architecture) -- this will be the FC client machine
	* fnord-201802 Ceph cluster (currently 3 HP (also no 'E') DL380e servers running Debian 12 for amd64 with 10Gbits/sec Ethernet connectivity) -- backend storage		* fnord-201802 Ceph cluster (currently 3 HP (also no 'E') DL380e servers running Debian 12 for amd64 with 10Gbits/sec Ethernet connectivity) -- backend storage
	* zarathud, a Dell PowerEdge R620 server running Debian 11 with plenty of connectivity to the Ceph cluster (10GbE and 40/56GbE both) and plenty of connectivity to the Fibre Channel fabrics -- the gateway between the Ceph backend storage and the client system		* zarathud, a Dell PowerEdge R620 server running Debian 11 with plenty of connectivity to the Ceph cluster (10GbE and 40/56GbE both) and plenty of connectivity to the Fibre Channel fabrics -- the gateway between the Ceph backend storage and the client system. This machine is also the client in this case. It has both a dual-port Qlogic Fibre Channel HBA (the target) and a dual-port Emulex HBA (the initiator).
	* Brocade 5100 FibreChannel switch(es) -- these run a locked down Linux CLI for configuration and management		* Brocade 5100 FibreChannel switch(es) -- these run a locked down Linux CLI for configuration and management

Adj: /* How to do it */

2025-05-08T16:54:26Z

How to do it

← Older revision		Revision as of 16:54, 8 May 2025
Line 36:		Line 36:
	# Get the Fibre Channel switch's/switches' zoning configuration set so that initiators (the client servers) and see the target (gateway) ports on the fabric can communicate. See the [[Brocade Fibre Channel zoning]] article.		# Get the Fibre Channel switch's/switches' zoning configuration set so that initiators (the client servers) and see the target (gateway) ports on the fabric can communicate. See the [[Brocade Fibre Channel zoning]] article.
	# Create an RBD in the Ceph cluster and map it to the gateway machine (something like <code>sudo rbd --cluster fnord-201802 --id zarathud-rbd map zarathud-fc-target-lun-1</code>)		# Create an RBD in the Ceph cluster and map it to the gateway machine (something like <code>sudo rbd --cluster fnord-201802 --id zarathud-rbd map zarathud-fc-target-lun-1</code>)
	# use the targetcli management tool to create a mapping between the RBD and the Fibre Channel initiators attached to the fabric (See the article on [[targetcli mappings]].		# use the targetcli management tool to create a mapping between the RBD and the Fibre Channel initiators attached to the fabric (See the article on [[targetcli mappings]].)
	# discover storage on the initiator machine(s)		# discover storage on the initiator machine(s)
	# proceed to read and write to the storage on the initiator machine(s)		# proceed to read and write to the storage on the initiator machine(s)

Adj: /* How to do it */

2025-04-16T18:26:24Z

How to do it

← Older revision		Revision as of 18:26, 16 April 2025
Line 35:		Line 35:
	# Collect HBA world wide port names (WWPNs) from gateway (target) and server (initiator) systems.		# Collect HBA world wide port names (WWPNs) from gateway (target) and server (initiator) systems.
	# Get the Fibre Channel switch's/switches' zoning configuration set so that initiators (the client servers) and see the target (gateway) ports on the fabric can communicate. See the [[Brocade Fibre Channel zoning]] article.		# Get the Fibre Channel switch's/switches' zoning configuration set so that initiators (the client servers) and see the target (gateway) ports on the fabric can communicate. See the [[Brocade Fibre Channel zoning]] article.
	# Create an RBD in the Ceph cluster and map it to the gateway machine		# Create an RBD in the Ceph cluster and map it to the gateway machine (something like <code>sudo rbd --cluster fnord-201802 --id zarathud-rbd map zarathud-fc-target-lun-1</code>)
	# use the targetcli management tool to create a mapping between the RBD and the Fibre Channel initiators attached to the fabric		# use the targetcli management tool to create a mapping between the RBD and the Fibre Channel initiators attached to the fabric (See the article on [[targetcli mappings]].
	# discover storage on the initiator machine(s)		# discover storage on the initiator machine(s)
	# proceed to read and write to the storage on the initiator machine(s)		# proceed to read and write to the storage on the initiator machine(s)

Adj: /* How to do it */

2025-04-14T19:23:14Z

How to do it

← Older revision		Revision as of 19:23, 14 April 2025
Line 34:		Line 34:
	# Install the Linux SCSI target management CLI, <code>targetcli</code> or, preferably, <code>targetcli-fb</code>		# Install the Linux SCSI target management CLI, <code>targetcli</code> or, preferably, <code>targetcli-fb</code>
	# Collect HBA world wide port names (WWPNs) from gateway (target) and server (initiator) systems.		# Collect HBA world wide port names (WWPNs) from gateway (target) and server (initiator) systems.
	# Get the Fibre Channel switch's/switches' zoning configuration set so that initiators (the client servers) and see the target (gateway) ports on the fabric can communicate.		# Get the Fibre Channel switch's/switches' zoning configuration set so that initiators (the client servers) and see the target (gateway) ports on the fabric can communicate. See the [[Brocade Fibre Channel zoning]] article.
	# Create an RBD in the Ceph cluster and map it to the gateway machine		# Create an RBD in the Ceph cluster and map it to the gateway machine
	# use the targetcli management tool to create a mapping between the RBD and the Fibre Channel initiators attached to the fabric		# use the targetcli management tool to create a mapping between the RBD and the Fibre Channel initiators attached to the fabric

Adj: /* How to do it */

2025-04-14T19:02:14Z

How to do it

← Older revision		Revision as of 19:02, 14 April 2025
Line 34:		Line 34:
	# Install the Linux SCSI target management CLI, <code>targetcli</code> or, preferably, <code>targetcli-fb</code>		# Install the Linux SCSI target management CLI, <code>targetcli</code> or, preferably, <code>targetcli-fb</code>
	# Collect HBA world wide port names (WWPNs) from gateway (target) and server (initiator) systems.		# Collect HBA world wide port names (WWPNs) from gateway (target) and server (initiator) systems.
		⚫	# Get the Fibre Channel switch's/switches' zoning configuration set so that initiators (the client servers) and see the target (gateway) ports on the fabric can communicate.
	# Create an RBD in the Ceph cluster and map it to the gateway machine		# Create an RBD in the Ceph cluster and map it to the gateway machine
	# use the targetcli management tool to create a mapping between the RBD and the Fibre Channel initiators attached to the fabric		# use the targetcli management tool to create a mapping between the RBD and the Fibre Channel initiators attached to the fabric
	# discover storage on the initiator machine(s)		# discover storage on the initiator machine(s)
	# proceed to read and write to the storage on the initiator machine(s)		# proceed to read and write to the storage on the initiator machine(s)
⚫	# Get the Fibre Channel switch's/switches' zoning configuration set so that initiators (the client servers) and see the target (gateway) ports on the fabric can communicate.

Adj at 18:54, 14 April 2025

2025-04-14T18:54:14Z

@@ Line 18: / Line 18: @@
 * tanstaafl, an HP (no 'E') 9000 rp3440, 2U PA-RISC server running the Debian (unreleased port for this architecture) -- this will be the FC client machine
 * fnord-201802 Ceph cluster (currently 3 HP (also no 'E') DL380e servers running Debian 12 for amd64 with 10Gbits/sec Ethernet connectivity) -- backend storage
-* zarathud, a Dell PowerEdge R620 server running Debian 11 with 10Gbits/sec Ethernet connectivity -- the gateway between the Ceph backend storage and the client system
+* zarathud, a Dell PowerEdge R620 server running Debian 11 with plenty of connectivity to the Ceph cluster (10GbE and 40/56GbE both) and plenty of connectivity to the Fibre Channel fabrics -- the gateway between the Ceph backend storage and the client system
 * Brocade 5100 FibreChannel switch(es) -- these run a locked down Linux CLI for configuration and management
@@ Line 26: / Line 26: @@
 * Ceph (ditto)
 * Linux SCSI target subsystem (not yet sure about fanboi status on this part)

Adj: /* Overview */

2025-04-11T14:49:46Z

Overview

← Older revision		Revision as of 14:49, 11 April 2025
Line 6:		Line 6:
	Anyway, in memory of my days dealing with Fibre Channel attached storage, HP EVAs, Brocade switches, HP-UX on Itanium, and fun teammates, this little excursion into nostalgia (and maybe something useful) is being called Mad Cow.		Anyway, in memory of my days dealing with Fibre Channel attached storage, HP EVAs, Brocade switches, HP-UX on Itanium, and fun teammates, this little excursion into nostalgia (and maybe something useful) is being called Mad Cow.

	== Overview ==		== Overview ==
			Software defined storage. Fibre Channel. Linux. Ceph. All the cool things...

	Not a general treatise on Fibre Channel technology. This is more about providing Ceph-backed disk storage (and all its benefits) over Fibre Channel to the Fnord home datacenter. There are a few machines here with Fibre Channel HBAs. There exists one functional Ceph cluster (and equipment for 2 more). And there are also some Fibre Channel switches and cabling to make it all work.		Not a general treatise on Fibre Channel technology. This is more about providing Ceph-backed disk storage (and all its benefits) over Fibre Channel to the Fnord home datacenter. There are a few machines here with Fibre Channel HBAs. There exists one functional Ceph cluster (and equipment for 2 more). And there are also some Fibre Channel switches and cabling to make it all work.

Adj: /* That is a weird name for IT stuff, or "You are an insensitive clod!" */

2025-04-11T14:48:56Z

That is a weird name for IT stuff, or "You are an insensitive clod!"

← Older revision		Revision as of 14:48, 11 April 2025
Line 3:		Line 3:

	So Swift and Company was eventually acquired by a Brazilian outfit called JBS. There was some confusion on the naming front. Like they didn't get jbs.com registered. So called themselves JBS USA instead. Some Googling in 2025 says they are now called JBS Foods Group. Sometime after the acquisition was finalized, the company CEO decided he wanted to approve all IT change tickets. When one came along that said something like "add addtional disk capacity to the MAD COW disk array" the reaction from the corner office (actually in the center of the building) was extremely irate and a demand was passed down that the name must be changed. After the company decided it didn't want me on the payroll any more, they engaged HP services to come along and rename the array. I hope they were billed outrageous amounts for that engagement. But really, all that it required was logging into the web management tool (called "Command View EVA") and changing a simple text field.		So Swift and Company was eventually acquired by a Brazilian outfit called JBS. There was some confusion on the naming front. Like they didn't get jbs.com registered. So called themselves JBS USA instead. Some Googling in 2025 says they are now called JBS Foods Group. Sometime after the acquisition was finalized, the company CEO decided he wanted to approve all IT change tickets. When one came along that said something like "add addtional disk capacity to the MAD COW disk array" the reaction from the corner office (actually in the center of the building) was extremely irate and a demand was passed down that the name must be changed. After the company decided it didn't want me on the payroll any more, they engaged HP services to come along and rename the array. I hope they were billed outrageous amounts for that engagement. But really, all that it required was logging into the web management tool (called "Command View EVA") and changing a simple text field.

			Anyway, in memory of my days dealing with Fibre Channel attached storage, HP EVAs, Brocade switches, HP-UX on Itanium, and fun teammates, this little excursion into nostalgia (and maybe something useful) is being called Mad Cow.

	== Overview ==		== Overview ==

Adj at 22:50, 10 April 2025

2025-04-10T22:50:08Z

← Older revision		Revision as of 22:50, 10 April 2025
Line 1:		Line 1:
	I hereby declare this "Project Mad Cow." For reasons.

⚫	Not a general treatise on Fibre Channel technology. This is more about providing Ceph-backed disk storage (and all its benefits) over Fibre Channel to the Fnord home datacenter. There are a few machines here with Fibre Channel HBAs. There exists one functional Ceph cluster (and equipment for 2 more). And there are also some Fibre Channel switches and cabling to make it all work.

	== That is a weird name for IT stuff, or "You are an insensitive clod!" ==		== That is a weird name for IT stuff, or "You are an insensitive clod!" ==
	Back in the day, before kids, I worked for IT at Swift and Company, a corporation that transformed cows, pigs, sheep and occasionally goats into meat. Swift and Company had a large project to overhaul the finance (PeopleSoft, I think), HR (also PeopleSoft), and warehouse management systems (mostly homegrown, and varied from plant to plant.) This involved a lot of then-neat servers and interesting new technologies. One of these was a decent for its day set of HP (no 'E') FibreChannel attached disk arrays, the EVA or Enterprise Virtual Array for storage. I was overall fairly happy with these arrays as hardware goes. They were pretty easy to get along with. I got to the point I could do an install at least as well as the local HP CE (field engineer) assigned to our account. The first one of these arrays to be installed, an EVA 8000, was dubbed "MAD COW" by the UNIX sysadmin team. That was probably my idea, TBH. But it seemed fitting. And all was OK with the world. Until...		Back in the day, before kids, I worked for IT at Swift and Company, a corporation that transformed cows, pigs, sheep and occasionally goats into meat. Swift and Company had a large project to overhaul the finance (PeopleSoft, I think), HR (also PeopleSoft), and warehouse management systems (mostly homegrown, and varied from plant to plant.) This involved a lot of then-neat servers and interesting new technologies. One of these was a decent for its day set of HP (no 'E') FibreChannel attached disk arrays, the EVA or Enterprise Virtual Array for storage. I was overall fairly happy with these arrays as hardware goes. They were pretty easy to get along with. I got to the point I could do an install at least as well as the local HP CE (field engineer) assigned to our account. The first one of these arrays to be installed, an EVA 8000, was dubbed "MAD COW" by the UNIX sysadmin team. That was probably my idea, TBH. But it seemed fitting. And all was OK with the world. Until...

	So Swift and Company was eventually acquired by a Brazilian outfit called JBS. There was some confusion on the naming front. Like they didn't get jbs.com registered. So called themselves JBS USA instead. Some Googling in 2025 says they are now called JBS Foods Group. Sometime after the acquisition was finalized, the company CEO decided he wanted to approve all IT change tickets. When one came along that said something like "add addtional disk capacity to the MAD COW disk array" the reaction from the corner office (actually in the center of the building) was extremely irate and a demand was passed down that the name must be changed. After the company decided it didn't want me on the payroll any more, they engaged HP services to come along and rename the array. I hope they were billed outrageous amounts for that engagement. But really, all that it required was logging into the web management tool (called "Command View EVA") and changing a simple text field.		So Swift and Company was eventually acquired by a Brazilian outfit called JBS. There was some confusion on the naming front. Like they didn't get jbs.com registered. So called themselves JBS USA instead. Some Googling in 2025 says they are now called JBS Foods Group. Sometime after the acquisition was finalized, the company CEO decided he wanted to approve all IT change tickets. When one came along that said something like "add addtional disk capacity to the MAD COW disk array" the reaction from the corner office (actually in the center of the building) was extremely irate and a demand was passed down that the name must be changed. After the company decided it didn't want me on the payroll any more, they engaged HP services to come along and rename the array. I hope they were billed outrageous amounts for that engagement. But really, all that it required was logging into the web management tool (called "Command View EVA") and changing a simple text field.

			== Overview ==
		⚫	Not a general treatise on Fibre Channel technology. This is more about providing Ceph-backed disk storage (and all its benefits) over Fibre Channel to the Fnord home datacenter. There are a few machines here with Fibre Channel HBAs. There exists one functional Ceph cluster (and equipment for 2 more). And there are also some Fibre Channel switches and cabling to make it all work.

	== Desired end state ==		== Desired end state ==

Adj: Adj moved page FibreChannel Storage to Mad Cow

2025-04-10T22:48:25Z

Adj moved page FibreChannel Storage to Mad Cow

← Older revision

Revision as of 22:48, 10 April 2025