Load Path Research The mechanism you have vs the property you need

Blog

The End-of-Life System You Can't Retire

Eventually, every enterprise architect finds themselves staring at a beige desktop tower from 2004 that controls a piece of hardware worth more than their house. Let us say it is a mass spectrometer in a pharmaceutical lab, or an imaging controller in a hospital. The instrument itself is a marvel of precision engineering, bolted to the floor, and built to last twenty years. The computer sitting on the desk next to it runs Windows XP. It has a proprietary 32-bit PCI card that connects to the spectrometer. The card will not fit in a modern motherboard. The control software will not run on a current operating system.

There are three clocks ticking in this room, and they do not sync. The first is the hardware lifecycle. The instrument was depreciated over fifteen years and is only in year eight. The second is the operating system lifecycle. The vendor stopped supporting this version of Windows a decade ago. The third is the certification lifecycle. The regulatory body certified the instrument and the software as a single, validated system. Changing the operating system voids the certification. Getting a new certification costs more than the instrument and takes two years. The certification is the binding constraint. It is the one that matters, and it is the one nobody outside the validation lab thinks about.

The standard advice is to replace it. The business case for replacement fails the moment it hits the capital allocation committee. Replacing a perfectly functioning four-million-dollar piece of industrial equipment because the five-hundred-dollar computer attached to it is out of support is a hard sell. The replacement is a one-time capital expenditure. Keeping the old machine running with compensating controls is an operating expense. The CFO compares the two. The capital request gets cut. The operating expense gets renewed. “Cannot be replaced this year” is not a technical constraint. It is a budget statement dressed up as an engineering one.

When you cannot patch a system, you stop trying to secure the system and start securing the perimeter around it. The goal shifts from preventing an infection to ensuring the infection has nowhere to go. You draw a VLAN. You put the machine on a subnet with no routing to the internet and no routing to the corporate network. You write firewall rules.

An air gap is a spectrum, and a USB stick is the air gap’s enemy. The lab needs to export a data file, so someone re-enables the USB port. The vendor needs to run a diagnostic, so they remote in through a jump server that has no multi-factor authentication. The vendor’s account is shared, and the password is in a password manager nobody checks. A firewall rule justified by a vendor requirement still needs a source, a destination, and a purpose. But the rule created in 2011 to allow remote desktop from a /24 subnet is still there. The ticket is closed. The rule is permanent. The temporary fix becomes the infrastructure.

The support boundary is often smaller than the asset. The vendor might support the instrument, but not the operating system. Or the vendor was acquired, spun off, and went bankrupt. When the vendor goes away, the instrument becomes a puzzle box with no key. You check the disaster recovery plan. The backup has never been tested. The restore requires the original install media, which is a scratched CD. The source code is in escrow at a law firm that has never been asked for it. Even if you retrieved the tape, you would need the compiler, the toolchain, and the build environment. Escrow is a legal arrangement, not a technical one.

This is where the technical work ends and the paperwork begins. The signature is the deliverable. The whole point of segmentation, compensating controls, and documentation is to give someone with authority a defensible reason to sign. IT cannot accept business risk. The person who signs the risk acceptance form owns the consequence. It is a career decision, not a paperwork exercise.

The risk register entry says accepted, with a name and a date. The name belongs to someone who left the company two years ago. The date is 2019. The compensating control listed is network segmentation, but the segmentation is a VLAN that was never fully implemented. When the auditor asks about the end-of-life system, you show them the risk acceptance. You show them the firewall rules. The compensating control is a story you tell auditors, and the story has to be true. If it is not true, you have a finding and a false statement.

To make the story true, the risk record must survive the departure of the engineer who knows why the machine is still there. You have to map the connections before writing the rules. You have to record the source, destination, protocol, and purpose of every allowed packet. You have to separate prevention from recovery. Segmentation reduces reachable attack paths, but it does not restore a failed disk. You need a tested image, spare hardware, and a recovery procedure. You have to treat vendor remote access as a named path, logging every session. And you have to put dates and decisions in the risk record. An exception without an expiry date is a purchasing decision nobody recorded.

The machine keeps running. It is often the most reliable thing in the building. It has not rebooted in eighteen years. That reliability is the trap. Uptime gets mistaken for safety. The clinician does not care about the operating system version. The clinician just wants the instrument to work. The IT person documents the risk. The risk is accepted. The acceptance is a signature. The machine sits in the lab, running the same assay it ran yesterday, waiting for the next audit.

Takeaways

  1. Certification lifecycles, not OS lifecycles, often dictate replacement timing
  2. Segmentation is a story you tell auditors, and the story has to be true
  3. Risk acceptance is a career decision for the signer, not a paperwork exercise
  4. Escrow is a legal arrangement, not a technical recovery plan

Questions

Why can't you just replace the old computer attached to the instrument?
The instrument and its control software are certified as a single validated system. Changing the operating system voids the certification, and recertification costs more than the instrument and takes two years.
What is the actual deliverable when you can't patch a system?
A signature. The point of segmentation, compensating controls, and documentation is to give someone with authority a defensible reason to accept the risk in writing.
Why do temporary firewall rules become permanent?
A rule created for a vendor requirement gets a ticket, the ticket gets closed, and nobody revisits it. The temporary fix becomes the infrastructure.

Tags

  • legacy systems
  • compensating controls
  • risk acceptance
  • patching