The people you've never heard of are making permanent decisions

Picture yourself as the researcher who finally gets access. You've waited months, filled in the forms, navigated the reading room's particular brand of hushed bureaucratic theatre. The finding aid promises forty boxes covering a department's internal security assessments across two decades. You open the first box. Then the second. By the fifth, you understand: the files that would answer your question were destroyed fifteen years ago, on schedule, by a process so orderly it left almost no trace of itself. Not suppressed. Disposed of. There is a difference, and it is the difference that lets everyone involved sleep soundly.

The appraiser who signed that disposal schedule didn't act alone, didn't act on a whim, and almost certainly didn't act in bad faith. What they did was follow a chain of institutional authority that most citizens don't know exists and that, once it runs its course, cannot be reversed. The box is gone. Whatever was in it is gone.

This is how national archives actually work. The question of which government records survive permanently and which are pulped or deleted is decided not by a single archivist with a rubber stamp, but by an internal governance structure: committees, appraisal frameworks, sign-off hierarchies, and accountability mechanisms whose design determines, with finality, what future historians will be allowed to know.

The architecture of the decision

Every national archives body operates under some version of the same basic structure. A legislative mandate (the Public Records Act in the United Kingdom, the Federal Records Act in the United States, equivalents elsewhere) grants the institution authority to advise government departments on what records have long-term value. The law typically speaks in broad terms. It is the internal governance of the archives itself that translates those broad terms into specific, binding appraisal decisions.

At the top sits a board or executive leadership whose composition matters enormously. A board drawn heavily from the civil service departments that generate records will approach the question of what to keep very differently from one that includes academic historians, investigative journalists, or legal scholars. The National Archives of the United Kingdom has historically maintained advisory panels that include external specialists precisely to counteract the institutional instinct of government to treat its own paperwork as either embarrassing or simply voluminous. When those external voices carry real voting weight, the governance architecture is genuinely pluralist. When they are consultative only, the word "advisory" is doing a lot of quiet work.

Below board level, most archives bodies run specialist appraisal teams. These teams develop what are called functional appraisal frameworks: systematic assessments of the activities a government body performs, with file-by-file reviews reserved for exceptional cases. The logic is defensible. If you understand that a department's core function is licensing, you can apply consistent criteria to licensing records across decades without reading every folder. The risk is equally obvious, and I think it is underweighted by almost everyone who administers these systems. A badly constructed functional framework can systematically exclude entire categories of evidence. Records of complaints, of failed policy, of informal advice that shaped formal decisions: these are precisely the materials that functional frameworks, written by people inside the system, are most likely to misclassify as routine and therefore destroyable.

The sign-off hierarchy is where governance theory meets practical consequence. A junior appraiser might draft a disposal schedule covering a thousand boxes. That schedule moves upward through a senior appraiser, through a head of appraisal, and in significant cases through a formal appraisal committee. Some archives require a final sign-off from the national archivist personally on records touching sensitive areas. Others delegate final authority to departmental records officers who are employed not by the archives but by the department whose records are under review. That distinction is not a technicality. It is the difference between an independent professional judgment and a departmental one.

A concrete scenario: two departments, one framework

Consider two hypothetical government departments: one responsible for environmental licensing, one responsible for internal security assessments. Both generate what appraisers call operational case files, the individual records of specific decisions made about specific subjects.

The archives applies the same functional appraisal framework to both. The framework says: retain a representative sample of case files, perhaps five percent, chosen to illustrate the range of decisions made; destroy the remainder after fifteen years. For the environmental licensing department, this is arguably defensible. The pattern of decisions is what matters to future researchers; individual licensing files are largely repetitive.

For the internal security department, the same logic produces a different outcome. The five percent sample, chosen by an archivist who has no way of knowing which specific cases will later prove significant, may exclude the precise files that document surveillance of a civil rights organisation, a wrongful designation, or a systemic error in the assessment process. Fifteen years after the fact, those files are gone. The governance mechanism that allowed the same framework to be applied to both departments without distinction is the failure point. It is a governance failure, not an appraisal failure.

Two researchers, call them Priya and Marco, discover this a generation later. Priya is writing a history of environmental policy and finds the sample files adequate for her purposes. Marco is investigating allegations of improper surveillance and finds the archive silent at exactly the moments that matter. The records were not destroyed maliciously. They were destroyed systematically, by a process that nobody specifically designed to suppress them but that nobody specifically designed to protect them either. That passivity is its own kind of decision, and archives institutions have been far too comfortable treating it as a neutral default.

What people misunderstand about appraisal accountability

The common assumption is that the danger lies in deliberate destruction: governments shredding inconvenient truths. That happens. But the more pervasive problem is structural opacity in routine process, the archival equivalent of a slow leak, not a burst pipe. Most national archives publish their appraisal criteria; far fewer publish the minutes of the committees that applied those criteria to contested cases. Fewer still make disposal schedules available for public comment before the destruction occurs, as opposed to after the fact when nothing can be recovered.

The Freedom of Information architecture that governs access to surviving records is often decades more developed than any equivalent framework for scrutinising destruction decisions. You can appeal a refusal to release a document you know exists. You cannot appeal the destruction of a document you don't know was created.

Ask yourself: if the institution responsible for preserving the record of government keeps its own deliberations off the record, what exactly is it modelling?

Some archives have moved toward what practitioners call macro-appraisal, a philosophy developed largely in Canada by theorists including Terry Cook, which argues that appraisers should document not just what they kept but why they destroyed what they destroyed, and that the appraisal rationale itself should be permanently preserved. This is a genuine improvement. A preserved rationale at least allows future researchers to understand the intellectual framework that shaped the gaps in the archive. It does not fill the gaps, but it names them.

The governance variable nobody audits

The single most consequential and least scrutinised variable in this whole system is staff continuity on appraisal committees. Institutional memory about why a particular framework was constructed the way it was, which departments pushed back, which categories were deliberately narrowed, lives in the heads of the people who were in the room. When those people retire or move on without adequate documentation of the reasoning behind framework decisions, the framework becomes a rule without a rationale. Junior appraisers apply it because it exists, not because they understand the judgment it encodes.

Governance reform in this area doesn't require new legislation in most jurisdictions. It requires something harder: a genuine commitment by archives leadership to treat the documentation of their own decision-making as a records-keeping obligation, not an administrative courtesy. The institution charged with preserving institutional memory has, in too many cases, been careless about preserving its own.

What gets destroyed shapes what gets remembered. What gets remembered shapes what gets believed about how power was used. The practical consequence of every governance choice made in every appraisal committee meeting that nobody outside the building will ever read is not abstract at all. It is Priya finding enough, and Marco finding nothing, and the difference between them having nothing to do with what actually happened.