How Johannesburg's Public Record Got Buried Under Thousands of Duplicate Images — and Why It Matters

Johannesburg's City of Joburg digital archive system is carrying a problem nobody officially wants to own: tens of thousands of duplicate image files scattered across municipal servers, choking storage, inflating IT costs, and making it harder for officials and ordinary residents to find the records they need. The issue did not appear overnight. It accumulated over roughly a decade of haphazard digitisation drives, departmental mergers, and repeated attempts to modernise systems that were never fully reconciled with one another.

The problem matters now because the city is in the middle of a broader push — accelerated under the current ANC-DA coalition administration in Gauteng — to reform public-facing services, including the Joburg Metrorail support infrastructure and the city's land and planning portals. Every rand spent storing the same photograph of a cracked pavement on Noord Street four hundred times is a rand not spent on the fibre connectivity upgrades those portals depend on.

How the Archive Got This Cluttered

The roots stretch back to at least 2014, when the City of Joburg and several Gauteng provincial departments launched parallel scanning initiatives to digitise paper records. The Joburg Metropolitan Municipality's Development Planning department, based on Rissik Street in the CBD, began uploading building permit imagery. The Johannesburg Heritage Foundation, which manages records relating to areas including Soweto's Orlando and the Westcliff ridge corridor, ran its own separate digitisation programme. Neither system talked to the other in any structured way.

Each subsequent system migration — and there were at least three major ones between 2015 and 2023, according to municipal IT tender documents publicly available on the Joburg eTender portal — copied files wholesale rather than deduplicating them first. Staff at satellite offices in Randburg and Roodepoort uploaded the same scanned floor plans and site photographs repeatedly when switching between platforms. The result, by the time a technical audit was flagged internally in late 2024, was a storage estate bloated with replicated content.

The South African Local Government Association has noted, in its annual State of Local Government Finance reports, that municipal IT infrastructure inefficiency is among the top five operational cost drivers for metros. Joburg's specific duplicate-image problem fits squarely inside that category, though the city has not published a standalone cost figure for this particular issue.

What Deduplication Actually Involves — and Where It Stands Now

Replacing duplicate images is not simply deleting files. Each image in a government archive is typically linked to a case reference — a building plan, an environmental impact record, a rates dispute. Delete the wrong file and you break the chain of evidence. The process requires what archivists call hash-based matching: generating a unique fingerprint for each file and systematically retiring copies that share the same fingerprint while preserving all associated metadata and case linkages.

The City of Joburg's Group Information and Communications Technology directorate put out a scope-of-work document in March 2025 seeking specialist vendors to perform exactly this kind of remediation across its document management system, which at that point held an estimated 14 million records. The tender closed in May 2025. As of this month, a remediation contractor is understood to be in the early phases of the work, though the city has not issued a formal progress statement.

For residents, the practical consequence has been slow load times and failed searches on the Joburg e-Services portal — a frustration well known to anyone who has tried to pull a rates clearance certificate from the Sandton Customer Service Centre on Rivonia Road or check a building approval status online from an office in Parktown. The fix is genuinely technical and genuinely boring, but the downstream effects — faster permit processing, more reliable heritage records, cheaper storage contracts — are concrete.

The city's IT remediation window is expected to run through the third quarter of 2026. Residents and professionals who regularly use the e-Services portal or lodge planning applications through the Development Planning office on Rissik Street should save local copies of any documents they have already retrieved, as the deduplication process may temporarily affect file accessibility during migration phases. The Joburg eTender portal remains the most reliable source for updates on contract progress.