Toowoomba Regional Council's digital records system contains thousands of duplicate image files — the product of at least three separate digitisation drives stretching back to 2014 — and a remediation project to identify and remove redundant files is now underway across council's document management platform. The duplication problem, long acknowledged internally, has grown pressing as the council prepares to migrate planning and development records to a new system ahead of the Inland Rail construction corridor entering its most document-intensive approval phase along the Toowoomba to Kagaru section.
The timing matters because development applications, engineering certificates and heritage assessments linked to the $10 billion Inland Rail project generate dense image-heavy PDF bundles. When those records enter a system already carrying duplicate versions of older cadastral maps, aerial surveys and infrastructure photographs, the risk of retrieval errors — pulling the wrong version of a plan during a compliance check, for instance — increases significantly. The Toowoomba and Surat Basin Enterprise region has been flagging digital infrastructure readiness as a priority since at least 2022, and the records backlog represents one of the more unglamorous corners of that conversation.
How the duplication built up over a decade
The roots of the problem trace to a 2014 decision by the then-council to digitise paper planning files held at the main administration building on Hume Street. A contractor scanned roughly 140,000 pages of legacy development records, but the ingestion process used a batch-upload method that did not check for existing files before adding new ones. A second digitisation pass in 2018 — prompted by a Queensland State Archives compliance review — created a second layer of duplicate images for any file touched in both rounds.
The pandemic years compounded things. Between March 2020 and mid-2021, staff working from home uploaded scanned documents directly to the council's Objective ECM system using personal scanner settings that often defaulted to different resolution and colour profiles than the office standard. That meant a single rates notice or site plan could end up stored as three separate image files: the original 2014 scan, the 2018 re-scan, and a 2020 home-office version. Multiplied across tens of thousands of records, the storage and retrieval implications were not trivial.
The University of Southern Queensland, whose Toowoomba campus on West Street maintains a records and information management program, has documented similar patterns in regional government digitisation projects across Queensland, noting that batch ingestion without deduplication logic is among the most common sources of archive bloat in councils that digitised in multiple tranches. The council's own IT division estimated in an internal review — details of which are not publicly released — that the remediation project would need to process records stored across multiple network directories before the planned system migration could proceed cleanly.
What the remediation project involves
The current project uses hashing software to compare image files byte-by-byte, flagging exact and near-exact duplicates for human review before any deletion. Records staff at the McDougall Street depot — where the council's physical archive is co-located with the digital records team — are working through flagged batches in priority order, starting with active planning files and working backward through historical records.
The Toowoomba and Surat Basin Enterprise has separately been working with regional councils on data readiness frameworks tied to Western Downs renewable energy zone approvals, where document accuracy is a live concern. Errors in recorded easement boundaries or environmental assessments, even when caused by a duplicate file overwriting a corrected version, can delay project sign-off by weeks.
For residents and businesses lodging development applications, the practical advice from council's planning counter on Hume Street is straightforward: when submitting supporting documents, use filenames that include the date and a version number, and avoid re-submitting identical attachments under different names. That small step reduces the chance of a new duplicate entering the system during the current remediation window. Council has indicated the migration to its replacement platform is targeted for completion before the end of the 2026–27 financial year, though no public deadline has been formally confirmed.
