Page 1 of 1
Over 13,000 Duplicate Patient IDs - Help!
Posted: Mon Sep 25, 2017 3:16 pm
by cwhamilton
The main source PacsOne gets its images from made a change last week to the way they send demographic data. In the past, we have received data with the MI being included as part of the first name - they made a change to break the MI into the Middlename field. And then they bulk sent ALL their records over again. Now I'm stuck with over 13,000 Duplicate Patient IDs that I would like to resolve somehow. At this point it's taking over 3 minutes to return the list (I had to change max_execution_time to =240) each time I resolve a duplicate so the most I could ever hope to clear would be 3 every 10 minutes. At this rate it will take forever.
Is there another faster, more efficient way of clearing these duplicates from the database? It's just name discrepancies and I don't really care if a patient is listed as First: John E Last: Doe or First: John MI: E Last: Doe.
Many thanks in advance!
Re: Over 13,000 Duplicate Patient IDs - Help!
Posted: Mon Sep 25, 2017 5:36 pm
by cwhamilton
OK, so I made a change to Duplicates.php that has made my situation at least a little more manageable, I added the
LIMIT 30 to limit the search to 30 records and that speeds up the list of duplicates greatly. I'm still interested in a bulk way of clearing all these, but right now this is keeping me from waiting almost 4 minutes between each duplicate resolve.
Duplicates.php
Code: Select all
$rows = array();
$query = "SELECT * FROM patient WHERE origid LIKE '%[%]%' LIMIT 30";
$result = $this->dbcon->query($query);
while ($row = $this->dbcon->fetch_array($result)) {
// exclude those with studies received today
$query = "SELECT * FROM study WHERE patientid='";
$query .= $row["origid"];
$query .= "' AND ";
$query .= $this->dbcon->useOracle? "TRUNC(received)=TRUNC(SYSDATE)" : "DATE(received)=CURDATE()";
$studies = $this->dbcon->query($query);
if ($studies && $this->dbcon->num_rows($studies))
continue;
$rows[] = $row;
Re: Over 13,000 Duplicate Patient IDs - Help!
Posted: Tue Sep 26, 2017 4:46 pm
by pacsone
If the conflicts in Patient Name for the duplicate Patient ID are of no concern, and you are Ok with overwriting existing patient records with newly received Patient Name (regardless of what the new names are), then we can create and send you a PHP script to remove all the duplicate Patient IDs and always update the existing patient records with the newly received Patient Names.
Please send your current version of PacsOne Server to
mailto:pacsone@pacsone.net