• Adam Thurgar

Dealing with sensitive data


What do you do when you are asked to deal with sensitive data. I was asked by the legal department of a mortgage provider to investigate some customer data. This was sensitive information about mortgages, interest rates and repayments.

I was the only person who was allowed to look at this data, no help from my team and I was not to tell anybody what I was doing. Secret data business.

It became more of a problem with my T-SQL skills. Although my skills were adequate, there was a team member vastly more proficient. They could have written better queries and got the results a lot quicker. This is why you need to keep your T-SQL skills up to date and keep learning what has been added/changed to the language. It could make your life a lot easier and more efficient code.

Whilst going through the data I found the information that was needed, customers who had not had their honeymoon discount rate applied. This was corrected and the customers informed and paid their refunds.

I also found other anomalies, customers who had never made repayments and where effectively getting free money. Other customers who had two mortgages on the same property and a few other business related issues like the loan being greater than the value of the property. I passed this information onto the legal department and let them deal with it. In reality all of this data needed to be audited and verified, but the need for data cleansing is another story.


4 views

Recent Posts

See All

Cardinality estimator

Recently I was asked by a software vendor to review a particular query that ran in under a second on a SQL Server 2014 installation at a compatibility level of 110 (SQL Server 2012), but when run unde

Index fragmentation

A law firm client, occasionally has issues with their legal software, that is provided by the global leader in this field. The response from the software provider is always the same - you have index f

Deleting large amounts of data

I had a client call me about wanting to delete a large amount of data from their database. They knew what tables they wanted to delete from. They also knew that deleting large amounts of data causes t