Comments on: 4 myths about Data Quality everyone thinks are true https://www.lightsondata.com/4-myths-about-data-quality-everyone-thinks-are-true/ Practical resources, online courses, free articles and videos for data management, data governance, data quality, and business intelligence Wed, 29 Jul 2020 22:42:19 +0000 hourly 1 https://wordpress.org/?v=6.8.3 By: George F https://www.lightsondata.com/4-myths-about-data-quality-everyone-thinks-are-true/#comments/7 http://www.lightsondata.com/?p=96#comment-7 In reply to Martin Storey.

Thanks for sharing these details. Would love to see your presentation if you can share it on this site.
Legacy data is definitely important, especially to derive meaningful analytics. That’s way, one of the things that I’ve seen to work is a side by side comparison on trends or other analytics derived from past data and how that is with or without including legacy data as part of the data set.
Thank you again for sharing this with us.

]]>
By: Martin Storey https://www.lightsondata.com/4-myths-about-data-quality-everyone-thinks-are-true/#comments/6 http://www.lightsondata.com/?p=96#comment-6 In reply to George F.

George,
I am a geoscientist (in the oil and gas industry), so I spend much of my life attempting to extract value from (existing data) – typically field- or lab-acquired data that becomes “legacy” almost immediately after acquisition. In this context, “legacy data” refers to data liable to decay and to lose fitness-for-purposes (immediate and future, planned and unforeseen). I also spend quite a bit of time planning the acquisition of new data, and I am acutely aware of the pressures to do things faster and cheaper, regardless of value, to the extent that we frequently spend time and money acquiring such half-arsed data sets that they will be of no value.
Data analysts know intimately about the importance of legacy data, although younger people have also been led to believe that technology can make up for any data issue (when in fact technology can make up and cover any data issue, but that doesn’t make it right or confident, only misleading). However, they tend to have little voice and use it even less.
The problem is that decision makers, frequently their +i managers, frequently do not understand about data and are relentlessly bombarded by software manufacturers’ spin. There’s no sexiness in legacy data, when compared to new data… not least because legacy data is imperfect, whereas managers can decree that from now on, all data will be good.
A presentation I gave some years ago to the data management community was entitled “Things are NOT getting better”. I wish they were and advocate for positive changes.

]]>
By: George F https://www.lightsondata.com/4-myths-about-data-quality-everyone-thinks-are-true/#comments/5 http://www.lightsondata.com/?p=96#comment-5 In reply to Martin Storey.

Very true. I’m guessing you had to deal with legacy data quite a bit? In your situation, were the business stakeholders ever convinced on the importance of legacy data?

]]>
By: Martin Storey https://www.lightsondata.com/4-myths-about-data-quality-everyone-thinks-are-true/#comments/4 http://www.lightsondata.com/?p=96#comment-4 Other frequently held beliefs and myths (not “which [I] thought they were true”):
. “Legacy data is not great”
. “New/incoming data is better than old/legacy”
. “Data quality is what it is and will not worsen”
and of course:
. “We are unlikely to need old/legacy data in the future”.

]]>