ڈیٹا سائنسدانوں اور کاروباری رہنماؤں کے لیے میٹرک ڈیزائن

What’s the hardest part of metric design?

In order to make good ڈیٹا پر مبنی فیصلے, you need 3 things:

1. Decision criteria based on well-designed میٹرکس.
2. The ability to collect the اعداد و شمار those metrics will be based on.
3. اعداد و شمار skills to calculate those metrics and interpret the results under غیر یقینی صورتحال.

Requirements #2 and #3 have been written about plenty (including by me), but what about requirement #1?

اب جب کہ اعداد و شمار collection is easier than ever, many leaders feel pressure to drag numbers to every meeting. Unfortunately, in the midst of the feeding frenzy, many of them fail to give metric design the amount of thought it deserves. Among those who are willing to put the effort in, most are making it up as they go along, as if it’s brand new.

ایسا نہیں ہے۔

Psychology — the scientific study of mind and behavior — has had over a century to stub its toe on the dangers of attempting to measure vague quantities that haven’t been properly defined, so the field has learned some solid gold nuggets that business leaders and ڈیٹا سائنسدانوں would be wise to borrow when designing metrics.

If you’re not convinced that metric design is hard, grab a pen and paper. I challenge you to write down a definition of خوشی that’s so ironclad that no one could take issue with your way of measuring it…

Tricky, right? Now try it with some other abstract nouns people throw around daily, like “memory” and “intelligence” and “love” and “attention” and so on. It’s damned near miraculous that any of us understand ourselves, let alone one another.

And yet, this is exactly the first hurdle that psychology researchers must clear in order to make scientific progress. In order to study mental processes, they must create precise and measurable proxies — metrics — to work with. So, how do psychologists and other social scientists think about metric design?

How do you rigorously, scientifically study concepts that you can’t easily define? Concepts like توجہ, کی اطمینان، اور تخلیقی? The answer is… you don’t! Instead, you چلانے. For the purposes of this example, let’s suppose you’re interested in measuring صارف کی خوشی.

What is operationalization?

What is operationalization? I’ve written an intro article to it یہاں for you, but the upshot is that when you operationalize, you first say to yourself, “I am never going to measure happiness and I’ve made my peace with that.” Philosophers have been at this for thousands of years, so it’s not like you’re suddenly going to come up with a single definition that satisfies سب.

Next, you distill the measurable essence of your concept into a proxy.

Always remember that you are not actually measuring happiness. Or memory. Or attention. Or intelligence. Or any other poetic fuzzword, no matter how grand it sounds to you.

Now that we’re okay with the fact that we’ll never measure happiness and its friends, it’s time to ask ourselves why we even considered that word in the first place. What is it about this concept — in its fuzzy form — that seems relevant and pertinent to the decision we want to make? What concrete (and obtainable!) information would lead us to prefer one course of action over another? (Metric design is much easier when you have اعمال in mind before you begin. If possible, think about potential decisions before attempting to design a metric.)

Then we distill the core idea that we are after to create a measurable proxy — a metric that captures this core essence we care about.

Define your metric before you name it.

And now comes the fun part! We’re allowed to name our metric anything we like: “blorktibork” or “user happiness” or “X” or whatever.

The reason it doesn’t make sense for us to be arrested by the language police is that no matter how hard we work at designing it, our proxy will *نہیں* be the Platonic form of user happiness.

While it may suit ہمارے needs, it’s important to remember that our metric is unlikely to fit everyone else’s needs too. That’s why it would be silly to lock horns in a useless debates about whether our metric does or does not capture True Happiness. It doesn’t. If you’re desperate for some kind of One Metric To Rule Them All, there’s a Disney song for you.

Any metric we create is simply a proxy that suits our own needs (and possibly no one else’s). It’s our personal means to a personal end: making an informed decision or summarizing a concept so we don’t have to write a whole paragraph every time we mention it. We can get along just fine without involving the language police in either one.

So far, so good. You simply determine what information you’d need for your decision, then you figure out a way of summarizing that information in a way that makes sense for your needs (ta-da, کہ your metric), and then name it whatever you like. Right? Right, but…

اس is a hardest part to all this. Any guesses as to what it might be? Tomorrow, I’ll share the answer with you — don’t forget to subscribe either here on Medium or on social media (ٹویٹر, لنکڈ) so you don’t miss it. In the meantime, share your thoughts on what the hardest part of metric design is یہاں or یہاں.

If you’re keen to learn more, watch lessons 039–047 from my Making Friends with Machine Learning course. They’re all short videos of a couple of minutes long. Start here and continue in the attached playlist:

اگر آپ کو یہاں مزہ آیا اور آپ ایک لاگو کردہ AI کورس تلاش کر رہے ہیں جو ابتدائی اور ماہرین کے لیے یکساں طور پر تفریح ​​کے لیے ڈیزائن کیا گیا ہے، تو یہ ہے میں نے آپ کی تفریح ​​کے لیے بنایا ہے:

PS کیا آپ نے یہاں میڈیم پر ایک سے زیادہ بار تالی کے بٹن کو دبانے کی کوشش کی ہے کہ کیا ہوتا ہے؟ ❤️

چلو دوست بن جائیں! آپ مجھے تلاش کر سکتے ہیں۔ ٹویٹر, یو ٹیوب پر, سب اسٹیک، اور لنکڈ. مجھے آپ کی تقریب میں بات کرنے میں دلچسپی ہے؟ استعمال کریں۔ اس فارم رابطے میں رہنے کے لئے.

Metric Design for Data Scientists and Business Leaders Republished from Source https://towardsdatascience.com/metric-design-for-data-scientists-and-business-leaders-b8adaf46c00?source=rss—-7f60cf5620c9—4 via https://towardsdatascience.com/feed

<!–

->