From insight to impact.

Using the ‘Perfect Information Concept’ for Smarter Analysis

In the presence of perfect information, there is no need for analytics. In fact, the whole aim of analytics, with all its methods, models, algorithms, and statistics, is to get as close to perfect information as possible (or, better said, as close as necessary). The analytics professional would do well to keep this aim in mind, as it has a way of focusing the analysis and getting rid of any wasteful processes.

Let’s take an example – one that illustrates well the value of aiming for perfect information. We will have a look into the field of web analytics.

Suppose we were just given access to a large set of web analytics data for a company that sells pugs (yes, the animals), and they want you to ‘optimize their website for pug sales’. The novice analyst, without any regard to what the phrase ‘optimize for pug sales’ even means, would no doubt jump right into the boundless data set and get lost in a fog of pageviews, unique visits, time on site, and convoluted navigational summaries. But this is not what is going to happen to us, because we are going to pause, consider what the concept of perfect information can tell us, and then dive into an effective session of analytics with the aim of selling lots and lots of pugs.

A Simple Question

First, we’ll consider a question. If we could know everything we needed to know in order to optimize pug sales, what would we want to know? Don’t be realistic here; remember, we’re discussing the inherently unrealistic concept of perfect information. Here’s what my pug selling informational paradise would look like:

I would know every single person in the United States of America who wants to own a pug. I would know them by name, where they lived, how much they were willing to pay, and how many pugs they would want. I would know the best time to reach all of these people, and I would know what method they would prefer to be communicated with, whether that be phone calls, direct mail, digital media, personal visits, smoke signals or carrier pigeons. I would know what motivates their love for pugs and what need having a pug would fulfill in their lives. And remember, I would know all this about each person individually. Further, I would know, by name, each person in the United States that could be persuaded into buying a pug. I would know all of the above information about them, along with what exactly it would take for them to make the decision to take home a pug, whether that be an Internet advertisement, a informational video, a seminar, a mailer piece, a discussion over a croissant lunch, or whatever else. I would know this about each and every one of them.

Phew! What a paradise! Unfortunately (or rather, we might say, fortunately), it is impossible for me to know all of these things. Getting all this information would take an infinite amount of time, and that’s to say nothing about keeping it updated. So what are we to do? We’ve taken the proverbial journey into pug selling informational heaven, only to realize we’ll never achieve it in this life.

But we don’t need to. The picture of everything we would want to know, in a perfect situation, is a useful framework to use as we start to list out all of the things that we can know.

We can’t know by name everyone in the U.S. that currently wants to own a pug. But what indications can we use to find and get to as many of them as possible? One – people searching for anything related to ‘pugs’, especially ‘buying pugs’, in search engines, will be an attribute of these people. Optimize for these terms and put up some relevant search engine advertising. Two – people looking at dog sites or pet sites, like petfinder.com, are also in the market, perhaps, for a pug. Advertise on these sites. Three – people that find your site and actually take time to browse the ‘pugs for sale’ pages or start entering in information on your shopping cart. Optimize this process for them. And on and on.

Above, we talked about persuading people to buy pugs – about knowing what it is that will convince them to make the buy decision. We can’t know this for every single person, but we can know it for certain types of people. I’d start by doing some analysis of the various past blog posts that the company has put up – which ones have been the most popular, induced the most checkouts, and brought the highest level of engagement? What were they about? You may notice that they were about finding companionship, or about giving a dog a good home, or about guarding your house from intruders (a stretch for a pug, I know, but perhaps they’d be effective at keeping away small cats). These are key findings into what is motivating people to buy pugs. (And if such a blog with diverse topics doesn’t exist, perhaps it’s time to start one. . .)

Conclusion

We can go on and on here. But I think the point is clear – start with what you would know in the perfect scenario, and work your way backwards into what you can know with the available resources and data. As you do this, you’ll notice that the individual information we knew in paradise will manifest itself as understanding certain groups of people with similar tendencies, or customer segments. These segments are the currency of effective analytics.

Please also take note that we did not actually stay within the realm of web analytics click-stream data as we were doing our analysis. This is important! Just because you have endless web analytics data doesn’t necessarily mean it is the most useful way at getting the information you need to know. Don’t let yourself get cornered – understand what you need to know, and then use the best resources available to you, whatever they may be, to know it.

Perfect information to knowable information to the data resources available for knowing it – that’s the thought process. If you do it the other way, you’ll soon find yourself spending many hours sifting through a sea of data, only to come up thirsty for insights. Don’t let that happen to you.

Share

Learn Analytics From Stanford, For Free

Analytics is a hard subject to learn well.  It involves the bringing together of several disciplines, such as statistics, business strategy, machine learning, data base management, computer science, etc.  It will therefore be necessary for the analyst to have a firm grasp and understanding of all of these topics and more – a daunting task, to say the least.

What if you could get Standford level learning and course material on these topics to help you become a better analyst.  And, what if you could get it without cost?  The world would be your oyster.

As it happens, today is the day the world becomes your oyster.  Stanford has started to leverage the capabilities of the internet to bring high level course work and education to the masses – for free.  And what’s more, the classes they are currently offering happen to be highly correlated with those skills necessary to be good at analytics.  Some of the free courses offered include Machine Learning, Introduction to Databases, Natural Language Processing, and Programming Methodology.

This is an awesome opportunity.  All you need to bring to the table is your time and some effort – the knowledge and course structure are there waiting for you.  Check out a class listing here, and the database class here.

Kudos, Standford.

 

Share

Analytics People Will Pay For

What kind of analytics are people willing to pay for?  That’s a fair question – it shows, perhaps, where there is greatest need and where one might successfully start up a business.  Let’s answer that question with a little analytics ourselves.

First, we need a data set.  Where might we find data on the kinds of analytics people pay for?  Doubtless there a various choices, but I think it would be wise to have a look at the current top analytics vendor, which, as anyone in the analytics space knows, is SAS.  Assuredly, they must have some customer testimonials and success stories, from which we can extrapolate the kinds of analytics being sold.

We are not disappointed in this assumption; in fact, we are pleasantly surprised.  Have a look at the SAS customer testimonials page.

That’s a TON of analytics success story data; and what’s more, it’s already structured into a nice data format!  Scrapping a little bit of data from the page, we can produce the following table, which shows the number of customer success stories by industry-

WOW!  That’s 665 accounts of people paying for analytics (and being happy about it) across 23 industries.  I believe we’ve found a rich data source for understanding the value that analytics has and how we can in turn apply it to solve real world problems.

We could go and have a look at all 665 successes to get an extremely broad overview of the space, but since life is all about decisions and segmentation, I’m going to leave the banking industry to SAS and have look at some of the more interesting verticals.  There are some fascinating things here.

Share

Google’s Pricing Strategy: The Automated Auction

Let’s take a moment and consider one of the more interesting of the pricing models – the auction.  And to see this model at its full potential, we’ll want to analyze the real world example of the company that got auctioning right, and is currently leveraging it to pull in billions of dollars every quarter: Google.

Yes, everyone’s favorite search engine is a giant auctioning machine.  You sign up for Adwords, put in a maximum bid, and BAM!  You’re in the largest and most sophisticated automated auction in the world.  There are many beauties and subtleties of the system.

Subtlety One

One, there is almost infinite segmentation.  If you can search for it, you can put an ad up for it – and with people searching for things like “pugs for sale in east sussex”, “ornithine transcarbamylase deficiency”, “my hamster is afraid of me”, and everything in between, there’s really no limit.  So how do you efficiently price an infinite amount of different ads? The automated auction.

Subtlety Two

A second aspect of Google’s Adwords sales is that the transactions need to be made quickly and effectively, because so many of them need to happen daily (on the order of billions per day, I’d estimate).  You therefore must have the auction automated, or else you could never hope to reach the scale necessary to accomplish the task.  So what else does the automated auction do for Google?  It provides the ability to scale.

Subtlety Three

What about a third aspect?  How about the fact that it’s impossible to know what the actual value is for a given ad space for a set of keywords at any given time?  How do you set a price for something like that, especially when it’s changing so often?  Again, the answer – the automated action.

It really is a genius concept.  But now we must be dutiful innovators and ask ourselves, what else could the automated auction be applied to?  Or, what other markets and product sets have the same kinds of characteristics as the three we just enumerated above?

Insurance

How about the insurance market?  Do we see infinite segmentation?  I think we do – you have people’s age, socio economic status, yearly income, health levels, gender, risky behaviors, etc. etc. etc., and all the combinations of all of those things – all of which could be used to determine a premium for health insurance, car insurance, home insurance, life insurance, etc. etc. etc.  Do transactions need to be made quickly?  Perhaps not on the daily basis that we see happening with Google, but with the number of people that could use an insurance policy (everyone) and the frequency that some of the above factors could change, it may be useful to have a system that would allow for more transactions to take place without demanding extra time.  And the third – impossibility of knowing the exact value of any given set of insurance policies for a given individual.  That one is in the bag – even with all of the sophisticated data crunching algorithms the industry uses today, we still haven’t quite been able to pin it down.

I wonder how the concept of the automated auction could transform the insurance industry.  (or any other industry, for that matter, that has a semblance of these same three characteristics.)

Share

Setting Effective Problem Solving Parameters with OOPSS

Done right, the first step to doing good analytics has nothing to do with math or calculations or equations – these come later. The first step is taking time to understand the problem that is to be solved, who it’s being solved for, and what the context of the situation is. Don’t let the impatient quant inside of your head take over before you’ve taken time to set the parameters of the problem.

So, for an example, lets start out with a problem people in the business world confront on a regular basis – pricing. They need to know what the price point is that will maximize their profits, and this can often be a difficult thing to pin down – a prime opportunity for analytics to step in with a helping hand.

Segments

We’ve defined our problem: people need to know how to price accurately. Now, which of those people are we going to try and help with our analytics? People selling consumer products? People selling professional services? People selling entertainment? People selling heavy machinery?

What level of understanding do they currently have of pricing and analytical methods? Are they beginners, intermediates, advanced, or PhD level geniuses? We also want to know the scope and context of their pricing strategy – are they introducing a new product or selling an old one? Are they operating on a large scale, like a Proctor and Gamble type business, or are they selling garage sale items on eBay? How fierce is the competition for the product/service they are selling? The closer we can narrow down the segment to a definable person, the better we will be able to understand and serve them.

It’s critical that we understand this target person. If we don’t, we may find ourselves pontificating about the finer points of a predictive neural network pricing model to optimize a large scale skimming strategy to someone who’s never even seen a supply and demand curve. And that would be embarrassing.

Capabilities

Keeping all of the above in mind, it’s also important to consider your capabilities and the resources available to you for designing such an analytical product. What is your expertise? What are the capabilities of your organization? What interests you? How much can you invest in the project? To quote an ancient Greek aphorism, “Know Thyself.”

Subject Matter

Then we must consider the scope and limitations demanded by the subject matter. Pricing analytics, for example, could include treatments of topics such as penetration vs. skimming pricing strategies, value pricing strategies, Conjoint analysis, the Van Westendorp Price Sensitivity Meter, commonly used pricing algorithms, data sources for pricing across the web, how to run robust pricing experiments, and so on and so on. Many of these topics could cover a few of the segments above at the same time (value pricing, for example, would help people selling products or services equally well). What about limitations? Pricing analytics is only as useful as far as the availability or ease of gathering relevant data to take action on exists; if the situation precludes this, the subject matter cannot help.

Conclusion

The key, then, is to convert the appropriate subject matter, covering the right segments, into a product that you are optimally capable of producing. Phew! I think we are discovering that setting the correct parameters for the problem to be solved is almost as much work (if not more so) as the actual data crunching part. To aid us in the understanding of this process, I’ve created a sophisticated circle chart below that provides, at best, marginal value.  But I thought was clever all the same (I drew it in about 14 seconds):

So there you have it – because the world needs another acronym, we have created the OOPSS – Our Optimal Problem Solving Sector. (Pronounced, of course, as either “oops” or “oh oh, p.s.s.”, depending on the feeling you may want to convey at any given time)

Be there, and you and everyone you know will be happy.

 

Share

How to Price Your Product in 1 Minute

Let’s say I have an idea for a new product I want to take to market, and I want to understand (naturally) what the price points for this particular product might be.  Let’s pretend further, for the sake of having an example, that my new product is a fiction book.
 
I may say to myself, “Now days, fiction books may not be very profitable, because with the advent of kindles and e-readers people aren’t willing to pay more than around .99 cents for an electronic copy of a book.”  And if I did say this to myself, I would be terribly wrong.  Let’s see how a quick 1 minute of research can help clear up this erroneous idea.

First, let’s take a trip over to the master database of product pricing – Amazon.com.  We notice a wonderful bit of functionality across the top, called the Search Bar, in which I will place the often unruly wildcard character (*).  In essence, I’m telling Amazon, “give me everything you’ve got.”

And it turns out Amazon has about 115 million products it returns.  Ample data, I would say, for pricing.  However, in this particular case we recall that we want to understand the price points of fiction books, so we will employ the analysts first rule of success – segmentation.  And thankfully, Amazon makes it easy for us – affording a glance to the left navigation bar, we will very cleverly click through the following series of topics to get to the data of interest: “Books -> Science Fiction and Fantasy -> Fantasy”

Hmmm. . . at a first glance, I may think that my fist notion was correct.  I’m seeing a lot of titles selling for “$0.00″.  It would seem that the kindle’s ruthless digitization of old fashioned paperbacks has doomed my dreams of ever selling a new fiction.  Until, of course, I decide to segment further by clicking on either the “New Releases” or “Best Sellers” buttons running along the top.

Aha!  Now I have a list of fiction books that people are actually buying, and I like the new price points I see – $18.40, $16.99, $7.99, ect.  A lot better than $0.00.   Most of the “analytics” is already done, because my previous erroneous notion has been proven false, and I now have a good estimate of where books that sell set their prices.

We can take this one quick step further, just to add a slight bit of data processing to our conclusions.  We will use two free tools that will make our data investigation so easy and fun it may feel like we’re eating red velvet cake.  Tool one: Google Docs.  Tool two: Google Chrome Scraping Tool.  If you don’t currently have this tools, please take a moment to enhance your life and get them.

Now back on our Amazon page, we do something easy and intuitive – highlight with the mouse the piece of information we want to analyze (the price), left click, and hit “scrape similar.”

Upon the click, we will find ourselves with the following screen:

Now, we have a complete list of every book price on that web page.  What if we want to pull out an average and a median?  Enter Google Docs.  Open up a new spreadsheet, and type in the following formula:    =importxml(“webpage“,”xml“).  You will be replacing the bold webpage with the URL of the Amazon page, and the xml with the highlighted xml that the scraping tool gave you, highlighted above.  (Also, please don’t forget the quotes (“”) in the formula, or this will all end in disaster.)  Once finished, you will end up with something like the below:

Wow!  That was easier than expected.  Don’t forget, you could also go back to Amazon, click on more results, and use those URLs in the same manner to give you more data.  If this 45 seconds of work is starting to wear on you, however, you can just grab the average and median of this current set, using the properly named functions  =average() and =median() in the Google Doc.

As it turns out, I would want to set my price somewhere around $14.00, much better than the $0.99 I had originally thought.  That’s a big difference in margin and profits coming in as a result of 1 minute of analysis!  And I could go deeper into the analysis, looking at the distribution curves, standard deviations, etc. etc.  But the analytics should never be more sophisticated than necessary for the task at hand (that would be a waste of precious time and effort!), and the task has been accomplished – I’ve given myself a ballpark, reasonable range for pricing a new fiction book.  Done.

Share

Netflix Price Increase – good business sense or a boondoggle?

Recently Netflix raised it prices 60% for many of their subscribers. While I do not have insight into their financial model or how that will impact profitability, I think the price increase was a mistake for the following reasons: Read More »

Share

What are Profit Levers?

Your CEO asks you to increase profitability.  First, find your profit levers. Read More »

Share

Improve Direct Marketing ROI with Visual Analytics

The only way to make your marketing campaigns more effective is to use good analytics. The best analytics are visual. Read More »

Share

Creating the Client Profitability Map

Making a client profitability map using a 2 x 2 matrix segments clients by profitability and also business volume.  This can give managers a clear course of action as detailed in the chart below.  Map volume on the x axis and profit on the y axis.  Divide your range of results into low and high quadrants by profit and volume.  The next post will show a Client Profitability Map.  The quadrants are defined as follows:

Related Posts with Thumbnails
Share