Tag Archives: Chittoor

Using Predictive Analytics on Web Data

Analytics around Web data have been a standard part of a marketer’s tool kit for years now. Free tools like Google Analytics have made it easy to track basic website metrics. At the same time, the market for paid Web analytics tools is growing rapidly, and is expected to generate close to a billion dollars in revenue by 2014. Analytics has been a powerful tool even for companies not on the Web. In a Harvard Business Review publication, “Competing on Analytics,” Thomas Davenport has examined how companies gain an edge using analytics. His research, which looks at companies like Marriott, Harrah’s, and Capital One among others, highlights the role of analytics in functions ranging from supply chain and R&D to customer selection, loyalty, and service.  The key to the success for many of these companies — and what companies of all sizes can learn from — has been to not only look at metrics retroactively to analyze what happened, but also to develop models to predict optimal offerings for the future.  In Davenport’s words Marriott  “has developed systems to optimize offerings to frequent customers and assess the likelihood of those customers’ defecting to competitors,” and the UPS Customer Intelligence Group “is able to accurately predict customer defections by examining usage patterns and complaints. When the data point to a potential defector, a salesperson contacts that customer to review and resolve the problem, dramatically reducing the loss of accounts.” This kind of analysis, known as “predictive analytics,” is still not commonly employed at Web companies, or commonly available in Web analytics tools. Most of the common analyses and tests done by Web companies treat are centered on the notion of “visitors” to their website (transactional, one time relationship with consumers, typically driven by traffic coming from search engines) rather than “users” of their service (longer term relationship, typically involves creating a user account with the Web service).  For lack of better terminology, I’ll refer to these two distinct notions as “visit-centric” and “user-centric” models of the world. In a visit-centric model of the world, common metrics include “time spent,” “click through rates” and “conversions”.  Free tools like Google Analytics are widely used for these analytics.  In a user-centric view, the metrics tend to be somewhat different. In his post “start-up metrics for pirates,” blogger Dave McClure talks about the five steps in the customer lifecycle of a user-centric model: Acquisition, Activation, Retention, Referral, and Revenue (AARRR). Others have talked about using methods like cohort analysis to measure whether these metrics are improving for progressive cohorts of users.  Not only are the metrics different, the methods for optimization that are applied in the visit-centric world don’t suffice in the user-centric world. In the former, you could run A/B tests to optimize “landing pages” and improve metrics on click-through rates and conversions per visit. Google Website Optimizer is a free tool for performing this optimization. In a user-centric world, a/b tests continue to be important. However, an important range of questions cannot be answered well, or optimized using a/b tests.  For example, it’s hard to associate metrics for users’ repeat visits with the immediate impact of changes on any particular page. Some other examples of problems that are difficult to answer or solve using visit-centric analysis include: How often should you send marketing communication to your users, and who are the customers who are likely to respond positively to this communication? What actions, over the long run, help reduce user churn and increase repeat usage or increased revenue per user? If a/b tests aren’t going to be sufficient, what other analytics should companies build? And if revenues are going to materialize over a period of time, how can companies make sure they don’t wait for months to understand the effectiveness of marketing dollars spent today? That’s where predictive analytics comes in. Historical customer data, which includes behavioral, transactional and demographic data, is mined to develop a model that predicts future behavior. Analytics companies like SPSS and Prediction Impact have talked about how to use predictive analytics for developing actionable predictions for each customer and decision optimization. These methods clearly need rich data about customers, which can form the basis for modeling. The good news is that it’s possible for user-centric Web companies to have rich and high-integrity data about signed-in users who have created rich profiles. This is not true for visit-centric companies where predictive analytics runs into a lot of challenges, as noted in this post (note that all the challenges mentioned by the author implicitly assume a visit-centric model — e.g. the author talks anonymity, or the inability to tie customer data to customer attributes).  It’s interesting to note that other industries that have a similar view of the customer lifecycle as the AARRR model have used predictive analytics to good effect. For instance, in the travel and hospitality industry, predictive analytics techniques have been used for acquiring customers in a cost-effective manner, for fine-tuning marketing offers that increase repeat-usage, and for increasing revenue through effective cross selling and better yield management. In the mobile industry, similar techniques have been used to reduce churn (i.e., increase retention) and improve profitability.  Savvy Web companies have also started using these techniques. For instance, Facebook has used R in predictive analytics to answer questions like “Which data points predict whether a user will stay? And if they stay, which data points predict how active they’ll be after three months?” The gaming company Zynga split its analytics team into two to become more proactive about analytics; while one team does the conventional reporting, the other “tests hypotheses and creates models using statistical and analytical methods.”  Looking at their success, it’s clear that many others will follow suit. If your Web service and your business model are built for repeat usage, you are probably already measuring metrics across the entire customer lifecycle from acquisition to repeat usage and revenue. By using predictive analytics, you can lower your cost of acquiring users, ensure sticky customers, and increase your revenue, just like Facebook, Marriott, and UPS. Vijay Chittoor is a co-founder of Mertado Social Deals. He was previously director of product management at Kosmix. A former McKinsey consultant, Chittoor is a graduate of Harvard Business School and the Indian Institute of Technology, Bombay.  He shares his thoughts on technology at his blog.  

Using Predictive Analytics on Web Data

Analytics around Web data have been a standard part of a marketer’s tool kit for years now. Free tools like Google Analytics have made it easy to track basic website metrics. At the same time, the market for paid Web analytics tools is growing rapidly, and is expected to generate close to a billion dollars in revenue by 2014. Analytics has been a powerful tool even for companies not on the Web. In a Harvard Business Review publication, “Competing on Analytics,” Thomas Davenport has examined how companies gain an edge using analytics. His research, which looks at companies like Marriott, Harrah’s, and Capital One among others, highlights the role of analytics in functions ranging from supply chain and R&D to customer selection, loyalty, and service.  The key to the success for many of these companies — and what companies of all sizes can learn from — has been to not only look at metrics retroactively to analyze what happened, but also to develop models to predict optimal offerings for the future.  In Davenport’s words Marriott  “has developed systems to optimize offerings to frequent customers and assess the likelihood of those customers’ defecting to competitors,” and the UPS Customer Intelligence Group “is able to accurately predict customer defections by examining usage patterns and complaints. When the data point to a potential defector, a salesperson contacts that customer to review and resolve the problem, dramatically reducing the loss of accounts.” This kind of analysis, known as “predictive analytics,” is still not commonly employed at Web companies, or commonly available in Web analytics tools. Most of the common analyses and tests done by Web companies treat are centered on the notion of “visitors” to their website (transactional, one time relationship with consumers, typically driven by traffic coming from search engines) rather than “users” of their service (longer term relationship, typically involves creating a user account with the Web service).  For lack of better terminology, I’ll refer to these two distinct notions as “visit-centric” and “user-centric” models of the world. In a visit-centric model of the world, common metrics include “time spent,” “click through rates” and “conversions”.  Free tools like Google Analytics are widely used for these analytics.  In a user-centric view, the metrics tend to be somewhat different. In his post “start-up metrics for pirates,” blogger Dave McClure talks about the five steps in the customer lifecycle of a user-centric model: Acquisition, Activation, Retention, Referral, and Revenue (AARRR). Others have talked about using methods like cohort analysis to measure whether these metrics are improving for progressive cohorts of users.  Not only are the metrics different, the methods for optimization that are applied in the visit-centric world don’t suffice in the user-centric world. In the former, you could run A/B tests to optimize “landing pages” and improve metrics on click-through rates and conversions per visit. Google Website Optimizer is a free tool for performing this optimization. In a user-centric world, a/b tests continue to be important. However, an important range of questions cannot be answered well, or optimized using a/b tests.  For example, it’s hard to associate metrics for users’ repeat visits with the immediate impact of changes on any particular page. Some other examples of problems that are difficult to answer or solve using visit-centric analysis include: How often should you send marketing communication to your users, and who are the customers who are likely to respond positively to this communication? What actions, over the long run, help reduce user churn and increase repeat usage or increased revenue per user? If a/b tests aren’t going to be sufficient, what other analytics should companies build? And if revenues are going to materialize over a period of time, how can companies make sure they don’t wait for months to understand the effectiveness of marketing dollars spent today? That’s where predictive analytics comes in. Historical customer data, which includes behavioral, transactional and demographic data, is mined to develop a model that predicts future behavior. Analytics companies like SPSS and Prediction Impact have talked about how to use predictive analytics for developing actionable predictions for each customer and decision optimization. These methods clearly need rich data about customers, which can form the basis for modeling. The good news is that it’s possible for user-centric Web companies to have rich and high-integrity data about signed-in users who have created rich profiles. This is not true for visit-centric companies where predictive analytics runs into a lot of challenges, as noted in this post (note that all the challenges mentioned by the author implicitly assume a visit-centric model — e.g. the author talks anonymity, or the inability to tie customer data to customer attributes).  It’s interesting to note that other industries that have a similar view of the customer lifecycle as the AARRR model have used predictive analytics to good effect. For instance, in the travel and hospitality industry, predictive analytics techniques have been used for acquiring customers in a cost-effective manner, for fine-tuning marketing offers that increase repeat-usage, and for increasing revenue through effective cross selling and better yield management. In the mobile industry, similar techniques have been used to reduce churn (i.e., increase retention) and improve profitability.  Savvy Web companies have also started using these techniques. For instance, Facebook has used R in predictive analytics to answer questions like “Which data points predict whether a user will stay? And if they stay, which data points predict how active they’ll be after three months?” The gaming company Zynga split its analytics team into two to become more proactive about analytics; while one team does the conventional reporting, the other “tests hypotheses and creates models using statistical and analytical methods.”  Looking at their success, it’s clear that many others will follow suit. If your Web service and your business model are built for repeat usage, you are probably already measuring metrics across the entire customer lifecycle from acquisition to repeat usage and revenue. By using predictive analytics, you can lower your cost of acquiring users, ensure sticky customers, and increase your revenue, just like Facebook, Marriott, and UPS. Vijay Chittoor is a co-founder of Mertado Social Deals. He was previously director of product management at Kosmix. A former McKinsey consultant, Chittoor is a graduate of Harvard Business School and the Indian Institute of Technology, Bombay.  He shares his thoughts on technology at his blog.  

Using Predictive Analytics on Web Data

Analytics around Web data have been a standard part of a marketer’s tool kit for years now. Free tools like Google Analytics have made it easy to track basic website metrics. At the same time, the market for paid Web analytics tools is growing rapidly, and is expected to generate close to a billion dollars in revenue by 2014. Analytics has been a powerful tool even for companies not on the Web. In a Harvard Business Review publication, “Competing on Analytics,” Thomas Davenport has examined how companies gain an edge using analytics. His research, which looks at companies like Marriott, Harrah’s, and Capital One among others, highlights the role of analytics in functions ranging from supply chain and R&D to customer selection, loyalty, and service.  The key to the success for many of these companies — and what companies of all sizes can learn from — has been to not only look at metrics retroactively to analyze what happened, but also to develop models to predict optimal offerings for the future.  In Davenport’s words Marriott  “has developed systems to optimize offerings to frequent customers and assess the likelihood of those customers’ defecting to competitors,” and the UPS Customer Intelligence Group “is able to accurately predict customer defections by examining usage patterns and complaints. When the data point to a potential defector, a salesperson contacts that customer to review and resolve the problem, dramatically reducing the loss of accounts.” This kind of analysis, known as “predictive analytics,” is still not commonly employed at Web companies, or commonly available in Web analytics tools. Most of the common analyses and tests done by Web companies treat are centered on the notion of “visitors” to their website (transactional, one time relationship with consumers, typically driven by traffic coming from search engines) rather than “users” of their service (longer term relationship, typically involves creating a user account with the Web service).  For lack of better terminology, I’ll refer to these two distinct notions as “visit-centric” and “user-centric” models of the world. In a visit-centric model of the world, common metrics include “time spent,” “click through rates” and “conversions”.  Free tools like Google Analytics are widely used for these analytics.  In a user-centric view, the metrics tend to be somewhat different. In his post “start-up metrics for pirates,” blogger Dave McClure talks about the five steps in the customer lifecycle of a user-centric model: Acquisition, Activation, Retention, Referral, and Revenue (AARRR). Others have talked about using methods like cohort analysis to measure whether these metrics are improving for progressive cohorts of users.  Not only are the metrics different, the methods for optimization that are applied in the visit-centric world don’t suffice in the user-centric world. In the former, you could run A/B tests to optimize “landing pages” and improve metrics on click-through rates and conversions per visit. Google Website Optimizer is a free tool for performing this optimization. In a user-centric world, a/b tests continue to be important. However, an important range of questions cannot be answered well, or optimized using a/b tests.  For example, it’s hard to associate metrics for users’ repeat visits with the immediate impact of changes on any particular page. Some other examples of problems that are difficult to answer or solve using visit-centric analysis include: How often should you send marketing communication to your users, and who are the customers who are likely to respond positively to this communication? What actions, over the long run, help reduce user churn and increase repeat usage or increased revenue per user? If a/b tests aren’t going to be sufficient, what other analytics should companies build? And if revenues are going to materialize over a period of time, how can companies make sure they don’t wait for months to understand the effectiveness of marketing dollars spent today? That’s where predictive analytics comes in. Historical customer data, which includes behavioral, transactional and demographic data, is mined to develop a model that predicts future behavior. Analytics companies like SPSS and Prediction Impact have talked about how to use predictive analytics for developing actionable predictions for each customer and decision optimization. These methods clearly need rich data about customers, which can form the basis for modeling. The good news is that it’s possible for user-centric Web companies to have rich and high-integrity data about signed-in users who have created rich profiles. This is not true for visit-centric companies where predictive analytics runs into a lot of challenges, as noted in this post (note that all the challenges mentioned by the author implicitly assume a visit-centric model — e.g. the author talks anonymity, or the inability to tie customer data to customer attributes).  It’s interesting to note that other industries that have a similar view of the customer lifecycle as the AARRR model have used predictive analytics to good effect. For instance, in the travel and hospitality industry, predictive analytics techniques have been used for acquiring customers in a cost-effective manner, for fine-tuning marketing offers that increase repeat-usage, and for increasing revenue through effective cross selling and better yield management. In the mobile industry, similar techniques have been used to reduce churn (i.e., increase retention) and improve profitability.  Savvy Web companies have also started using these techniques. For instance, Facebook has used R in predictive analytics to answer questions like “Which data points predict whether a user will stay? And if they stay, which data points predict how active they’ll be after three months?” The gaming company Zynga split its analytics team into two to become more proactive about analytics; while one team does the conventional reporting, the other “tests hypotheses and creates models using statistical and analytical methods.”  Looking at their success, it’s clear that many others will follow suit. If your Web service and your business model are built for repeat usage, you are probably already measuring metrics across the entire customer lifecycle from acquisition to repeat usage and revenue. By using predictive analytics, you can lower your cost of acquiring users, ensure sticky customers, and increase your revenue, just like Facebook, Marriott, and UPS. Vijay Chittoor is a co-founder of Mertado Social Deals. He was previously director of product management at Kosmix. A former McKinsey consultant, Chittoor is a graduate of Harvard Business School and the Indian Institute of Technology, Bombay.  He shares his thoughts on technology at his blog.  

Online Retail: Getting the Right Product in Front of Your Customers

After surviving the bust at the end of the ’90s, online retail has done quite well in the first decade of the new millennium. From being just 0.6 percent of all retail in early 2000,online commerce has now grown to account for nearly 4 percent of all retail in the United States. In this article, we review some technology trends that are likely to further accelerate this trend. Our focus will be around looking at technologies that help consumers find the right product easily as well as help retailers put the right merchandise in front of customers. While most of these technologies trends apply to a wide spectrum of applications, their impact on online commerce deserves a special mention. Many of these technologies have been around for a while, but it’s only now that they are gaining wide adoption. Semantic Web and structured data The semantic Web and structured data will make product search dramatically better. Last year, Google made two subtle announcements that have the potential of completely transforming how users search for products.  The first affected Google’s organic (or unpaid) results, when the company launched what it called rich snippets, using microformats and Resource Description Frameworka (RDFa) standards. Google was late to the game, as Yahoo had already announced similar support a year ago. The second change applied to Adwords, Google’s paid search program, when the search engine started listing richer product listing ads from retail advertisers, displaying an image of the product, the price, and many other attributes. These ads will be priced on a “cost per action” basis, as opposed to the standard “cost per click” model that’s offered for all other Adwords advertisers. It is interesting that Google’s rich snippets were first rolled out only for 2 applications, one of which is closely related to online commerce: • Providing a summary of reviews, when searching for products or services.• Distinguishing between people with similar names, when searching for a person.  Similarly, Google’s CPA program was also rolled out only for product searches. Search-engines are already a very important tool for online shoppers, and a Nielsen study had found that more than one third of shoppers use search engines. Richer snippets and richer ads will make search engines even more important to shoppers, and consequently to retailers. According to Yahoo, “enhanced search results” drive 15 percent more clickthroughs for many websites.  With results like that, it’s no wonder that adoption is picking up among websites. In the same blog post, Yahoo reported an increase of more than 400% in the RDFs structured data driven by Search Monkey. Best Buy recently released their entire product catalog in RDFa, perhaps becoming the first Fortune-500 company to join this trend, and has reportedly seen strong results. Recommendations and personalization engines Recommendations and personalization engines are now available as plug and play components. Outside of search, one of the most important ways for shoppers to discover products has been through recommendation engines. Personalization and recommendation engines have been around for a while and have been a strong driver of sales. For example, Amazon’s recommendation system was said to account for up to 35 percent of sales in 2006. Recently, the adoption of recommendation engines has increased substantially because of the emergence of third party services that are easy to plug into your ecommerce store. For instance Urban Outfitters has seen a triple digit percentage increase in sale by using a solution offered by Baynote. Other companies like Mybuys and Certona also deliver hosted solutions for personalization. Creating application programming interfaces (APIs) Creating APIs that distribute products across the Web is easier. Over the last few years, the Web is increasingly becoming a collection of Web services that can be accessed through APIs. Retailers like Ebay and Amazon have for a long time used APIs to expose their data to the external world, primarily to affiliates and partners who then sell these products at other places on the Web. Now many traditional retailers are jumping into the fray, utilizing services that make it easier to create and manage APIs.  For instance, Best Buy recently launched Best Buy Remix powered by API management infrastructure from Mashery. In addition to these, in one of my previous columns I had written about how the real time Web is becoming an increasingly important tool, and how companies like Dell are using it to increase their online retail sales. The increasing adoption of these technologies sets up online commerce for an exciting new decade, for shoppers as well as for retailers. Vijay Chittoor is a co-founder of Six Times Seven. He was previously director of product management at Kosmix. A former McKinsey consultant, Chittoor is a graduate of Harvard Business School and the Indian Institute of Technology, Bombay.  He shares his thoughts on technology at his blog.    

The Real-Time Web and You

One of the biggest technology trends in 2009 has been the emergence of the “Real-Time Web.” The real-time Web is a made up of technologies and practices that can inform users as soon as information is published, instead of requiring users to check for updates. The real-time Web discards the traditional notion of the more static “webpages,” and instead adopts the notion of dynamic “streams” of information. The real-time Web is also very conversational because it makes it possible to get instant responses across very large networks of people. Action in the real-time Web started with companies like Twitter and Friendfeed, which built their own infrastructure for large scale delivery of real-time messages. By providing Web service application programming interfaces (APIs), these companies enabled many other developers to create applications based on the real-time Web. However, Anil Dash, a prominent blogger, points out that real time services need not be built on the back of Twitter and Facebook anymore. Due to emerging technologies, the pieces are falling together for creating a free, open and decentralized “pushbutton platform,” which makes it easy for websites to add real-time messaging services. With these developments, we can expect many more websites to jump onto the real-time bandwagon. Growing importance to business The real-time Web is becoming increasingly important to businesses in multiple ways. Firstly, as many webmasters and Web analytics companies have pointed out, the real-time Web is starting to rival search engines like Google as a source of website traffic. For example, Mark Cuban talked a few months ago about how his blog receives more visits from Twitter and Facebook than from Google. Secondly, the real-time Web opens up communication opportunities that the traditional Web could not have provided. For instance, if an airline wants to sell off its last minute tickets, the real-time Web provides a great outlet for advertising this very time-sensitive deal.  Thirdly, by making information instantaneously accessible, the real-time Web can create, or erase, instances of information arbitrage. As an example, take a look at Skygrid, a service that provides high quality financial news in real time, giving its users an edge, but at the same time leveling the playing field between professional investors and amateurs in terms of the speed of access to reliable information. Finally, because the real-time Web is very conversational, it becomes a repository of people’s sentiment, and mining this sentiment can be very useful to marketers and others. Taking advantage of real-time Web Beyond creating an account on Twitter, how can you take advantage of the real-time Web?  Here are some thoughts to get you started: Engage with the real-time Web with tailored offers and content. Several companies are seeing success with time-sensitive programs that could not have been conceived without the real-time Web. Jet Blue’s “cheeps” and United Airlines’ twares are exclusive Twitter promotions for last minute fare deals. Another company that has encountered great success with offering exclusive deals on Twitter is Dell. A Dell blog post from June mentioned that Dell had surpassed $2 million in Twitter sales fro Dell Outlet, which sells refurbished items, scratch and dent items, and previously ordered new laptops. The real-time Web also acts as a place where people express their intent to shop (e.g. someone may tweet “thinking of buying an ipod touch.”) Selectively targeting such users, without spamming them, might also be a great way to help your customers make real time buying decisions. A service like Twitterhawk can be used to automate this kind of marketing. Make use of real-time Web tools for business intelligence. The real-time Web is a great source of knowledge and sentiment about your customers, your competitors and your industry. You can use services like Firstrain to research the real Web for the news that matters to you. You could also use Twitter’s search functionality in simple ways to keep track of some of this information, or go to one of the many real time search engines. A recent article in mashable talks about the many tools that help analyze Twitter content. Join in the conversation about your company. In one of my previous articles, I had talked about how companies like Comcast are using Twitter to understand their customers’ concerns and address them. The conversational nature of real time web can be very powerful in building relationships with your customers. Create the infrastructure that allows your company to respond in real time. Real-time enterprise data integration has been around for a long time. However, with the emergence of the real-time Web and the opportunities it creates, it is becoming increasingly critical for companies to be able to access all their internal data in real time. In other words, “real-time data integration is no longer a luxury.” Vijay Chittoor is the director of product management at Kosmix, an exploration engine that offers a 360 degree view of any topic on the Web.  A former McKinsey consultant, Chittoor is a graduate of Harvard Business School and the Indian Institute of Technology, Bombay.  He shares his thoughts on technology at his blog.