While reading the latter I wondered if next year will truly be about integration (maybe next year will just continue this years’ “formation” trend, but then, maybe it will be much as Jeremiah predicts and turn into “integration”).
Still focusing on the Social Business Forecast types of social media organization structure (centralized, distributed, coordinated, multiple hub and spoke and holistic) it’s interesting to me in so far as with this “map” anyone can attempt to identify what type of organization they are working in, but disturbing because it is also easy to miss-categorize an organization, thinking it’s one of the 1.4% holistic when it’s really more like the 28.8% centralized, for example – see slide 12 of his deck ).
The devil is in the details, otherwise everything sounds easy and good even when it’s not (see the bottom of the post).
Half of the 140 social media strategists Jeremiah asked said SM-ROI would be one of their main goals for 2011.
Why don’t we just come out and say it, the new name of businesses that want to succeed using social media should now be called “Social Businesses”; they still do all the stuff they did before, but with an awareness business processes (and measurement processes) should converge in Social Media rather than Social Media being an “appendage” added on to everything else.
Actually think Jeremiah should call his deck Social Business Metrics and be done with it and leave ROI out of it.
Why? Because at the top of the pyramid (where the Business Metrics are) Revenue, Reputation and CSAT (I worked in the CSAT group when I was at IBM, btw so I know a bit about Customer Satisfaction) aren’t ROI measurements – they are qualitative measures as there is no auction or market that assigns a specific value to anyone’s social media reputation or a brand’s customer satisfaction. The rest of the metrics in the bottom two rungs of the Pyramid also don’t really map to any market assigned market values and any value they have is assigned by the brand (which are easy to fudge).
Sure, there is a net promoter score – but that’s not an ROI metric in my book though it correlates highly to ROI- still, it’s just another piece of data computed from qualitative input, in IBM’s case it came down to 4 questions that visitors were randomly asked when they visited IBM.com by using a Flash Applet that launched off the home page (and often gave us problems when we tried pulling data off Coremetrics/Surfaid – but that was back in the day).
Maybe I’m unfair in saying this … .but Frameworks need to come from people who actually pull and work with the data on a regular basis not so much from Web Strategists. Frameworks assume the data will fit together, but that’s often not possible to do with data being collected today – you need to do a lot of work in order to make anything fit together – go ask a carpenter or architect just how much work there is in making sure everything fits together and the whole building doesn’t fall down (because the foundation is sound).
I come at it from a different perspective, the diagrams should evolve from the bottom up and from people like me who actually pull data and make intelligence out of it, the social media analyst, not the business strategist, unless the strategist was first a data analyst working with similar datasets as they are drawing pyramids for (and continues to work with these things when they become a business strategist). Why?
Because the medium is the message …. unless you worked with the data itself and ways you had gather it you zero conception of what actually can be done with it - then figure out what you can do with it.
If you don’t do that, when you assemble all this data that the Social Media ROI Pyramid asked for, the inputs and outputs won’t match up ….. and I bet anyone who tried so far has been frustrated with the result they got, and probably had to “fluff” the diagrams and scorecards to get anything interesting to show up they could present to upper management. But then again, that’s what you have PR and Marketing firms for … right? Don’t they always end up “messaging” the data to make it fit …. because it doesn’t fit together when it comes out of the different data sources (totally manual in many cases) where it’s collected.
There’s also one more fly in the ointment with the Social Media ROI pyramid, though on the good side, at least it makes clear who gets what data – thank you Jeremiah Owyang, at least that problem is solved!
The issue is none of these three sets of metrics is connected to each other, they all look like separate reports that go to different stakeholders – in other words – it’s not actually a Framework, after all. Shouldn’t there have been a couple of up and down arrows in there as well?
I don’t know, but maybe the KPI’s you give to community managers can layer into the Business Stakeholders since the Social Media Monitoring Platforms do, with various levels of success, measure both check ins, and views (they don’t measure clicks – unless it’s a bit.ly or Radian6–>WebTrends/Site Catalyst/Google Analytics) but they certainly don’t layer into the Revenue, Reputation, CSAT stuff that the CEO’s get … right? How can they – there’s no assigned value (unless someone makes one up).
I close with a few quotes from Gary Angel – I asked Semphonic for a case study that will be published in my book (you’ll have to wait about 6 months before you can see the case study … but it’s well worth the wait).
“…. Enterprise dashboards are growing ever more complex. The integration of multiple data sources is great for providing a much broader and richer view of the competitive landscape and marketing funnel to marketing executives. However, using all these data sources comes with a significant price in terms of complexity – particularly around automation and internationalization.”
“….Getting the most value from social listening and panel-based research tools generally requires additional levels of classification of the data. Simple reporting of mentions data is not generally very interesting.
Classification of the data is often a manual process, by the way – though it can be automated – but it takes quite a bit of planning and effort … and if you lining up international data, your problems mushroom and get almost much more complex due to language, lexicon, local meanings that don’t translate well and need people who are familiar with all the ins and outs of a geography, language and culture along with local events on the ground- otherwise you miss too much of what’s important.
Gary goes on to finish with this regarding social media metrics…
“…. Because organizations haven’t hardened into standards in these areas yet and there is little organizational stake in any particular metric or method, it proved easier to adjust the reporting framework here than in the Website space.
This suggests that measurement organizations should move aggressively to standardize on robust measurement and reporting around social media before uncontrolled and poorly thought out “home-grown” measurements become organizational norms and acquire institutional stakeholders committed to their preservation.”
What Gary Angel wrote is exactly what Jeremiah Owyang is saying when …
“…….The Corporate Social Strategist Must Develop Frameworks Now. Most corporations are already forming in the “Hub and Spoke” formation (see data) which means a small cross-functional team is helping a variety of business units. Establishing a standard way of measuring now is important before corporations move into “Dandelion” where measurement strategy fragments into spokes.“
We’re at a stage where companies are going to create Frameworks one way or another – the time is ripe for Standards is now … and I might add, 2011 may more rightfully end up being called the year of “Standardization” rather than the year of “Integration”. But we’ll know for sure a year from now.
Let’s put it this way …. I want my book to be about building this stuff from the bottom up – where all the pieces fit together into something that actually makes sense, that you can look at, that’s what my Compete paper on Social Media Analytics and Ultra Violet data is all about – lining up business and measurement goals and metrics.
Tracking Social Media ROI using Spectrum Analytics