At this level, it is getting tricky. We observed in the past years that many ‘design thinking’ initiatives were actually transformation programs with the intention to change culture by introducing the principles of DT into the ways of working of the wider organization. On the one hand, we welcome such cultural interventions driven by design (thinking). On the other hand, we observed that change-inexperienced teams without much design expertise could only burn their fingers on something like this. It is the level where the most obstacles will be put in your way by the organization. Also, you cannot just apply the methods from product/service design thinking to challenges of this (higher) order. Thus such programs need to be (co)run by experienced change and design professionals bringing their more sophisticated repertoire of interventions. Such programs require sound financing and top executive buy-in too. Only then are they likely to become success stories like Intuit, IBM, or GOV.UK.
Here is a selection of example metrics on how one could measure at this level:
People Activity Metrics
- CEOs / decision-makers available calendar time for innovation
- # of people who have heard about design thinking
- # of people who received a training in design thinking
- # of people who regularly practice design thinking in their daily work, in product teams, or in recurring project work
- # of products/services built using design thinking
- Ratio of designerly job roles to other job roles (e.g. UX Designer, Design Researcher, etc.)
- Improved internal collaboration and knowledge sharing
- etc.
Organizational Output Metrics
- Large scale changes in thinking and behavior of training/program participants and other people in the organization, e.g. via Psychological Safety , Design Ecology 2.0 , or the metrics mentioned in the team and project levels.
- Training/program participant satisfaction, e.g. via NPS
- Increase in employee satisfaction and productivity
- Easier recruiting and retaining of talent
- etc.
References
{2420821:8WARPJ5K};{2420821:2SM73D92};{2420821:I7AA8MCC}
apa
default
asc
no
3810
%7B%22status%22%3A%22success%22%2C%22updateneeded%22%3Afalse%2C%22instance%22%3A%22zotpress-1567bbcccb824ad4c5d34edde5894d3c%22%2C%22meta%22%3A%7B%22request_last%22%3A0%2C%22request_next%22%3A0%2C%22used_cache%22%3Atrue%7D%2C%22data%22%3A%5B%7B%22key%22%3A%228WARPJ5K%22%2C%22library%22%3A%7B%22id%22%3A2420821%7D%2C%22meta%22%3A%7B%22creatorSummary%22%3A%22Porter%20and%20Nohria%22%2C%22parsedDate%22%3A%222018-07-01%22%2C%22numChildren%22%3A1%7D%2C%22bib%22%3A%22%3Cdiv%20class%3D%5C%22csl-bib-body%5C%22%20style%3D%5C%22line-height%3A%202%3B%20padding-left%3A%201em%3B%20text-indent%3A-1em%3B%5C%22%3E%5Cn%20%20%3Cdiv%20class%3D%5C%22csl-entry%5C%22%3EPorter%2C%20M.%20E.%2C%20%26amp%3B%20Nohria%2C%20N.%20%282018%2C%20July%201%29.%20What%20Do%20CEOs%20Actually%20Do%3F%20%3Ci%3EHarvard%20Business%20Review%3C%5C%2Fi%3E.%20%3Ca%20href%3D%27https%3A%5C%2F%5C%2Fhbr.org%5C%2F2018%5C%2F07%5C%2Fwhat-do-ceos-actually-do%27%3Ehttps%3A%5C%2F%5C%2Fhbr.org%5C%2F2018%5C%2F07%5C%2Fwhat-do-ceos-actually-do%3C%5C%2Fa%3E%3C%5C%2Fdiv%3E%5Cn%3C%5C%2Fdiv%3E%22%2C%22data%22%3A%7B%22itemType%22%3A%22magazineArticle%22%2C%22title%22%3A%22What%20Do%20CEOs%20Actually%20Do%3F%22%2C%22creators%22%3A%5B%7B%22creatorType%22%3A%22author%22%2C%22firstName%22%3A%22Michael%20E.%22%2C%22lastName%22%3A%22Porter%22%7D%2C%7B%22creatorType%22%3A%22author%22%2C%22firstName%22%3A%22Nitin%22%2C%22lastName%22%3A%22Nohria%22%7D%5D%2C%22abstractNote%22%3A%22A%20look%20at%20the%20data%20on%20how%20CEOs%20allocated%20their%20time%20among%20various%20activities%2C%20places%2C%20priorities%2C%20constituencies%2C%20and%20meetings%22%2C%22date%22%3A%222018-07-01T04%3A00%3A00Z%22%2C%22language%22%3A%22%22%2C%22ISSN%22%3A%220017-8012%22%2C%22url%22%3A%22https%3A%5C%2F%5C%2Fhbr.org%5C%2F2018%5C%2F07%5C%2Fwhat-do-ceos-actually-do%22%2C%22collections%22%3A%5B%22PLDH3R42%22%5D%2C%22dateModified%22%3A%222021-10-28T15%3A04%3A34Z%22%7D%7D%2C%7B%22key%22%3A%222SM73D92%22%2C%22library%22%3A%7B%22id%22%3A2420821%7D%2C%22meta%22%3A%7B%22creatorSummary%22%3A%22Edmondson%22%2C%22parsedDate%22%3A%221999%22%2C%22numChildren%22%3A1%7D%2C%22bib%22%3A%22%3Cdiv%20class%3D%5C%22csl-bib-body%5C%22%20style%3D%5C%22line-height%3A%202%3B%20padding-left%3A%201em%3B%20text-indent%3A-1em%3B%5C%22%3E%5Cn%20%20%3Cdiv%20class%3D%5C%22csl-entry%5C%22%3EEdmondson%2C%20A.%20%281999%29.%20Psychological%20Safety%20and%20Learning%20Behavior%20in%20Work%20Teams.%20%3Ci%3EAdministrative%20Science%20Quarterly%3C%5C%2Fi%3E%2C%20%3Ci%3E44%3C%5C%2Fi%3E%282%29%2C%20350%26%23x2013%3B383.%20%3Ca%20href%3D%27https%3A%5C%2F%5C%2Fdoi.org%5C%2F10.2307%5C%2F2666999%27%3Ehttps%3A%5C%2F%5C%2Fdoi.org%5C%2F10.2307%5C%2F2666999%3C%5C%2Fa%3E%3C%5C%2Fdiv%3E%5Cn%3C%5C%2Fdiv%3E%22%2C%22data%22%3A%7B%22itemType%22%3A%22journalArticle%22%2C%22title%22%3A%22Psychological%20Safety%20and%20Learning%20Behavior%20in%20Work%20Teams%22%2C%22creators%22%3A%5B%7B%22creatorType%22%3A%22author%22%2C%22firstName%22%3A%22Amy%22%2C%22lastName%22%3A%22Edmondson%22%7D%5D%2C%22abstractNote%22%3A%22This%20paper%20presents%20a%20model%20of%20team%20learning%20and%20tests%20it%20in%20a%20multimethod%20field%20study.%20It%20introduces%20the%20construct%20of%20team%20psychological%20safety-a%20shared%20belief%20held%20by%20members%20of%20a%20team%20that%20the%20team%20is%20safe%20for%20interpersonal%20risk%20taking-and%20models%20the%20effects%20of%20team%20psychological%20safety%20and%20team%20efficacy%20together%20on%20learning%20and%20performance%20in%20organizational%20work%20teams.%20Results%20of%20a%20study%20of%2051%20work%20teams%20in%20a%20manufacturing%20company%2C%20measuring%20antecedent%2C%20process%2C%20and%20outcome%20variables%2C%20show%20that%20team%20psychological%20safety%20is%20associated%20with%20learning%20behavior%2C%20but%20team%20efficacy%20is%20not%2C%20when%20controlling%20for%20team%20psychological%20safety.%20As%20predicted%2C%20learning%20behavior%20mediates%20between%20team%20psychological%20safety%20and%20team%20performance.%20The%20results%20support%20an%20integrative%20perspective%20in%20which%20both%20team%20structures%2C%20such%20as%20context%20support%20and%20team%20leader%20coaching%2C%20and%20shared%20beliefs%20shape%20team%20outcomes.%22%2C%22date%22%3A%221999%22%2C%22language%22%3A%22%22%2C%22DOI%22%3A%2210.2307%5C%2F2666999%22%2C%22ISSN%22%3A%220001-8392%22%2C%22url%22%3A%22https%3A%5C%2F%5C%2Fwww.jstor.org%5C%2Fstable%5C%2F2666999%22%2C%22collections%22%3A%5B%22PLDH3R42%22%5D%2C%22dateModified%22%3A%222021-10-27T15%3A00%3A41Z%22%7D%7D%2C%7B%22key%22%3A%22I7AA8MCC%22%2C%22library%22%3A%7B%22id%22%3A2420821%7D%2C%22meta%22%3A%7B%22creatorSummary%22%3A%22Royalty%20et%20al.%22%2C%22parsedDate%22%3A%222019%22%2C%22numChildren%22%3A0%7D%2C%22bib%22%3A%22%3Cdiv%20class%3D%5C%22csl-bib-body%5C%22%20style%3D%5C%22line-height%3A%202%3B%20padding-left%3A%201em%3B%20text-indent%3A-1em%3B%5C%22%3E%5Cn%20%20%3Cdiv%20class%3D%5C%22csl-entry%5C%22%3ERoyalty%2C%20A.%2C%20Chen%2C%20H.%2C%20Roth%2C%20B.%2C%20%26amp%3B%20Sheppard%2C%20S.%20%282019%29.%20Measuring%20Design%20Thinking%20Practice%20in%20Context.%20In%20C.%20Meinel%20%26amp%3B%20L.%20Leifer%20%28Eds.%29%2C%20%3Ci%3EDesign%20Thinking%20Research%26%23x202F%3B%3A%20Looking%20Further%3A%20Design%20Thinking%20Beyond%20Solution-Fixation%3C%5C%2Fi%3E%20%28pp.%2061%26%23x2013%3B73%29.%20Springer%20International%20Publishing.%20%3Ca%20href%3D%27https%3A%5C%2F%5C%2Fdoi.org%5C%2F10.1007%5C%2F978-3-319-97082-0_4%27%3Ehttps%3A%5C%2F%5C%2Fdoi.org%5C%2F10.1007%5C%2F978-3-319-97082-0_4%3C%5C%2Fa%3E%3C%5C%2Fdiv%3E%5Cn%3C%5C%2Fdiv%3E%22%2C%22data%22%3A%7B%22itemType%22%3A%22bookSection%22%2C%22title%22%3A%22Measuring%20Design%20Thinking%20Practice%20in%20Context%22%2C%22creators%22%3A%5B%7B%22creatorType%22%3A%22author%22%2C%22firstName%22%3A%22Adam%22%2C%22lastName%22%3A%22Royalty%22%7D%2C%7B%22creatorType%22%3A%22author%22%2C%22firstName%22%3A%22Helen%22%2C%22lastName%22%3A%22Chen%22%7D%2C%7B%22creatorType%22%3A%22author%22%2C%22firstName%22%3A%22Bernard%22%2C%22lastName%22%3A%22Roth%22%7D%2C%7B%22creatorType%22%3A%22author%22%2C%22firstName%22%3A%22Sheri%22%2C%22lastName%22%3A%22Sheppard%22%7D%2C%7B%22creatorType%22%3A%22editor%22%2C%22firstName%22%3A%22Christoph%22%2C%22lastName%22%3A%22Meinel%22%7D%2C%7B%22creatorType%22%3A%22editor%22%2C%22firstName%22%3A%22Larry%22%2C%22lastName%22%3A%22Leifer%22%7D%5D%2C%22abstractNote%22%3A%22Design%20thinking%20is%20often%20misconceived%20as%20a%20competency%20that%20a%20person%20or%20organization%20either%20has%20or%20does%20not%20have.%20This%20is%20problematic%20because%20that%20perspective%20can%20lead%20to%20an%20incorrect%20assumption%20that%20design%20thinking%20is%20uniformly%20applied%20at%20the%20same%20level%20by%20anyone%20who%20knows%20it.%20This%20chapter%20describes%20design%20thinking%20as%20a%20practice%20that%20can%20range%20greatly%20depending%20on%20context.%20It%20outlines%20a%20series%20of%20measures%20developed%20to%20highlight%20both%20different%20aspects%20of%20design%20thinking%20and%20how%20those%20aspects%20can%20vary.%20These%20measures%20provide%20a%20more%20detailed%20assessment%20of%20what%20is%20necessary%20to%20successfully%20apply%20design%20thinking.%22%2C%22bookTitle%22%3A%22Design%20Thinking%20Research%20%3A%20Looking%20Further%3A%20Design%20Thinking%20Beyond%20Solution-Fixation%22%2C%22date%22%3A%222019%22%2C%22language%22%3A%22en%22%2C%22ISBN%22%3A%22978-3-319-97082-0%22%2C%22url%22%3A%22https%3A%5C%2F%5C%2Fdoi.org%5C%2F10.1007%5C%2F978-3-319-97082-0_4%22%2C%22collections%22%3A%5B%22PLDH3R42%22%5D%2C%22dateModified%22%3A%222021-10-27T15%3A00%3A41Z%22%7D%7D%5D%7D
Porter, M. E., & Nohria, N. (2018, July 1). What Do CEOs Actually Do?
Harvard Business Review.
https://hbr.org/2018/07/what-do-ceos-actually-do
Edmondson, A. (1999). Psychological Safety and Learning Behavior in Work Teams.
Administrative Science Quarterly,
44(2), 350–383.
https://doi.org/10.2307/2666999
Royalty, A., Chen, H., Roth, B., & Sheppard, S. (2019). Measuring Design Thinking Practice in Context. In C. Meinel & L. Leifer (Eds.),
Design Thinking Research : Looking Further: Design Thinking Beyond Solution-Fixation (pp. 61–73). Springer International Publishing.
https://doi.org/10.1007/978-3-319-97082-0_4
