logologologo
  • Home
  • About
    • Contributors
    • Guide for contributors
  • Themes
    • Roadmapping
    • Open Innovation
    • Managing the R&D pipeline
    • Technology Strategy
    • Managing international R&D
    • Ideation and creativity in R&D
    • Impact of digital technologies
    • The resurgence of frugal innovation
  • Tools
  • News
  • Resources
  • Papers
  • Case Studies
  • Events
  • R&D Conference
  • Contact
  • Home
  • About
    • Contributors
    • Guide for contributors
  • Themes
    • Roadmapping
    • Open Innovation
    • Managing the R&D pipeline
    • Technology Strategy
    • Managing international R&D
    • Ideation and creativity in R&D
    • Impact of digital technologies
    • The resurgence of frugal innovation
  • Tools
  • News
  • Resources
  • Papers
  • Case Studies
  • Events
  • R&D Conference
  • Contact

Improving objectiveness of idea selection

With the increase in use of online ideation platforms to harness creativity, it is important that ideas are fairly judged, without bias, and that the truly best ones bubble up to the top, comments Phil Kennedy who has reviewed the following paper for R&D Today.

Persuasion in Corporate Idea Contests: The Moderating Role of Content Scarcity on Decision-Making Tobias Kruft , Christoph Tilsner, Andreas Schindler, and Alexander Kock

The authors contend that, “Finding indicators for idea success is a major goal of idea evaluation research. In order to do so, an understanding about how issue-irrelevant information affects an evaluation team’s decision-making process is of high importance since persuasion might lead evaluators to select certain ideas over others.”

online ideationThis paper explores the phenomenon of ‘content scarcity’ for ideas – submitters not giving enough information about the idea in the submission – and how that gives rise to those ideas being unfairly judged as assessors fall back on ‘issue-irrelevant’ information around which to make their decision. ‘Issue-irrelevant’ refers to information is such as the originator of the idea, personal distance to authors, the idea message’s sentiments, the writing style, the community’s attention to an idea in the form of comments or votes, and the source credibility.

In such cases, evaluators may make a more intuitive, rather than reflective, choice. In a nutshell, if evaluation teams do not have sufficient issue-relevant information, they seek issue-irrelevant information to close the gap and make a decision. But even if issue-relevant information is available, issue-irrelevant information can bias evaluation teams to make an intuitive decision rather than a reflective one.

What are take-aways for practitioners?

  1. Idea descriptions should not be too short; otherwise evaluators tend to supplement the scarce content with even more intuitive information.
  2. Ideators may omit information as they think it is obvious. Encourage them to more fully explain their ideas and not assume the evaluators will correctly fill in the information gaps.
  3. Instead of providing too much text-based content, ideators should consider providing visualisations of the content, which enable evaluators to more quickly and effectively assimilate the gist of the idea.
  4. The persuasive issue-irrelevant aspects of the ideator, message, and community – the three dimensions – increase the probability that an idea may be selected with bias (see Yale attitude change approach). Content scarcity strengthens the relationships between the persuasive aspects and idea selection. This may be further compounded by having too many ideas (crowding), and/or lack of evaluator resource or time and/or evaluator expertise.
  5. Reflective decisions from the evaluators are what are needed. These can be promoted by suppressing the issue-irrelevant information. A central strategy could, for example, be to deliberately prevent the evaluators from seeing issue-irrelevant information. This strategy works particularly well with the ideator dimension. If evaluators do not know who the ideators are, they cannot derive information about their reputation and dedication.
  6. Managers should try to give all the ideators the same opportunity to persuade the evaluator through the message dimension (the idea). For example, campaign managers should define the campaign search fields more clearly.
  7. Evaluators should transparently and in advance communicate their decision criteria in order to align the ideators to the same goals.
  8. Platform managers could also provide ideators with predefined templates that allow them to address specific aspects of their idea, thus enhancing the ideas’ assessment and explicitness. However, such templates could be an obstacle to ideators posting ideas. Consequently, this work suggests that the initial idea should be posted form-free on the platform, but that the final template fields must be filled out at the end of the campaign. Ideators should thereafter be encouraged to improve their idea in exchange with the community and fill out the templates consecutively.
  9. Platform managers should consider incentivising comments, which contribute to the idea with the help of gamification elements, while also incentivising ideators to actively improve the idea accordingly. Then, however, the comments and votes should not be visible to the evaluators, as they distract from the actual idea’s content.
  10. Managers should offer ideators training that explains the importance of issue-relevant information.
  11. Each ideator should write an idea description of at least 170 well-considered words, or perhaps longer. However, it is important for ideators to understand that more content is not always better; content needs to add to the idea, not submerge it, and evaluators may have limited time to review ideas.

In conclusion

Overall, this work presents certain simple strategies for reducing bias from ‘issue-irrelevant’ content when evaluating ideas posted on an online ideation platform. These are derived from a detailed analysis, based on a data set of 3025 ideas from 227 campaigns on a globally operated corporate online ideation platform, as well as consideration of much past work in the field of decision analysis and persuasion.

The paper: Persuasion in Corporate Idea Contests: The Moderating Role of Content Scarcity on Decision-Making Tobias Kruft , Christoph Tilsner, Andreas Schindler, and Alexander Kock J PROD INNOV MANAG 2019;36(5):560–585
 © 2019 Product Development & Management Association DOI: 10.1111/jpim.12502

Reviewed by:

Phillip A. Kennedy, PhD FIKE
Visiting Professor, Queen Mary University of London,
School of Engineering and Materials Science

LinkedIn Profile

Alexander KockAndreas SchindlerChristoph Tilsnercreative ideationideas selectionideationonline ideation platformsPhil KennedyTobias Kruft
Previous PostThe Right Way to Lead Design Thinking - a rev...
Next PostHow successful use of Absorptive Capacity add...
Search R&D Today
Search
Generic filters
Exact matches only
Search in title
Search in content
Search in excerpt
Filter by Article Type
Papers
Events
Tools
Funding Articles
Case Studies
Resources
Opportunities
Theme Editor Blogs
Filter by Categories
Business model innovation
Ideation and creativity in R&D
Latest news
Managing international R&D
Managing technology platforms
Managing the R&D pipeline
Open innovation
Outsourcing R&D
Project valuation and selection
R&D strategy
Roadmapping
Stage gate processes
Technology intelligence
Theme Editor Blogs
  • Digital disruption in the lab: The case for R&D digitalization in chemicals – a review
  • Accelerating product development: the tools you need now – a review
  • Using good practice R&D management to create new innovations in malodour control
Associated Papers
  • How successful use of Absorptive Capacity adds value
  • A review of TRIZ its benefits and challenges in practice
Resources
  • Coffee Time Conversations: Brainstorming
  • Innovation Management: Learning for the experiences of companies in European countries
  • How to write and publish your research
Related Posts
  • Must read papers on aspects of R&D Management
  • Techniques for Effective Prioritisation
  • Good techniques for prioritising projects
Tools
  • Paired comparison
    Techniques for Effective Prioritisation
    Gut feeling may be a valid basis for making decisions about your personal life...
  • FEMA
    Failure Mode and Effects Analysis (FMEA)
    To fail fast can save enormous waste later in the product lifecycle. Failure Mode...
  • 'How to' statements
    A useful tool in creative problem solving is the ‘how to’ statement which provides...
  • TRIZ Toolkit
    The challenge of applying TRIZ tool kit for ideation
    TRIZ (the theory of inventive problem solving) provides a logical approach to developing creativity...
  • portfolio tools
    Portfolio management tools and approaches
    The aim of portfolio management is to ensure that a sensible set of innovation...
Have Your Say…

Have Your Say / Follow Us

R&D Today is the outreach site for the Research and Development Management Association, a charitable organisation that supports research, best practice and innovation.  www.radma.net

Click here to sign up to our newsletter, and click here to view our newsletter archive.

Copyright R&D Today 2020. All rights reserved.