• Seilevel Team

    Here’s the Team

    Welcome to our Seilevel Photo Op.

Seilevel Requirements Management Tool Evaluation – Part 1

9/22/11 IMPORTANT NOTE AND UPDATE: We have updated the criteria and tool scores — please go to this post for the most current material. Also, there is a known issue for Excel 2003 users that is fixed in the update – click here for the updated material that addresses this issue.

We have decided to do a requirements management tool research study, much like we did back in 2007.  One of the main reasons for doing this is that we have found the tool landscape has changed dramatically in the last 4 years, with many new vendors showing up as strong contenders in this space. In addition, beyond looking for the best tools for Seilevel to use, we actually want to understand how the tools compare against one another in general, beyond just our needs.

With this year’s study, we are making some changes to the process this time around, and our new research approach is:

  1. Compile a complete list of possible requirements tools
  2. Compile a list of prioritized features for a tool, or “criteria”
  3. Filter that tool list down to ones that look like they could be considered requirements management tools (as compared to requirements definition tools, prototyping tools, or agile tools)
  4. Evaluate all of the requirements management tools against the first pass criteria (31 items from the full list)
  5. Evaluate the top 15-20 tools from the first pass evaluation against the full criteria list (200 items)
  6. Have the top 15-20 vendors self-evaluate their tools against our criteria, looking for any discrepancies
  7. Publish the results for the industry to review

We are currently in this first phase at step 5 and 6 simultaneously and hope to have the results soon. But before waiting any further, I want to share the criteria and the original tool list with a larger audience, so you can find it on our templates page at Requirements Management Tool Evaluation for Business Analysts. I am certainly interested in any feedback if you find criteria you think are missing or miss-prioritized, as well as any additional tools you think we should be considering but are not. As you look at this list, you may see some that you think shouldn’t be on it, but at this point, we are using a broad sweeping net instead of limiting the list, and we’ll let the criteria limit for us. Also in this file you can find the top tools that have been selected for full evaluation based on the scores from the first pass evaluation.

I also want to point out that some of our ideas for criteria and tools came from the INCOSE survey, which is also useful, though we find it less useful in that the vendors complete their own evaluation, which could introduce some bias or differences in interpretation of the criteria across tools. So we are really just hoping to build upon this original set of information to provide even more useful tool selection information for business analysts.

Later in the year, we hope to take the few tools and implement them on actual projects, so we can get our hands dirty in them to see if they hold up to the evaluation we did. Ultimately we will select a new tool to use at Seilevel, but beyond that, we are really looking to help the business analyst community have more information when they go to select a requirements management tool.

If you are interested in perusing the evaluation worksheet we are using, you can download Requirements Management Tool Evaluation for Business Analysts. The first tab is a set of use cases primarily organized with business analysts as the main actor, but there are a few use cases for managers, developers, and the business. These are prioritized on a scale of 1 to 3, where 3 is high. Those use cases helped us refine our criteria list, which is on the second tab of the worksheet. You can see each criteria is linked to a use case and further prioritized at the feature level. A third tab shows you the complete tool list we started with and how we categorized them initially. Our next level of detail will be to post the evaluation scores, where we evaluate our top tools from the list against the entire criteria list.

5 Responses to Seilevel Requirements Management Tool Evaluation – Part 1

  1. Larry Madson August 18, 2011 at 9:44 am #

    What is the ETA for delivering the third part of your evaluation?


  2. Lori Witzel August 18, 2011 at 11:09 am #

    Hi Larry – I will find out for you, and will have Joy share the info. Thanks for stopping by!

  3. Joy Beatty August 18, 2011 at 11:17 am #

    Hi Larry!
    I am just finishing up part 2 of the study now. We had some challenges with some of the larger companies and getting demo copies, which slowed us down a bit. I hope to have the results of part 2 up the week after next and the corresponding whitepaper shortly after. Part 3 we are actually also getting underway right now, so the results of part 3 are a bit further off. The issue will be in finding some real unique projects to use them on for a month or two. So I would expect it could be end of Q3 at the earliest. At any point I’m happy to chat with you informally about the results we are seeing as well.

  4. Edward January 3, 2013 at 1:32 pm #

    I just came across your evaluation and I am very interested in seeing part 3 of your evaluation. Have you had time to fully vert Technosolutions Top Team Analyst? I am currently evaluating this tool and specifically trying to understand how the tool works with use cases. Can you share any insight to how Top Team Analyst accomodates use cases? Thanks.

  5. Devang Sanghrajka January 13, 2022 at 1:19 am #

    Hi Joy,

    Wish you and your team a very Happy New Year!

    I am going through some of your blog posts as well as this particular post which is indeed very interesting as I am trying to wrap my head around all-things “Requirements Management Tools”. I would like to read through Part 2 and Part 3 of Seilevel Requirements Management Tool Evaluation to complete my understanding. Can you share those documents with me, or point me to a download link please?

    Thank you!
    Stay safe, and take care!

Leave a Reply

Your email address will not be published. Required fields are marked *