Help me help you (market your web framework)
Rather than trolling through google searches, mailing list archives and Amazon book searches, I'd like to try something new. For those projects represented in my Comparing Java Web Frameworks talks (MyFaces, Spring MVC, Stripes, Struts 2, Tapestry and Wicket), would you be interested in helping me gather statistics? I think by allowing projects to gather their own statistics, we'll get a more accurate number of their statistics. Here's the questions I need you to answer:
- How many tools (i.e. IDE plugins) are available for your web framework?
- How many jobs are available for your framework on Dice.com? What about Indeed.com?
- How many messages where posted to your user mailing list (or forum) in March 2007?
- How many books are available for your framework?
Of course, if you don't have time, I'll be more than happy to gather these statistics myself. However, those that do answer might get some extra marketing love during my talk. Answering in a comment or sending me an e-mail are the best ways to provide your findings. Thanks!
Update: Alastair asks for further clarification. Here goes:
> If you have lots of IDE tooling available, it probably means the configuration for the framework is overly complex and unmanageable without tooling.
While this may be true, if your framework is hot or uber productive, people want tools. Especially new developers. Remember there's a plethora of new Java developers every year and a lot of them prefer tool-based solutions. Good or bad, IDEs are nice and people like to use them. I've had many clients dismiss frameworks simply because no tools were available.
> The framework with the largest number of jobs available is probably Struts 1. Enough said.
Yes, you're definitely right. However, Struts 1 is not in this comparison - I dropped it because I don't want to recommend it to anyone.
> People only post to user lists when they are stuck. If the framework is hard to use, there will be lots of e-mails. If it has a steep learning curve, and/or the documentation is poor, this will be particularly so. On the other hand, an active list might point to a large active user base. Who knows which is which from a raw figure?
What about community? Mailing lists and their activity is a sign of an active community. Even though SiteMesh is a mature and good solution, its community sucks. There's little support, no new features, no bug fixes. An open source project w/o a community is tough for a company to adopt. Also, the best communities do a lot more than answer questions on mailing lists. They develop their applications, get advice, offer advice and sometimes even hang out. The Struts list used to have threads 30-50 messages long about development philosophies. When you joined the mailing list, you felt like you were a part of something, not just a user of a product.
> If your framework is fairly stable, and someone has written a fabulous tome on it that is universally acknowledged as "the bible", few people would bother writing another book for it.
I don't agree - this just means there's no market for other books because not that many people are using it. Look at Grails, Groovy, GWT and Rails - there's been quite a few books on each and no slowdown in sight. Then again, there weren't many Ant books and that was/is hugely popular. I'm willing to change this question to "How many good does your framework have?", but that's up to everyone's own interpretation. Again, lots of books means there's an active community outside the immediate mailing list - it's a sign the general "market" is interested and the framework fills a need.
Of course, I am interested in asking the questions that developers want to see answered. Do you have suggestions for replacement (or new) questions? Remember, people like hard facts, not wishy washy statements about how productive and OO your framework is. Every framework can be uber productive if you have the right developer(s) and they're genuinely interested in getting stuff done.
Posted by Niall on April 27, 2007 at 01:41 AM MDT #
Posted by Niall on April 27, 2007 at 01:52 AM MDT #
- Dice (WebWork) - approx. 40 jobs
- Indeed (WebWork) - approx. 358 jobs
It's not that accurate as most jobs description has lots of web framework mentioned, its really hard to tell from the search which framework they actually used.Books
- WebWork in Action
- WebWork's Wiki (is this considered as a book? :) )
- Ian's working on a Struts2 book but its not published yet.
IDE & toolsPosted by tmjee on April 27, 2007 at 06:03 AM MDT #
Posted by Leonid on April 27, 2007 at 06:43 AM MDT #
------------------------
Mailing lists:
Pretty active
See http://sourceforge.net/mailarchive/forum.php?forum_name=wicket-user for the user list numbers.
Note that http://www.nabble.com/Web-Development-Framework-f16257.html shows Wicket as the most active of the web frameworks listed, same for the listed Apache Incubator projects at http://www.nabble.com/Apache-Incubator-f355.html and number 4 in this list http://www.nabble.com/Java-Software-f787.html
Also note that I *still* think mailing list activity is not a good indicator for the quality of the framework :)
Books on Wicket:
* Pro Wicket http://www.apress.com/book/bookDisplay.html?bID=10189
* Wicket In action is *still* in the works (I'm writing it, and it's hell). We're about at 4/3.
Plugins:
don't know the locations, but there is an Eclipse plugin (useable and mature) and an IDEA plugin (don't know the state of it) for Wicket, and NetBeans has a couple of wizards and helpers and a set of tutorials integrated.
Jobs:
Probably nothing compared to Struts etc. But on the rise. I'm sure you'll find statistics. Another metric I personally don't find very useful.
Wicket is about to graduate and become a top level Apache project (*knocks on wood*) and we have a couple of interesting references soon. Also, projects like PaxWicket, Eclipse RSP and cooperation with Terracotta are all indicators we're gaining momentum.
Ok, that's enough blah blah for now. :)
Posted by Eelco Hillenius on April 27, 2007 at 07:30 AM MDT #
I have a point-by-point here: http://herebebeasties.com/2007-04-27/lies-damned-lies-and-statistics.
Posted by Alastair Maw on April 27, 2007 at 08:03 AM MDT #
Posted by Alastair Maw on April 27, 2007 at 08:04 AM MDT #
Posted by Matt Raible on April 27, 2007 at 08:47 AM MDT #
I think the problem with 'hard facts' lists is that it is nearly impossible to get real useful ones. Take Smalltalk for instance. It's generally seen as a very good development environment, especially by 'the better' (yes, that's subjective) developers. But it would fail in almost every aspect when it comes to hard fact lists.
These lists work fine if you want to measure the relative success of a framework, and they may, just may, be useful for companies that want to persue a risk avoiding strategy when it comes to being able to find new personel quickly etc, but they say little at best about it's technical merits.
Now, what *does* work then? Imho, skip the hard fact lists to start with. Instead, compile a story of what you think are the strong and weak points of a framework and why. You can still mention tool support for instance, but rather than than just stating how many there are for framework X, you can say something about their usefulness, how bad they were needed in the first place, and where the development seems to be heading (IDE plugin projects often strike me being amongst the worst maintained of all open source projects). Also, say something about your experience with starting up with the framework, it's short-term merits (how quick is it to develop something; Rails would do well here), how it scales for development (does it hold when complexity of the project grows and you start adding more developers) and the long-term advantages (does it produce maintainable, optimizable software; Rails would do pretty bad here). Etc, etc. I know it isn't as catchy as short lists, and you have to look at what people want to read, but personally, I rather read through 10 pages of deliberations, than 10 bullet points of statistics.
The web framework comparison where you asked some framework committers for their opinions for instance, that's a pretty valueble document. I have pointed it out many times in the past, and most people came back saying it gave them new insights.
My 2c
Posted by Eelco Hillenius on April 27, 2007 at 09:20 AM MDT #
More than half the talk is my opinions (from experience), authors opinions (the sweetspots document) and what the audience thinks (participation).
Posted by Matt Raible on April 27, 2007 at 09:29 AM MDT #
Posted by Upayavira on April 27, 2007 at 10:16 AM MDT #
Posted by Peter Thomas on April 27, 2007 at 10:53 AM MDT #
- Average time between first and last post per thread on a mailing list. (Shows vaguely how quickly issues are resolved for users. You'd need to throw away the outliers, too.)
- Number of words of documentation on framework wiki/primary documentation site.
- Code coverage of framework with unit tests as % (for Java, should give a useful metric of how dedicated the developers are to correctness and stability).
- Code coverage of framework with maintained example code (very hard to measure).
- Number of active committers (committed more than 50 lines of code in the last three months).
- Number of active posters resolving questions on mailing list.
- Average time taken to fix bugs/issues from report to resolution in trunk/HEAD.
- Average time taken to fix bugs/issues from report to new release.
- Average time between releases (minor ones).
- Ratio of comments to lines of code. This is a bit nebulous but nearly always, better commented code is better code. You're therefore less likely to be bitten by bugs in it. Pretty good correlation there, I think.
More qualitative:- Does the project have a useful IRC channel for support?
- Are there best practice documents/examples available and how good are they?
Things that are seriously meaningless, and why:Posted by Alastair Maw on April 27, 2007 at 01:31 PM MDT #
Along with the number of jobs on Indeed, you could use our Job Trends tool to monitor the fluctuations in job volume over time by framework.
Here's an example:
http://www.indeed.com/jobtrends?q=%22spring+mvc%22
Jason
www.indeed.com
Posted by Jason Whitman on April 27, 2007 at 01:43 PM MDT #
Posted by Matt Raible on April 27, 2007 at 03:21 PM MDT #