Raible Designs

Wednesday March 05, 2008

Selenium User Meetup Videos Posted Videos of last week's Selenium User Meetup have been posted on YouTube. You can watch them below or click on the video to watch it on YouTube. Enjoy!

Lightning Talks

Q and A Session

Posted in Open Source at Mar 05 2008, 09:19:23 PM MST 1 Comment

Tuesday February 26, 2008

Last Night's Selenium Users Meetup at Google Last night, I attended the inaugural Selenium User Group meetup at Google's Campus in Mountain View. It was an excellent event, with many of the core committers on hand to present and answer questions. Each presenter had about 5 minutes to speak and we learned many things about the Selenium Project itself, what's coming in the future and how Google has standardized on Selenium as their integration testing tool of choice.

Patrick Lightbody started the meeting by going over a number of project statistics with pretty graphs and such. There were simply too many numbers to write down, so hopefully his slides will be published soon. I was pleased to see that Google did videotape the entire event, so it should be available online soon. I'll update this post when it it. Below are my notes from the event.

Jason Huggins, Test Engineer at Google
Selenium is a test automation framework. Some folks abuse it as a macro tool. There's two reasons Selenium became so popular: it was able to test Ajax before any other testing tool and it allows end-to-end workflow testing. Selenium works on any platform, with any browser and allows many, many languages. It's possible that other frameworks that are more focused are better. There are 4 Selenium products:

• Selenium Core (TestRunner)
• Selenium IDE (for Firefox)
• Selenium Remote Control
• Selenium Grid

Paul Hammant, Open Source Manager at Thoughtworks
Selenium 1.0 - beta this week. RC, Core, Grid and IDE together. 1.0 will be shipped in a few weeks. Compared to today, lots of bugs killed, documentation improved and a greatly improved Selenium IDE.

Selenium 1.1 will be shipped in a couple months. Selenium IDE will be enhanced to obey RC instruction ... becoming the best mode of operation when it ships.

Some experimental iPhone-Safari capability (dependent on SDK for iPhone).

Selenium 2.0 will hopefully be released this year. Roll in of WebDriver functionality and code. New model-based API. IE plugin and Safari plugin (not really a plugin, most likely uses AppleScript).

Philippe Hanrigou (http://ph7spot.com)
Testing is good! Selenium is awesome! However, end-to-end web testing is slow. It is and always will be slow. How do you solve this problem? You solve it the same way we've solved slow traffic in the past - by building more lanes. Rather than one browser testing everything, Selenium Grid allows multiple lanes and 20 browsers. Features include:

• Faster Builds, Faster Feedback!
• Easy Install and Everyday Use
• No Need to Change Your Tests
• Leverage Your Existing Computing Infrastructure

One of the best parts about Selenium Grid is you can download and have it running in 10 minutes or less. Selenium Grid comes out-of-the-box with Amazon EC2 support.

Jennifer Bevan, Lead from Selenium Farm Project at Google
As of Friday, Google has over 50 teams running over 51K tests per day on internal Selenium Farm. 96% of these tests are handled by Selenium RC and the Farm machines correctly. The other 4% are partly due to RC bugs, partly to test errors, but isolating the cause can be difficult. Selenium has been adopted as the primary technology for functional testing of web applications within Google. That's the good news.

The bad news is Google is pushing the limits of Selenium. Using Selenium (RC + Core) at this scale exposed certain issues not originally anticipated as high-impact. IE/XPath slowness has a high impaction given that can only run one test at a time. Tests can cause many conditions from which RC cannot easily or automatically recover (for example, tests that don't call stop() in every exit path). Unexpected browser dialogs, popups, etc. eventually cause timeout exceptions.

Googlers expect that RC will work for the most part, but they want it to be more reliable, with better performance. So they have:

1. Created utility methods to improve performance when examinging large tables, overlaying domain-specific languages, etc.
2. Deployed retry policies based on failure reason.

Looking to the future - Google has not yet reached their expected usage of Selenium RC. Some projects cannot use the Farm until RC supports session-level configuration (not server-level). Many just want RC to be more reliable. So Google will:

1. Continue to contribute to RC, Core and to user-created helper libraries.
2. Keep doing so until all failed tests are not Selenium's fault.

Dave Astels, Google (Driving Selenium with RSpec)
Using RSpec, you can create a very easy-to-read Story with Scenarios that can be read (and likely written) by practically anyone. Dave then uses a small script to load up the stories and run them in Selenium. When he runs the script, the scenario is spit out and test pass/fail information. Learn more at rspec.info.

Alex Chaffee, Mad Scientist at Pivotal Labs (The Selenium/Ruby Project that Must Not Be Named)
What is Polonium? It's also known as Selenium RC Fu or Selenium On Rails 2 or Funkytown. It has simple extensions to Selenium RC:

• wait_for
• element assertions
• launching/managing servers locally

Blackbox testing you're sitting out of the box and send in stuff. In whitebox testing, you get to open up the box and look at stuff. With Selenium, you can do Graybox testing, where you are doing blackbox testing (against the UI) and querying your database (or other resources) at the same time.

Dan Faulich, Sr. QA Engineer at Redfin Corporation (How Not to Run a Successful Open Source Project)
The first thing you don't want to do is support everything. The second thing you don't want to do is write your project in JavaScript. While it's great that almost anyone can hack on it, running in a sandbox sucks. Don't use a language that's bound by other people's security restrictions. Don't roll your own multi-language remoting. It's written using XML + XSLT and its such a pain in the ass to maintain that Dan is the only one that fixes bugs.

Shinya Kasatani, Developer of Selenium IDE
Selenium IDE is a Firefox extension that can record and play back tests in your browser. It can translate the recorded tests to many languages.

Selenium IDE 1.0 adds support for TestSuites. Another new feature is better recording features - it detects when the DOM is modified. Shinya has a demo where he uses the new IDE to test the Dojo Dijit Theme Test Page. Apparently, this doesn't work in the current version.

The Goal of Selenium IDE is to get more people interested in test automation of web applications and to help their projects to be successful.

Haw-bin Chai, Developer at CommerceHub
XPath is a powerful selection took, but it'd be great if we could use something like "article 5" instead of the cryptic //table[5]/tbody/... syntax.

Why UI-Element? Traditional locations can be ugly and they don't convey purpose. UI-Element is a Selenium Core extension and has Selenium IDE integration. It's written in 100% JavaScript. Examples:

ui=frontPage::topStoriesCountry()
ui=listingPages::article(index=5)
ui=listingPages::articleSource(articleIndex=1)

The UI Map is in JavaScript shorthand. It contains logic to map ui locators to traditional locations. Each UI element implements getLocator(), then you add a page set and add an element - all in JSON Format.

Simon Stewart on Web Driver
What on earth is Web Driver? One of the main problems with Selenium is it's written in JavaScript and it's too easy to hack. WebDriver is an idealized browser which allows you to do browser things like call get(URL), findElement(By.xpath()) and getTitle(). WebDriver is similar to Selenium RC, but it's not written using JavaScript. It's written in the native languages for each browser, which allows you to break out of the JavaScript Jail. The IE Driver is written in COM (C++). The Firefox Driver is written as a Firefox extension. Safari uses Apple events.

Soon there won't be a WebDriver project ... because it will be part of Selenium!

WebDriver likely won't be part of the core until Selenium 2.0 later this year. One of the nice things about WebDriver is you can implement different browsers. Out-of-the-box, it will support all the major browsers, as well as HtmlUnit with JavaScript turned off.

I had a great time learning more about Selenium and how most of its problems will be solved in the near future. The beers afterwards weren't so bad either.

Update: Videos of this event have been posted. Posted in Open Source at Feb 26 2008, 03:51:56 PM MST 8 Comments

Thursday February 21, 2008

Selenium Users Meetup in Mountain View on Monday From Patrick Lightbody's blog:

Next week in Mountain View, CA, we'll be hosting the world's first Selenium Users Meetup. If you're in the area and are even remotely interested in development methodologies, QA, or automation, come on by. The event is on Monday, February 25 from 6:30PM to 9:00PM. You can find out more here.

I'm pleased to report I just booked my flight to Mountain View and I'll be attending. Should be a good time for sure: killer location, cool topic, great people - what more could you ask for?! Posted in Java at Feb 21 2008, 03:45:29 PM MST Add a Comment

Thursday January 24, 2008

Denver Tech Meetup, Consulting Panel and My Jobs Timeline If you live in Denver and are involved in open source (or simply technology in general), you should make it a point to attend tonight's Denver Tech Meetup. I'm planning on going for about an hour. From there, I'm heading over to the DeRailed User Group for a Consulting Panel at 8. If you're interested in moving from a full-time position to contracting, you should come. This is open to the public, so anyone can attend.

While I was thinking about things to talk about on the panel tonight, I started reflecting on the jobs I've had in my almost-11-year career in technology. Here's my timeline since college:

1. 1997: Full-time at MCI Systemhouse
2. 1998: Contractor for IBM Global Services (6 figures w/in 6 months of graduating!)
3. April 1999 - April 2001: Full-time for eDeploy.com (Friday lunches rocked)
4. May 2001 - October 2001: Contractor for Douglas County (introduced to Ant, Struts, etc.)
5. January 2002 - November 2002: Contractor for OnPoint Digital (100% remote)
6. December 2002 - August 2003: Contractor for Comcast Media Center
7. August 2003 - October 2003: Contractor for ResortQuest
8. November 2003 - June 2004: Contractor for Adams County
9. June 2004 - August 2004: Contractor for Open Logic
10. October 2004 - December 2004: Contractor for Oak Grove Systems
11. January 2005 - May 2005: Contractor for Xcel Energy
12. June 2005 - January 2007: Contractor for Virtuas
13. February 2007 - June 2007: Contractor for Checkerboard
14. July 2007 - Present: Contractor for LinkedIn

Phew - that's 14 jobs in 11-ish years! Notice that I've only ever had 2 full-time positions. So far, I have no regrets and really enjoy being a consultant. If you're interested in learning more about how I started Raible Designs or how I get contracts, you might want to read the following posts.

• How I started Raible Designs (Nov 2002)
• How do you become an independent consultant and get contracts? (Jan 2005)

If you live in Denver and want to learn more - show up at the The Hive at 8:00 tonight.

Update June 2008: My 3rd full-time gig started in May. Now I'm the Lead UI Architect at LinkedIn. Posted in Open Source at Jan 24 2008, 01:39:38 PM MST Add a Comment

Tuesday January 15, 2008

Action Packed Week in California

Morning light on the Golden Gate Bridge
Originally uploaded by TravelnFotog

This week is shaping up to be quite the action-packed week in California. First of all, the MacWorld 2008 Keynote is happening today. This is the event where new Apple products are announced and everyone yawns. I hope they announce some interesting stuff, but I'm not getting my hopes up. The only thing I'd likely buy is a screaming laptop with 8 GB of RAM.

Tonight, there's a presentation on GWT at Google. Since this is only a few blocks from LinkedIn, I'm going to try to make the meeting and checkout the "Googleplex" for the first time.

Finally, tomorrow night a bunch of us are getting together for a Silicon Valley Tech Meetup at The Old Pro in Palo Alto. Start time is 6:30. Posted in General at Jan 15 2008, 08:33:13 AM MST Add a Comment

Friday January 11, 2008

Denver Tech Meetup: January 24th at 6:30 From the RedMonk Social Planner:

Why our holiday decorations are still up, I couldn’t tell you, but I do have the answer you’re all looking for: the date of the next Denver Tech Meetup. You remember, the Denver Tech Meetup? The User Group without the User Group? But with beers? Denver’s least ambitious monthly(ish) (ha!) gathering of technology workers?

Yes, I’ve failed spectacularly in my ambition to hold these things every other month, as was the expectation back in 2005, but I’ve been a little busy. And as I’m fond of telling our clients, a percentage of something is better than an entirety of nothing, right?

So ignore the inset picture - I posted it merely for nostalgic reasons; two Thursdays from today we’ll convene at our probationary new venue (my bartending friend is now way uptown) and frequent Jabber hangout, the Celtic. 18th and Blake, for the Denver folks in the audience. Still very easy walking distance for yours truly, not to worry.

Let’s you and me cram as many Tech Meetups in as we can before I flee back east before the hell that is the Denver summer. If things break as I hope they will next week and the week after, it’s possible that I’ll have my own not-so-captive audience to drag along.

See you at the Celtic. No Smithwick’s, sadly, but there is Murphy’s.

It's shaping up to be a good month for meetups: Silicon Valley next week, Denver the following. I'm participating in a Consulting Panel at the local Ruby on Rails user group that same night. Hopefully they won't mind if I have a couple cold ones beforehand. Posted in Open Source at Jan 11 2008, 02:15:16 PM MST 1 Comment

Wednesday January 09, 2008

Tech Meetup in Silicon Valley next week? Dave's going to be in California next week:

I'm going to be traveling to California next week (Jan 13-18) to sync up with my co-workers at Sun HQ in Santa Clara. I'll be in town Sunday through Friday and though my days will be pretty busy, I'll probably have some free time in the evenings for a meet-up or two.

Coincidentally, I'll be out there as well (Tuesday - Friday @ LinkedIn). Sounds like an excellent excuse to meetup and have some beers. Wanna join us? Posted in Roller at Jan 09 2008, 03:16:40 PM MST 3 Comments

Monday October 08, 2007

Maven Meetup in San Francisco tomorrow (Tuesday) If you live in the Bay Area and you're interested in talking with the inventors of Maven and/or XWiki, you should checkout the XWiki + Maven meetup at Terracotta's HQ. Java Open Source gurus Vincent Massol and Jason van Zyl will be there - sounds like a fun event! Posted in Java at Oct 08 2007, 10:55:41 PM MDT 1 Comment