Monday, 11 June 2012

Club Revit 2012 Knowledge Challenge - Results



For the past couple of months, we have been running an open Revit knowledge challenge, in association with leading industry network, Club Revit.  Contestants were presented with 24 questions, with a time limit of 30 minutes to complete the assessment.  The best score in the fastest time, determined the winner for each Track.

The competition is now finished, so let's review how it all went.

The Results 

Congratulations to the following contestants, who won their respective Tracks:

Revit Architecture Track Winner:  Duarte Couto

Revit MEP Track Winner:  Don Bokmiller

Revit Structure Track Winner:  John Fout


So, let's take a detailed look at the results of this year's Club Revit Knowledge Challenge.

Overall

No. of Tests Completed:  198
Overall Average:  66% in 24 mins 45 secs


Track 1 - Revit Architecture

Track Winner:  Duarte Couto
Winning Score:  99% in 15 mins 40 secs

Top 10 Contestants:

Duarte Couto        
John Fout 
Kate Hovis  
Melissa Thiessens       
Jeremy Stroebel     
Randy Rush    
Matt McKechnie
Morgan Blum
Rebecca Frangipane
Simon Gale

No. Completed:  139
Group Average:  68% in 24 mins 22 secs
Top 10 Average:  88% in 21 mins 0 secs
Bottom 10 Average:  21% in 30 mins


Track 2 - Revit MEP

Track Winner:  Don Bokmiller
Winning Score:  88% in 24 mins 50 secs

Top 10 Contestants:

Don Bokmiller
Julian Jameson
Sam Scorsone
Jason Seck
Rebecca Frangipane
Glen Walson
Juliana Milanov
John Fout
Jonathan Herrera
Thomas Maleski

No. Completed:  33
Group Average:  64% in 27 mins 29 secs
Top 10 Average:  81% in 24 mins 32 secs
Bottom 10 Average:  42% in 29 mins 20 secs



Track 3 - Revit Structure

Track Winner:  John Fout
Winning Score:  95% in 24 mins 25 secs

Top 10 Contestants:

John Fout 
Rebecca Frangipane
Ben Osborne
Jesse Mickle
Ben May
Victoria Prescott
Mike Bolduc
Kathleen Chapman
George Guevarra     
Isabella Risolvo 

No. Completed:  26
Group Average:  58% in 26 mins 14 secs
Top 10 Average:  81% in 24 mins 27 secs
Bottom 10 Average:  33% in 27 mins 57 secs



Further Analysis & Observations

Popular Tracks

The most popular tracks, in order of completed tests, were as follows:

Revit Architecture - 139 results
Revit MEP - 33 results
Revit Structure - 26 results


Training Needs Analysis

So what does all this mean, in terms of performance and training?

For Revit Architecture, the top 10 training items were, in priority order:
Key Schedules, Schedules, Tagging, 3D Components, Graphic Display, Detach File, File Management, Conceptual Massing, Model Management and Worksharing.



For Revit MEP, the top 10 training items were, in priority order:
Apparent Load Values, Edit Properties, Modifying Light Fixtures, Photometric Web Files, Annotation, Key Schedules, Schedules, Tagging, Model Management and Views.



For Revit Structure, the top 10 training items were, in priority order:
Key Schedules, Schedules, Tagging, 3D Components, Graphic Display, Types, Families, Clipboard, Data Integrity and Model Management.



Overall

It's interesting to compare results, across the 3 disciplines, which arguably reflects where Revit currently sits, in terms of wider industry adoption. Revit Architecture proved to be the most popular track and the overall experience of the users taking part in the contest suggests that this software is the most mature, in terms of individual expertise. Revit MEP and Revit Structure were close, in terms of overall numbers, with RMEP posting average scores 6% higher than RST, but the average elapsed time to complete the exercises was longer.

RAC overall:  68% in 24 mins 22 secs
RMEP overall:  64% in 27 mins 29 secs
RST overall:  58% in 26 mins 14 secs


Comparing the difference between the top 10 and bottom 10 performers in each category, is also a fascinating insight into the huge variance of practical ability, out there in the AEC industry.  The average for RAC was just 21% accuracy across the bottom 10 scores, with RST faring little better at 33%.  Overall, RMEP was the most consistent group, with a bottom 10 average of 42% (or, put another way, twice as accurate as RAC).

This sends out a rather important message to firms who recruit Revit specialists, without any means of skills assessment at interview!

Honourable mentions

Along with our track winners, the following contestants deserve a special mention, for their overall performance in the competition:

John Fout, for winning the RST track, placing second for RAC and eighth for RMEP.  A true all-rounder!

Rebecca Frangipane, for placing second in the RST track, posting a top 5 score in RMEP and top 10 for RAC.  Another exceptional performance!

Philip Russo, for posting above average scores in both RAC and RMEP tracks.

Dishonourable mentions

All those competitors who were disqualified for taking an assessment more than once in the same track, which was a definite no-no, as mentioned in the contest rules.  You know who you are!  The RAC track had the highest percentage of disqualified contestants.  Does this mean engineers abide by the rules more than architects??

Boys vs Girls

Finally, let's take a look at the demographic breakdown of the competition. Out of 198 contestants, 155 were male and 43 female. The average overall performance for each group breaks down like this:

Male: 66% in 25 mins 24 secs
Female: 68% in 24 mins 7 secs


So, there we have it! The girls are the winners in the Revit battle of the sexes!  Both more accurate and faster than their male colleagues.  The gauntlet has been thrown down!

Congratulations to all our winners. Thanks to everyone who took part in the competition.  And special thanks to Lonnie Cumpton and the Club Revit team for making it all happen.

R

3 comments: