Tuesday 26 January 2016

Global Test Scores Posted by Architects

Architects from across the world have submitted several thousand KS test scores, in recent years. Let’s take a more detailed look at the people behind the headline stats.

We capture some interesting user demographic data at the start of each test session. This includes the following questions:

- Primary Industry/Discipline
- Primary Role
- Country & State
- Self rating (out of 5)
- How many years have you used this tool?
- Where did you learn to use this tool?
- How often do you use this tool? (Daily, weekly, occasional)
- How did you learn to use this tool? (On the job, Formal training, College)


The top 4 skills assessments completed by Architects are, in order (by volume):

Revit Architecture
AutoCAD
MicroStation
BIM Management


The results data comes from a wide range of countries and territories, primarily, US, Canada, UK, Australia, New Zealand, Singapore, South Africa and Middle East regions.

Here are the overall results:

Revit Architecture

Avg score/time for:

Regular users = 73.5% in 4894 secs
Part-time users = 67.3% in 5542 secs
1 to 5 years' experience (all types) = 66.2% in 5333 secs
6 to 10 years' experience (all types) = 74.5% in 5215 secs
11 to 15 years' experience (all types) = 73.0% in 5199 secs
On the job learning (all types) = 73.3% in 5637 secs
Formal learning (all types) = 70.3% in 4834 secs

The average Revit Architecture self-rating score for Architects is: 3.7.

  
AutoCAD

Avg score/time for:

Regular users = 55.5% in 4919 secs
Part-time users = 52.8% in 6019 secs
1 to 5 years' experience (all types) = 45.9% in 4241 secs
6 to 10 years' experience (all types) = 55.1% in 5772 secs
11 to 15 years' experience (all types) = 53.7% in 5430 secs
On the job learning (all types) = 57.5% in 5140 secs
Formal learning (all types) = 51.8% in 4932 secs

The average AutoCAD self-rating score for Architects is: 3.4.


MicroStation

Avg score/time for:

Regular users = 61.2% in 4652 secs
Part-time users = 56.2% in 5165 secs
1 to 5 years' experience (all types) = 58.2% in 4901 secs
6 to 10 years' experience (all types) = 62.3% in 4639 secs
11 to 15 years' experience (all types) = 63.4% in 4519 secs
On the job learning (all types) = 62.6% in 4673 secs
Formal learning (all types) = 65.8% in 5037 secs

The average MicroStation self-rating score for Architects is: 3.5.


BIM Management

Avg score/time for:

Regular users = 71.1% in 2029 secs
Part-time users = 67.8% in 2152 secs
1 to 5 years' experience (all types) = 68.3% in 2037 secs
6 to 10 years' experience (all types) = 69.1% in 1947 secs
11 to 15 years' experience (all types) = 67.7% in 1923 secs
On the job learning (all types) = 70.4% in 2035 secs
Formal learning (all types) = 70.5% in 1947 secs

The average BIM self-rating score for Architects is: 3.6.


Trends:

Overall, regular users are more accurate and faster than part-time users.

Architects with 6 to 10 years' of experience with these tools are the most efficient. They reach a plateau in performance after c. 7 years and make no further productivity gains.

Architects who learn to apply these tools on projects are more accurate than those who have primarily formal training, but less practical experience. Formally trained users are faster overall than self-taught users.

R

1 comment:

  1. Thanks for sharing, I find it very interesting that the scores for AutoCAD and Microstation are much lower than Revit and BIM management (although I am not sure what the types of skills are tested there..). Does this make sense - is ? I suspect that the '7th year plateau' may have something to so with people gaining more (overall) experience and have more tasks that involve less drafting/modeling etc. - would you agree ?
    Thanks , Jonathan Talisman

    ReplyDelete