Saturday 30 January 2016

Global Test Scores Posted by Structural Engineers

Structural Engineers from across the world have submitted a wide variety of KS test scores, in recent years. Let’s take a more detailed look at the people behind the headline stats.

We capture some interesting user demographic data at the start of each test session. This includes the following questions:

- Primary Industry/Discipline
- Primary Role
- Country & State
- Self rating
- How many years have you used this tool?
- Where did you learn to use this tool?
- How often do you use this tool? (Daily, weekly, occasional)
- How did you learn to use this tool? (On the job, Formal training, College)


The top 2 tests completed by Structural Engineers are, in order (by volume):

Revit Structure
AutoCAD


The results data comes from a wide range of countries and territories, primarily, US, Canada, UK, Australia, South Africa, Singapore, HK and Middle East regions.

Here are the overall results:

Revit Structure

Avg score/time for:

Regular users = 71.1% in 4201 secs
Part-time users = 67.2% in 3871 secs
1 to 5 years = 66.7% in 4110 secs
6 to 10 years = 69.9% in 3489 secs
11 to 15 years = 67.1% in 3892 secs
On the job learning = 69.1% in 4287 secs
Formal learning = 64.3% in 3956 secs

The average Revit Structure self-rating score for Structural Engineers is: 3.7.


AutoCAD

Avg score/time for:

Regular users = 56.7% in 4756 secs
Part-time users = 54.9% in 5064 secs
1 to 5 years = 51.3% in 4536 secs
6 to 10 years = 56.3% in 4201 secs
11 to 15 years = 56.7% in 5337 secs
On the job learning = 54.8% in 4466 secs
Formal learning = 52.1% in 4215 secs

The average AutoCAD self-rating score for Structural Engineers is: 3.3.


Trends:

Overall, regular users are more accurate and faster than part-time users.

Structural Engineers with 6 to 10 years' of experience with these tools are the most efficient. They reach a plateau in performance after c. 7 years and make no further productivity gains.

Structural Engineers who learn to apply these tools on projects are more accurate than those who have primarily formal training, but less practical experience. Formally trained users are faster overall than self-taught users.

Structural Engineers are generally confident in their ability to use technical software tools on Construction projects, although overall, there is still room for further improvement in their core skills.

Structural Engineers are more confident and more accurate using modeling software than drafting software.

R

Friday 29 January 2016

Global Test Scores Posted by MEP Engineers

MEP Engineers from across the world have submitted a wide variety of KS test scores, in recent years. Let’s take a more detailed look at the people behind the headline stats.

We capture some interesting user demographic data at the start of each test session. This includes the following questions:

- Primary Industry/Discipline
- Primary Role
- Country & State
- Self rating
- How many years have you used this tool?
- Where did you learn to use this tool?
- How often do you use this tool? (Daily, weekly, occasional)
- How did you learn to use this tool? (On the job, Formal training, College)


The top 2 tests completed by MEP Engineers are, in order (by volume):

Revit MEP
AutoCAD

The results data comes from a wide range of countries and territories, primarily, US, Canada, UK, Australia, South Africa, Singapore, HK and Middle East regions.

Here are the overall results:

Revit MEP

Avg score/time for:

Regular users = 68.5% in 3110 secs
Part-time users = 65.7% in 3871 secs
1 to 5 years' experience (all types) = 56.6% in 3901 secs
6 to 10 years' experience (all types) = 68.7% in 3401 secs
On the job learning (all types) = 70.2% in 3781 secs
Formal learning (all types) = 64.8% in 3911 secs

The average Revit MEP self-rating score for MEP Engineers is: 3.8.

AutoCAD

Avg score/time for:

Regular users = 59.8% in 5356 secs
Part-time users = 54.9% in 4864 secs
1 to 5 years' experience (all types) = 52.7% in 5752 secs
6 to 10 years' experience (all types) = 57.5% in 5240 secs
11 to 15 years' experience (all types) = 54.7% in 5449 secs
On the job learning (all types) = 57.8% in 4516 secs
Formal learning (all types) = 55.1% in 4344 secs

The average AutoCAD self-rating score for MEP Engineers is: 3.4.

Trends:

Overall, regular users are more accurate and faster than part-time users.

MEP Engineers with 6 to 10 years' of experience with these tools are the most efficient. They reach a plateau in performance after c. 7 years and make no further productivity gains.

MEP Engineers who learn to apply these tools on projects are more accurate than those who have primarily formal training, but less practical experience. Formally trained users are faster overall than self-taught users.

MEP Engineers are generally confident in their ability to use technical software tools on Construction projects, although overall, there is still room for further improvement in their core skills.

MEP Engineers are more confident and more accurate using modeling software than drafting software.

R

Thursday 28 January 2016

Global Test Scores Posted by Civil Engineers

Civil Engineers from across the world have submitted several thousand KS test scores, in recent years. Let’s take a more detailed look at the people behind the headline stats.

We capture some interesting user demographic data at the start of each test session. This includes the following questions:

- Primary Industry/Discipline
- Primary Role
- Country & State
- Self rating
- How many years have you used this tool?
- Where did you learn to use this tool?
- How often do you use this tool? (Daily, weekly, occasional)
- How did you learn to use this tool? (On the job, Formal training, College)


The top 3 tests completed by Civil Engineers are, in order (by volume):

AutoCAD Civil 3D
AutoCAD
MicroStation


The results data comes from a wide range of countries and territories, primarily, US, Canada, UK, Australia, South Africa and Middle East regions.


Here are the overall results:

AutoCAD Civil 3D

Avg score/time for:

Regular users = 73.4% in 3294 secs
Part-time users = 68.2% in 4109 secs
1 to 5 years' experience (all types) = 63.4% in 3783 secs
6 to 10 years' experience (all types) = 75.5% in 3170 secs
11 to 15 years' experience (all types) = 76.3% in 3290 secs
On the job learning (all types) = 71.1% in 3463 secs
Formal learning (all types) = 67.4% in 3587 secs

The average AutoCAD Civil 3D self-rating score for Civil Engineers is: 3.9.


AutoCAD

Avg score/time for:

Regular users = 70.2% in 4867 secs
Part-time users = 63.1% in 4842 secs
1 to 5 years' experience (all types) = 55.3% in 5130 secs
6 to 10 years' experience (all types) = 70.4% in 4363 secs
11 to 15 years' experience (all types) = 69.9% in 3799 secs
On the job learning (all types) = 67.2% in 4576 secs
Formal learning (all types) = 55.7% in 4644 secs

The average AutoCAD self-rating score for Civil Engineers is: 3.7.


MicroStation

Avg score/time for:

Regular users = 69.6% in 5144 secs
Part-time users = 64.6% in 5455 secs
1 to 5 years' experience (all types) = 61.3% in 5656 secs
6 to 10 years' experience (all types) = 73.3% in 4842 secs
11 to 15 years' experience (all types) = 71.4% in 4338 secs
On the job learning (all types) = 71.6% in 4686 secs
Formal learning (all types) = 57.5% in 4339 secs

The average MicroStation self-rating score for Civil Engineers is: 3.6.


Trends:

Overall, regular users are more accurate and faster than part-time users.

Civil Engineers with 6 to 10 years' of experience with these tools are the most efficient. They reach a plateau in performance after c. 7 years and make no further productivity gains.

Civil Engineers who learn to apply these tools on projects are more accurate than those who have primarily formal training, but less practical experience. There is little to choose between the two, in terms of speed.

Civil Engineers are generally confident in their ability to use technical software tools on Construction projects, although overall, there is still room for further improvement in their core skills.

R

Wednesday 27 January 2016

Global Test Scores Posted by CAD & BIM Managers

CAD and BIM Managers from across the world have submitted a wide range of KS test scores, in recent years. Let’s take a more detailed look at the people behind the headline stats.

We capture some interesting user demographic data at the start of each test session. This includes the following questions:

- Primary Industry/Discipline
- Primary Role
- Country & State
- Self rating
- How many years have you used this tool?
- Where did you learn to use this tool?
- How often do you use this tool? (Daily, weekly, occasional)
- How did you learn to use this tool? (On the job, Formal training, College)


The top 6 tests completed by CAD & BIM Managers are, in order (by volume):

Revit Architecture
BIM Management
Revit MEP
Revit Structure
AutoCAD
MicroStation

The results data comes from a wide range of countries and territories, primarily, US, Canada, UK, Australia, New Zealand, Singapore, HK, South Africa and Middle East regions.


Here are the overall results:

Revit Architecture

Avg score/time for:

Regular users = 81.7% in 2551 secs
Part-time users = 78.3% in 3945 secs
1 to 5 years' experience (all types) = 76.3% in 2940 secs
6 to 10 years' experience (all types) = 82.0% in 2912 secs
11 to 15 years' experience (all types) = 81.1% in 2832 secs
On the job learning (all types) = 82.3% in 3725 secs
Formal learning (all types) = 76.7% in 3317 secs

The average Revit Architecture self-rating score for CAD & BIM Managers is: 4.2.


BIM Management

Avg score/time for:

Regular users = 79.1% in 1767 secs
Part-time users = 71.2% in 2252 secs
1 to 5 years' experience (all types) = 72.3% in 2771 secs
6 to 10 years' experience (all types) = 79.3% in 1682 secs
11 to 15 years' experience (all types) = 78.7% in 1711 secs
On the job learning (all types) = 76.4% in 2248 secs
Formal learning (all types) = 72.5% in 1843 secs

The average BIM self-rating score for CAD & BIM Managers is: 4.3.


Revit MEP

Avg score/time for:

Regular users = 77.6% in 3136 secs
Part-time users = 72.8% in 3316 secs
1 to 5 years' experience (all types) = 70.8% in 2996 secs
6 to 10 years' experience (all types) = 78.7% in 2552 secs
11 to 15 years' experience (all types) = 75.1% in 2732 secs
On the job learning (all types) = 77.6% in 3470 secs
Formal learning (all types) = 74.8% in 3311 secs

The average Revit MEP self-rating score for CAD & BIM Managers is: 4.1.


Revit Structure

Avg score/time for:

Regular users = 78.6% in 3214 secs
Part-time users = 73.3% in 3745 secs
1 to 5 years' experience (all types) = 69.7% in 3640 secs
6 to 10 years' experience (all types) = 81.0% in 2819 secs
11 to 15 years' experience (all types) = 80.2% in 2832 secs
On the job learning (all types) = 80.1% in 2902 secs
Formal learning (all types) = 75.7% in 2493 secs

The average Revit Structure self-rating score for CAD & BIM Managers is: 4.0.


AutoCAD

Avg score/time for:

Regular users = 64.0% in 4230 secs
Part-time users = 62.8% in 4535 secs
1 to 5 years' experience (all types) = 53.2% in 3827 secs
6 to 10 years' experience (all types) = 57.6% in 3621 secs
11 to 15 years' experience (all types) = 59.7% in 4038 secs
On the job learning (all types) = 66.9% in 3782 secs
Formal learning (all types) = 62.2% in 3814 secs

The average AutoCAD self-rating score for CAD & BIM Managers is: 3.5.


 MicroStation

Avg score/time for:

Regular users = 63.6% in 4154 secs
Part-time users = 57.2% in 4766 secs
1 to 5 years' experience (all types) = 55.6% in 4901 secs
6 to 10 years' experience (all types) = 63.3% in 4546 secs
11 to 15 years' experience (all types) = 64.4% in 4527 secs
On the job learning (all types) = 61.8% in 4273 secs
Formal learning (all types) = 58.5% in 4139 secs


The average MicroStation self-rating score for CAD & BIM Managers is: 3.6.


Trends:

Overall, regular users are more accurate and faster than part-time users.

CAD & BIM Managers with 6 to 10 years' of experience with these tools are the most efficient. They reach a plateau in performance after c. 7 years and make no further productivity gains.

CAD & BIM Managers who learn to apply these tools on projects are more accurate than those who have primarily formal training, but less practical experience. Formally trained users are faster overall than self-taught users.

CAD & BIM Managers are generally very confident in their ability to use technical software tools on Construction projects.

CAD & BIM Managers are more confident and more accurate using modeling software than drafting software.

R

Tuesday 26 January 2016

Global Test Scores Posted by Architects

Architects from across the world have submitted several thousand KS test scores, in recent years. Let’s take a more detailed look at the people behind the headline stats.

We capture some interesting user demographic data at the start of each test session. This includes the following questions:

- Primary Industry/Discipline
- Primary Role
- Country & State
- Self rating (out of 5)
- How many years have you used this tool?
- Where did you learn to use this tool?
- How often do you use this tool? (Daily, weekly, occasional)
- How did you learn to use this tool? (On the job, Formal training, College)


The top 4 skills assessments completed by Architects are, in order (by volume):

Revit Architecture
AutoCAD
MicroStation
BIM Management


The results data comes from a wide range of countries and territories, primarily, US, Canada, UK, Australia, New Zealand, Singapore, South Africa and Middle East regions.

Here are the overall results:

Revit Architecture

Avg score/time for:

Regular users = 73.5% in 4894 secs
Part-time users = 67.3% in 5542 secs
1 to 5 years' experience (all types) = 66.2% in 5333 secs
6 to 10 years' experience (all types) = 74.5% in 5215 secs
11 to 15 years' experience (all types) = 73.0% in 5199 secs
On the job learning (all types) = 73.3% in 5637 secs
Formal learning (all types) = 70.3% in 4834 secs

The average Revit Architecture self-rating score for Architects is: 3.7.

  
AutoCAD

Avg score/time for:

Regular users = 55.5% in 4919 secs
Part-time users = 52.8% in 6019 secs
1 to 5 years' experience (all types) = 45.9% in 4241 secs
6 to 10 years' experience (all types) = 55.1% in 5772 secs
11 to 15 years' experience (all types) = 53.7% in 5430 secs
On the job learning (all types) = 57.5% in 5140 secs
Formal learning (all types) = 51.8% in 4932 secs

The average AutoCAD self-rating score for Architects is: 3.4.


MicroStation

Avg score/time for:

Regular users = 61.2% in 4652 secs
Part-time users = 56.2% in 5165 secs
1 to 5 years' experience (all types) = 58.2% in 4901 secs
6 to 10 years' experience (all types) = 62.3% in 4639 secs
11 to 15 years' experience (all types) = 63.4% in 4519 secs
On the job learning (all types) = 62.6% in 4673 secs
Formal learning (all types) = 65.8% in 5037 secs

The average MicroStation self-rating score for Architects is: 3.5.


BIM Management

Avg score/time for:

Regular users = 71.1% in 2029 secs
Part-time users = 67.8% in 2152 secs
1 to 5 years' experience (all types) = 68.3% in 2037 secs
6 to 10 years' experience (all types) = 69.1% in 1947 secs
11 to 15 years' experience (all types) = 67.7% in 1923 secs
On the job learning (all types) = 70.4% in 2035 secs
Formal learning (all types) = 70.5% in 1947 secs

The average BIM self-rating score for Architects is: 3.6.


Trends:

Overall, regular users are more accurate and faster than part-time users.

Architects with 6 to 10 years' of experience with these tools are the most efficient. They reach a plateau in performance after c. 7 years and make no further productivity gains.

Architects who learn to apply these tools on projects are more accurate than those who have primarily formal training, but less practical experience. Formally trained users are faster overall than self-taught users.

R

Saturday 23 January 2016

Navisworks Test Scores Around The World

Navisworks is a 3D design review package, used primarily in the AEC sector to complement 3D design packages (such as Revit, AutoCAD and MicroStation). 

Navisworks allows users to open and combine 3D models, navigate around them in real-time and review the model using a set of tools including comments, redlining, viewpoint and measurements.

Over the years, KnowledgeSmart has captured test scores for a wide range of of Navisworks users, in multiple countries across the globe.

Here are the variances in our overall benchmark data, from 2013 to 2015:

2013
Average Score: 54.0%
Average Time: 49 mins

2014
Average Score: 57.0%
Average Time: 52 mins

2015
Average Score: 58.4%
Average Time: 43 mins


Let's take a look at some overall aggregate score and time data on a country vs country basis. Numbers of test scores vary, so this list does not imply that one country is 'better' than another. It's interesting to see what kind of data is generated in different parts of the globe.

Navisworks Fundamentals


Country  Score (%)   Time (secs)
Australia 67.7 2172.2
Bahrain 53.3 3123.3
Canada 63.4 2275.5
Hong Kong 68.4 2643.3
India 49.7 2789.8
Kuwait 52.4 3320.2
New Zealand 68.1 2346.7
Oman 51.2 3630.4
Pakistan 53.2 2478.8
Philippines 60.0 2489.8
Qatar 52.6 2880.6
Saudi Arabia 59.8 2590.0
Singapore 58.8 2467.7
UAE 63.1 3543.5
UK 66.5 2525.9
USA 57.7 2491.4


We also capture data on a per State basis, for our US customers. The list below represents those States where the volume of data makes for meaningful data sharing.


State Score (%)   Time (secs)
USA all 57.7 2491.4
Arizona 56.5 2676.1
California 63.4 2374.2
Colorado 58.8 2298.8
Florida 62.9 2387.6
Georgia 59.6 2478.5
Illinois 54.6 2664.4
Louisiana 55.7 2599.4
Michigan 58.8 2490.7
Missouri 51.2 2974.1
New York 58.9 2185.5
North Carolina 53.3 2776.1
Oregon 52.7 2687.8
Pennsylvania 57.9 2489.9
Tennessee 54.3 2567.7
Texas 63.2 2234.4
Utah 57.3 2512.2
Virginia 56.1 2775.5


Navisworks is a Top 10 KS test topic, across our global customers. Overall results data illustrates that there is a clear need for training across the wider industry, with respect to model navigation and clash detection.

R

Evolve Consultancy - BIM Workshops

Longtime friends of KS, Evolve Consultancy, are hosting a series of BIM workshops in the coming weeks, to help UK Construction prepare for the BIM L2 target date of early April.

Here are the details:

2016 is here! But are you ready for the biggest single change to UK construction in recent history?

You will, of course, be aware of Building Information Modelling by now, and the fact that all UK publicly procured projects (not forgetting the many private projects following suit) need to be delivered as Level 2 BIM projects from April.

But what does that mean? And what effect will it have on you and your business?

You are invited to join us and find out all the answers at our popular interactive BIM Level 2 Implementation Workshops being held across the country in 2016.

LONDON, MARYLEBONE STATION
24 Feb 2016, 10am-4pm

BRISTOL, HIGH STREET
22 March 2016, 10am-4pm

MANCHESTER, DUCIE STREET
22 April 2016, 10am-4pm


This is not your normal training course. We’ll lead you through a series of discussions and exercises designed to help you apply the implications of BIM to your own office practices. You will go away with an action plan totally and utterly tailored to your needs.

All levels of staff are welcome from large and small practices.

What will we cover? Everything essential to understand what BIM means to you:

·                The UK Government BIM initiative

·                The Common Data Environment

·                Understanding BIM Level 2

·                Collaborative working

·                Strategic priorities & project delivery


All for only £100 (+VAT) per person. Just fill in the attached booking form and send it back to admin@evolve-consultancy.com. Spaces are limited.

Where else could you get a full day’s BIM Level 2 workshop for only £100?

(KnowledgeSmart customers: please contact Evolve for a special discount code to save 20% off the booking fee!)

R

Revit MEP Test Scores Around The World

Autodesk Revit is building information modeling software for architects, structural engineers, MEP engineers, designers and contractors. It allows users to design a building and structure and its components in 3D, annotate the model with 2D drafting elements, and access building information from the building model's database. Revit is 4D BIM capable with tools to plan and track various stages in the building's lifecycle, from concept to construction and later demolition.

Over the years, KnowledgeSmart has captured test scores for thousands of Revit MEP users, in multiple countries across the globe.

Here are the variances in our overall benchmark data, from 2013 to 2015. (For the first couple of years, the data was combined into an overall value):

2013
Average Score: 65.0%
Average Time: 1 hr 16 mins

2014
Average Score: 66.0%
Average Time: 1 hr 12 mins

2015
Electrical

Average Score: 63.7%
Average Time: 1 hr 6 mins


Mechanical
Average Score: 62.2%
Average Time: 1 hr 7 mins


Plumbing
Average Score: 70.1%
Average Time: 1 hr 11 mins



Let's take a look at some overall aggregate score and time data on a country vs country basis. Numbers of test scores vary, so this list does not imply that one country is 'better' than another. It's interesting to see what kind of data is generated in different parts of the globe.

Revit MEP Fundamentals - Electrical


Country  Score (%)   Time (secs)
Australia 67.7 3683.0
Bahrain 58.7 5031.1
Canada 66.8 4008.6
Hong Kong 65.9 4071.9
India 57.1 3770.5
Kuwait 53.7 4280.8
New Zealand 71.8 3487.1
Oman 56.5 4855.6
Pakistan 53.1 3872.2
Philippines 59.9 3136.8
Qatar 55.0 3505.2
Saudi Arabia 58.7 3716.6
Singapore 66.1 4765.1
UAE 60.3 3715.4
UK 67.7 3525.3
USA 65.7 4143.9


Revit MEP Fundamentals - Mechanical

Country  Score (%)   Time (secs)
Australia 65.9 4176.4
Bahrain 57.6 4365.4
Canada 64.2 4787.8
Hong Kong 62.7 4034.4
India 58.0 4467.4
Kuwait 56.6 4576.7
New Zealand 71.2 3413.3
Oman 54.4 5123.5
Pakistan 51.1 4176.6
Philippines 56.0 3663.3
Qatar 58.1 3687.7
Saudi Arabia 60.1 4245.6
Singapore 65.7 4838.3
UAE 58.0 3822.4
UK 68.3 3516.3
USA 66.3 4076.4


Revit MEP Fundamentals - Plumbing

Country  Score (%)   Time (secs)
Australia 69.7 4378.4
Bahrain 64.3 4897.1
Canada 73.4 3597.5
Hong Kong 73.1 4346.1
India 63.8 3951.8
Kuwait 58.8 4020.0
New Zealand 73.2 4132.9
Oman 59.8 4676.4
Pakistan 60.5 4876.3
Philippines 67.6 3176.7
Qatar 58.7 4899.4
Saudi Arabia 67.8 4346.7
Singapore 74.1 4343.3
UAE 67.8 3984.0
UK 72.8 3474.5
USA 69.9 3919.5


We also capture data on a per State basis, for our US customers. The list below represents those States where the volume of data makes for meaningful data sharing.


Revit MEP Fundamentals - Electrical

State Score (%)   Time (secs)
USA all 65.7 4143.9
Arizona 63.7 3956.7
California 67.7 4697.8
Colorado 71.5 4234.5
Florida 73.2 4212.5
Georgia 68.5 3790.7
Illinois 68.1 5212.2
Louisiana 62.2 3987.5
Michigan 65.8 3887.4
North Carolina 62.3 4960.0
Oregon 58.7 4345.9
Pennsylvania 65.0 3803.8
Texas 68.8 3806.8
Utah 64.8 4234.8
Virginia 61.3 4340.0


Revit MEP Fundamentals - Mechanical


State Score (%)   Time (secs)
USA all 66.3 4076.4
Alabama 64.2 3815.4
Arizona 61.1 3595.0
California 72.5 5092.5
Colorado 72.4 5051.2
Florida 69.1 3531.4
Georgia 70.7 4470.8
Illinois 64.4 3424.2
Kentucky 65.0 3765.9
Louisiana 65.5 3815.3
Maryland 63.1 3402.5
Michigan 69.4 3580.1
Missouri 72.0 3920.4
North Carolina 59.7 4268.9
Ohio 73.2 3880.0
Oregon 63.0 4022.0
Pennsylvania 63.3 3769.6
Tennessee 65.9 5410.0
Texas 67.1 3522.5
Utah 66.7 4237.7
Virginia 61.0 3950.1
Washington 71.1 4326.6
Wisconsin 66.5 4345.3


Revit MEP Fundamentals - Plumbing

State Score (%)   Time (secs)
USA all 69.9 3919.5
Arizona 68.0 3315.0
California 74.7 4693.4
Colorado 71.5 4234.5
Florida 73.7 4252.7
Georgia 73.0 4132.2
Illinois 67.9 3822.2
Louisiana 67.6 3987.5
Michigan 71.1 3619.9
North Carolina 65.7 4268.9
Oregon 62.2 4205.5
Pennsylvania 69.8 3769.6
Texas 72.0 4374.4
Utah 69.7 4167.8
Virginia 63.3 4123.3


Revit MEP Advanced


2015
Mechanical
Average Score: 56.0%
Average Time: 1 hr 3 mins


Plumbing
Average Score: 57.0%
Average Time: 1 hr 6 mins



Revit MEP is a Top 5 KS test topic, across our global customers. The impact of BIM on the AEC industry is significant and Revit is the dominant design tool, in terms of overall market share and breadth of supply chain resources.

R