Global Test Scores Posted by Structural Engineers

Structural Engineers from across the world have submitted a wide variety of KS test scores, in recent years. Let’s take a more detailed look at the people behind the headline stats.

We capture some interesting user demographic data at the start of each test session. This includes the following questions:

- Primary Industry/Discipline
- Primary Role
- Country & State
- Self rating
- How many years have you used this tool?
- Where did you learn to use this tool?
- How often do you use this tool? (Daily, weekly, occasional)
- How did you learn to use this tool? (On the job, Formal training, College)

The top 2 tests completed by Structural Engineers are, in order (by volume):

Revit Structure
AutoCAD

The results data comes from a wide range of countries and territories, primarily, US, Canada, UK, Australia, South Africa, Singapore, HK and Middle East regions.

Here are the overall results:

Revit Structure

Avg score/time for:

Regular users = 71.1% in 4201 secs

Part-time users = 67.2% in 3871 secs

1 to 5 years = 66.7% in 4110 secs

6 to 10 years = 69.9% in 3489 secs

11 to 15 years = 67.1% in 3892 secs

On the job learning = 69.1% in 4287 secs

Formal learning = 64.3% in 3956 secs

The average Revit Structure self-rating score for Structural Engineers is: 3.7.

AutoCAD

Avg score/time for:

Regular users = 56.7% in 4756 secs

Part-time users = 54.9% in 5064 secs

1 to 5 years = 51.3% in 4536 secs

6 to 10 years = 56.3% in 4201 secs

11 to 15 years = 56.7% in 5337 secs

On the job learning = 54.8% in 4466 secs

Formal learning = 52.1% in 4215 secs

The average AutoCAD self-rating score for Structural Engineers is: 3.3.

Trends:

Overall, regular users are more accurate and faster than part-time users.

Structural Engineers with 6 to 10 years' of experience with these tools are the most efficient. They reach a plateau in performance after c. 7 years and make no further productivity gains.

Structural Engineers who learn to apply these tools on projects are more accurate than those who have primarily formal training, but less practical experience. Formally trained users are faster overall than self-taught users.

Structural Engineers are generally confident in their ability to use technical software tools on Construction projects, although overall, there is still room for further improvement in their core skills.

Structural Engineers are more confident and more accurate using modeling software than drafting software.

R

Global Test Scores Posted by MEP Engineers

MEP Engineers from across the world have submitted a wide variety of KS test scores, in recent years. Let’s take a more detailed look at the people behind the headline stats.

We capture some interesting user demographic data at the start of each test session. This includes the following questions:

- Primary Industry/Discipline
- Primary Role
- Country & State
- Self rating
- How many years have you used this tool?
- Where did you learn to use this tool?
- How often do you use this tool? (Daily, weekly, occasional)
- How did you learn to use this tool? (On the job, Formal training, College)

The top 2 tests completed by MEP Engineers are, in order (by volume):

Revit MEP
AutoCAD

The results data comes from a wide range of countries and territories, primarily, US, Canada, UK, Australia, South Africa, Singapore, HK and Middle East regions.

Here are the overall results:

Revit MEP

Avg score/time for:

Regular users = 68.5% in 3110 secs

Part-time users = 65.7% in 3871 secs

1 to 5 years' experience (all types) = 56.6% in 3901 secs

6 to 10 years' experience (all types) = 68.7% in 3401 secs

On the job learning (all types) = 70.2% in 3781 secs

Formal learning (all types) = 64.8% in 3911 secs

The average Revit MEP self-rating score for MEP Engineers is: 3.8.

AutoCAD

Avg score/time for:

Regular users = 59.8% in 5356 secs

Part-time users = 54.9% in 4864 secs

1 to 5 years' experience (all types) = 52.7% in 5752 secs

6 to 10 years' experience (all types) = 57.5% in 5240 secs

11 to 15 years' experience (all types) = 54.7% in 5449 secs

On the job learning (all types) = 57.8% in 4516 secs

Formal learning (all types) = 55.1% in 4344 secs

The average AutoCAD self-rating score for MEP Engineers is: 3.4.

Trends:

Overall, regular users are more accurate and faster than part-time users.

MEP Engineers with 6 to 10 years' of experience with these tools are the most efficient. They reach a plateau in performance after c. 7 years and make no further productivity gains.

MEP Engineers who learn to apply these tools on projects are more accurate than those who have primarily formal training, but less practical experience. Formally trained users are faster overall than self-taught users.

MEP Engineers are generally confident in their ability to use technical software tools on Construction projects, although overall, there is still room for further improvement in their core skills.

MEP Engineers are more confident and more accurate using modeling software than drafting software.

R

Global Test Scores Posted by Civil Engineers

Civil Engineers from across the world have submitted several thousand KS test scores, in recent years. Let’s take a more detailed look at the people behind the headline stats.

We capture some interesting user demographic data at the start of each test session. This includes the following questions:

- Primary Industry/Discipline
- Primary Role
- Country & State
- Self rating
- How many years have you used this tool?
- Where did you learn to use this tool?
- How often do you use this tool? (Daily, weekly, occasional)
- How did you learn to use this tool? (On the job, Formal training, College)

The top 3 tests completed by Civil Engineers are, in order (by volume):

AutoCAD Civil 3D
AutoCAD
MicroStation

The results data comes from a wide range of countries and territories, primarily, US, Canada, UK, Australia, South Africa and Middle East regions.

Here are the overall results:

AutoCAD Civil 3D

Avg score/time for:

Regular users = 73.4% in 3294 secs

Part-time users = 68.2% in 4109 secs

1 to 5 years' experience (all types) = 63.4% in 3783 secs

6 to 10 years' experience (all types) = 75.5% in 3170 secs

11 to 15 years' experience (all types) = 76.3% in 3290 secs

On the job learning (all types) = 71.1% in 3463 secs

Formal learning (all types) = 67.4% in 3587 secs

The average AutoCAD Civil 3D self-rating score for Civil Engineers is: 3.9.

AutoCAD

Avg score/time for:

Regular users = 70.2% in 4867 secs

Part-time users = 63.1% in 4842 secs

1 to 5 years' experience (all types) = 55.3% in 5130 secs

6 to 10 years' experience (all types) = 70.4% in 4363 secs

11 to 15 years' experience (all types) = 69.9% in 3799 secs

On the job learning (all types) = 67.2% in 4576 secs

Formal learning (all types) = 55.7% in 4644 secs

The average AutoCAD self-rating score for Civil Engineers is: 3.7.

MicroStation

Avg score/time for:

Regular users = 69.6% in 5144 secs

Part-time users = 64.6% in 5455 secs

1 to 5 years' experience (all types) = 61.3% in 5656 secs

6 to 10 years' experience (all types) = 73.3% in 4842 secs

11 to 15 years' experience (all types) = 71.4% in 4338 secs

On the job learning (all types) = 71.6% in 4686 secs

Formal learning (all types) = 57.5% in 4339 secs

The average MicroStation self-rating score for Civil Engineers is: 3.6.

Trends:

Overall, regular users are more accurate and faster than part-time users.

Civil Engineers with 6 to 10 years' of experience with these tools are the most efficient. They reach a plateau in performance after c. 7 years and make no further productivity gains.

Civil Engineers who learn to apply these tools on projects are more accurate than those who have primarily formal training, but less practical experience. There is little to choose between the two, in terms of speed.

Civil Engineers are generally confident in their ability to use technical software tools on Construction projects, although overall, there is still room for further improvement in their core skills.

R

Global Test Scores Posted by CAD & BIM Managers

CAD and BIM Managers from across the world have submitted a wide range of KS test scores, in recent years. Let’s take a more detailed look at the people behind the headline stats.

We capture some interesting user demographic data at the start of each test session. This includes the following questions:

- Primary Industry/Discipline
- Primary Role
- Country & State
- Self rating
- How many years have you used this tool?
- Where did you learn to use this tool?
- How often do you use this tool? (Daily, weekly, occasional)
- How did you learn to use this tool? (On the job, Formal training, College)

The top 6 tests completed by CAD & BIM Managers are, in order (by volume):

Revit Architecture
BIM Management
Revit MEP
Revit Structure
AutoCAD
MicroStation

The results data comes from a wide range of countries and territories, primarily, US, Canada, UK, Australia, New Zealand, Singapore, HK, South Africa and Middle East regions.

Here are the overall results:

Revit Architecture

Avg score/time for:

Regular users = 81.7% in 2551 secs

Part-time users = 78.3% in 3945 secs

1 to 5 years' experience (all types) = 76.3% in 2940 secs

6 to 10 years' experience (all types) = 82.0% in 2912 secs

11 to 15 years' experience (all types) = 81.1% in 2832 secs

On the job learning (all types) = 82.3% in 3725 secs

Formal learning (all types) = 76.7% in 3317 secs

The average Revit Architecture self-rating score for CAD & BIM Managers is: 4.2.

BIM Management

Avg score/time for:

Regular users = 79.1% in 1767 secs

Part-time users = 71.2% in 2252 secs

1 to 5 years' experience (all types) = 72.3% in 2771 secs

6 to 10 years' experience (all types) = 79.3% in 1682 secs

11 to 15 years' experience (all types) = 78.7% in 1711 secs

On the job learning (all types) = 76.4% in 2248 secs

Formal learning (all types) = 72.5% in 1843 secs

The average BIM self-rating score for CAD & BIM Managers is: 4.3.

Revit MEP

Avg score/time for:

Regular users = 77.6% in 3136 secs

Part-time users = 72.8% in 3316 secs

1 to 5 years' experience (all types) = 70.8% in 2996 secs

6 to 10 years' experience (all types) = 78.7% in 2552 secs

11 to 15 years' experience (all types) = 75.1% in 2732 secs

On the job learning (all types) = 77.6% in 3470 secs

Formal learning (all types) = 74.8% in 3311 secs

The average Revit MEP self-rating score for CAD & BIM Managers is: 4.1.

Revit Structure

Avg score/time for:

Regular users = 78.6% in 3214 secs

Part-time users = 73.3% in 3745 secs

1 to 5 years' experience (all types) = 69.7% in 3640 secs

6 to 10 years' experience (all types) = 81.0% in 2819 secs

11 to 15 years' experience (all types) = 80.2% in 2832 secs

On the job learning (all types) = 80.1% in 2902 secs

Formal learning (all types) = 75.7% in 2493 secs

The average Revit Structure self-rating score for CAD & BIM Managers is: 4.0.

AutoCAD

Avg score/time for:

Regular users = 64.0% in 4230 secs

Part-time users = 62.8% in 4535 secs

1 to 5 years' experience (all types) = 53.2% in 3827 secs

6 to 10 years' experience (all types) = 57.6% in 3621 secs

11 to 15 years' experience (all types) = 59.7% in 4038 secs

On the job learning (all types) = 66.9% in 3782 secs

Formal learning (all types) = 62.2% in 3814 secs

The average AutoCAD self-rating score for CAD & BIM Managers is: 3.5.

 MicroStation

Avg score/time for:

Regular users = 63.6% in 4154 secs

Part-time users = 57.2% in 4766 secs

1 to 5 years' experience (all types) = 55.6% in 4901 secs

6 to 10 years' experience (all types) = 63.3% in 4546 secs

11 to 15 years' experience (all types) = 64.4% in 4527 secs

On the job learning (all types) = 61.8% in 4273 secs

Formal learning (all types) = 58.5% in 4139 secs

The average MicroStation self-rating score for CAD & BIM Managers is: 3.6.

Trends:

Overall, regular users are more accurate and faster than part-time users.

CAD & BIM Managers with 6 to 10 years' of experience with these tools are the most efficient. They reach a plateau in performance after c. 7 years and make no further productivity gains.

CAD & BIM Managers who learn to apply these tools on projects are more accurate than those who have primarily formal training, but less practical experience. Formally trained users are faster overall than self-taught users.

CAD & BIM Managers are generally very confident in their ability to use technical software tools on Construction projects.

CAD & BIM Managers are more confident and more accurate using modeling software than drafting software.

R

Global Test Scores Posted by Architects

Architects from across the world have submitted several thousand KS test scores, in recent years. Let’s take a more detailed look at the people behind the headline stats.

We capture some interesting user demographic data at the start of each test session. This includes the following questions:

- Primary Industry/Discipline
- Primary Role
- Country & State
- Self rating (out of 5)
- How many years have you used this tool?
- Where did you learn to use this tool?
- How often do you use this tool? (Daily, weekly, occasional)
- How did you learn to use this tool? (On the job, Formal training, College)

The top 4 skills assessments completed by Architects are, in order (by volume):

Revit Architecture
AutoCAD
MicroStation
BIM Management

The results data comes from a wide range of countries and territories, primarily, US, Canada, UK, Australia, New Zealand, Singapore, South Africa and Middle East regions.

Here are the overall results:

Revit Architecture

Avg score/time for:

Regular users = 73.5% in 4894 secs

Part-time users = 67.3% in 5542 secs

1 to 5 years' experience (all types) = 66.2% in 5333 secs

6 to 10 years' experience (all types) = 74.5% in 5215 secs

11 to 15 years' experience (all types) = 73.0% in 5199 secs

On the job learning (all types) = 73.3% in 5637 secs

Formal learning (all types) = 70.3% in 4834 secs

The average Revit Architecture self-rating score for Architects is: 3.7.

  

AutoCAD

Avg score/time for:

Regular users = 55.5% in 4919 secs

Part-time users = 52.8% in 6019 secs

1 to 5 years' experience (all types) = 45.9% in 4241 secs

6 to 10 years' experience (all types) = 55.1% in 5772 secs

11 to 15 years' experience (all types) = 53.7% in 5430 secs

On the job learning (all types) = 57.5% in 5140 secs

Formal learning (all types) = 51.8% in 4932 secs

The average AutoCAD self-rating score for Architects is: 3.4.

MicroStation

Avg score/time for:

Regular users = 61.2% in 4652 secs

Part-time users = 56.2% in 5165 secs

1 to 5 years' experience (all types) = 58.2% in 4901 secs

6 to 10 years' experience (all types) = 62.3% in 4639 secs

11 to 15 years' experience (all types) = 63.4% in 4519 secs

On the job learning (all types) = 62.6% in 4673 secs

Formal learning (all types) = 65.8% in 5037 secs

The average MicroStation self-rating score for Architects is: 3.5.

BIM Management

Avg score/time for:

Regular users = 71.1% in 2029 secs

Part-time users = 67.8% in 2152 secs

1 to 5 years' experience (all types) = 68.3% in 2037 secs

6 to 10 years' experience (all types) = 69.1% in 1947 secs

11 to 15 years' experience (all types) = 67.7% in 1923 secs

On the job learning (all types) = 70.4% in 2035 secs

Formal learning (all types) = 70.5% in 1947 secs

The average BIM self-rating score for Architects is: 3.6.

Trends:

Overall, regular users are more accurate and faster than part-time users.

Architects with 6 to 10 years' of experience with these tools are the most efficient. They reach a plateau in performance after c. 7 years and make no further productivity gains.

Architects who learn to apply these tools on projects are more accurate than those who have primarily formal training, but less practical experience. Formally trained users are faster overall than self-taught users.

R

Navisworks Test Scores Around The World

Navisworks is a 3D design review package, used primarily in the AEC sector to complement 3D design packages (such as Revit, AutoCAD and MicroStation). 

Navisworks allows users to open and combine 3D models, navigate around them in real-time and review the model using a set of tools including comments, redlining, viewpoint and measurements.

Over the years, KnowledgeSmart has captured test scores for a wide range of of Navisworks users, in multiple countries across the globe.

Here are the variances in our overall benchmark data, from 2013 to 2015:

2013
Average Score: 54.0%
Average Time: 49 mins

2014
Average Score: 57.0%
Average Time: 52 mins

2015
Average Score: 58.4%
Average Time: 43 mins


Let's take a look at some overall aggregate score and time data on a country vs country basis. Numbers of test scores vary, so this list does not imply that one country is 'better' than another. It's interesting to see what kind of data is generated in different parts of the globe.

Navisworks Fundamentals

Country	Score (%)	Time (secs)
Australia	67.7	2172.2
Bahrain	53.3	3123.3
Canada	63.4	2275.5
Hong Kong	68.4	2643.3
India	49.7	2789.8
Kuwait	52.4	3320.2
New Zealand	68.1	2346.7
Oman	51.2	3630.4
Pakistan	53.2	2478.8
Philippines	60.0	2489.8
Qatar	52.6	2880.6
Saudi Arabia	59.8	2590.0
Singapore	58.8	2467.7
UAE	63.1	3543.5
UK	66.5	2525.9
USA	57.7	2491.4

We also capture data on a per State basis, for our US customers. The list below represents those States where the volume of data makes for meaningful data sharing.

State	Score (%)	Time (secs)
USA all	57.7	2491.4
Arizona	56.5	2676.1
California	63.4	2374.2
Colorado	58.8	2298.8
Florida	62.9	2387.6
Georgia	59.6	2478.5
Illinois	54.6	2664.4
Louisiana	55.7	2599.4
Michigan	58.8	2490.7
Missouri	51.2	2974.1
New York	58.9	2185.5
North Carolina	53.3	2776.1
Oregon	52.7	2687.8
Pennsylvania	57.9	2489.9
Tennessee	54.3	2567.7
Texas	63.2	2234.4
Utah	57.3	2512.2
Virginia	56.1	2775.5

Navisworks is a Top 10 KS test topic, across our global customers. Overall results data illustrates that there is a clear need for training across the wider industry, with respect to model navigation and clash detection.

R

Evolve Consultancy - BIM Workshops

Longtime friends of KS, Evolve Consultancy, are hosting a series of BIM workshops in the coming weeks, to help UK Construction prepare for the BIM L2 target date of early April.

Here are the details:

2016 is here! But are you ready for the biggest single change to UK construction in recent history?

You will, of course, be aware of Building Information Modelling by now, and the fact that all UK publicly procured projects (not forgetting the many private projects following suit) need to be delivered as Level 2 BIM projects from April.

But what does that mean? And what effect will it have on you and your business?

You are invited to join us and find out all the answers at our popular interactive BIM Level 2 Implementation Workshops being held across the country in 2016.

LONDON, MARYLEBONE STATION
24 Feb 2016, 10am-4pm

BRISTOL, HIGH STREET
22 March 2016, 10am-4pm

MANCHESTER, DUCIE STREET
22 April 2016, 10am-4pm


This is not your normal training course. We’ll lead you through a series of discussions and exercises designed to help you apply the implications of BIM to your own office practices. You will go away with an action plan totally and utterly tailored to your needs.

All levels of staff are welcome from large and small practices.

What will we cover? Everything essential to understand what BIM means to you:

·                The UK Government BIM initiative

·                The Common Data Environment

·                Understanding BIM Level 2

·                Collaborative working

·                Strategic priorities & project delivery


All for only £100 (+VAT) per person. Just fill in the attached booking form and send it back to admin@evolve-consultancy.com. Spaces are limited.

Where else could you get a full day’s BIM Level 2 workshop for only £100?

(KnowledgeSmart customers: please contact Evolve for a special discount code to save 20% off the booking fee!)

R

Revit MEP Test Scores Around The World

Autodesk Revit is building information modeling software for architects, structural engineers, MEP engineers, designers and contractors. It allows users to design a building and structure and its components in 3D, annotate the model with 2D drafting elements, and access building information from the building model's database. Revit is 4D BIM capable with tools to plan and track various stages in the building's lifecycle, from concept to construction and later demolition.

Over the years, KnowledgeSmart has captured test scores for thousands of Revit MEP users, in multiple countries across the globe.

Here are the variances in our overall benchmark data, from 2013 to 2015. (For the first couple of years, the data was combined into an overall value):

2013
Average Score: 65.0%
Average Time: 1 hr 16 mins

2014
Average Score: 66.0%
Average Time: 1 hr 12 mins

2015
Electrical
Average Score: 63.7%
Average Time: 1 hr 6 mins

Mechanical
Average Score: 62.2%
Average Time: 1 hr 7 mins

Plumbing
Average Score: 70.1%
Average Time: 1 hr 11 mins


Let's take a look at some overall aggregate score and time data on a country vs country basis. Numbers of test scores vary, so this list does not imply that one country is 'better' than another. It's interesting to see what kind of data is generated in different parts of the globe.

Revit MEP Fundamentals - Electrical

Country	Score (%)	Time (secs)
Australia	67.7	3683.0
Bahrain	58.7	5031.1
Canada	66.8	4008.6
Hong Kong	65.9	4071.9
India	57.1	3770.5
Kuwait	53.7	4280.8
New Zealand	71.8	3487.1
Oman	56.5	4855.6
Pakistan	53.1	3872.2
Philippines	59.9	3136.8
Qatar	55.0	3505.2
Saudi Arabia	58.7	3716.6
Singapore	66.1	4765.1
UAE	60.3	3715.4
UK	67.7	3525.3
USA	65.7	4143.9

Revit MEP Fundamentals - Mechanical

Country	Score (%)	Time (secs)
Australia	65.9	4176.4
Bahrain	57.6	4365.4
Canada	64.2	4787.8
Hong Kong	62.7	4034.4
India	58.0	4467.4
Kuwait	56.6	4576.7
New Zealand	71.2	3413.3
Oman	54.4	5123.5
Pakistan	51.1	4176.6
Philippines	56.0	3663.3
Qatar	58.1	3687.7
Saudi Arabia	60.1	4245.6
Singapore	65.7	4838.3
UAE	58.0	3822.4
UK	68.3	3516.3
USA	66.3	4076.4

Revit MEP Fundamentals - Plumbing

Country	Score (%)	Time (secs)
Australia	69.7	4378.4
Bahrain	64.3	4897.1
Canada	73.4	3597.5
Hong Kong	73.1	4346.1
India	63.8	3951.8
Kuwait	58.8	4020.0
New Zealand	73.2	4132.9
Oman	59.8	4676.4
Pakistan	60.5	4876.3
Philippines	67.6	3176.7
Qatar	58.7	4899.4
Saudi Arabia	67.8	4346.7
Singapore	74.1	4343.3
UAE	67.8	3984.0
UK	72.8	3474.5
USA	69.9	3919.5

We also capture data on a per State basis, for our US customers. The list below represents those States where the volume of data makes for meaningful data sharing.

Revit MEP Fundamentals - Electrical

State	Score (%)	Time (secs)
USA all	65.7	4143.9
Arizona	63.7	3956.7
California	67.7	4697.8
Colorado	71.5	4234.5
Florida	73.2	4212.5
Georgia	68.5	3790.7
Illinois	68.1	5212.2
Louisiana	62.2	3987.5
Michigan	65.8	3887.4
North Carolina	62.3	4960.0
Oregon	58.7	4345.9
Pennsylvania	65.0	3803.8
Texas	68.8	3806.8
Utah	64.8	4234.8
Virginia	61.3	4340.0

Revit MEP Fundamentals - Mechanical

State	Score (%)	Time (secs)
USA all	66.3	4076.4
Alabama	64.2	3815.4
Arizona	61.1	3595.0
California	72.5	5092.5
Colorado	72.4	5051.2
Florida	69.1	3531.4
Georgia	70.7	4470.8
Illinois	64.4	3424.2
Kentucky	65.0	3765.9
Louisiana	65.5	3815.3
Maryland	63.1	3402.5
Michigan	69.4	3580.1
Missouri	72.0	3920.4
North Carolina	59.7	4268.9
Ohio	73.2	3880.0
Oregon	63.0	4022.0
Pennsylvania	63.3	3769.6
Tennessee	65.9	5410.0
Texas	67.1	3522.5
Utah	66.7	4237.7
Virginia	61.0	3950.1
Washington	71.1	4326.6
Wisconsin	66.5	4345.3

Revit MEP Fundamentals - Plumbing

State	Score (%)	Time (secs)
USA all	69.9	3919.5
Arizona	68.0	3315.0
California	74.7	4693.4
Colorado	71.5	4234.5
Florida	73.7	4252.7
Georgia	73.0	4132.2
Illinois	67.9	3822.2
Louisiana	67.6	3987.5
Michigan	71.1	3619.9
North Carolina	65.7	4268.9
Oregon	62.2	4205.5
Pennsylvania	69.8	3769.6
Texas	72.0	4374.4
Utah	69.7	4167.8
Virginia	63.3	4123.3

Revit MEP Advanced

2015
Mechanical
Average Score: 56.0%
Average Time: 1 hr 3 mins

Plumbing
Average Score: 57.0%
Average Time: 1 hr 6 mins


Revit MEP is a Top 5 KS test topic, across our global customers. The impact of BIM on the AEC industry is significant and Revit is the dominant design tool, in terms of overall market share and breadth of supply chain resources.

R