Revit MEP Test Scores Around The World

Autodesk Revit is building information modeling software for architects, structural engineers, MEP engineers, designers and contractors. It allows users to design a building and structure and its components in 3D, annotate the model with 2D drafting elements, and access building information from the building model's database. Revit is 4D BIM capable with tools to plan and track various stages in the building's lifecycle, from concept to construction and later demolition.

Over the years, KnowledgeSmart has captured test scores for thousands of Revit MEP users, in multiple countries across the globe.

Here are the variances in our overall benchmark data, from 2013 to 2015. (For the first couple of years, the data was combined into an overall value):

2013
Average Score: 65.0%
Average Time: 1 hr 16 mins

2014
Average Score: 66.0%
Average Time: 1 hr 12 mins

2015
Electrical
Average Score: 63.7%
Average Time: 1 hr 6 mins

Mechanical
Average Score: 62.2%
Average Time: 1 hr 7 mins

Plumbing
Average Score: 70.1%
Average Time: 1 hr 11 mins


Let's take a look at some overall aggregate score and time data on a country vs country basis. Numbers of test scores vary, so this list does not imply that one country is 'better' than another. It's interesting to see what kind of data is generated in different parts of the globe.

Revit MEP Fundamentals - Electrical

Country	Score (%)	Time (secs)
Australia	67.7	3683.0
Bahrain	58.7	5031.1
Canada	66.8	4008.6
Hong Kong	65.9	4071.9
India	57.1	3770.5
Kuwait	53.7	4280.8
New Zealand	71.8	3487.1
Oman	56.5	4855.6
Pakistan	53.1	3872.2
Philippines	59.9	3136.8
Qatar	55.0	3505.2
Saudi Arabia	58.7	3716.6
Singapore	66.1	4765.1
UAE	60.3	3715.4
UK	67.7	3525.3
USA	65.7	4143.9

Revit MEP Fundamentals - Mechanical

Country	Score (%)	Time (secs)
Australia	65.9	4176.4
Bahrain	57.6	4365.4
Canada	64.2	4787.8
Hong Kong	62.7	4034.4
India	58.0	4467.4
Kuwait	56.6	4576.7
New Zealand	71.2	3413.3
Oman	54.4	5123.5
Pakistan	51.1	4176.6
Philippines	56.0	3663.3
Qatar	58.1	3687.7
Saudi Arabia	60.1	4245.6
Singapore	65.7	4838.3
UAE	58.0	3822.4
UK	68.3	3516.3
USA	66.3	4076.4

Revit MEP Fundamentals - Plumbing

Country	Score (%)	Time (secs)
Australia	69.7	4378.4
Bahrain	64.3	4897.1
Canada	73.4	3597.5
Hong Kong	73.1	4346.1
India	63.8	3951.8
Kuwait	58.8	4020.0
New Zealand	73.2	4132.9
Oman	59.8	4676.4
Pakistan	60.5	4876.3
Philippines	67.6	3176.7
Qatar	58.7	4899.4
Saudi Arabia	67.8	4346.7
Singapore	74.1	4343.3
UAE	67.8	3984.0
UK	72.8	3474.5
USA	69.9	3919.5

We also capture data on a per State basis, for our US customers. The list below represents those States where the volume of data makes for meaningful data sharing.

Revit MEP Fundamentals - Electrical

State	Score (%)	Time (secs)
USA all	65.7	4143.9
Arizona	63.7	3956.7
California	67.7	4697.8
Colorado	71.5	4234.5
Florida	73.2	4212.5
Georgia	68.5	3790.7
Illinois	68.1	5212.2
Louisiana	62.2	3987.5
Michigan	65.8	3887.4
North Carolina	62.3	4960.0
Oregon	58.7	4345.9
Pennsylvania	65.0	3803.8
Texas	68.8	3806.8
Utah	64.8	4234.8
Virginia	61.3	4340.0

Revit MEP Fundamentals - Mechanical

State	Score (%)	Time (secs)
USA all	66.3	4076.4
Alabama	64.2	3815.4
Arizona	61.1	3595.0
California	72.5	5092.5
Colorado	72.4	5051.2
Florida	69.1	3531.4
Georgia	70.7	4470.8
Illinois	64.4	3424.2
Kentucky	65.0	3765.9
Louisiana	65.5	3815.3
Maryland	63.1	3402.5
Michigan	69.4	3580.1
Missouri	72.0	3920.4
North Carolina	59.7	4268.9
Ohio	73.2	3880.0
Oregon	63.0	4022.0
Pennsylvania	63.3	3769.6
Tennessee	65.9	5410.0
Texas	67.1	3522.5
Utah	66.7	4237.7
Virginia	61.0	3950.1
Washington	71.1	4326.6
Wisconsin	66.5	4345.3

Revit MEP Fundamentals - Plumbing

State	Score (%)	Time (secs)
USA all	69.9	3919.5
Arizona	68.0	3315.0
California	74.7	4693.4
Colorado	71.5	4234.5
Florida	73.7	4252.7
Georgia	73.0	4132.2
Illinois	67.9	3822.2
Louisiana	67.6	3987.5
Michigan	71.1	3619.9
North Carolina	65.7	4268.9
Oregon	62.2	4205.5
Pennsylvania	69.8	3769.6
Texas	72.0	4374.4
Utah	69.7	4167.8
Virginia	63.3	4123.3

Revit MEP Advanced

2015
Mechanical
Average Score: 56.0%
Average Time: 1 hr 3 mins

Plumbing
Average Score: 57.0%
Average Time: 1 hr 6 mins


Revit MEP is a Top 5 KS test topic, across our global customers. The impact of BIM on the AEC industry is significant and Revit is the dominant design tool, in terms of overall market share and breadth of supply chain resources.

R

KS New Release - Data Query Tool

The KS admin dashboard has a new element this month... a new query builder and reporting tool. The release is part one of three, for this tool.

When you log in to your dashboard as a KS admin, you will now see a new landing page, called 'HOME'.

The top half of the page displays 4 sections, which summarize some useful at-a-glance data, as follows:

Number of Invites sent in last 30 days
Number of Tests in last 30 days (Not Started, In Progress and Complete)
Top 8 Skills Gaps (based on results from last 6 months' results)
Results (last 5 completed tests)

At the bottom of the page, you will find the new query tool. This includes a range of 'pre-defined' queries, as follows:

50% or less test scores
70% or greater test scores
All invites from last 30 days
All results from last 30 days
Incomplete invites from last 30 days
All employee scores
All interviewee scores
All expired invites

You can edit pre-defined copies by first taking a copy, then editing the copy and saving with a different name.

Create new queries by clicking on the 'Create New Query' button.

Edit queries by clicking on the 'Edit Query' button.

Copy existing (or pre-defined) queries by clicking on the 'Copy Query' button.

Delete queries by clicking on the 'Delete Query' button.

Run queries across all linked accounts, or selected child accounts, by checking the relevant boxes in the 'Run Against Accounts' area:

When you create a new query, you will see this box appear:

There are 4 main sections which can be presented in your report: 

Users - this captures data about the user profile and account where the user record is stored

Background - this captures data about user demographics info

Invites - this captures data about invite (and related test) status

Results - this captures data about results (and related test) status

Click 'Display these columns' to expand the top section. Use the check boxes to build up the columns of your data query. The columns selected here will also be presented in your csv export. Click on the '+' icon, if you want to add this element to your filter options in the 'match ALL conditions' section below.  

In the query conditions section below, use the filter on the left of the screen to toggle between the following search topics: Users, Background, Invites, Results.

Queries can be a combination of 'ALL of these conditions' only, or 'ANY of these conditions' only, or both.

Use the dropdowns to build up the logic of your queries. There are lots of different options available, so you can filter your user, invites and results data in lots of new ways.

Export queries to csv for further analysis, by clicking on the 'Download' button.

This release is part one of three. Here's what we're working on next.

Part Two

Allow KS admins to perform a series of bulk actions, with the results of a query.  

For example:

Delete users

Move users from one account to another

Invite users to a test

Delete results

Move results from one account to another

Delete invites

Change invite expiry date

Re-send invites

We'll also add individual training tags to the search options, allowing you to create workshop groups for users who have common skills gaps.

Part Three

Graphics & charts: we plan to display a range of visual summary fields on the dashboard landing page.

For example:

No. of invites sent in last x days

No. of completed tests in last x days

No. of incomplete tests in last x days

Users who have 'incomplete tests' 

Most popular test topics by number taken

Average score and time for top 5 test topics

Average score for Employees vs Interviewees

Global benchmark comparison for top 5 test topics

Last x results: user names, test names, scores & times

Top 20 skills gaps (i.e. training tags)

Top 20 hardest test questions (i.e. lowest scoring average)

We will also include the ability to send auto-email reports to KS admins, which contain custom values and timescales.

As always, we welcome your feedback and ideas, so if you have any additional feature requests, in the context of searching, filtering, grouping and reporting data, we'd love to hear them!

R

Revit Structure Test Scores Around The World

Autodesk Revit is building information modeling software for architects, structural engineers, MEP engineers, designers and contractors. It allows users to design a building and structure and its components in 3D, annotate the model with 2D drafting elements, and access building information from the building model's database. Revit is 4D BIM capable with tools to plan and track various stages in the building's lifecycle, from concept to construction and later demolition.

Over the years, KnowledgeSmart has captured test scores for thousands of Revit Structure users, in multiple countries across the globe.

Here are the variances in our overall benchmark data, from 2012 to 2015:

2012
Average Score: 62.0%
Average Time: 1 hr 6 mins

2013
Average Score: 63.0%
Average Time: 1 hr 4 mins

2014
Average Score: 64.0%
Average Time: 1 hr 2 mins

2015
Average Score: 67.1%
Average Time: 1 hr 12 mins


Let's take a look at some overall aggregate score and time data on a country vs country basis. Numbers of test scores vary, so this list does not imply that one country is 'better' than another. It's interesting to see what kind of data is generated in different parts of the globe.

Revit Structure Fundamentals

Country	Score (%)	Time (secs)
Australia	68.7	4191.2
Canada	72.4	3886.3
Denmark	70.0	4375.0
Hong Kong	72.2	5414.2
India	62.4	4231.5
New Zealand	67.4	3891.7
Pakistan	64.4	3725.0
Philippines	67.5	3587.5
Poland	63.7	3537.5
Qatar	57.7	3521.5
Saudi Arabia	67.5	3927.5
Singapore	60.8	3775.6
South Africa	63.7	3582.5
UAE	63.0	5095.9
UK	71.1	4887.5
USA	73.7	4218.2

We also capture data on a per State basis, for our US customers. The list below represents those States where the volume of data makes for meaningful data sharing.

State	Score (%)	Time (secs)
USA all	73.7	4218.2
California	80.3	3531.0
Colorado	74.0	4210.0
Florida	78.3	4033.8
Georgia	69.8	4323.0
Illinois	80.5	5365.0
Missouri	81.7	4093.9
New York	73.0	5067.5
Oregon	75.4	5197.0
Tennessee	67.5	3327.5
Texas	68.3	3857.5
Virginia	63.5	3595.0

Revit Structure Advanced

2015
Average Score: 57.2%
Average Time: 1 hr 4 mins

Country	Score (%)	Time (secs)
Australia	61.5	4465.3
Canada	62.4	4665.6
Egypt	62.3	3563.3
Hong Kong	54.3	4433.6
India	51.4	3738.8
New Zealand	59.5	3700.9
Qatar	52.5	4800.8
South Africa	53.0	1950.0
UAE	54.8	4182.5
UK	63.7	3905.7
USA	64.6	4598.1

State	Score (%)	Time (secs)
USA all	64.6	4598.1
California	66.4	5435.0
Colorado	63.3	4365.7
Florida	63.0	4542.0
Georgia	66.0	4595.1
Illinois	63.4	4365.6
Pennsylvania	68.3	4623.4
Tennessee	63.6	4242.5
Texas	62.5	4607.5

Revit Structure is a Top 5 KS test topic, across our global customers. The impact of BIM on the AEC industry is significant and Revit is the dominant design tool, in terms of overall market share and breadth of supply chain resources.

R

Revit Architecture Test Scores Around The World

Autodesk Revit is building information modeling software for architects, structural engineers, MEP engineers, designers and contractors. It allows users to design a building and structure and its components in 3D, annotate the model with 2D drafting elements, and access building information from the building model's database. Revit is 4D BIM capable with tools to plan and track various stages in the building's lifecycle, from concept to construction and later demolition.

Over the years, KnowledgeSmart has captured test scores for thousands of Revit Architecture users, in multiple countries across the globe.

Here are the variances in our overall benchmark data, from 2010 to 2015:

2010
Average Score: 63.0%
Average Time: 1 hr 11 mins

2011
Average Score: 65.0%
Average Time: 1 hr 15 mins

2012
Average Score: 69.0%
Average Time: 1 hr 5 mins

2013
Average Score: 69%
Average Time: 1 hr 3 mins

2014
Average Score: 70.0%
Average Time: 1 hr 1 mins

2015
Average Score: 68.5%
Average Time: 1 hr 8 mins


Let's take a look at some overall aggregate score and time data on a country vs country basis. Numbers of test scores vary, so this list does not imply that one country is 'better' than another. It's interesting to see what kind of data is generated in different parts of the globe.

Revit Architecture Fundamentals

Country	Score (%)	Time (secs)
Australia	69.4	4736.5
Bahrain	73.2	4493.3
Canada	70.1	4341.4
China	63.5	6178.3
Egypt	68.1	4290.2
Hong Kong	73.5	5096.3
India	48.4	4555.6
Ireland	69.8	4053.8
Italy	73.0	4620.8
Kuwait	73.7	3951.8
New Zealand	74.2	4902.1
Nigeria	71.1	4778.6
Oman	49.3	3660.0
Pakistan	48.0	4459.0
Philippines	53.4	4238.6
Poland	74.0	4305.0
Portugal	67.6	5695.0
Qatar	69.0	4910.8
Saudi Arabia	70.7	4094.4
Singapore	74.5	4788.7
South Africa	66.8	4278.5
South Korea	64.0	4321.3
Spain	65.3	4454.6
Sweden	68.0	4615.0
UAE	66.4	5183.1
UK	73.6	4783.2
USA	72.4	4671.5
Vietnam	71.9	4513.5

We also capture data on a per State basis, for our US customers. The list below represents those States where the volume of data makes for meaningful data sharing.

State	Score (%)	Time (secs)
USA all	72.4	4671.5
Arizona	70.9	3581.7
Arkansas	66.0	3185.0
California	73.6	6101.1
Colorado	66.0	3333.8
District of Columbia	74.9	3995.6
Florida	67.2	4197.8
Georgia	70.3	6449.2
Hawaii	77.5	6622.5
Illinois	77.1	4888.4
Kansas	77.3	3731.7
Maryland	70.8	3986.0
Massachusetts	62.0	4268.3
Michigan	77.8	4113.8
Minnesota	76.2	4648.2
Mississippi	70.1	6366.9
Missouri	74.0	5197.3
New Jersey	76.0	3624.2
New York	75.1	5617.6
North Carolina	69.6	4462.7
Ohio	72.6	5928.0
Oregon	71.0	3861.7
Pennsylvania	75.9	3387.8
South Carolina	64.0	5235.8
Texas	74.3	5242.4
Utah	74.0	5515.1
Virginia	75.0	4322.5
Washington	68.0	4265.8

Revit Architecture Advanced

2015
Average Score: 57.1%
Average Time: 1 hr 24 mins

Country	Score (%)	Time (secs)
Argentina	57.2	5435.0
Australia	61.1	5256.2
Canada	62.3	5404.8
China	48.7	4998.0
Egypt	50.3	6677.5
Hong Kong	57.5	5700.8
India	49.0	4497.7
Ireland	52.2	3995.0
Italy	48.4	4587.0
New Zealand	64.5	4560.0
Nigeria	61.2	4222.5
Philippines	48.1	5904.3
Qatar	61.8	4562.5
Saudi Arabia	63.2	4332.5
Singapore	57.4	4862.6
South Africa	63.0	4034.3
Spain	62.5	5280.0
UAE	61.7	8002.5
UK	60.7	4860.0
USA	62.9	5706.2
Vietnam	58.6	6426.7

State	Score (%)	Time (secs)
USA all	62.9	5706.2
California	60.4	5739.9
District of Columbia	67.0	7167.5
Florida	59.5	6343.1
Georgia	68.3	7535.8
Michigan	61.5	5005.0
Minnesota	61.4	4824.0
New York	67.7	6050.0
North Carolina	56.3	5516.3
Oregon	62.6	5955.0
Pennsylvania	65.0	6665.0
Texas	56.1	6039.7
Virginia	66.8	4505.8
Washington	63.7	4433.3

Revit Architecture is the most popular KS test topic, across our global customers. The impact of BIM on the AEC industry is significant and Revit is the dominant design tool, in terms of overall market share and breadth of supply chain resources.

R

Bentley MicroStation Test Scores Around The World

MicroStation is a CAD software product for two and three dimensional design and drafting, developed and sold byBentley Systems.

Over the years, KnowledgeSmart has captured test scores for thousands of MicroStation users, in several countries worldwide.

Here is our overall benchmark data, from 2011 to 2015:

V8i

Average Score: 59.3%

Average Time: 1 hr 24 mins

Let's take a look at some overall aggregate score and time data on a country vs country basis. Numbers of test scores vary, so this list does not imply that one country is 'better' than another. It's interesting to see what kind of data is generated in different parts of the globe.

Country	Score (%)	Time (secs)
Australia	58.7	4873.3
Canada	57.7	5172.2
China	65.0	3965.7
India	54.7	4660.0
Ireland	57.0	6195.0
Oman	55.0	6620.4
Portugal	63.0	6680.6
S. Africa	62.4	6801.3
Spain	61.2	4420.0
UAE	58.2	4145.2
UK	61.3	4859.4
USA	59.2	5373.6

We also capture data on a per State basis, for our US customers. The list below represents those States where the volume of data makes for meaningful data sharing.

State	Score (%)	Time (secs)
USA (all)	59.2	5373.6
California	59.8	5567.5
Florida	64.7	4400.8
Indiana	55.1	4060.3
Kansas	58.8	4600.4
New York	66.2	4225.2
North Carolina	53.7	5710.1
Texas	61.4	6025.0

As with AutoCAD, even though the software has been commercially available for many years, there are still notable skills gaps across the overall user base. Our data shows that MicroStation users reach a performance 'plateau' after about 5 years and then remain at a similar skill level in subsequent years. 

MicroStation has traditionally maintained a strong base in Rail and Infrastructure projects, with a large legacy .dgn file format history in this sector.

R