How do your users' Revit skills measure up?

Image Screenshot Source: http://blogs.autodesk.com/revit/

I came across a great article this morning written by Jeff Hanson called Five must-know Revit skills for beginners. Autodesk's content experience team has developed some valuable video content on the five must-know Revit skills for beginners.

The article identifies these skills as:

• Trim and Extend Elements
• About the Crop Region
• Best Practices: Printing
• About Curtain Wall Panels (Add a Door to a Curtain Wall)
• Workflow: Select Fields for a Schedule

You can find the videos here.

 This brings me to a couple of salient questions:

• How does your users' measure up in terms of these skills?
• Should they be spending valuable company time watching these videos at all?
• Are there more relevant videos based on their skill gaps?
• What percentage of people on your team do need more training on these topics?
• What is the percentage skill gap amongst your users?

The only way to accurately and objectively answer the above questions is through a skills assessment process. Each user starts their Revit journey with a unique set of skills and knowledge, and a one-size-fits-all training policy is hardly ever appropriate.

Skills assessment and training go hand-in-hand - always!

So could skills testing help a company align the right training? Absolutely! KnowledgeSmart customers strategically use skill-based testing to identify learning needs, highlight areas of strength and expose areas of growth both before and after employment.

 So how did I create the visual above?

I analysed some of the KnowledgeSmart demo data based on question performance. I isolated all questions with training tags linked to the 5 skill areas the Autodesk article identifies and then sorted them in order of priority in Microsoft PowerBI. Based on my industry experience and the fact that these five skills were compiled from Autodesk customer data I agreed with Autodesk's findings that these Revit skills were important for users. Looking at my results data, it would appear that worksharing, view properties, detailing and worksets were priority areas for my group.

Next I can start thinking about slicing this data based on office location or perhaps based on some of the other valuable background data that KnowledgeSmart offers. But I will save that for another day.

Focus your time and efforts and assign training where it is needed most. Increase productivity and reduce project risk.

Assessment Suite - BIM Level 2 Capability

Introduction

Do you manage BIM projects? Do you have responsibility for implementing BIM in your business? Can you generate a detailed report for your management team of your current organisational BIM strengths and weaknesses? How does your firm compare to your peers in the wider AEC Industry?
To comply with PAS91, how do you assess BIM training and skills? How do you demonstrate on your PQQ that you have all the necessary metrics in place?

This comprehensive library of skills assessments will empower your organisation to capture helpful, relevant and accurate metrics, to better demonstrate individual and organisational BIM capability. The results data and gap analysis will also inform your training and hiring plans, so you can continuously improve your performance in this business-critical area.


BIM Management and Process

BIM01_UK BIM Level 2 Awareness
The foundation-level knowledge required by everyone involved with BIM in your organisation.
Understand the implications and value proposition of BIM. Understand the implications and value proposition of BIM within your organisation.
Modules include: What is BIM?, BS1192, PAS1192-2, PAS1192-3, PAS1192-2-EIR, CIC BIM Protocol, RIBA-Plan of Works.

BIM02_UK BIM Level 2 Management Fundamentals
Understand the implications and value proposition of BIM within your organisation.
Understand the requirement for the management and exchange of information between supply chain members and clients as described in the 1192 suite of standards and PAS55 / ISO 55000.
Modules include: Project Start-up Requirements, PAS1192-2-BEP, BS1192-CDE, BS1192-Container Naming, PAS1192-Roles, BS1192-4, PAS1192-5, Government Soft Landings.

BIM03_UK BIM Level 2 Learning Outcomes Framework
Understand the requirement for the management and exchange of information between supply chain members and clients as described in the 1192 suite of standards and PAS55 / ISO 55000.
Understand what BIM is, the contextual requirement for BIM Level 2 and its connection to the Government Construction Strategy and Industrial Strategy 2025.
Topics include: UK Govt BIM L2 LOF Part 1, UK Govt BIM L2 LOF Part 2, UK Govt BIM L2 LOF Part 3.

BIM04_Practical BIM Fundamentals
This assessment looks at knowledge of a range of general BIM management tasks, including; General BIM Principles, Implementation, Modelling, Information Exchange and Project Coordination.

BIM05A_BIM Authoring with AECOsim (Fundamentals)
This assessment for Information Originators looks at basic concepts of BIM authoring and knowledge of the DPSM (Digital Production Standards Manual), for firms using Bentley AECOsim. Topics include: Purpose, Documents, Coordinates, Parameters, Validation, Model Types, File Naming, Layer Naming and Drawing Coordination.

BIM05R_BIM Authoring with Revit (Fundamentals)
This assessment for Information Originators looks at basic concepts of BIM authoring and knowledge of the DPSM (Digital Production Standards Manual), for firms using Autodesk Revit. Topics include: Purpose, Documents, Coordinates, Parameters, Validation, Model Types, File Naming, Layer Naming and Drawing Coordination.

BIM06A_BIM Authoring with AECOsim (Advanced)
This assessment for Information Originators looks at more advanced concepts of BIM authoring and knowledge of the DPSM (Digital Production Standards Manual), for firms using Bentley AECOsim. Topics include: Project Setup, Compound Cells, Project Items, IFC Import, IFC Export, IFC Modelling, IFC Validation.

BIM06R_BIM Authoring with Revit (Advanced)
This assessment for Information Originators looks at more advanced concepts of BIM authoring and knowledge of the DPSM (Digital Production Standards Manual), for firms using Autodesk Revit. Topics include: Project Setup, System Family, IFC Import, IFC Export, IFC Modelling, IFC Validation.

BIM07A_BIM Software Management (AECOsim)
This assessment for Task Information Management (Reviewers) looks at basic concepts of BIM Software Management, for firms using Bentley AECOsim. Topics include: Uniclass1.4 / Uniclass 2015, Information Validation, Project Review.
 
BIM07R_BIM Software Management (Revit)
This assessment for Task Information Management (Reviewers) looks at basic concepts of BIM Software Management, for firms using Autodesk Revit. Topics include: Uniclass1.4 / Uniclass 2015, Information Validation, Project Review.

BIM08R_BIM Coordination (Revit)
This assessment for BIM Coordinators looks at basic concepts of BIM Software Coordination, for firms using Autodesk Revit. Topics include: Revit Configuration, Project Resources, Parameters, View Templates, Family Editor.

Project Process (Revit)
This assessment for BIM Coordinators and Managers looks at the impact of using Autodesk Revit in a Project environment. Topics include: Views, Families, Worksharing and Schedules. Sample data sets for the task based questions are based on Revit Architecture.


BIM Software 

AutoCAD Civil 3D Fundamentals
This online skills assessment covers a selection of core AutoCAD Civil 3D skills. The content is split into 4 parts, as follows:
Part 1: Surfaces, Alignments and Profiles
Part 2: Corridors, Sections and Parcels
Part 3: Pipe Networks, Grading and Finalizing a Project
Part 4: User Interface, Civil 3D Environment and Survey Tools

AutoCAD Civil 3D – Xpress
A short skills assessment for AutoCAD Civil 3D, designed for interviews. This assessment comprises questions covering a range of basic AutoCAD Civil 3D skills.

AutoCAD Civil 3D Road Design (Advanced)
Web based skills test for more experienced users of AutoCAD Civil 3D, with a particular focus on Roadway Design.

InfraWorks 360
Detailed skills assessment and training needs analysis for InfraWorks 360.
This assessment comprises questions covering a range of basic InfraWorks 360 skills, relating to Importing, Data, Options, Styles, Exploring models, Menus, Themes, Objects and Measuring.

Revit Architecture Fundamentals
This test comprises questions covering a range of basic Revit Architecture skills, including: Basic Element Creation; Views & Sheets; Detailing; Keynotes & Annotation; Worksharing; Dimensions & Rules; Interoperability; Families & Parts; Scheduling; Coordinates & Orientation; Output.

Revit Architecture Xpress
A short skills assessment for Revit Architecture, designed for interviews. This assessment comprises questions covering a range of basic Revit Architecture skills. Modules covered include; Basic Element Creation; Views & Sheets; Detailing; Keynoting & Annotation; Worksharing; Dimensions & Rules; Interoperability; Families & Parts; Scheduling; Coordinates & Orientation; Output.

Revit Architecture Occasional
Skills assessment and training needs analysis for casual/novice users of Revit Architecture. This test comprises questions covering a range of basic Revit skills. Modules covered include; Navigation, Views & Sheets, Measuring, Exporting Data, Families, Element Selection.

Revit Architecture Advanced
Detailed skills assessment and training needs analysis for Revit Architecture. This test comprises questions covering a range of advanced Revit skills.

Revit Content Creation
This assessment looks at Content Creation and Families in Revit. Sample data sets for the task based questions are based on Revit Architecture.

Revit Architecture for Interiors
A short skills assessment for Revit Architecture, as it is applied to the Interiors discipline. This assessment comprises questions covering a range of basic Revit skills.

Revit MEP Fundamentals (Mechanical)
Detailed skills assessment and training needs analysis for Revit MEP, as it is applied to the Mechanical discipline.

Revit MEP Fundamentals (Electrical)
Skills gap assessment and staff training needs analysis for Revit MEP, as it is applied to the Electrical discipline.

Revit MEP Fundamentals (Plumbing)
Online skills assessments and gap analysis tests for Revit MEP, as it applies to the Plumbing discipline.

Revit MEP Xpress
A short skills assessment for Revit MEP, designed for interviews. This assessment comprises questions covering a range of basic Revit MEP skills, across all disciplines.

Revit MEP Advanced
These assessments comprise questions covering a range of advanced Revit MEP (Mechanical and Plumbing) skills.

Revit Structure Fundamentals
Detailed skills assessment and skills gap analysis for Revit Structure, covering a variety of core skills, including: The Project Environment; Creating the Model; Editing the Model; Detailing the Model; Documenting the Model.

Revit Structure Xpress
A short skills assessment for Revit Structure, designed for interviews. This assessment comprises questions covering a range of basic Revit Structure skills. Modules covered include; The Project Environment; Creating the Model; Editing the Model; Detailing the Model; Documenting the Model.

Revit Structure Advanced
Skills gap assessment and staff training needs analysis for more experienced users of Revit Structure.

BIM 360 Glue fundamentals
Skills assessment and training needs analysis for BIM 360 Glue. This test comprises questions covering a range of basic BIM 360 Glue skills, including: Objects, Clashes, Administration, Model Management and General Operation.

Navisworks Manage fundamentals
This test comprises questions covering a range of basic Navisworks skills, including: Quantification, Rendering, TimeLiner, Appearance Profiler, Clash Detective, User Interface, File Formats, Measuring and Operations.

Vault fundamentals
This test comprises questions covering a range of basic Vault skills, including: File Details, Version History, File Check Out, File Relationships, Searching, Saving, Working Folders, Opening Files.

Solibri fundamentals
This test comprises questions covering a range of basic Solibri Model Checker skills, including: User Interface, Model Review & Annotation, Data Interrogation, Model Checking, Model Comparison.

Bentley AECOsim Building Designer fundamentals (Architectural)
This test comprises questions covering a range of basic AECOsim Building Designer skills, including: Families and Parts, Element Creation, Element Modification, DataGroups, Annotation, Drawings, Data Exchange, Setting Out, Scheduling (Output), Spaces.

Bentley AECOsim Building Designer fundamentals (Structural)
This test comprises questions covering a range of basic AECOsim Building Designer skills, including: Families & Parts, Setting Out, Data Exchange, DataGroups, Element Creation, Element Modify, Annotation, Drawings & Views, Scheduling.

Graphisoft ArchiCAD fundamentals (Parts 1-4)
This test comprises questions covering a range of ArchiCAD skills, including: User Interface, Navigation & Workflow, General Drafting, General Modelling, Model Management, Printing & Plotting.


Capture helpful, relevant and accurate metrics to demonstrate individual and organisational BIM capability. Use results and gap analysis data to inform training and hiring plans, with the aim of continuously improving performance in this business-critical area.

If you would like to find out more about our suite of BIM assessments, please get in touch.

"This suite of educational resources and assessment material from KnowledgeSmart is World Class and an essential resource for any AEC business that is serious about upskilling their team's BIM knowledge and practical capability. Most firms claim to have the ability to deliver projects to BIM Level 2, but how many really know where their strengths and weaknesses lie? Now, there can be no excuses. Capturing performance metrics and measuring staff capability should be a mandatory part of every BIM deliverable."

Global BIM Lead, Top 20 UK Multidisciplinary Firm

R

'BIG 5' Benchmark Stats

If your firm increases productivity by 1% per person annually, you gain 2 extra working days per team member.

How do you measure your firm's productivity against your peers and the wider AEC industry?

KnowledgeSmart has been capturing test scores across a wide range of technical software products, used by Architects & Engineers around the world.

We have data-mined thousands of results for the 'BIG 5' Autodesk software titles, as follows:

Revit Architecture
Revit MEP
Revit Structure
AutoCAD
AutoCAD Civil 3D

The results form a fascinating insight into the way these tools are deployed and utilised in different territories around the world. This is the most detailed study of software proficiency ever carried out with live test data, across thousands of users and hundreds of AEC businesses.

A detailed PDF report can be downloaded for each topic from this microsite.

Now, for the first time, management teams can compare their in-house performance and technical software capability against the wider Global industry benchmark.

This data can be included in the hiring process, new team selection, annual appraisals and when bidding for new project work.

R

KS exhibiting at Autodesk University

A key theme for us this year is that of measuring technical software skills and performance, against a wider body of results data. We are featuring our analysis of the 'BIG 5' Autodesk skills assessments at this year's Autodesk University conference, which takes place from 15-17 November, in Las Vegas, USA.  Here is the conference link: http://au.autodesk.com.

The BIG 5 tests are:
Revit Architecture, Revit Structure, Revit MEP, AutoCAD and AutoCAD Civil 3D.

KnowledgeSmart will be exhibiting in the main hall, at booth number 2810.

We look forward to seeing you there!

R

KS Dev Update - Exam Mode

The impact of BIM on the global AEC industry has created a need for firms to be able to demonstrate evidence of their actual ability (and capability) to perform and deliver on client projects. This includes individual and team technical skills, as well as business process and standards methodology.

Skills assessments are a key part of the mix and KnowledgeSmart has been working in this space for over 10 years, enabling firms to capture real evidence and benchmark data to include in training plans, hiring programmes and project bid documentation.

More recently, however, we have seen a significant rise in demand for a more formal output at the end of a test session, than the current gap analysis report which highlights where individual improvements can be made to help improve productivity.

So, we have created a new work flow, called 'Exam Mode', which enables AEC firms, educators and industry member organisations to deploy a more formal certification exam type experience, with a final result output along the lines of traditional exam models.

To clarify; this is not designed to replace formal large software vendor exams, for example commercially available Autodesk, Adobe, Cisco or Microsoft qualifications.

But we are well placed to offer firms and member organisations the opportunity to create custom exams, with their own result bandings and levels of achievement, enabling them to demonstrate capability (and excellence) across their teams.

Here is a preview of the new functionality:

The main KS login page will have a new button, called 'Exam':

This tool can be used by KS admins and sub admins, to log in to a new exam session.

Users enter their details at the candidate info screen.

When the candidate is ready to begin, they click 'Start' to open their exam session. All sessions are timed.

There are 9 different types of questions to choose from and the candidate works through the questions which display on the Exam UI.

When all the questions have been answered, the candidate clicks 'Finish' and their final grade displays.

From an authoring perspective, KS exams are broadly similar to the existing KS assessments, with a few key differences.

You can now select 'Exam mode' when editing or creating a KS assessment. The default result bandings are: Fail (0-40%), Pass (41-60%), Merit (61-80%) and Distinction (81-100%).

Result bandings can be edited, if you wish to select a different score range and/or different labels for the various exam outcomes. An error will display, if the banding values are not concurrent, or if they exceed 100%. Click 'Finish' to save your changes.

When exam mode is enabled, the user data capture pages at the start and end of a session are disabled. The 'Request training' button is also disabled on the exam UI.

You will notice some new choices on the Settings > Branding page.

It is possible to add a corporate/organisation logo to the top of the exam UI and at the top of the exam certificate. (On a related note, we have also included in this release the ability to add branding to user pages and user test certificates).

As with KS test reports, administrators can control when candidates are presented with their exam certificate, via the Settings > Feedback page.  If 'No exam certificate' is selected, users will see a message at the end, as per the current 'No Report' option.

If a result is emailed to a candidate, it will send a plain text email, with a link to their exam certificate.

KS admins can easily distinguish KS exam results from test results on the Results > Data page, by looking for the orange 'Rosette' icon, next to the score.

KS admins will still be able to see a link to the old style test report, which shows the question mix and answer feedback, but this view will not available to users. Clicking on the Rosette will display the exam certificate.

There is a new search filter on the Library > Draft Content > Draft Tests page, which allows admins to search for assessments and exams.

Users will see a new section on their personal dashboard page, called 'My Exams'.

This displays a new area, with a history of exam results and links to exam certificates.

The new functionality is scheduled to go live in the autumn. In addition to traditional skills testing and survey capability, the new KS exam mode offers customers, educators and industry member organisations a stable, customizable, web based platform, capable of capturing and presenting a wide range of formal exam and certification-style results.

R

How Good Are Engineers at Using Revit Structure?

With the global adoption of Building Information Modelling (BIM) well underway, it is a huge challenge for Engineering businesses to manage the change in their project delivery processes from more conventional drawing production environments, to that of virtual design, clash detection and 'intelligent' modelling.

Looking at the global AEC picture, it is clear that the commercial software application adopted by a wide majority of the world's Structural Engineering firms, as their modelling tool of choice, is Autodesk's Revit Structure platform.

In recent years, KnowledgeSmart's online skills assessment software platform has captured test scores from thousands of Engineers, representing hundreds of firms, spread across six continents and a couple of dozen countries.

We have analysed the results data generated from these live assessments, at a basic skills level, and noted the following trends. For this particular study, the majority of our data is generated in the USA, UK, Canada and Australia (in that order).

A simple key to interpret the data below:

Str Eng = Job Title

RST = Revit Structure

1 to 5 = 1 to 5 years' experience using the tool

6 to 10 = 6 to 10 years' experience using the tool

Regular = use the tool daily (or almost daily)

Occasional = use the tool weekly (or less than weekly)

Self taught = learned to use the tool primarily 'on the job'

Formal = learned to the tool primarily via formal classroom or online training

All = overall KS benchmark data

AUS = Australia

CAN = Canada

UK = UK

USA = USA

Here is a summary of the results presented by different types of Engineers.

Overall

RST Fundamentals score overall: 67.1% in 4320 s

Str Eng/RST/1 to 5/regular/self taught/All = 59.3% in 4854 s

Str Eng/RST/1 to 5/regular/formal/All = 58.2% in 4738 s

Str Eng/RST/6 to 10/regular/self taught/All = 68.3% in 4141 s

Str Eng/RST/6 to 10/regular/formal/All = 67.4% in 4372 s

Str Eng/RST/1 to 5/occasional/self taught/All = 55.2% in 5353 s

Str Eng/RST/1 to 5/occasional/formal/All = 54.5% in 5244 s

Str Eng/RST/6 to 10/occasional/self taught/All = 63.3% in 4967 s

Str Eng/RST/6 to 10/occasional/formal/All = 62.5% in 4777 s

Australia

RST Fundamentals score Australia: 68.7% in 4191 s

Str Eng/RST/1 to 5/regular/self taught/US = 59.4% in 4786 s

Str Eng/RST/1 to 5/regular/formal/US = 58.0% in 4553 s

Str Eng/RST/6 to 10/regular/self taught/US = 68.6% in 4003 s

Str Eng/RST/6 to 10/regular/formal/US = 67.2% in 3967 s

 

Str Eng/RST/1 to 5/occasional/self taught/US = 53.4% in 4822 s

Str Eng/RST/1 to 5/occasional/formal/US = 52.0% in 4687 s

Str Eng/RST/6 to 10/occasional/self taught/US = 59.6% in 4566 s

Str Eng/RST/6 to 10/occasional/formal/US = 58.7 in 4330 s

Canada

RST Fundamentals score Canada: 72.4% in 3886 s

Str Eng/RST/1 to 5/regular/self taught/US = 63.4% in 4378 s

Str Eng/RST/1 to 5/regular/formal/US = 61.6% in 4233 s

Str Eng/RST/6 to 10/regular/self taught/US = 72.6% in 3717 s

Str Eng/RST/6 to 10/regular/formal/US = 71.4% in 3578 s

 

Str Eng/RST/1 to 5/occasional/self taught/US = 58.1% in 4516 s

Str Eng/RST/1 to 5/occasional/formal/US = 56.7% in 4439 s

Str Eng/RST/6 to 10/occasional/self taught/US = 63.6% in 4248 s

Str Eng/RST/6 to 10/occasional/formal/US = 62.5% in 4036 s

UK

RST Fundamentals score UK: 71.1% in 4887 s

Str Eng/RST/1 to 5/regular/self taught/US = 62.2% in 5343 s

Str Eng/RST/1 to 5/regular/formal/US = 60.6% in 5154 s

Str Eng/RST/6 to 10/regular/self taught/US = 71.3% in 4673 s

Str Eng/RST/6 to 10/regular/formal/US = 70.1% in 4491 s

 

Str Eng/RST/1 to 5/occasional/self taught/US = 58.4% in 5616 s

Str Eng/RST/1 to 5/occasional/formal/US = 56.9% in 5552 s

Str Eng/RST/6 to 10/occasional/self taught/US = 62.6% in 5254 s

Str Eng/RST/6 to 10/occasional/formal/US = 61.7% in 4987 s

USA

RST Fundamentals score USA: 73.7% in 4218 s

Str Eng/RST/1 to 5/regular/self taught/US = 64.6% in 4843 s

Str Eng/RST/1 to 5/regular/formal/US = 62.9% in 4661 s

Str Eng/RST/6 to 10/regular/self taught/US = 73.8% in 4073 s

Str Eng/RST/6 to 10/regular/formal/US = 72.1% in 3891 s

 

Str Eng/RST/1 to 5/occasional/self taught/US = 59.3% in 4916 s

Str Eng/RST/1 to 5/occasional/formal/US = 57.9% in 4856 s

Str Eng/RST/6 to 10/occasional/self taught/US = 64.8% in 4668 s

Str Eng/RST/6 to 10/occasional/formal/US = 63.7% in 4448 s

Observations

All four territories in this study are mature markets, in terms of Revit adoption. 

Each country has an established Autodesk Training Centre market, offering high quality learning and development opportunities and consultancy. 

Each country has a pool of further education colleges, community colleges and universities, many of whom teach technical software skills as part of courses in the built environment. 

Each country is well supported by professional bodies and information-rich conference series', such as BIM Forum, RTC, AU, BIM Day Out and BIM Show Live.

Overall, regular users are more accurate and faster than part-time users.

Engineers with 6 to 10 years' of experience with these tools are the most efficient. They reach a plateau in performance after c. 7 years and make no further productivity gains.

Engineers who learn to apply these tools on projects are more accurate than those who have primarily formal training, but less practical experience. Formally trained users are faster overall than self-taught users.

R

How Good Are Engineers at Using Revit MEP?

With the global adoption of Building Information Modelling (BIM) well underway, it is a huge challenge for Engineering businesses to manage the change in their project delivery processes from more conventional drawing production environments, to that of virtual design, clash detection and 'intelligent' modelling.

Looking at the global AEC picture, it is clear that the commercial software application adopted by a wide majority of the world's MEP Engineering firms, as their modelling tool of choice, is Autodesk's Revit MEP platform.

In recent years, KnowledgeSmart's online skills assessment software platform has captured test scores from thousands of Engineers, representing hundreds of firms, spread across six continents and a couple of dozen countries.

We have analysed the results data generated from these live assessments, at a basic skills level, and noted the following trends. For this particular study, the majority of our data is generated in the USA, UK, Canada and Australia (in that order).

A simple key to interpret the data below:

MEP Eng = Job Title

RMEP = Revit MEP

1 to 5 = 1 to 5 years' experience using the tool

6 to 10 = 6 to 10 years' experience using the tool

Regular = use the tool daily (or almost daily)

Occasional = use the tool weekly (or less than weekly)

Self taught = learned to use the tool primarily 'on the job'

Formal = learned to the tool primarily via formal classroom or online training

All = overall KS benchmark data

AUS = Australia

CAN = Canada

UK = UK

USA = USA

Here is a summary of the results presented by different types of Engineers.

Overall

RMEP Fundamentals score overall: 66.3% in 4084 s

MEP Eng/RMEP/1 to 5/regular/self taught/All = 58.6% in 4771 s

MEP Eng/RMEP/1 to 5/regular/formal/All = 57.7% in 4626 s

MEP Eng/RMEP/6 to 10/regular/self taught/All = 67.1% in 4188 s

MEP Eng/RMEP/6 to 10/regular/formal/All = 66.4% in 4111 s

MEP Eng/RMEP/1 to 5/occasional/self taught/All = 53.3% in 5146 s

MEP Eng/RMEP/1 to 5/occasional/formal/All = 52.8% in 5025 s

MEP Eng/RMEP/6 to 10/occasional/self taught/All = 61.3% in 4644 s

MEP Eng/RMEP/6 to 10/occasional/formal/All = 60.4% in 4561 s

Australia

RMEP Fundamentals score Australia: 66.7% in 4079 s

MEP Eng/RMEP/1 to 5/regular/self taught/AUS = 57.8% in 4971 s

MEP Eng/RMEP/1 to 5/regular/formal/AUS = 57.0% in 4786 s

MEP Eng/RMEP/6 to 10/regular/self taught/AUS = 66.8% in 4006 s

MEP Eng/RMEP/6 to 10/regular/formal/AUS = 65.9% in 3768 s

MEP Eng/RMEP/1 to 5/occasional/self taught/AUS = 53.7% in 5116 s

MEP Eng/RMEP/1 to 5/occasional/formal/AUS = 52.6% in 4910 s

MEP Eng/RMEP/6 to 10/occasional/self taught/AUS = 59.8% in 4557 s

MEP Eng/RMEP/6 to 10/occasional/formal/AUS = 58.7% in 4388 s

Canada

RMEP Fundamentals score Canada: 68.1% in 4391 s

MEP Eng/RMEP/1 to 5/regular/self taught/CAN = 60.5% in 4835 s

MEP Eng/RMEP/1 to 5/regular/formal/CAN = 58.8% in 4754 s

MEP Eng/RMEP/6 to 10/regular/self taught/CAN = 68.6% in 4272 s

MEP Eng/RMEP/6 to 10/regular/formal/CAN = 67.3% in 4113 s

MEP Eng/RMEP/1 to 5/occasional/self taught/CAN = 55.3% in 5002 s

MEP Eng/RMEP/1 to 5/occasional/formal/CAN = 54.2% in 4849 s

MEP Eng/RMEP/6 to 10/occasional/self taught/CAN = 62.2% in 4458 s

MEP Eng/RMEP/6 to 10/occasional/formal/CAN = 61.4% in 4367 s

UK

RMEP Fundamentals score UK: 69.4% in 3705 s

MEP Eng/RMEP/1 to 5/regular/self taught/UK = 61.2% in 4216 s

MEP Eng/RMEP/1 to 5/regular/formal/UK = 60.6% in 4011 s

MEP Eng/RMEP/6 to 10/regular/self taught/UK = 69.5% in 3665 s

MEP Eng/RMEP/6 to 10/regular/formal/UK = 68.5% in 3487 s

MEP Eng/RMEP/1 to 5/occasional/self taught/UK = 56.2% in 4558 s

MEP Eng/RMEP/1 to 5/occasional/formal/UK = 54.3% in 4543 s

MEP Eng/RMEP/6 to 10/occasional/self taught/UK = 62.4% in 4313 s

MEP Eng/RMEP/6 to 10/occasional/formal/UK = 61.6% in 4282 s

USA

RMEP Fundamentals score USA: 67.3% in 4046 s

MEP Eng/RMEP/1 to 5/regular/self taught/US = 59.6% in 4632 s

MEP Eng/RMEP/1 to 5/regular/formal/US = 57.8% in 4411 s

MEP Eng/RMEP/6 to 10/regular/self taught/US = 67.6% in 3933 s

MEP Eng/RMEP/6 to 10/regular/formal/US = 66.7% in 3731 s

MEP Eng/RMEP/1 to 5/occasional/self taught/US = 55.1% in 4806 s

MEP Eng/RMEP/1 to 5/occasional/formal/US = 53.2% in 4723 s

MEP Eng/RMEP/6 to 10/occasional/self taught/US = 60.8% in 4543 s

MEP Eng/RMEP/6 to 10/occasional/formal/US = 59.7% in 4368 s

Observations

All four territories in this study are mature markets, in terms of Revit adoption. 

Each country has an established Autodesk Training Centre market, offering high quality learning and development opportunities and consultancy. 

Each country has a pool of further education colleges, community colleges and universities, many of whom teach technical software skills as part of courses in the built environment. 

Each country is well supported by professional bodies and information-rich conference series', such as BIM Forum, RTC, AU, BIM Day Out and BIM Show Live.

Overall, regular users are more accurate and faster than part-time users.

Engineers with 6 to 10 years' of experience with these tools are the most efficient. They reach a plateau in performance after c. 7 years and make no further productivity gains.

Engineers who learn to apply these tools on projects are more accurate than those who have primarily formal training, but less practical experience. Formally trained users are faster overall than self-taught users.

R

How Good Are Architects at Using Revit Architecture?

With the global adoption of Building Information Modelling (BIM) well underway, it is a huge challenge for Architectural design businesses to manage the change in their project delivery processes from more conventional draughting and sketching production environments, to that of virtual design and 'intelligent' modelling.

Looking at the global AEC picture, it is clear that the commercial software application adopted by over half of the world's design firms, as their modelling tool of choice, is Autodesk's Revit Architecture platform.

In recent years, KnowledgeSmart's online skills assessment software platform has captured test scores from thousands of Architects, representing hundreds of design firms, spread across six continents and a couple of dozen countries.

We have analysed the results data generated from these live assessments, at a basic skills level, and noted the following trends. For this particular study, the majority of our data is generated in the USA, UK, Australia and Canada (in that order).

A simple key to interpret the data below:

Architect = Job Title
RAC = Revit Architecture
1 to 5 = 1 to 5 years' experience using the tool
6 to 10 = 6 to 10 years' experience using the tool
11 to 15 = 11 to 15 years' experience using the tool
Regular = use the tool daily (or almost daily)
Occasional = use the tool weekly (or less than weekly)
Self taught = learned to use the tool primarily 'on the job'
Formal = learned to the tool primarily via formal classroom or online training
All = overall KS benchmark data
AUS = Australia
CAN = Canada
UK = UK
USA = USA


Here is a summary of the results presented by different types of Architects.

Overall

RAC Fundamentals score overall: 68.8% in 4764 secs

Architect/RAC/1 to 5/regular/self taught/All = 63.3% in 5121 secs

Architect/RAC/1 to 5/regular/formal/All = 62.8% in 4976 secs

Architect/RAC/6 to 10/regular/self taught/All = 69.4% in 4588 secs

Architect/RAC/6 to 10/regular/formal/All = 68.7% in 4461 secs

Architect/RAC/11 to 15/regular/self taught/All = 69.7% in 4701 secs

Architect/RAC/11 to 15/regular/formal/All = 68.4% in 4529 secs

Architect/RAC/1 to 5/occasional/self taught/All = 58.4% in 5446 secs

Architect/RAC/1 to 5/occasional/formal/All = 57.8% in 5228 secs

Architect/RAC/6 to 10/occasional/self taught/All = 66.7% in 4843 secs

Architect/RAC/6 to 10/occasional/formal/All = 65.9% in 4677 secs

Architect/RAC/11 to 15/occasional/self taught/All = 67.4% in 4802 secs

Architect/RAC/11 to 15/occasional/formal/All = 66.5% in 4646 secs

Australia

RAC Fundamentals score Australia: 69.4% in 4737 secs

Architect/RAC/1 to 5/regular/self taught/AUS = 63.8% in 5181 secs

Architect/RAC/1 to 5/regular/formal/AUS = 62.3% in 4986 secs

Architect/RAC/6 to 10/regular/self taught/AUS = 69.8% in 4836 secs

Architect/RAC/6 to 10/regular/formal/AUS = 69.1% in 4768 secs

Architect/RAC/11 to 15/regular/self taught/AUS = 69.4% in 4787 secs

Architect/RAC/11 to 15/regular/formal/AUS = 68.8% in 4679 secs

Architect/RAC/1 to 5/occasional/self taught/AUS = 57.4% in 5336 secs

Architect/RAC/1 to 5/occasional/formal/AUS = 56.5% in 5210 secs

Architect/RAC/6 to 10/occasional/self taught/AUS = 65.8% in 4757 secs

Architect/RAC/6 to 10/occasional/formal/AUS = 65.2% in 4588 secs

Architect/RAC/11 to 15/occasional/self taught/AUS = 66.4% in 4818 secs

Architect/RAC/11 to 15/occasional/formal/AUS = 66.2% in 4701 secs

Canada

RAC Fundamentals score Canada: 70.1% in 4341 secs

Architect/RAC/1 to 5/regular/self taught/CAN = 64.1% in 5227 secs

Architect/RAC/1 to 5/regular/formal/CAN = 63.6% in 5026 secs

Architect/RAC/6 to 10/regular/self taught/CAN = 70.6% in 4532 secs

Architect/RAC/6 to 10/regular/formal/CAN = 70.3% in 4311 secs

Architect/RAC/11 to 15/regular/self taught/CAN = 70.8% in 4488 secs

Architect/RAC/11 to 15/regular/formal/CAN = 70.4% in 4501 secs

Architect/RAC/1 to 5/occasional/self taught/CAN = 58.3% in 5411 secs

Architect/RAC/1 to 5/occasional/formal/CAN = 57.2% in 5317 secs

Architect/RAC/6 to 10/occasional/self taught/CAN = 65.7% in 4858 secs

Architect/RAC/6 to 10/occasional/formal/CAN = 64.8% in 4767 secs

Architect/RAC/11 to 15/occasional/self taught/CAN = 66.1% in 4777 secs

Architect/RAC/11 to 15/occasional/formal/CAN = 65.8% in 4689 secs

UK

RAC Fundamentals score UK: 73.6% in 4783 secs

Architect/RAC/1 to 5/regular/self taught/UK = 65.2% in 5075 secs

Architect/RAC/1 to 5/regular/formal/UK = 64.5% in 5033 secs

Architect/RAC/6 to 10/regular/self taught/UK = 73.1% in 4767 secs

Architect/RAC/6 to 10/regular/formal/UK = 72.4% in 4554 secs

Architect/RAC/11 to 15/regular/self taught/UK = 73.5% in 4748 secs

Architect/RAC/11 to 15/regular/formal/UK = 72.6% in 4579 secs

Architect/RAC/1 to 5/occasional/self taught/UK = 60.3% in 5186 secs

Architect/RAC/1 to 5/occasional/formal/UK = 59.3% in 5032 secs

Architect/RAC/6 to 10/occasional/self taught/UK = 67.4% in 4711 secs

Architect/RAC/6 to 10/occasional/formal/UK = 66.9% in 4665 secs

Architect/RAC/11 to 15/occasional/self taught/UK = 67.4% in 4788 secs

Architect/RAC/11 to 15/occasional/formal/UK = 67.1% in 4667 secs

USA

RAC Fundamentals score USA: 72.4% in 4672 secs

Architect/RAC/1 to 5/regular/self taught/US = 64.7% in 5039 secs

Architect/RAC/1 to 5/regular/formal/US = 63.8% in 4911 secs

Architect/RAC/6 to 10/regular/self taught/US = 72.6% in 4577 secs

Architect/RAC/6 to 10/regular/formal/US = 71.7% in 4491 secs

Architect/RAC/11 to 15/regular/self taught/US = 72.3% in 4632 secs

Architect/RAC/11 to 15/regular/formal/US = 71.6% in 4478 secs

Architect/RAC/1 to 5/occasional/self taught/US = 59.1% in 5206 secs

Architect/RAC/1 to 5/occasional/formal/US = 58.2% in 5123 secs

Architect/RAC/6 to 10/occasional/self taught/US = 66.9% in 4743 secs

Architect/RAC/6 to 10/occasional/formal/US = 66.1% in 4668 secs

Architect/RAC/11 to 15/occasional/self taught/US = 67.3% in 4725 secs

Architect/RAC/11 to 15/occasional/formal/US = 66.4% in 4512 secs

Observations

All four territories in this study are mature markets, in terms of Revit adoption. 

Each country has an established Autodesk Training Centre market, offering high quality learning and development opportunities and consultancy. 

Each country has a pool of further education colleges, community colleges and universities, many of whom teach technical software skills as part of courses in the built environment. 

Each country is well supported by professional bodies and information-rich conference series', such as BIM Forum, RTC, AU, BIM Day Out and BIM Show Live.

Overall, regular users are more accurate and faster than part-time users.

Architects with 6 to 10 years' of experience with these tools are the most efficient. They reach a plateau in performance after c. 7 years and make no further productivity gains.

Architects who learn to apply these tools on projects are more accurate than those who have primarily formal training, but less practical experience. Formally trained users are faster overall than self-taught users.

R

Navisworks Test Scores Around The World

Navisworks is a 3D design review package, used primarily in the AEC sector to complement 3D design packages (such as Revit, AutoCAD and MicroStation). 

Navisworks allows users to open and combine 3D models, navigate around them in real-time and review the model using a set of tools including comments, redlining, viewpoint and measurements.

Over the years, KnowledgeSmart has captured test scores for a wide range of of Navisworks users, in multiple countries across the globe.

Here are the variances in our overall benchmark data, from 2013 to 2015:

2013
Average Score: 54.0%
Average Time: 49 mins

2014
Average Score: 57.0%
Average Time: 52 mins

2015
Average Score: 58.4%
Average Time: 43 mins


Let's take a look at some overall aggregate score and time data on a country vs country basis. Numbers of test scores vary, so this list does not imply that one country is 'better' than another. It's interesting to see what kind of data is generated in different parts of the globe.

Navisworks Fundamentals

Country	Score (%)	Time (secs)
Australia	67.7	2172.2
Bahrain	53.3	3123.3
Canada	63.4	2275.5
Hong Kong	68.4	2643.3
India	49.7	2789.8
Kuwait	52.4	3320.2
New Zealand	68.1	2346.7
Oman	51.2	3630.4
Pakistan	53.2	2478.8
Philippines	60.0	2489.8
Qatar	52.6	2880.6
Saudi Arabia	59.8	2590.0
Singapore	58.8	2467.7
UAE	63.1	3543.5
UK	66.5	2525.9
USA	57.7	2491.4

We also capture data on a per State basis, for our US customers. The list below represents those States where the volume of data makes for meaningful data sharing.

State	Score (%)	Time (secs)
USA all	57.7	2491.4
Arizona	56.5	2676.1
California	63.4	2374.2
Colorado	58.8	2298.8
Florida	62.9	2387.6
Georgia	59.6	2478.5
Illinois	54.6	2664.4
Louisiana	55.7	2599.4
Michigan	58.8	2490.7
Missouri	51.2	2974.1
New York	58.9	2185.5
North Carolina	53.3	2776.1
Oregon	52.7	2687.8
Pennsylvania	57.9	2489.9
Tennessee	54.3	2567.7
Texas	63.2	2234.4
Utah	57.3	2512.2
Virginia	56.1	2775.5

Navisworks is a Top 10 KS test topic, across our global customers. Overall results data illustrates that there is a clear need for training across the wider industry, with respect to model navigation and clash detection.

R