Showing posts with label Skills assessment. Show all posts
Showing posts with label Skills assessment. Show all posts

Tuesday, 10 April 2018

BIM Implementation Workshop - 25 April - London

Evolve’s BIM Awareness Workshops help AEC businesses prepare and develop a strategy for adopting BIM on design and engineering projects. KnowledgeSmart will be talking about the importance of skills assessments, measuring BIM capability and capturing key business metrics to support a wider learning and development framework.

Through interactive one-day workshops presentations, best practice advice, discussion, and hands-on project-based exercises the Evolve team make sure AEC firms appreciate how BIM integrates with existing workflows and production of project deliverables. By the end of the day, teams will be able to identify key actions and prepare a company-wide, office or project BIM strategy.

DEFINING BIM
Assessing what Building Information Modelling really means and how it applies to your business.

BS1192
Understanding the basic requirements for data production & exchange.

PAS1192
Understanding the expectations of BIM Level 2 and managing projects.

THE PILLARS OF BIM
Additional documentation designed to align BIM methodologies across design teams.

COLLABORATION
Appreciating the issues of digital production and data exchange.

INTERNAL UNDERSTANDING
The education process; maintaining production while minimising risk.

NEXT STEPS
Formulating an action plan and the necessary strategies to implement BIM.

Join Evolve and KnowledgeSmart at Evolve's offices on WEDNESDAY 25 APRIL 2018 for this powerful opportunity to drive your BIM understanding and adoption.

Click here to book your place. KS customers and partners can enter the code KSBIM01 for a 20% discount at the checkout.

R

Monday, 9 October 2017

New Feature - Bulk Question Upload

KS customers have a number of options for editing existing library content and also creating new assessment questions from scratch.


It is now possible to upload multiple questions in one go, via a new tool called, 'Bulk Add'.




From this page, you can bulk upload questions and answers from an Excel spread sheet, for 5 question types: True or False, Multiple Choice, Pick List, Order List and Free Text.


To use this feature, click on the link in the help notes box to download the template Excel file.





Replace the contents of this spreadsheet with your questions and use the controls on this page to upload your file.




Sanity check your content on the preview page.




Click 'Add Questions', to upload your new material.  You will see an advisory note which tells you that the upload was successful.




Click 'View questions', to see your new question displayed in your draft library area.




You can make further edits from here, using the normal editing controls.




Here are some more detailed instructions, which will help you when you are completing your Excel template:

The column names of your spreadsheet must match the column names in the template file. The first column denotes the question type. This can be one of 5 values: FT, MC, PL, OL, or TF. These represent the question types: Free text, Multiple choice, Pick list, Order list and True or false respectively.

For all questions, the QuestionName, QuestionSummary and QuestionText values are mandatory.

Enter your category tags and training tags in the fields provided. Separate each entry with a comma. These are extremely important for later gap analysis and charting, so be sure to include them!


Free Text
For free text questions, enter your answer into the Answer1 column. With free text questions, you can also provide the following details:
FTNumeric - enter True if the answer is numeric.
FTCaseWhitespaceVariance - enter True to enable case and white space variance. When true, the marking will disregard incorrect case and white spacing.
FTAllowVariance - for numeric questions, enter True to enable variance.
FTPercent - when variance is true, your can enter a percentage value.
FTLower - when variance is true, enter the lower threshold.
FTUpper - when variance is true, enter the upper threshold.
FTPrecisionHint - for numeric questions, enter True to enable precision hint.


True or False
For true or false questions, enter the correct answer into the Answer1 column. Valid values are True or False.


Multi Choice
For multi choice questions, enter the available options in the columns Answer1 through to Answer10. Prefix the correct answer with an * symbol. If more than one column contains a * symbol, the import process records the first answer with an * symbol as the correct option.


Pick List
For pick list questions, enter the available options in the columns Answer1 through to Answer10. You can prefix multiple correct answers with the * symbol.
PLPartialScoring - for pick list questions, enter True to enable partial scoring.


Order List
For order list questions, enter the answers in the columns Answer1 through to Answer10. You should enter the answers in the correct sequence.


R

Thursday, 16 February 2017

Case Study - Skills Assessment at David Morley Architects

David Morley Architects has partnered with KnowledgeSmart and Evolve Consultancy to identify gaps in its team’s CAD and BIM expertise and provide the targeted training needed to raise benchmarks across the firm.

Click here for a detailed case study, recently published in AEC Magazine, about the benefits of an enlightened, forward-thinking, process-driven, tech-savvy, BIM-capable business.

This case study looks in detail at skills assessment, benchmarking, technology, data, metrics, relevant consultancy and focused training.  An excellent example of good practice in the AEC industry.

R

Tuesday, 27 September 2016

KS API calls

A popular theme for our customers this year is to have closer integration between the KS system and other in-house IT systems. In particular, LMS, HR and E-Learning systems.

So, with this in mind, we have been working on creating a series of automated processes and API calls, which can simplify and speed up the exchange of key data across platforms.

Here is a brief summary of what we have created so far:

List assessments for logged in account:
https://online.knowledgesmart.net/api/api/assessments/getallassessments

Invite user to an assessment (replace the query string elements as required):
https://online.knowledgesmart.net/api/api/assessments/GetNewInvite?UserEmail=john@xyz.com&TestID=4841&FirstName=john&LastName=smith&Status=1

List users for account:
https://online.knowledgesmart.net/api/api/users/getallusers

Search users by name (change the name value to a name you want to search):
https://online.knowledgesmart.net/api/api/users/getusersbyname?name=john

Search users by id (change the userid value to an id you know):
https://online.knowledgesmart.net/api/api/users/getuserbyid?userid=xxxx

List results for account:
https://online.knowledgesmart.net/api/api/results/GetAllResults

List results for a user (change the userid value to an id you know):
https://online.knowledgesmart.net/api/api/results/GetResultsForUser?userid=xxxx

Show all results for a particular test id:
https://online.knowledgesmart.net/api/api/results/GetResultsForAssessment?testid=xxxx
It will return the results for a given test id for the logged in account.

Add a new user:
https://online.knowledgesmart.net/api/api/users/adduser?email=john@xyz.com&firstname=john&lastname=smith

Simply substitute the email/firstname/lastname to the user you would like to add. If a user already exists with that email address then that user is added to the account.

Get answers for a result:
https://online.knowledgesmart.net/api/api/results/getanswersforresult?resultid=xxxx

Pass in the resultid you would like to see the answers for. N.B. you would probably use the existing methods GetAllResults or GetResultsForUser first to get the list of results and their resultids which you could then pass in.


If you would like to schedule a call with our technical team, to discuss your own organisation's requirements for closer integration with KS user and results data, please do get in touch.

R

Tuesday, 26 April 2016

How Good Are Engineers at Using Revit Structure?

With the global adoption of Building Information Modelling (BIM) well underway, it is a huge challenge for Engineering businesses to manage the change in their project delivery processes from more conventional drawing production environments, to that of virtual design, clash detection and 'intelligent' modelling.

Looking at the global AEC picture, it is clear that the commercial software application adopted by a wide majority of the world's Structural Engineering firms, as their modelling tool of choice, is Autodesk's Revit Structure platform.

In recent years, KnowledgeSmart's online skills assessment software platform has captured test scores from thousands of Engineers, representing hundreds of firms, spread across six continents and a couple of dozen countries.

We have analysed the results data generated from these live assessments, at a basic skills level, and noted the following trends. For this particular study, the majority of our data is generated in the USA, UK, Canada and Australia (in that order).

A simple key to interpret the data below:

Str Eng = Job Title
RST = Revit Structure
1 to 5 = 1 to 5 years' experience using the tool
6 to 10 = 6 to 10 years' experience using the tool
Regular = use the tool daily (or almost daily)
Occasional = use the tool weekly (or less than weekly)
Self taught = learned to use the tool primarily 'on the job'
Formal = learned to the tool primarily via formal classroom or online training
All = overall KS benchmark data
AUS = Australia
CAN = Canada
UK = UK
USA = USA


Here is a summary of the results presented by different types of Engineers.

Overall

RST Fundamentals score overall: 67.1% in 4320 s

Str Eng/RST/1 to 5/regular/self taught/All = 59.3% in 4854 s
Str Eng/RST/1 to 5/regular/formal/All = 58.2% in 4738 s
Str Eng/RST/6 to 10/regular/self taught/All = 68.3% in 4141 s
Str Eng/RST/6 to 10/regular/formal/All = 67.4% in 4372 s

Str Eng/RST/1 to 5/occasional/self taught/All = 55.2% in 5353 s
Str Eng/RST/1 to 5/occasional/formal/All = 54.5% in 5244 s
Str Eng/RST/6 to 10/occasional/self taught/All = 63.3% in 4967 s
Str Eng/RST/6 to 10/occasional/formal/All = 62.5% in 4777 s

Australia

RST Fundamentals score Australia: 68.7% in 4191 s

Str Eng/RST/1 to 5/regular/self taught/US = 59.4% in 4786 s
Str Eng/RST/1 to 5/regular/formal/US = 58.0% in 4553 s
Str Eng/RST/6 to 10/regular/self taught/US = 68.6% in 4003 s
Str Eng/RST/6 to 10/regular/formal/US = 67.2% in 3967 s
 
Str Eng/RST/1 to 5/occasional/self taught/US = 53.4% in 4822 s
Str Eng/RST/1 to 5/occasional/formal/US = 52.0% in 4687 s
Str Eng/RST/6 to 10/occasional/self taught/US = 59.6% in 4566 s
Str Eng/RST/6 to 10/occasional/formal/US = 58.7 in 4330 s

Canada

RST Fundamentals score Canada: 72.4% in 3886 s

Str Eng/RST/1 to 5/regular/self taught/US = 63.4% in 4378 s
Str Eng/RST/1 to 5/regular/formal/US = 61.6% in 4233 s
Str Eng/RST/6 to 10/regular/self taught/US = 72.6% in 3717 s
Str Eng/RST/6 to 10/regular/formal/US = 71.4% in 3578 s
 
Str Eng/RST/1 to 5/occasional/self taught/US = 58.1% in 4516 s
Str Eng/RST/1 to 5/occasional/formal/US = 56.7% in 4439 s
Str Eng/RST/6 to 10/occasional/self taught/US = 63.6% in 4248 s
Str Eng/RST/6 to 10/occasional/formal/US = 62.5% in 4036 s

UK

RST Fundamentals score UK: 71.1% in 4887 s

Str Eng/RST/1 to 5/regular/self taught/US = 62.2% in 5343 s
Str Eng/RST/1 to 5/regular/formal/US = 60.6% in 5154 s
Str Eng/RST/6 to 10/regular/self taught/US = 71.3% in 4673 s
Str Eng/RST/6 to 10/regular/formal/US = 70.1% in 4491 s
 
Str Eng/RST/1 to 5/occasional/self taught/US = 58.4% in 5616 s
Str Eng/RST/1 to 5/occasional/formal/US = 56.9% in 5552 s
Str Eng/RST/6 to 10/occasional/self taught/US = 62.6% in 5254 s
Str Eng/RST/6 to 10/occasional/formal/US = 61.7% in 4987 s

USA

RST Fundamentals score USA: 73.7% in 4218 s

Str Eng/RST/1 to 5/regular/self taught/US = 64.6% in 4843 s
Str Eng/RST/1 to 5/regular/formal/US = 62.9% in 4661 s
Str Eng/RST/6 to 10/regular/self taught/US = 73.8% in 4073 s
Str Eng/RST/6 to 10/regular/formal/US = 72.1% in 3891 s
 
Str Eng/RST/1 to 5/occasional/self taught/US = 59.3% in 4916 s
Str Eng/RST/1 to 5/occasional/formal/US = 57.9% in 4856 s
Str Eng/RST/6 to 10/occasional/self taught/US = 64.8% in 4668 s
Str Eng/RST/6 to 10/occasional/formal/US = 63.7% in 4448 s


Observations

All four territories in this study are mature markets, in terms of Revit adoption. 

Each country has an established Autodesk Training Centre market, offering high quality learning and development opportunities and consultancy. 

Each country has a pool of further education colleges, community colleges and universities, many of whom teach technical software skills as part of courses in the built environment. 

Each country is well supported by professional bodies and information-rich conference series', such as BIM Forum, RTC, AU, BIM Day Out and BIM Show Live.

Overall, regular users are more accurate and faster than part-time users.

Engineers with 6 to 10 years' of experience with these tools are the most efficient. They reach a plateau in performance after c. 7 years and make no further productivity gains.

Engineers who learn to apply these tools on projects are more accurate than those who have primarily formal training, but less practical experience. Formally trained users are faster overall than self-taught users.

R

Friday, 11 March 2016

How Good Are Engineers at Using Revit MEP?

With the global adoption of Building Information Modelling (BIM) well underway, it is a huge challenge for Engineering businesses to manage the change in their project delivery processes from more conventional drawing production environments, to that of virtual design, clash detection and 'intelligent' modelling.

Looking at the global AEC picture, it is clear that the commercial software application adopted by a wide majority of the world's MEP Engineering firms, as their modelling tool of choice, is Autodesk's Revit MEP platform.

In recent years, KnowledgeSmart's online skills assessment software platform has captured test scores from thousands of Engineers, representing hundreds of firms, spread across six continents and a couple of dozen countries.

We have analysed the results data generated from these live assessments, at a basic skills level, and noted the following trends. For this particular study, the majority of our data is generated in the USA, UK, Canada and Australia (in that order).

A simple key to interpret the data below:

MEP Eng = Job Title
RMEP = Revit MEP
1 to 5 = 1 to 5 years' experience using the tool
6 to 10 = 6 to 10 years' experience using the tool
Regular = use the tool daily (or almost daily)
Occasional = use the tool weekly (or less than weekly)
Self taught = learned to use the tool primarily 'on the job'
Formal = learned to the tool primarily via formal classroom or online training
All = overall KS benchmark data
AUS = Australia
CAN = Canada
UK = UK
USA = USA


Here is a summary of the results presented by different types of Engineers.

Overall

RMEP Fundamentals score overall: 66.3% in 4084 s

MEP Eng/RMEP/1 to 5/regular/self taught/All = 58.6% in 4771 s
MEP Eng/RMEP/1 to 5/regular/formal/All = 57.7% in 4626 s
MEP Eng/RMEP/6 to 10/regular/self taught/All = 67.1% in 4188 s
MEP Eng/RMEP/6 to 10/regular/formal/All = 66.4% in 4111 s
MEP Eng/RMEP/1 to 5/occasional/self taught/All = 53.3% in 5146 s
MEP Eng/RMEP/1 to 5/occasional/formal/All = 52.8% in 5025 s
MEP Eng/RMEP/6 to 10/occasional/self taught/All = 61.3% in 4644 s
MEP Eng/RMEP/6 to 10/occasional/formal/All = 60.4% in 4561 s

Australia

RMEP Fundamentals score Australia: 66.7% in 4079 s

MEP Eng/RMEP/1 to 5/regular/self taught/AUS = 57.8% in 4971 s
MEP Eng/RMEP/1 to 5/regular/formal/AUS = 57.0% in 4786 s
MEP Eng/RMEP/6 to 10/regular/self taught/AUS = 66.8% in 4006 s
MEP Eng/RMEP/6 to 10/regular/formal/AUS = 65.9% in 3768 s
 
MEP Eng/RMEP/1 to 5/occasional/self taught/AUS = 53.7% in 5116 s
MEP Eng/RMEP/1 to 5/occasional/formal/AUS = 52.6% in 4910 s
MEP Eng/RMEP/6 to 10/occasional/self taught/AUS = 59.8% in 4557 s
MEP Eng/RMEP/6 to 10/occasional/formal/AUS = 58.7% in 4388 s

Canada

RMEP Fundamentals score Canada: 68.1% in 4391 s

MEP Eng/RMEP/1 to 5/regular/self taught/CAN = 60.5% in 4835 s
MEP Eng/RMEP/1 to 5/regular/formal/CAN = 58.8% in 4754 s
MEP Eng/RMEP/6 to 10/regular/self taught/CAN = 68.6% in 4272 s
MEP Eng/RMEP/6 to 10/regular/formal/CAN = 67.3% in 4113 s
MEP Eng/RMEP/1 to 5/occasional/self taught/CAN = 55.3% in 5002 s
MEP Eng/RMEP/1 to 5/occasional/formal/CAN = 54.2% in 4849 s
MEP Eng/RMEP/6 to 10/occasional/self taught/CAN = 62.2% in 4458 s
MEP Eng/RMEP/6 to 10/occasional/formal/CAN = 61.4% in 4367 s

UK

RMEP Fundamentals score UK: 69.4% in 3705 s

MEP Eng/RMEP/1 to 5/regular/self taught/UK = 61.2% in 4216 s
MEP Eng/RMEP/1 to 5/regular/formal/UK = 60.6% in 4011 s
MEP Eng/RMEP/6 to 10/regular/self taught/UK = 69.5% in 3665 s
MEP Eng/RMEP/6 to 10/regular/formal/UK = 68.5% in 3487 s
 
MEP Eng/RMEP/1 to 5/occasional/self taught/UK = 56.2% in 4558 s
MEP Eng/RMEP/1 to 5/occasional/formal/UK = 54.3% in 4543 s
MEP Eng/RMEP/6 to 10/occasional/self taught/UK = 62.4% in 4313 s
MEP Eng/RMEP/6 to 10/occasional/formal/UK = 61.6% in 4282 s

USA

RMEP Fundamentals score USA: 67.3% in 4046 s

MEP Eng/RMEP/1 to 5/regular/self taught/US = 59.6% in 4632 s
MEP Eng/RMEP/1 to 5/regular/formal/US = 57.8% in 4411 s
MEP Eng/RMEP/6 to 10/regular/self taught/US = 67.6% in 3933 s
MEP Eng/RMEP/6 to 10/regular/formal/US = 66.7% in 3731 s
 
MEP Eng/RMEP/1 to 5/occasional/self taught/US = 55.1% in 4806 s
MEP Eng/RMEP/1 to 5/occasional/formal/US = 53.2% in 4723 s
MEP Eng/RMEP/6 to 10/occasional/self taught/US = 60.8% in 4543 s
MEP Eng/RMEP/6 to 10/occasional/formal/US = 59.7% in 4368 s


Observations

All four territories in this study are mature markets, in terms of Revit adoption. 

Each country has an established Autodesk Training Centre market, offering high quality learning and development opportunities and consultancy. 

Each country has a pool of further education colleges, community colleges and universities, many of whom teach technical software skills as part of courses in the built environment. 

Each country is well supported by professional bodies and information-rich conference series', such as BIM Forum, RTC, AU, BIM Day Out and BIM Show Live.

Overall, regular users are more accurate and faster than part-time users.

Engineers with 6 to 10 years' of experience with these tools are the most efficient. They reach a plateau in performance after c. 7 years and make no further productivity gains.

Engineers who learn to apply these tools on projects are more accurate than those who have primarily formal training, but less practical experience. Formally trained users are faster overall than self-taught users.

R

Saturday, 27 February 2016

How Good Are Architects at Using MicroStation?

Architects around the world have been using 2D draughting tools on live projects for over 20 years.  One of the most popular applications for design firms is Bentley Systems' MicroStation platform.

In recent years, KnowledgeSmart's online skills assessment software platform has captured test scores from thousands of Architects, representing hundreds of design firms, spread across six continents and a couple of dozen countries.

We have analysed the results data generated from these live assessments, at a basic skills level, and noted the following trends. For this particular study, the majority of our data is generated in the UK, USA, Australia and Canada (in that order).

A simple key to interpret the data below:

Architect = Job Title
MicroStation = MicroStation 2D skills
1 to 5 = 1 to 5 years' experience using the tool
6 to 10 = 6 to 10 years' experience using the tool
11 to 15 = 11 to 15 years' experience using the tool
Regular = use the tool daily (or almost daily)
Occasional = use the tool weekly (or less than weekly)
Self taught = learned to use the tool primarily 'on the job'
Formal = learned to the tool primarily via formal classroom or online training
All = overall KS benchmark data
AUS = Australia
CAN = Canada
UK = UK
USA = USA

Here is a summary of the results presented by different types of Architects.

Overall

MicroStation score overall: 59.3% in 5040 secs

Architect/MicroStation/1 to 5/regular/self taught/all = 53.8% in 5249 secs
Architect/MicroStation/1 to 5/regular/formal/all = 53.1% in 5131 secs
Architect/MicroStation/6 to 10/regular/self taught/all = 60.4% in 4974 secs
Architect/MicroStation/6 to 10/regular/formal/all = 59.9% in 4854 secs
Architect/MicroStation/11 to 15/regular/self taught/all = 59.7% in 4824 secs
Architect/MicroStation/11 to 15/regular/formal/all = 59.3% in 4754 secs

Architect/MicroStation/1 to 5/occasional/self taught/all = 49.5% in 5657 secs
Architect/MicroStation/1 to 5/occasional/formal/all = 48.8% in 5520 secs
Architect/MicroStation/6 to 10/occasional/self taught/all = 55.3% in 5309 secs
Architect/MicroStation/6 to 10/occasional/formal/all = 55.2% in 5267 secs
Architect/MicroStation/11 to 15/occasional/self taught/all = 55.8% in 5278 secs
Architect/MicroStation/11 to 15/occasional/formal/all = 55.1% in 5222 secs

Australia

MicroStation score Australia: 58.7% in 4873 secs

Architect/MicroStation/1 to 5/regular/self taught/AUS = 53.6% in 5201 secs
Architect/MicroStation/1 to 5/regular/formal/AUS = 53.0% in 5160 secs
Architect/MicroStation/6 to 10/regular/self taught/AUS = 59.2% in 4954 secs
Architect/MicroStation/6 to 10/regular/formal/AUS = 58.8% in 4889 secs
Architect/MicroStation/11 to 15/regular/self taught/AUS = 58.8% in 4876 secs
Architect/MicroStation/11 to 15/regular/formal/AUS = 58.2% in 4565 secs

Architect/MicroStation/1 to 5/occasional/self taught/AUS = 48.1% in 5595 secs
Architect/MicroStation/1 to 5/occasional/formal/AUS = 47.3% in 5476 secs
Architect/MicroStation/6 to 10/occasional/self taught/AUS = 54.9% in 5212 secs
Architect/MicroStation/6 to 10/occasional/formal/AUS = 54.2% in 5131 secs
Architect/MicroStation/11 to 15/occasional/self taught/AUS = 55.2% in 5152 secs
Architect/MicroStation/11 to 15/occasional/formal/AUS = 54.4% in 5059 secs

Canada

MicroStation score Canada: 57.7% in 5172 secs

Architect/MicroStation/1 to 5/regular/self taught/CAN = 52.7% in 5421 secs
Architect/MicroStation/1 to 5/regular/formal/CAN = 52.6% in 5387 secs
Architect/MicroStation/6 to 10/regular/self taught/CAN = 58.2% in 5178 secs 
Architect/MicroStation/6 to 10/regular/formal/CAN = 57.8% in 5102 secs
Architect/MicroStation/11 to 15/regular/self taught/CAN = 58.3% in 5046 secs
Architect/MicroStation/11 to 15/regular/formal/CAN = 57.6% in 5012 secs

Architect/MicroStation/1 to 5/occasional/self taught/CAN = 47.4% in 5754 secs
Architect/MicroStation/1 to 5/occasional/formal/CAN = 46.8% in 5632 secs
Architect/MicroStation/6 to 10/occasional/self taught/CAN = 54.6% in 5512 secs
Architect/MicroStation/6 to 10/occasional/formal/CAN = 53.8% in 5466 secs
Architect/MicroStation/11 to 15/occasional/self taught/CAN = 55.1% in 5432 secs

Architect/MicroStation/11 to 15/occasional/formal/CAN = 54.7% in 5313 secs


UK

MicroStation score UK: 61.3% in 4859 secs

Architect/MicroStation/1 to 5/regular/self taught/UK = 55.5% in 5285 secs
Architect/MicroStation/1 to 5/regular/formal/UK = 55.1% in 5222 secs
Architect/MicroStation/6 to 10/regular/self taught/UK = 61.5% in 4862 secs
Architect/MicroStation/6 to 10/regular/formal/UK = 61.1% in 4828 secs
Architect/MicroStation/11 to 15/regular/self taught/UK = 61.3% in 4901 secs
Architect/MicroStation/11 to 15/regular/formal/UK = 60.8% in 4788 secs

Architect/MicroStation/1 to 5/occasional/self taught/UK = 49.7% in 5456 secs
Architect/MicroStation/1 to 5/occasional/formal/UK = 49.1% in 5402 secs
Architect/MicroStation/6 to 10/occasional/self taught/UK = 56.3% in 5232 secs
Architect/MicroStation/6 to 10/occasional/formal/UK = 55.6% in 5179 secs
Architect/MicroStation/11 to 15/occasional/self taught/UK = 56.7% in 5143 secs
Architect/MicroStation/11 to 15/occasional/formal/UK = 55.8% in 5056 secs

USA

MicroStation score USA: 59.2% in 5374 secs

Architect/MicroStation/1 to 5/regular/self taught/US = 54.2% in 5767 secs
Architect/MicroStation/1 to 5/regular/formal/US = 53.6% in 5647 secs
Architect/MicroStation/6 to 10/regular/self taught/US = 59.6% in 5387 secs
Architect/MicroStation/6 to 10/regular/formal/US = 59.2 in 5322 secs
Architect/MicroStation/11 to 15/regular/self taught/US = 59.5% in 5278 secs
Architect/MicroStation/11 to 15/regular/formal/US = 59.2% in 5166 secs

Architect/MicroStation/1 to 5/occasional/self taught/US = 48.4% in 5767 secs
Architect/MicroStation/1 to 5/occasional/formal/US = 47.7% in 5665 secs
Architect/MicroStation/6 to 10/occasional/self taught/US = 55.1% in 5489 secs
Architect/MicroStation/6 to 10/occasional/formal/US = 54.8% in 5447 secs 
Architect/MicroStation/11 to 15/occasional/self taught/US = 55.6% in 5420 secs
Architect/MicroStation/11 to 15/occasional/formal/US = 55.1% in 5391 secs


Observations

All four territories in this study are mature markets, in terms of MicroStation adoption. 

Each country is an established Bentley Systems' market, with a high quality learning and development environment and vendor consultancy support. 

Each country is well supported by professional bodies, AEC industry conferences and established vendor user community groups and online resources.

Overall, regular users are more accurate and faster than part-time users.

Architects with 6 to 10 years' of experience with these tools are the most efficient. They reach a plateau in performance after c. 7 years and make no further productivity gains.

Architects who learn to apply these tools on projects are more accurate than those who have primarily formal training, but less practical experience. Formally trained users are faster overall than self-taught users.


R

Sunday, 21 February 2016

How Good Are Architects at Using Revit Architecture?

With the global adoption of Building Information Modelling (BIM) well underway, it is a huge challenge for Architectural design businesses to manage the change in their project delivery processes from more conventional draughting and sketching production environments, to that of virtual design and 'intelligent' modelling.

Looking at the global AEC picture, it is clear that the commercial software application adopted by over half of the world's design firms, as their modelling tool of choice, is Autodesk's Revit Architecture platform.

In recent years, KnowledgeSmart's online skills assessment software platform has captured test scores from thousands of Architects, representing hundreds of design firms, spread across six continents and a couple of dozen countries.

We have analysed the results data generated from these live assessments, at a basic skills level, and noted the following trends. For this particular study, the majority of our data is generated in the USA, UK, Australia and Canada (in that order).

A simple key to interpret the data below:

Architect = Job Title
RAC = Revit Architecture
1 to 5 = 1 to 5 years' experience using the tool
6 to 10 = 6 to 10 years' experience using the tool
11 to 15 = 11 to 15 years' experience using the tool
Regular = use the tool daily (or almost daily)
Occasional = use the tool weekly (or less than weekly)
Self taught = learned to use the tool primarily 'on the job'
Formal = learned to the tool primarily via formal classroom or online training
All = overall KS benchmark data
AUS = Australia
CAN = Canada
UK = UK
USA = USA


Here is a summary of the results presented by different types of Architects.

Overall

RAC Fundamentals score overall: 68.8% in 4764 secs

Architect/RAC/1 to 5/regular/self taught/All = 63.3% in 5121 secs
Architect/RAC/1 to 5/regular/formal/All = 62.8% in 4976 secs
Architect/RAC/6 to 10/regular/self taught/All = 69.4% in 4588 secs
Architect/RAC/6 to 10/regular/formal/All = 68.7% in 4461 secs
Architect/RAC/11 to 15/regular/self taught/All = 69.7% in 4701 secs
Architect/RAC/11 to 15/regular/formal/All = 68.4% in 4529 secs
Architect/RAC/1 to 5/occasional/self taught/All = 58.4% in 5446 secs
Architect/RAC/1 to 5/occasional/formal/All = 57.8% in 5228 secs
Architect/RAC/6 to 10/occasional/self taught/All = 66.7% in 4843 secs
Architect/RAC/6 to 10/occasional/formal/All = 65.9% in 4677 secs
Architect/RAC/11 to 15/occasional/self taught/All = 67.4% in 4802 secs
Architect/RAC/11 to 15/occasional/formal/All = 66.5% in 4646 secs

Australia

RAC Fundamentals score Australia: 69.4% in 4737 secs

Architect/RAC/1 to 5/regular/self taught/AUS = 63.8% in 5181 secs
Architect/RAC/1 to 5/regular/formal/AUS = 62.3% in 4986 secs
Architect/RAC/6 to 10/regular/self taught/AUS = 69.8% in 4836 secs
Architect/RAC/6 to 10/regular/formal/AUS = 69.1% in 4768 secs
Architect/RAC/11 to 15/regular/self taught/AUS = 69.4% in 4787 secs
Architect/RAC/11 to 15/regular/formal/AUS = 68.8% in 4679 secs
Architect/RAC/1 to 5/occasional/self taught/AUS = 57.4% in 5336 secs
Architect/RAC/1 to 5/occasional/formal/AUS = 56.5% in 5210 secs
Architect/RAC/6 to 10/occasional/self taught/AUS = 65.8% in 4757 secs
Architect/RAC/6 to 10/occasional/formal/AUS = 65.2% in 4588 secs
Architect/RAC/11 to 15/occasional/self taught/AUS = 66.4% in 4818 secs
Architect/RAC/11 to 15/occasional/formal/AUS = 66.2% in 4701 secs

Canada

RAC Fundamentals score Canada: 70.1% in 4341 secs

Architect/RAC/1 to 5/regular/self taught/CAN = 64.1% in 5227 secs
Architect/RAC/1 to 5/regular/formal/CAN = 63.6% in 5026 secs
Architect/RAC/6 to 10/regular/self taught/CAN = 70.6% in 4532 secs
Architect/RAC/6 to 10/regular/formal/CAN = 70.3% in 4311 secs
Architect/RAC/11 to 15/regular/self taught/CAN = 70.8% in 4488 secs
Architect/RAC/11 to 15/regular/formal/CAN = 70.4% in 4501 secs
Architect/RAC/1 to 5/occasional/self taught/CAN = 58.3% in 5411 secs
Architect/RAC/1 to 5/occasional/formal/CAN = 57.2% in 5317 secs
Architect/RAC/6 to 10/occasional/self taught/CAN = 65.7% in 4858 secs
Architect/RAC/6 to 10/occasional/formal/CAN = 64.8% in 4767 secs
Architect/RAC/11 to 15/occasional/self taught/CAN = 66.1% in 4777 secs
Architect/RAC/11 to 15/occasional/formal/CAN = 65.8% in 4689 secs

UK

RAC Fundamentals score UK: 73.6% in 4783 secs

Architect/RAC/1 to 5/regular/self taught/UK = 65.2% in 5075 secs
Architect/RAC/1 to 5/regular/formal/UK = 64.5% in 5033 secs
Architect/RAC/6 to 10/regular/self taught/UK = 73.1% in 4767 secs
Architect/RAC/6 to 10/regular/formal/UK = 72.4% in 4554 secs
Architect/RAC/11 to 15/regular/self taught/UK = 73.5% in 4748 secs
Architect/RAC/11 to 15/regular/formal/UK = 72.6% in 4579 secs
Architect/RAC/1 to 5/occasional/self taught/UK = 60.3% in 5186 secs
Architect/RAC/1 to 5/occasional/formal/UK = 59.3% in 5032 secs
Architect/RAC/6 to 10/occasional/self taught/UK = 67.4% in 4711 secs
Architect/RAC/6 to 10/occasional/formal/UK = 66.9% in 4665 secs
Architect/RAC/11 to 15/occasional/self taught/UK = 67.4% in 4788 secs
Architect/RAC/11 to 15/occasional/formal/UK = 67.1% in 4667 secs

USA

RAC Fundamentals score USA: 72.4% in 4672 secs

Architect/RAC/1 to 5/regular/self taught/US = 64.7% in 5039 secs
Architect/RAC/1 to 5/regular/formal/US = 63.8% in 4911 secs
Architect/RAC/6 to 10/regular/self taught/US = 72.6% in 4577 secs
Architect/RAC/6 to 10/regular/formal/US = 71.7% in 4491 secs
Architect/RAC/11 to 15/regular/self taught/US = 72.3% in 4632 secs
Architect/RAC/11 to 15/regular/formal/US = 71.6% in 4478 secs
Architect/RAC/1 to 5/occasional/self taught/US = 59.1% in 5206 secs
Architect/RAC/1 to 5/occasional/formal/US = 58.2% in 5123 secs
Architect/RAC/6 to 10/occasional/self taught/US = 66.9% in 4743 secs
Architect/RAC/6 to 10/occasional/formal/US = 66.1% in 4668 secs
Architect/RAC/11 to 15/occasional/self taught/US = 67.3% in 4725 secs
Architect/RAC/11 to 15/occasional/formal/US = 66.4% in 4512 secs


Observations

All four territories in this study are mature markets, in terms of Revit adoption. 

Each country has an established Autodesk Training Centre market, offering high quality learning and development opportunities and consultancy. 

Each country has a pool of further education colleges, community colleges and universities, many of whom teach technical software skills as part of courses in the built environment. 

Each country is well supported by professional bodies and information-rich conference series', such as BIM Forum, RTC, AU, BIM Day Out and BIM Show Live.

Overall, regular users are more accurate and faster than part-time users.

Architects with 6 to 10 years' of experience with these tools are the most efficient. They reach a plateau in performance after c. 7 years and make no further productivity gains.

Architects who learn to apply these tools on projects are more accurate than those who have primarily formal training, but less practical experience. Formally trained users are faster overall than self-taught users.

R

Saturday, 30 January 2016

Global Test Scores Posted by Structural Engineers

Structural Engineers from across the world have submitted a wide variety of KS test scores, in recent years. Let’s take a more detailed look at the people behind the headline stats.

We capture some interesting user demographic data at the start of each test session. This includes the following questions:

- Primary Industry/Discipline
- Primary Role
- Country & State
- Self rating
- How many years have you used this tool?
- Where did you learn to use this tool?
- How often do you use this tool? (Daily, weekly, occasional)
- How did you learn to use this tool? (On the job, Formal training, College)


The top 2 tests completed by Structural Engineers are, in order (by volume):

Revit Structure
AutoCAD


The results data comes from a wide range of countries and territories, primarily, US, Canada, UK, Australia, South Africa, Singapore, HK and Middle East regions.

Here are the overall results:

Revit Structure

Avg score/time for:

Regular users = 71.1% in 4201 secs
Part-time users = 67.2% in 3871 secs
1 to 5 years = 66.7% in 4110 secs
6 to 10 years = 69.9% in 3489 secs
11 to 15 years = 67.1% in 3892 secs
On the job learning = 69.1% in 4287 secs
Formal learning = 64.3% in 3956 secs

The average Revit Structure self-rating score for Structural Engineers is: 3.7.


AutoCAD

Avg score/time for:

Regular users = 56.7% in 4756 secs
Part-time users = 54.9% in 5064 secs
1 to 5 years = 51.3% in 4536 secs
6 to 10 years = 56.3% in 4201 secs
11 to 15 years = 56.7% in 5337 secs
On the job learning = 54.8% in 4466 secs
Formal learning = 52.1% in 4215 secs

The average AutoCAD self-rating score for Structural Engineers is: 3.3.


Trends:

Overall, regular users are more accurate and faster than part-time users.

Structural Engineers with 6 to 10 years' of experience with these tools are the most efficient. They reach a plateau in performance after c. 7 years and make no further productivity gains.

Structural Engineers who learn to apply these tools on projects are more accurate than those who have primarily formal training, but less practical experience. Formally trained users are faster overall than self-taught users.

Structural Engineers are generally confident in their ability to use technical software tools on Construction projects, although overall, there is still room for further improvement in their core skills.

Structural Engineers are more confident and more accurate using modeling software than drafting software.

R

Friday, 29 January 2016

Global Test Scores Posted by MEP Engineers

MEP Engineers from across the world have submitted a wide variety of KS test scores, in recent years. Let’s take a more detailed look at the people behind the headline stats.

We capture some interesting user demographic data at the start of each test session. This includes the following questions:

- Primary Industry/Discipline
- Primary Role
- Country & State
- Self rating
- How many years have you used this tool?
- Where did you learn to use this tool?
- How often do you use this tool? (Daily, weekly, occasional)
- How did you learn to use this tool? (On the job, Formal training, College)


The top 2 tests completed by MEP Engineers are, in order (by volume):

Revit MEP
AutoCAD

The results data comes from a wide range of countries and territories, primarily, US, Canada, UK, Australia, South Africa, Singapore, HK and Middle East regions.

Here are the overall results:

Revit MEP

Avg score/time for:

Regular users = 68.5% in 3110 secs
Part-time users = 65.7% in 3871 secs
1 to 5 years' experience (all types) = 56.6% in 3901 secs
6 to 10 years' experience (all types) = 68.7% in 3401 secs
On the job learning (all types) = 70.2% in 3781 secs
Formal learning (all types) = 64.8% in 3911 secs

The average Revit MEP self-rating score for MEP Engineers is: 3.8.

AutoCAD

Avg score/time for:

Regular users = 59.8% in 5356 secs
Part-time users = 54.9% in 4864 secs
1 to 5 years' experience (all types) = 52.7% in 5752 secs
6 to 10 years' experience (all types) = 57.5% in 5240 secs
11 to 15 years' experience (all types) = 54.7% in 5449 secs
On the job learning (all types) = 57.8% in 4516 secs
Formal learning (all types) = 55.1% in 4344 secs

The average AutoCAD self-rating score for MEP Engineers is: 3.4.

Trends:

Overall, regular users are more accurate and faster than part-time users.

MEP Engineers with 6 to 10 years' of experience with these tools are the most efficient. They reach a plateau in performance after c. 7 years and make no further productivity gains.

MEP Engineers who learn to apply these tools on projects are more accurate than those who have primarily formal training, but less practical experience. Formally trained users are faster overall than self-taught users.

MEP Engineers are generally confident in their ability to use technical software tools on Construction projects, although overall, there is still room for further improvement in their core skills.

MEP Engineers are more confident and more accurate using modeling software than drafting software.

R

Thursday, 28 January 2016

Global Test Scores Posted by Civil Engineers

Civil Engineers from across the world have submitted several thousand KS test scores, in recent years. Let’s take a more detailed look at the people behind the headline stats.

We capture some interesting user demographic data at the start of each test session. This includes the following questions:

- Primary Industry/Discipline
- Primary Role
- Country & State
- Self rating
- How many years have you used this tool?
- Where did you learn to use this tool?
- How often do you use this tool? (Daily, weekly, occasional)
- How did you learn to use this tool? (On the job, Formal training, College)


The top 3 tests completed by Civil Engineers are, in order (by volume):

AutoCAD Civil 3D
AutoCAD
MicroStation


The results data comes from a wide range of countries and territories, primarily, US, Canada, UK, Australia, South Africa and Middle East regions.


Here are the overall results:

AutoCAD Civil 3D

Avg score/time for:

Regular users = 73.4% in 3294 secs
Part-time users = 68.2% in 4109 secs
1 to 5 years' experience (all types) = 63.4% in 3783 secs
6 to 10 years' experience (all types) = 75.5% in 3170 secs
11 to 15 years' experience (all types) = 76.3% in 3290 secs
On the job learning (all types) = 71.1% in 3463 secs
Formal learning (all types) = 67.4% in 3587 secs

The average AutoCAD Civil 3D self-rating score for Civil Engineers is: 3.9.


AutoCAD

Avg score/time for:

Regular users = 70.2% in 4867 secs
Part-time users = 63.1% in 4842 secs
1 to 5 years' experience (all types) = 55.3% in 5130 secs
6 to 10 years' experience (all types) = 70.4% in 4363 secs
11 to 15 years' experience (all types) = 69.9% in 3799 secs
On the job learning (all types) = 67.2% in 4576 secs
Formal learning (all types) = 55.7% in 4644 secs

The average AutoCAD self-rating score for Civil Engineers is: 3.7.


MicroStation

Avg score/time for:

Regular users = 69.6% in 5144 secs
Part-time users = 64.6% in 5455 secs
1 to 5 years' experience (all types) = 61.3% in 5656 secs
6 to 10 years' experience (all types) = 73.3% in 4842 secs
11 to 15 years' experience (all types) = 71.4% in 4338 secs
On the job learning (all types) = 71.6% in 4686 secs
Formal learning (all types) = 57.5% in 4339 secs

The average MicroStation self-rating score for Civil Engineers is: 3.6.


Trends:

Overall, regular users are more accurate and faster than part-time users.

Civil Engineers with 6 to 10 years' of experience with these tools are the most efficient. They reach a plateau in performance after c. 7 years and make no further productivity gains.

Civil Engineers who learn to apply these tools on projects are more accurate than those who have primarily formal training, but less practical experience. There is little to choose between the two, in terms of speed.

Civil Engineers are generally confident in their ability to use technical software tools on Construction projects, although overall, there is still room for further improvement in their core skills.

R