Showing posts with label Training needs analysis. Show all posts
Showing posts with label Training needs analysis. Show all posts

Friday, 27 April 2018

New Test Title - Newforma Fundamentals

KnowledgeSmart's skills assessment library helps AEC businesses capture evidence of individual and corporate skills capability, across a wide variety of essential technical software titles.

This includes popular software products from major vendors, including Autodesk, Bentley Systems, Graphisoft, Oracle, Adobe and Microsoft.

One of the most popular requests in recent months has been to create assessment content for Project Information Management tool, Newforma.

This assessment looks at knowledge of using Newforma, across a range of core functions, and is written primarily with novice users in mind.

Modules covered include:

User Interface
My Projects
Email Management
Info Exchange
Transmittals

We will also be adding content for intermediate and advanced users, in the coming months.

R

Friday, 9 March 2018

4 WAYS TO GARNER MANAGEMENT SUPPORT FOR YOUR SKILL ASSESSMENT PLAN



The most critical element of any skills assessment activity is to draw together support from management to drive the process and ensure a successful deployment and adoption.

Experience shows that it is helpful to gain support from the following key business areas:
  • Human Resources and Learning & Development
  • Technology and Building Information Modelling Management (to ensure alignment with company CAD / BIM standards and protocols e.g. BIM Level 2)
  • Senior Management
Without collective management support, your skills assessment activity might turn into a very frustrating, futile exercise.

Clarify the concept of skills assessment

People’s perception of skills assessment may be very different. Make sure that you define your interpretation of skill assessments, keeping in mind the priorities for each business division and ensuring alignment.

Once the definition is clarified it is substantially easier to explain the resulting benefits. Since most people have an adverse reaction when the word ‘test’ is mentioned, it is often a good idea to start with a quick comparison between ‘test’ and ‘assessment’. In most cases, the purpose of most tests is to assign a score. They offer limited diagnostic information to identify areas for improvement. Users often report feeling judged when tested and fear results might be used for other purposes than skills development.

To achieve the ultimate purpose of assessment - to improve learning and development - we need to answer not only questions on how our teams have learned but also questions on how they learned and why specific results occurred. Thus, an assessment is a far-reaching concept, focalising its efforts on learning, and serving the purpose of enhancement and development through a variety of ways.

Demonstrate the benefits

Firstly, your influencing skills will be tried and tested. There is no doubt that you will have to demonstrate how a skills assessment process can help your organisation with quantifiable benefits.

Linking the skills assessment benefits to a current strategic goal will undoubtedly go a long way towards helping to spark and keep management attention.

The most important benefits typically focus on the company’s recruitment process, efficient use of training budgets, productive skills development plans and optimised project resourcing. The challenges that each business division face might differ, but you will often find they are symbiotically interlinked.

In some cases, it is best practice to identify a ‘pilot’ group within the company first and develop a compelling internal case study before rolling out an assessment plan across your whole organisation. Stay aware of the tangible benefits of each business division. It is not productive for managers to continually fight fires. A successful assessment process shines a light on the root causes of some of the challenges faced. A successful skills assessment plan allows for the necessary course correction to be identified and implemented.

Catalyse improved management with improved data-driven decisions

Make sure you understand how your management team is measured and what their current strategic deliverables are. Connect the outcomes of the assessment programme to the overall metrics that management needs for reporting and to the overall strategic priorities and you will have a better chance of getting approval and buy-in. 

At RTKL – a global architecture, engineering, planning and creative services organisation – HR leadership challenged its BIM management team to source a BIM skills analysis tool to help the firm make smarter, more well-informed data-driven decisions about people’s CAD and BIM skills when resourcing project teams. The team reviewed the market and selected KnowledgeSmart based on reasons described by Andrew Victory, an Associate at RTKL, London, UK.

                              

HR now understands ‘why’ people were hired and provides a high-level view of the firm’s talent base, but historically it has not fully appreciated some of the finer details about CAD and BIM skills. The nature of project-centric resourcing determines that individuals are moved from one project team to another as the workflow rises and falls across a project’s lifecycle, and their BIM skill-levels will critically influence their ability to contribute to their new team. With KnowledgeSmart results and analysis in hand, HR now has perhaps the most comprehensive oversight of all staff and their skills.”

Remember the financial benefits

Remember that a big priority for any successful management team is to show a good return on investment or prove financial benefits. Make sure you illustrate how the outcomes of your proposed assessment plan can lead to those management priorities. 

A quick cost-benefit analysis focusing on one of the following factors could be helpful:
  • the cost to employ inappropriate personnel over a 3-month period the cost of losing top performers (due to lack of recognition, support or training)
  • retaining an under-performing user (due to poor performance management)
  • project productivity gains due to identified performance improvements (being able to deliver on projects faster or with fewer resources

KnowledgeSmart is an invaluable tool for professionals that helps businesses capture knowledge on a wide range of software tools, workflows and, standards. More information is available at www.knowledgesmart.net

Sunday, 11 February 2018

KS Value Proposition - an Explanation

A KS software subscription price is determined by two factors: number of users to be tested (in a year) and number of required library topics to be included in the assessment mix.

There are 4 KS license types:
KS Pro1 - 1 primary library topic, i.e. Revit Architecture
KS Pro2 - 2 primary topics, i.e. Revit Architecture, Revit MEP
KS Pro3 - 3 primary topics, i.e. Revit Architecture, Revit MEP, Revit Structure
KS Enterprise - 4 or more primary topics

We also have different user number bands, to help identify firm size, i.e. 1-25, 26-50, 51-100, 101-250, 251-500, 501-1,000, etc.

For firms who only need to perform a small number of assessments each year, the 'pay-as-you-go' cost is $50/£50/E50 per test.

Before deciding on the best type of KS license, an AEC business should give due consideration to both of these factors.

It is important to establish precisely how many primary test topics they plan to use. If it is 4 (or greater), then KS Enterprise is the best fit. If they want to focus on fewer titles, then perhaps a KS Pro1, Pro2 or Pro3 would be more appropriate. 

Also, we do not monetise 'secondary' library titles, if a customer has invested in one or more 'primary' titles.

Here are some examples:

Primary:
Revit Architecture, Revit MEP, Revit Structure, AutoCAD, Civil 3D, InfraWorks, Plant 3D, Inventor, AECOsim, MicroStation, GEOPAK, InRoads, ProjectWise, ARCHICAD, MS Office, BIM L2, Primavera P6, MS Project, Newforma.

Secondary:
Bluebeam, Design Review, Photoshop, InDesign, Rhino, SketchUp, Navisworks, Glue, Solibri, Vault, Revit Process, BIM Fundamentals, BIM Software Management, BIM Coordination, BIM Authoring, USACE BIM.

To further clarify, a 'test topic' refers to all related assessment titles under an 'umbrella' heading. For example, to assess Revit Architecture  skills for a company would require a KS Pro1 license, but might include the following titles:

Example:
Revit Architecture for occasional users
Revit Architecture fundamentals
Revit Architecture – Xpress 
Revit Architecture advanced
Revit Architecture - Extra questions
Revit Content Creation
Revit for Interiors
Revit Project Process
BIM Authoring with Revit
BIM Software Management (Revit)
BIM Coordination (Revit)
Practical BIM fundamentals
Navisworks
Glue
Solibri
Bluebeam
Vault

If a customer exceeds their user count by a small margin, we tend not to worry about it, and will review their future needs at the license anniversary. If they find their requirements go up by a bigger number (part-way through the license), then we typically have a conversation and sometimes upgrade to the next user band before the anniversary swings around. In this circumstance, they pay the difference between price bands, pro-rated to the license anniversary date. Customers are not blocked from using the tools at any time.

Here are links to the KS product and price pages.

R

Sunday, 4 February 2018

Developing Group Learning Strategies

We talk a lot about collaboration in the AEC industry... particularly in the context of delivering BIM projects.

Group learning, also known as “collaborative learning”, refers to the instructional strategy of having learners work together in groups in order address a task or goal.

The clever folks at efront Learning wrote an articulate and informed blog about developing a better approach to group learning strategies.

By taking a new approach to group learning, AEC businesses can develop an effective strategy to increase employees’ team spirit, collaboration skills, and workplace productivity.

Group learning which includes a mix of mentoring, lunch and learns, classroom training and focused E-learning - backed up with effective skills gap analysis - allows businesses to implement a blended, collaborative learning program that allows employees to study and work together to achieve common goals for themselves and the wider organisation.

R

Tuesday, 23 January 2018

Assessing BIM Skills

I recently read an articulate and informed blog post by Carillion's Technical BIM Lead, John Ford, about the business of measuring BIM skills.

Read the full post here: 'Are we Underestimating the Value of BIM Assessments?'

John makes a number of perceptive points about the organisational and process challenges facing AEC businesses, on their journey to BIM excellence.

There is no 'right or wrong' way to capture useful business intelligence, if it feeds into a wider BIM improvement plan. As Ford points out in his article, there are many effective methods for analysing data and metrics around the topic of BIM experience and capability, both within an organisation and across the wider industry supply chain.

A mix of formal assessment, self-assessment, survey responses, RAG tables and industry certification offer AEC firms all the tools they need, to create a clearer picture of BIM experience and credentials.

KnowledgeSmart has been working consistently in this space for the past 5 years, creating software and library content designed to help AEC businesses measure BIM maturity, skills gaps, training needs and technical expertise.

Here is a link to a recent KS webcast, which provides all the necessary tools and benchmark data for Global AEC businesses to create their own tailored BIM excellence plan.

To slightly misquote management guru, Peter Drucker, 'If you can't measure it, you can't manage it'. Wise words.

R

Wednesday, 25 October 2017

KS Webinar - Demonstrating Individual and Team BIM Level 2 Capability

Earlier today, we recorded our first Webinar to support the upcoming launch of our new KS library material: The presentation is titled, "Demonstrating Individual and Team BIM Level 2 Capability".


The session was co-presented by KnowledgeSmart CEO, Rory Vance, and Evolve Consultancy Principal, Nigel Davies.

The session runs for 45 mins, plus 15 mins delegate Q&A at the end.  Here is the agenda:


The content is aimed at AEC business leadership, BIM professionals and technical management. Here is a link to a recording of the session.

R

Tuesday, 29 August 2017

New Test Title - BIM Level 2

KnowledgeSmart's skills assessment library helps AEC businesses capture evidence of individual and corporate skills capability, across a wide variety of essential technical software titles and business processes.

This includes popular software products from major vendors, including Autodesk, Bentley Systems, Graphisoft, Oracle, Adobe and Microsoft.

One of the most popular requests in recent months has been to create new assessment content for BIM Level 2.

This assessment looks at knowledge of BIM process and policy, across 3 key sections:

1) Understand what is BIM, the contextual requirement for BIM Level 2 and its connection to the Government Construction Strategy and Industrial Strategy 2025.

2) Understand the implications and value proposition of BIM within your organisation.

3) Understand the requirement for the management and exchange of information between supply chain members and clients as described in the 1192 suite of standards and PAS55 / ISO 55000.

The official AEC Industry BIM Learning Outcomes Framework (LOF) document can be downloaded here.

This question set enables AEC businesses to undertake a gap analysis for all staff involved in delivering projects using the Government' s published documents and tools.

Section 1 of the LOF sets out the requirement for an awareness of the industry concerns, the global context, the changes required in communication and collaboration and the relevant standards that address information requirements, contracts, team appointment, project planning, collaboration, roles and responsibilities, data security and operational information requirements.

This assessment is not intended to formally 'certify' BIM knowledge. Rather, to help clarify the understanding of 'why' we should work in this manner and what is needed at project and company levels in order to reduce waste and increase efficiency. This will help to identify further training needs and ensure the project delivery has all the aspects of project management that it needs to succeed.

Applicable to company directors through to project delivery teams, this question set is an ideal start to your BIM implementation business success.

This set of questions has been written in partnership with our friends at Evolve Consultancy and digital green.

R

Sunday, 30 July 2017

New Test Title - MS Excel

KnowledgeSmart's skills assessment library helps AEC businesses capture evidence of individual and corporate skills capability, across a wide variety of essential technical software titles.

This includes popular software products from major vendors, including Autodesk, Bentley Systems, Graphisoft, Oracle, Adobe and Microsoft

One of the most popular requests in recent months has been to create assessment content for MS Excel software.



This assessment looks at knowledge of using MS Project, across a range of core functions. We have written both basic and advanced assessments. Modules covered include:

Excel Fundamentals

Edit Workbooks
Adding and Formatting Charts
File Tasks
Collaborating with others

Excel Advanced

Basic Formulas and Functions
Advanced Formulae and Functions
Pivot Tables and Pivot Charts


This set of questions has been written by our friends at Evolve Consultancy and goes live in August. Later in the year, we will also be adding an assessment for MS Word.

R

Friday, 30 June 2017

New Test Title - MS Project

KnowledgeSmart's skills assessment library helps AEC businesses capture evidence of individual and corporate skills capability, across a wide variety of essential technical software titles.
This includes popular software products from major vendors, including Autodesk, Bentley Systems, Graphisoft, Oracle and Adobe. And now, for the first time, we have added Microsoft to our stable of vendors.


One of the most popular requests in recent months has been to create assessment content for MS Project Management software.


This assessment looks at knowledge of using MS Project, across a range of core functions.

Modules covered include:

- Starting Up and Navigation
- Creating a New Project
- Calendars
- Creating Activities
- Formatting
- Relationships
- Constraints
- Layouts
- Filters
- Scheduling/Setting a Baseline
- Updating an Unresourced Schedule
- User Preferences
- Creating Resources
- Assigning Resources
- Managing Resources
- Organising Project Data
- Security

This set of questions has been written by our friends at Prima Skills and goes live in August.

Later in the year, we will be adding assessment content for MS Excel and MS Word.

R

Friday, 21 April 2017

How To Explain Skills Assessments To Your Teams

A common question asked by KS customers is how to present the topic of skills testing to your teams.

Here is an example of a recent customer mail:

"Do you have experience with encouraging employees to take the assessments? We want to encourage staff without being off-putting or making it seem like the point of the exercise is to determine their tenure within the organization.

What do you think is the best approach to engage our staff? Do you give it a different name besides assessment?

Your assistance is greatly appreciated."



Here is our reply...

The key to your communication is to emphasize the 'What's in it for me?' aspect of the assessments. No-one likes to take tests. As human beings, we'll avoid it where at all possible! But, conversely, people are curious as to how well they are doing. And they want to improve. Also, they don't know what they don't know. Or how they measure up to their peers and wider industry. So you need to focus your message on the training needs side of the learning path. You can't take them on a focused training journey, if you don't know their starting off point.  And you can't assume everyone knows the basics, therefore deserves advanced training. They need to prove it.

When you have a clear firm benchmark, you can also hire more confidently and intelligently. Which is good news for incoming staff and existing teams.

So don't make the assessments optional. This needs to be managed and mandatory, but with a light touch. And the results need to be analysed and fed into a relevant training plan.

Also, people have a natural fear of failure. So make it clear that nothing bad will happen if they screw up. They don't need to feel apprehensive or nervous. This is about positive improvement, not picking on people who happen to have gaps in their knowledge.

And make it clear that the results are confidential. Only to be accessed by people with a position of responsibility for leadership and staff development.

Here is a useful User FAQ guide, which will help you shape your communications in this space:


WHAT IS KNOWLEDGESMART?
KnowledgeSmart is a web-based skills assessment tool, which enables architectural and engineering practices to measure the software skills of their teams. Since 2003, by carrying out in excess of 30,000 individual assessments globally, a helpful independent benchmark has been established for basic proficiency, across a range of subjects.

Here is a microsite which provides helpful industry benchmark data for our Top 5 skills assessment topics: http://www.2dim4bim.com.

The KnowledgeSmart tools help to identify skills associated with design and engineering software applications, such as AutoCAD, Civil 3D, Plant 3D, Revit, Inventor, MicroStation, ProjectWise, 3ds Max, ArchiCAD, Primavera P6, Adobe Photoshop, Adobe InDesign, SketchUp and Rhino. The process aims to assess current performance in order to identify areas where individuals can benefit from additional training.


WHAT IS THE POINT OF KNOWLEDGESMART AND WHY SHOULD I DO IT?
This process is not about a big-brother style test to check up on unsuspecting users. Nor is it a matter of pointing out who is the more knowledgeable software user. Rather, the point of the exercise is to highlight how much each individual currently knows – in order to identify those areas where focused training can improve basic knowledge.

Everyone uses software in a different way. Some people use these tools full time in their role; others may only use the tools from time to time. The objective is not to teach a veteran user how to perform basic tasks. But the fact remains, a more detailed knowledge of basic commands and operations can alleviate apprehension in using technical software applications and assist in speeding up routine tasks.

IS IT THE SAME ASSESSMENT FOR EVERYONE?
There are a number of assessment modules to choose from, created by a team of expert authors. Firms can also create their own material in-house. For Revit skills, as an example, there is a choice of material, ranging from introductory level, all the way up to more advanced concepts. Summary reports take into consideration whether an individual is a full time user, or someone who only uses the software occasionally as part of a wider role. Follow-up comparisons and training recommendations should be reflected accordingly.

WHAT KIND OF TOPICS DOES EACH ASSESSMENT COVER?
KnowledgeSmart assessments typically break down complex technical software applications into a series of stages or modules.
For example, the fundamentals assessments (for AutoCAD & MicroStation) cover a range of basic commands, including; basic object/element creation, layers/levels, blocks/cells, annotation, referencing & printing, UCS/ACS and preferences.

Assessments typically comprise 20-30 questions and present scores as a percentage, based on the accuracy of the answers presented. There are 2 question types and 9 question styles. Question types are either task-based (i.e. you need to perform a task using the software in order to work out the answer) or knowledge-based (i.e. you are being evaluated on your understanding of certain software functions, without having to actually use the tools). Question styles include; Free text, Multiple choice, Pick list, Order list, True or false, Complete the blank, Matching list, Matrix and Essay.

WHAT IF I DO NOT SCORE VERY WELL?
This exercise is not about who is the best. You will identify areas where you can improve your own performance with the help of more targeted training workshops.
Following the assessment everyone receives an overall result and summary report with feedback on dropped marks, training recommendations and coaching notes.

WHEN AND WHERE WILL THE ASSESSMENT TAKE PLACE?
Your administrator will have details of your assessment program. If you are unavailable to make the date or time arranged please contact your administrator to reschedule.

HOW LONG DOES IT TAKE?
There is no limit to how long the exercise will take. The average time is approximately an hour, but this is not a strict rule.
Try to work at your usual speed. Don’t rush, as many simple mistakes are made by people not reading the instructions carefully. Conversely, don’t take too long to complete each task, as your score plus time taken will be looked at in the overall results analysis.

WHEN DO I GET MY RESULT?
You will receive your score straight away when you finish the assessment. You may also be emailed with a link to your assessment report, including feedback on any marks which have been dropped.

ADDITIONAL INFORMATION
The amount of time you take will not affect the accuracy of your score.
Before you start, you may be presented with a zip folder containing files which you’ll need to refer to during your assessment. Save the zip folder locally on your machine and extract the sample data sets from the zip. And remember where you save it – as you will need to navigate back to this folder during your assessment!
Please read the written instructions carefully for each question. This is also an assessment of your ability to follow instructions. Often, marks are dropped through candidates simply not doing what they have been asked to do.
During your assessment session, you can answer the questions in any order, using the KnowledgeSmart question navigator. You can also edit your answers during the session and review your work once more at the end, before you select Finish.
The time taken to complete an assessment varies depending on the individual, but an average is about an hour. You don’t have to complete the assessment in one sitting; you can log out and return later if you prefer. When you resume, your previous answers will have been saved.


R

Friday, 31 March 2017

New Test Title - Oracle Primavera P6

KnowledgeSmart's extensive skills assessment library helps AEC businesses capture evidence of individual and corporate skills capability, across a wide variety of essential technical software titles.
This includes popular software products from major vendors, including Autodesk, Bentley Systems, Graphisoft and Adobe. And now, for the first time, we have added Oracle to our stable of vendors.



One of the most popular requests in recent months has been to create assessment content for Project Management software. Starting with Oracle's Primavera P6 tool.



This assessment looks at knowledge of using Primavera P6, across a range of core functions.

Modules covered include:

- Starting Up and Navigation
- Creating a New Project
- Calendars
- WBS Nodes
- Creating Activities
- Formatting
- Relationships
- Constraints
- Layouts
- Filters
- Scheduling/Setting a Baseline
- Updating an Unresourced Schedule
- User Preferences
- Creating Resources
- Assigning Resources
- Managing Resources
- Organising Project Data
- Security

This set of questions has been written by our friends at Prima Skills and goes live in April.

R

Tuesday, 26 April 2016

How Good Are Engineers at Using Revit Structure?

With the global adoption of Building Information Modelling (BIM) well underway, it is a huge challenge for Engineering businesses to manage the change in their project delivery processes from more conventional drawing production environments, to that of virtual design, clash detection and 'intelligent' modelling.

Looking at the global AEC picture, it is clear that the commercial software application adopted by a wide majority of the world's Structural Engineering firms, as their modelling tool of choice, is Autodesk's Revit Structure platform.

In recent years, KnowledgeSmart's online skills assessment software platform has captured test scores from thousands of Engineers, representing hundreds of firms, spread across six continents and a couple of dozen countries.

We have analysed the results data generated from these live assessments, at a basic skills level, and noted the following trends. For this particular study, the majority of our data is generated in the USA, UK, Canada and Australia (in that order).

A simple key to interpret the data below:

Str Eng = Job Title
RST = Revit Structure
1 to 5 = 1 to 5 years' experience using the tool
6 to 10 = 6 to 10 years' experience using the tool
Regular = use the tool daily (or almost daily)
Occasional = use the tool weekly (or less than weekly)
Self taught = learned to use the tool primarily 'on the job'
Formal = learned to the tool primarily via formal classroom or online training
All = overall KS benchmark data
AUS = Australia
CAN = Canada
UK = UK
USA = USA


Here is a summary of the results presented by different types of Engineers.

Overall

RST Fundamentals score overall: 67.1% in 4320 s

Str Eng/RST/1 to 5/regular/self taught/All = 59.3% in 4854 s
Str Eng/RST/1 to 5/regular/formal/All = 58.2% in 4738 s
Str Eng/RST/6 to 10/regular/self taught/All = 68.3% in 4141 s
Str Eng/RST/6 to 10/regular/formal/All = 67.4% in 4372 s

Str Eng/RST/1 to 5/occasional/self taught/All = 55.2% in 5353 s
Str Eng/RST/1 to 5/occasional/formal/All = 54.5% in 5244 s
Str Eng/RST/6 to 10/occasional/self taught/All = 63.3% in 4967 s
Str Eng/RST/6 to 10/occasional/formal/All = 62.5% in 4777 s

Australia

RST Fundamentals score Australia: 68.7% in 4191 s

Str Eng/RST/1 to 5/regular/self taught/US = 59.4% in 4786 s
Str Eng/RST/1 to 5/regular/formal/US = 58.0% in 4553 s
Str Eng/RST/6 to 10/regular/self taught/US = 68.6% in 4003 s
Str Eng/RST/6 to 10/regular/formal/US = 67.2% in 3967 s
 
Str Eng/RST/1 to 5/occasional/self taught/US = 53.4% in 4822 s
Str Eng/RST/1 to 5/occasional/formal/US = 52.0% in 4687 s
Str Eng/RST/6 to 10/occasional/self taught/US = 59.6% in 4566 s
Str Eng/RST/6 to 10/occasional/formal/US = 58.7 in 4330 s

Canada

RST Fundamentals score Canada: 72.4% in 3886 s

Str Eng/RST/1 to 5/regular/self taught/US = 63.4% in 4378 s
Str Eng/RST/1 to 5/regular/formal/US = 61.6% in 4233 s
Str Eng/RST/6 to 10/regular/self taught/US = 72.6% in 3717 s
Str Eng/RST/6 to 10/regular/formal/US = 71.4% in 3578 s
 
Str Eng/RST/1 to 5/occasional/self taught/US = 58.1% in 4516 s
Str Eng/RST/1 to 5/occasional/formal/US = 56.7% in 4439 s
Str Eng/RST/6 to 10/occasional/self taught/US = 63.6% in 4248 s
Str Eng/RST/6 to 10/occasional/formal/US = 62.5% in 4036 s

UK

RST Fundamentals score UK: 71.1% in 4887 s

Str Eng/RST/1 to 5/regular/self taught/US = 62.2% in 5343 s
Str Eng/RST/1 to 5/regular/formal/US = 60.6% in 5154 s
Str Eng/RST/6 to 10/regular/self taught/US = 71.3% in 4673 s
Str Eng/RST/6 to 10/regular/formal/US = 70.1% in 4491 s
 
Str Eng/RST/1 to 5/occasional/self taught/US = 58.4% in 5616 s
Str Eng/RST/1 to 5/occasional/formal/US = 56.9% in 5552 s
Str Eng/RST/6 to 10/occasional/self taught/US = 62.6% in 5254 s
Str Eng/RST/6 to 10/occasional/formal/US = 61.7% in 4987 s

USA

RST Fundamentals score USA: 73.7% in 4218 s

Str Eng/RST/1 to 5/regular/self taught/US = 64.6% in 4843 s
Str Eng/RST/1 to 5/regular/formal/US = 62.9% in 4661 s
Str Eng/RST/6 to 10/regular/self taught/US = 73.8% in 4073 s
Str Eng/RST/6 to 10/regular/formal/US = 72.1% in 3891 s
 
Str Eng/RST/1 to 5/occasional/self taught/US = 59.3% in 4916 s
Str Eng/RST/1 to 5/occasional/formal/US = 57.9% in 4856 s
Str Eng/RST/6 to 10/occasional/self taught/US = 64.8% in 4668 s
Str Eng/RST/6 to 10/occasional/formal/US = 63.7% in 4448 s


Observations

All four territories in this study are mature markets, in terms of Revit adoption. 

Each country has an established Autodesk Training Centre market, offering high quality learning and development opportunities and consultancy. 

Each country has a pool of further education colleges, community colleges and universities, many of whom teach technical software skills as part of courses in the built environment. 

Each country is well supported by professional bodies and information-rich conference series', such as BIM Forum, RTC, AU, BIM Day Out and BIM Show Live.

Overall, regular users are more accurate and faster than part-time users.

Engineers with 6 to 10 years' of experience with these tools are the most efficient. They reach a plateau in performance after c. 7 years and make no further productivity gains.

Engineers who learn to apply these tools on projects are more accurate than those who have primarily formal training, but less practical experience. Formally trained users are faster overall than self-taught users.

R

Friday, 11 March 2016

How Good Are Engineers at Using Revit MEP?

With the global adoption of Building Information Modelling (BIM) well underway, it is a huge challenge for Engineering businesses to manage the change in their project delivery processes from more conventional drawing production environments, to that of virtual design, clash detection and 'intelligent' modelling.

Looking at the global AEC picture, it is clear that the commercial software application adopted by a wide majority of the world's MEP Engineering firms, as their modelling tool of choice, is Autodesk's Revit MEP platform.

In recent years, KnowledgeSmart's online skills assessment software platform has captured test scores from thousands of Engineers, representing hundreds of firms, spread across six continents and a couple of dozen countries.

We have analysed the results data generated from these live assessments, at a basic skills level, and noted the following trends. For this particular study, the majority of our data is generated in the USA, UK, Canada and Australia (in that order).

A simple key to interpret the data below:

MEP Eng = Job Title
RMEP = Revit MEP
1 to 5 = 1 to 5 years' experience using the tool
6 to 10 = 6 to 10 years' experience using the tool
Regular = use the tool daily (or almost daily)
Occasional = use the tool weekly (or less than weekly)
Self taught = learned to use the tool primarily 'on the job'
Formal = learned to the tool primarily via formal classroom or online training
All = overall KS benchmark data
AUS = Australia
CAN = Canada
UK = UK
USA = USA


Here is a summary of the results presented by different types of Engineers.

Overall

RMEP Fundamentals score overall: 66.3% in 4084 s

MEP Eng/RMEP/1 to 5/regular/self taught/All = 58.6% in 4771 s
MEP Eng/RMEP/1 to 5/regular/formal/All = 57.7% in 4626 s
MEP Eng/RMEP/6 to 10/regular/self taught/All = 67.1% in 4188 s
MEP Eng/RMEP/6 to 10/regular/formal/All = 66.4% in 4111 s
MEP Eng/RMEP/1 to 5/occasional/self taught/All = 53.3% in 5146 s
MEP Eng/RMEP/1 to 5/occasional/formal/All = 52.8% in 5025 s
MEP Eng/RMEP/6 to 10/occasional/self taught/All = 61.3% in 4644 s
MEP Eng/RMEP/6 to 10/occasional/formal/All = 60.4% in 4561 s

Australia

RMEP Fundamentals score Australia: 66.7% in 4079 s

MEP Eng/RMEP/1 to 5/regular/self taught/AUS = 57.8% in 4971 s
MEP Eng/RMEP/1 to 5/regular/formal/AUS = 57.0% in 4786 s
MEP Eng/RMEP/6 to 10/regular/self taught/AUS = 66.8% in 4006 s
MEP Eng/RMEP/6 to 10/regular/formal/AUS = 65.9% in 3768 s
 
MEP Eng/RMEP/1 to 5/occasional/self taught/AUS = 53.7% in 5116 s
MEP Eng/RMEP/1 to 5/occasional/formal/AUS = 52.6% in 4910 s
MEP Eng/RMEP/6 to 10/occasional/self taught/AUS = 59.8% in 4557 s
MEP Eng/RMEP/6 to 10/occasional/formal/AUS = 58.7% in 4388 s

Canada

RMEP Fundamentals score Canada: 68.1% in 4391 s

MEP Eng/RMEP/1 to 5/regular/self taught/CAN = 60.5% in 4835 s
MEP Eng/RMEP/1 to 5/regular/formal/CAN = 58.8% in 4754 s
MEP Eng/RMEP/6 to 10/regular/self taught/CAN = 68.6% in 4272 s
MEP Eng/RMEP/6 to 10/regular/formal/CAN = 67.3% in 4113 s
MEP Eng/RMEP/1 to 5/occasional/self taught/CAN = 55.3% in 5002 s
MEP Eng/RMEP/1 to 5/occasional/formal/CAN = 54.2% in 4849 s
MEP Eng/RMEP/6 to 10/occasional/self taught/CAN = 62.2% in 4458 s
MEP Eng/RMEP/6 to 10/occasional/formal/CAN = 61.4% in 4367 s

UK

RMEP Fundamentals score UK: 69.4% in 3705 s

MEP Eng/RMEP/1 to 5/regular/self taught/UK = 61.2% in 4216 s
MEP Eng/RMEP/1 to 5/regular/formal/UK = 60.6% in 4011 s
MEP Eng/RMEP/6 to 10/regular/self taught/UK = 69.5% in 3665 s
MEP Eng/RMEP/6 to 10/regular/formal/UK = 68.5% in 3487 s
 
MEP Eng/RMEP/1 to 5/occasional/self taught/UK = 56.2% in 4558 s
MEP Eng/RMEP/1 to 5/occasional/formal/UK = 54.3% in 4543 s
MEP Eng/RMEP/6 to 10/occasional/self taught/UK = 62.4% in 4313 s
MEP Eng/RMEP/6 to 10/occasional/formal/UK = 61.6% in 4282 s

USA

RMEP Fundamentals score USA: 67.3% in 4046 s

MEP Eng/RMEP/1 to 5/regular/self taught/US = 59.6% in 4632 s
MEP Eng/RMEP/1 to 5/regular/formal/US = 57.8% in 4411 s
MEP Eng/RMEP/6 to 10/regular/self taught/US = 67.6% in 3933 s
MEP Eng/RMEP/6 to 10/regular/formal/US = 66.7% in 3731 s
 
MEP Eng/RMEP/1 to 5/occasional/self taught/US = 55.1% in 4806 s
MEP Eng/RMEP/1 to 5/occasional/formal/US = 53.2% in 4723 s
MEP Eng/RMEP/6 to 10/occasional/self taught/US = 60.8% in 4543 s
MEP Eng/RMEP/6 to 10/occasional/formal/US = 59.7% in 4368 s


Observations

All four territories in this study are mature markets, in terms of Revit adoption. 

Each country has an established Autodesk Training Centre market, offering high quality learning and development opportunities and consultancy. 

Each country has a pool of further education colleges, community colleges and universities, many of whom teach technical software skills as part of courses in the built environment. 

Each country is well supported by professional bodies and information-rich conference series', such as BIM Forum, RTC, AU, BIM Day Out and BIM Show Live.

Overall, regular users are more accurate and faster than part-time users.

Engineers with 6 to 10 years' of experience with these tools are the most efficient. They reach a plateau in performance after c. 7 years and make no further productivity gains.

Engineers who learn to apply these tools on projects are more accurate than those who have primarily formal training, but less practical experience. Formally trained users are faster overall than self-taught users.

R

Saturday, 27 February 2016

How Good Are Architects at Using MicroStation?

Architects around the world have been using 2D draughting tools on live projects for over 20 years.  One of the most popular applications for design firms is Bentley Systems' MicroStation platform.

In recent years, KnowledgeSmart's online skills assessment software platform has captured test scores from thousands of Architects, representing hundreds of design firms, spread across six continents and a couple of dozen countries.

We have analysed the results data generated from these live assessments, at a basic skills level, and noted the following trends. For this particular study, the majority of our data is generated in the UK, USA, Australia and Canada (in that order).

A simple key to interpret the data below:

Architect = Job Title
MicroStation = MicroStation 2D skills
1 to 5 = 1 to 5 years' experience using the tool
6 to 10 = 6 to 10 years' experience using the tool
11 to 15 = 11 to 15 years' experience using the tool
Regular = use the tool daily (or almost daily)
Occasional = use the tool weekly (or less than weekly)
Self taught = learned to use the tool primarily 'on the job'
Formal = learned to the tool primarily via formal classroom or online training
All = overall KS benchmark data
AUS = Australia
CAN = Canada
UK = UK
USA = USA

Here is a summary of the results presented by different types of Architects.

Overall

MicroStation score overall: 59.3% in 5040 secs

Architect/MicroStation/1 to 5/regular/self taught/all = 53.8% in 5249 secs
Architect/MicroStation/1 to 5/regular/formal/all = 53.1% in 5131 secs
Architect/MicroStation/6 to 10/regular/self taught/all = 60.4% in 4974 secs
Architect/MicroStation/6 to 10/regular/formal/all = 59.9% in 4854 secs
Architect/MicroStation/11 to 15/regular/self taught/all = 59.7% in 4824 secs
Architect/MicroStation/11 to 15/regular/formal/all = 59.3% in 4754 secs

Architect/MicroStation/1 to 5/occasional/self taught/all = 49.5% in 5657 secs
Architect/MicroStation/1 to 5/occasional/formal/all = 48.8% in 5520 secs
Architect/MicroStation/6 to 10/occasional/self taught/all = 55.3% in 5309 secs
Architect/MicroStation/6 to 10/occasional/formal/all = 55.2% in 5267 secs
Architect/MicroStation/11 to 15/occasional/self taught/all = 55.8% in 5278 secs
Architect/MicroStation/11 to 15/occasional/formal/all = 55.1% in 5222 secs

Australia

MicroStation score Australia: 58.7% in 4873 secs

Architect/MicroStation/1 to 5/regular/self taught/AUS = 53.6% in 5201 secs
Architect/MicroStation/1 to 5/regular/formal/AUS = 53.0% in 5160 secs
Architect/MicroStation/6 to 10/regular/self taught/AUS = 59.2% in 4954 secs
Architect/MicroStation/6 to 10/regular/formal/AUS = 58.8% in 4889 secs
Architect/MicroStation/11 to 15/regular/self taught/AUS = 58.8% in 4876 secs
Architect/MicroStation/11 to 15/regular/formal/AUS = 58.2% in 4565 secs

Architect/MicroStation/1 to 5/occasional/self taught/AUS = 48.1% in 5595 secs
Architect/MicroStation/1 to 5/occasional/formal/AUS = 47.3% in 5476 secs
Architect/MicroStation/6 to 10/occasional/self taught/AUS = 54.9% in 5212 secs
Architect/MicroStation/6 to 10/occasional/formal/AUS = 54.2% in 5131 secs
Architect/MicroStation/11 to 15/occasional/self taught/AUS = 55.2% in 5152 secs
Architect/MicroStation/11 to 15/occasional/formal/AUS = 54.4% in 5059 secs

Canada

MicroStation score Canada: 57.7% in 5172 secs

Architect/MicroStation/1 to 5/regular/self taught/CAN = 52.7% in 5421 secs
Architect/MicroStation/1 to 5/regular/formal/CAN = 52.6% in 5387 secs
Architect/MicroStation/6 to 10/regular/self taught/CAN = 58.2% in 5178 secs 
Architect/MicroStation/6 to 10/regular/formal/CAN = 57.8% in 5102 secs
Architect/MicroStation/11 to 15/regular/self taught/CAN = 58.3% in 5046 secs
Architect/MicroStation/11 to 15/regular/formal/CAN = 57.6% in 5012 secs

Architect/MicroStation/1 to 5/occasional/self taught/CAN = 47.4% in 5754 secs
Architect/MicroStation/1 to 5/occasional/formal/CAN = 46.8% in 5632 secs
Architect/MicroStation/6 to 10/occasional/self taught/CAN = 54.6% in 5512 secs
Architect/MicroStation/6 to 10/occasional/formal/CAN = 53.8% in 5466 secs
Architect/MicroStation/11 to 15/occasional/self taught/CAN = 55.1% in 5432 secs

Architect/MicroStation/11 to 15/occasional/formal/CAN = 54.7% in 5313 secs


UK

MicroStation score UK: 61.3% in 4859 secs

Architect/MicroStation/1 to 5/regular/self taught/UK = 55.5% in 5285 secs
Architect/MicroStation/1 to 5/regular/formal/UK = 55.1% in 5222 secs
Architect/MicroStation/6 to 10/regular/self taught/UK = 61.5% in 4862 secs
Architect/MicroStation/6 to 10/regular/formal/UK = 61.1% in 4828 secs
Architect/MicroStation/11 to 15/regular/self taught/UK = 61.3% in 4901 secs
Architect/MicroStation/11 to 15/regular/formal/UK = 60.8% in 4788 secs

Architect/MicroStation/1 to 5/occasional/self taught/UK = 49.7% in 5456 secs
Architect/MicroStation/1 to 5/occasional/formal/UK = 49.1% in 5402 secs
Architect/MicroStation/6 to 10/occasional/self taught/UK = 56.3% in 5232 secs
Architect/MicroStation/6 to 10/occasional/formal/UK = 55.6% in 5179 secs
Architect/MicroStation/11 to 15/occasional/self taught/UK = 56.7% in 5143 secs
Architect/MicroStation/11 to 15/occasional/formal/UK = 55.8% in 5056 secs

USA

MicroStation score USA: 59.2% in 5374 secs

Architect/MicroStation/1 to 5/regular/self taught/US = 54.2% in 5767 secs
Architect/MicroStation/1 to 5/regular/formal/US = 53.6% in 5647 secs
Architect/MicroStation/6 to 10/regular/self taught/US = 59.6% in 5387 secs
Architect/MicroStation/6 to 10/regular/formal/US = 59.2 in 5322 secs
Architect/MicroStation/11 to 15/regular/self taught/US = 59.5% in 5278 secs
Architect/MicroStation/11 to 15/regular/formal/US = 59.2% in 5166 secs

Architect/MicroStation/1 to 5/occasional/self taught/US = 48.4% in 5767 secs
Architect/MicroStation/1 to 5/occasional/formal/US = 47.7% in 5665 secs
Architect/MicroStation/6 to 10/occasional/self taught/US = 55.1% in 5489 secs
Architect/MicroStation/6 to 10/occasional/formal/US = 54.8% in 5447 secs 
Architect/MicroStation/11 to 15/occasional/self taught/US = 55.6% in 5420 secs
Architect/MicroStation/11 to 15/occasional/formal/US = 55.1% in 5391 secs


Observations

All four territories in this study are mature markets, in terms of MicroStation adoption. 

Each country is an established Bentley Systems' market, with a high quality learning and development environment and vendor consultancy support. 

Each country is well supported by professional bodies, AEC industry conferences and established vendor user community groups and online resources.

Overall, regular users are more accurate and faster than part-time users.

Architects with 6 to 10 years' of experience with these tools are the most efficient. They reach a plateau in performance after c. 7 years and make no further productivity gains.

Architects who learn to apply these tools on projects are more accurate than those who have primarily formal training, but less practical experience. Formally trained users are faster overall than self-taught users.


R