Showing posts with label Revit training needs. Show all posts
Showing posts with label Revit training needs. Show all posts

Saturday, 23 January 2016

Revit MEP Test Scores Around The World

Autodesk Revit is building information modeling software for architects, structural engineers, MEP engineers, designers and contractors. It allows users to design a building and structure and its components in 3D, annotate the model with 2D drafting elements, and access building information from the building model's database. Revit is 4D BIM capable with tools to plan and track various stages in the building's lifecycle, from concept to construction and later demolition.

Over the years, KnowledgeSmart has captured test scores for thousands of Revit MEP users, in multiple countries across the globe.

Here are the variances in our overall benchmark data, from 2013 to 2015. (For the first couple of years, the data was combined into an overall value):

2013
Average Score: 65.0%
Average Time: 1 hr 16 mins

2014
Average Score: 66.0%
Average Time: 1 hr 12 mins

2015
Electrical

Average Score: 63.7%
Average Time: 1 hr 6 mins


Mechanical
Average Score: 62.2%
Average Time: 1 hr 7 mins


Plumbing
Average Score: 70.1%
Average Time: 1 hr 11 mins



Let's take a look at some overall aggregate score and time data on a country vs country basis. Numbers of test scores vary, so this list does not imply that one country is 'better' than another. It's interesting to see what kind of data is generated in different parts of the globe.

Revit MEP Fundamentals - Electrical


Country  Score (%)   Time (secs)
Australia 67.7 3683.0
Bahrain 58.7 5031.1
Canada 66.8 4008.6
Hong Kong 65.9 4071.9
India 57.1 3770.5
Kuwait 53.7 4280.8
New Zealand 71.8 3487.1
Oman 56.5 4855.6
Pakistan 53.1 3872.2
Philippines 59.9 3136.8
Qatar 55.0 3505.2
Saudi Arabia 58.7 3716.6
Singapore 66.1 4765.1
UAE 60.3 3715.4
UK 67.7 3525.3
USA 65.7 4143.9


Revit MEP Fundamentals - Mechanical

Country  Score (%)   Time (secs)
Australia 65.9 4176.4
Bahrain 57.6 4365.4
Canada 64.2 4787.8
Hong Kong 62.7 4034.4
India 58.0 4467.4
Kuwait 56.6 4576.7
New Zealand 71.2 3413.3
Oman 54.4 5123.5
Pakistan 51.1 4176.6
Philippines 56.0 3663.3
Qatar 58.1 3687.7
Saudi Arabia 60.1 4245.6
Singapore 65.7 4838.3
UAE 58.0 3822.4
UK 68.3 3516.3
USA 66.3 4076.4


Revit MEP Fundamentals - Plumbing

Country  Score (%)   Time (secs)
Australia 69.7 4378.4
Bahrain 64.3 4897.1
Canada 73.4 3597.5
Hong Kong 73.1 4346.1
India 63.8 3951.8
Kuwait 58.8 4020.0
New Zealand 73.2 4132.9
Oman 59.8 4676.4
Pakistan 60.5 4876.3
Philippines 67.6 3176.7
Qatar 58.7 4899.4
Saudi Arabia 67.8 4346.7
Singapore 74.1 4343.3
UAE 67.8 3984.0
UK 72.8 3474.5
USA 69.9 3919.5


We also capture data on a per State basis, for our US customers. The list below represents those States where the volume of data makes for meaningful data sharing.


Revit MEP Fundamentals - Electrical

State Score (%)   Time (secs)
USA all 65.7 4143.9
Arizona 63.7 3956.7
California 67.7 4697.8
Colorado 71.5 4234.5
Florida 73.2 4212.5
Georgia 68.5 3790.7
Illinois 68.1 5212.2
Louisiana 62.2 3987.5
Michigan 65.8 3887.4
North Carolina 62.3 4960.0
Oregon 58.7 4345.9
Pennsylvania 65.0 3803.8
Texas 68.8 3806.8
Utah 64.8 4234.8
Virginia 61.3 4340.0


Revit MEP Fundamentals - Mechanical


State Score (%)   Time (secs)
USA all 66.3 4076.4
Alabama 64.2 3815.4
Arizona 61.1 3595.0
California 72.5 5092.5
Colorado 72.4 5051.2
Florida 69.1 3531.4
Georgia 70.7 4470.8
Illinois 64.4 3424.2
Kentucky 65.0 3765.9
Louisiana 65.5 3815.3
Maryland 63.1 3402.5
Michigan 69.4 3580.1
Missouri 72.0 3920.4
North Carolina 59.7 4268.9
Ohio 73.2 3880.0
Oregon 63.0 4022.0
Pennsylvania 63.3 3769.6
Tennessee 65.9 5410.0
Texas 67.1 3522.5
Utah 66.7 4237.7
Virginia 61.0 3950.1
Washington 71.1 4326.6
Wisconsin 66.5 4345.3


Revit MEP Fundamentals - Plumbing

State Score (%)   Time (secs)
USA all 69.9 3919.5
Arizona 68.0 3315.0
California 74.7 4693.4
Colorado 71.5 4234.5
Florida 73.7 4252.7
Georgia 73.0 4132.2
Illinois 67.9 3822.2
Louisiana 67.6 3987.5
Michigan 71.1 3619.9
North Carolina 65.7 4268.9
Oregon 62.2 4205.5
Pennsylvania 69.8 3769.6
Texas 72.0 4374.4
Utah 69.7 4167.8
Virginia 63.3 4123.3


Revit MEP Advanced


2015
Mechanical
Average Score: 56.0%
Average Time: 1 hr 3 mins


Plumbing
Average Score: 57.0%
Average Time: 1 hr 6 mins



Revit MEP is a Top 5 KS test topic, across our global customers. The impact of BIM on the AEC industry is significant and Revit is the dominant design tool, in terms of overall market share and breadth of supply chain resources.

R

Friday, 15 January 2016

Revit Structure Test Scores Around The World

Autodesk Revit is building information modeling software for architects, structural engineers, MEP engineers, designers and contractors. It allows users to design a building and structure and its components in 3D, annotate the model with 2D drafting elements, and access building information from the building model's database. Revit is 4D BIM capable with tools to plan and track various stages in the building's lifecycle, from concept to construction and later demolition.

Over the years, KnowledgeSmart has captured test scores for thousands of Revit Structure users, in multiple countries across the globe.

Here are the variances in our overall benchmark data, from 2012 to 2015:

2012
Average Score: 62.0%
Average Time: 1 hr 6 mins

2013
Average Score: 63.0%
Average Time: 1 hr 4 mins

2014
Average Score: 64.0%
Average Time: 1 hr 2 mins

2015
Average Score: 67.1%
Average Time: 1 hr 12 mins


Let's take a look at some overall aggregate score and time data on a country vs country basis. Numbers of test scores vary, so this list does not imply that one country is 'better' than another. It's interesting to see what kind of data is generated in different parts of the globe.

Revit Structure Fundamentals


Country  Score (%)   Time (secs)
Australia 68.7 4191.2
Canada 72.4 3886.3
Denmark 70.0 4375.0
Hong Kong 72.2 5414.2
India 62.4 4231.5
New Zealand 67.4 3891.7
Pakistan 64.4 3725.0
Philippines 67.5 3587.5
Poland 63.7 3537.5
Qatar 57.7 3521.5
Saudi Arabia 67.5 3927.5
Singapore 60.8 3775.6
South Africa 63.7 3582.5
UAE 63.0 5095.9
UK 71.1 4887.5
USA 73.7 4218.2

We also capture data on a per State basis, for our US customers. The list below represents those States where the volume of data makes for meaningful data sharing.


State Score (%)   Time (secs)
USA all 73.7 4218.2
California 80.3 3531.0
Colorado 74.0 4210.0
Florida 78.3 4033.8
Georgia 69.8 4323.0
Illinois 80.5 5365.0
Missouri 81.7 4093.9
New York 73.0 5067.5
Oregon 75.4 5197.0
Tennessee 67.5 3327.5
Texas 68.3 3857.5
Virginia 63.5 3595.0


Revit Structure Advanced

2015
Average Score: 57.2%
Average Time: 1 hr 4 mins


Country  Score (%)   Time (secs)
Australia 61.5 4465.3
Canada 62.4 4665.6
Egypt 62.3 3563.3
Hong Kong 54.3 4433.6
India 51.4 3738.8
New Zealand 59.5 3700.9
Qatar 52.5 4800.8
South Africa 53.0 1950.0
UAE 54.8 4182.5
UK 63.7 3905.7
USA 64.6 4598.1


State Score (%)   Time (secs)
USA all 64.6 4598.1
California 66.4 5435.0
Colorado 63.3 4365.7
Florida 63.0 4542.0
Georgia 66.0 4595.1
Illinois 63.4 4365.6
Pennsylvania 68.3 4623.4
Tennessee 63.6 4242.5
Texas 62.5 4607.5


Revit Structure is a Top 5 KS test topic, across our global customers. The impact of BIM on the AEC industry is significant and Revit is the dominant design tool, in terms of overall market share and breadth of supply chain resources.

R

Wednesday, 13 January 2016

Revit Architecture Test Scores Around The World

Autodesk Revit is building information modeling software for architects, structural engineers, MEP engineers, designers and contractors. It allows users to design a building and structure and its components in 3D, annotate the model with 2D drafting elements, and access building information from the building model's database. Revit is 4D BIM capable with tools to plan and track various stages in the building's lifecycle, from concept to construction and later demolition.

Over the years, KnowledgeSmart has captured test scores for thousands of Revit Architecture users, in multiple countries across the globe.

Here are the variances in our overall benchmark data, from 2010 to 2015:

2010
Average Score: 63.0%
Average Time: 1 hr 11 mins

2011
Average Score: 65.0%
Average Time: 1 hr 15 mins

2012
Average Score: 69.0%
Average Time: 1 hr 5 mins

2013
Average Score: 69%
Average Time: 1 hr 3 mins

2014
Average Score: 70.0%
Average Time: 1 hr 1 mins

2015
Average Score: 68.5%
Average Time: 1 hr 8 mins


Let's take a look at some overall aggregate score and time data on a country vs country basis. Numbers of test scores vary, so this list does not imply that one country is 'better' than another. It's interesting to see what kind of data is generated in different parts of the globe.

Revit Architecture Fundamentals

Country Score (%)  Time (secs)
Australia 69.4 4736.5
Bahrain 73.2 4493.3
Canada 70.1 4341.4
China 63.5 6178.3
Egypt 68.1 4290.2
Hong Kong 73.5 5096.3
India 48.4 4555.6
Ireland 69.8 4053.8
Italy 73.0 4620.8
Kuwait 73.7 3951.8
New Zealand 74.2 4902.1
Nigeria 71.1 4778.6
Oman 49.3 3660.0
Pakistan 48.0 4459.0
Philippines 53.4 4238.6
Poland 74.0 4305.0
Portugal 67.6 5695.0
Qatar 69.0 4910.8
Saudi Arabia 70.7 4094.4
Singapore 74.5 4788.7
South Africa 66.8 4278.5
South Korea 64.0 4321.3
Spain 65.3 4454.6
Sweden 68.0 4615.0
UAE 66.4 5183.1
UK 73.6 4783.2
USA 72.4 4671.5
Vietnam 71.9 4513.5


We also capture data on a per State basis, for our US customers. The list below represents those States where the volume of data makes for meaningful data sharing.

State Score (%)  Time (secs)
USA all 72.4 4671.5
Arizona 70.9 3581.7
Arkansas 66.0 3185.0
California 73.6 6101.1
Colorado 66.0 3333.8
District of Columbia 74.9 3995.6
Florida 67.2 4197.8
Georgia 70.3 6449.2
Hawaii 77.5 6622.5
Illinois 77.1 4888.4
Kansas 77.3 3731.7
Maryland 70.8 3986.0
Massachusetts 62.0 4268.3
Michigan 77.8 4113.8
Minnesota 76.2 4648.2
Mississippi 70.1 6366.9
Missouri 74.0 5197.3
New Jersey 76.0 3624.2
New York 75.1 5617.6
North Carolina 69.6 4462.7
Ohio 72.6 5928.0
Oregon 71.0 3861.7
Pennsylvania 75.9 3387.8
South Carolina 64.0 5235.8
Texas 74.3 5242.4
Utah 74.0 5515.1
Virginia 75.0 4322.5
Washington 68.0 4265.8


Revit Architecture Advanced

2015
Average Score: 57.1%
Average Time: 1 hr 24 mins

Country Score (%)  Time (secs)
Argentina 57.2 5435.0
Australia 61.1 5256.2
Canada  62.3 5404.8
China 48.7 4998.0
Egypt 50.3 6677.5
Hong Kong 57.5 5700.8
India 49.0 4497.7
Ireland 52.2 3995.0
Italy 48.4 4587.0
New Zealand 64.5 4560.0
Nigeria 61.2 4222.5
Philippines 48.1 5904.3
Qatar 61.8 4562.5
Saudi Arabia 63.2 4332.5
Singapore 57.4 4862.6
South Africa 63.0 4034.3
Spain 62.5 5280.0
UAE 61.7 8002.5
UK 60.7 4860.0
USA 62.9 5706.2
Vietnam 58.6 6426.7


State Score (%)  Time (secs)
USA all 62.9 5706.2
California 60.4 5739.9
District of Columbia 67.0 7167.5
Florida 59.5 6343.1
Georgia 68.3 7535.8
Michigan 61.5 5005.0
Minnesota 61.4 4824.0
New York 67.7 6050.0
North Carolina 56.3 5516.3
Oregon 62.6 5955.0
Pennsylvania 65.0 6665.0
Texas 56.1 6039.7
Virginia 66.8 4505.8
Washington 63.7 4433.3


Revit Architecture is the most popular KS test topic, across our global customers. The impact of BIM on the AEC industry is significant and Revit is the dominant design tool, in terms of overall market share and breadth of supply chain resources.

R

Monday, 8 June 2015

Training Needs Analysis (TNA)

Popular AEC trainer and author, Shaun Bryant, is writing a 3-article series for AEC Magazine, about how design and engineering firms make the move to BIM.

Part one of the series can be found here.

In part two, Bryant addresses the issue of identifying training needs, in the context of a wider Revit software implementation.

Here is an excerpt from the article:

CAD manager to director level

“We will need to ensure that all Revit users undergo a Training Needs Analysis (TNA) to assess their training needs and requirements. This will give us a picture of exactly what they need and allow us to use the training effectively and get the most out of our incumbent training provider. It is imperative we allow the team to work with their strengths but also get trained up on areas of weakness, so that we have fully rounded Revit users that are effective and productive.”

CAD manager to the team

“We need you all to undergo a Training Needs Analysis (TNA). This is to assess your existing Revit knowledge (if you have any) and what areas you need to work on to make sure you are fully trained on every aspect of Revit you need to perform your role within the practice effectively. We need you to make sure that you include everything in your TNA so that we can get the best training for you from our training provider.”

Effective training on any CAD product is imperative. The CAD manager is using the TNA to ensure each Revit user is trained to their strengths and that any areas where their product knowledge is weak is thoroughly assessed and appropriate training given. The TNA is done individually per user to make sure that each user gets training tailored to them. It also provides the user with the reassurance that with the new CAD product, in this case Revit, they will be fully trained and prepared to use the product on live projects that the practice is, or will be, working on.

The full article can be found here.

KnowledgeSmart is a popular choice for AEC firms who are looking to capture accurate, independent data on software skills gaps, across their business. Detailed training needs analysis for individuals, teams and organisations is a key deliverable of the KS tools.

R

Tuesday, 19 June 2012

3 Levels of Revit Proficiency


How do you identify someone who has basic skills in Revit and distinguish them from an advanced user?

Further, do AEC firms actually need all of their users to be 'specialists' in Revit?  In some instances, people just need to receive a file, open it up and perform some straightforward analysis of the model (without causing any problems).  For example, Construction Managers, PM's, Engineers, Project Architects, and the like.  So a basic working knowledge of some key concepts is perfectly adequate for these users.

For the primary modeling team, AEC firms require a broader level of understanding across their user base, for example the people tasked with creating the detailed production information and modeling outputs on a project.  And firms need to have a handful of Revit ‘specialists'; people with a deeper understanding of the way in which Revit is deployed on a project, an appreciation of the collaborative process and the impact of using the technology across a broader environment.  And lastly, if content creation is a key part of the firm’s process, a handful of Revit Family specialists, who understand the importance of creating quality content, that can be re-used on subsequent projects, not simply re-modeled from scratch every time.

So it makes sense to establish 3 recognised levels of competence.  In a broad sense, we could label them:

  • Level 1 – basic skills
  • Level 2 – intermediate skills
  • Level 3 – advanced skills

With respect to Revit, this could work as follows:

  • Level 1 – Basics of Revit (i.e. an assessment aimed at occasional users; Construction Managers, PM’s, Engineers, Project Architects, etc.)
  • Level 2 – Revit fundamentals (i.e. core skills for primary modelers) 
  • Level 3 – More advanced concepts of Revit, (i.e. Revit project process & workflow, collaborative working, Family creation, etc., for BIM Co-ordinators and model managers)

AEC firms can use skills assessment, as a means of demonstrating to clients (or prospective clients) and partners, that they have the skills required, to truly deliver on a BIM project.  

KS Library 

In the KnowledgeSmart library, we have a range of modules available, which can assist firms in creating an appropriate assessment program for their organisation to capture helpful benchmark data and skills gaps information.
  • Level 1 – Revit for occasional users (available Summer 12).
  • Level 2 – Revit Architecture fundamentals, Revit for Interiors, Revit MEP fundamentals, Revit Structure fundamentals.
  • Level 3 – Revit Project Process, Revit Process & Workflow, Revit Architecture advanced (available Summer 12), Revit Structure advanced (available Summer 12), Revit Content Creation.
Firms might also consider writing their own custom assessment modules, based on their BIM standards.  All users can demonstrate an understanding of the correct standards and protocols, by passing this module.

Self-Assessment

In the broader context of self-assessment, the “above-average effect” is the tendency of the average person to believe he or she is above average, a result that defies the logic of statistics.
In studies, participants scoring in the bottom quartile on tests grossly overestimate their performance and ability. Although test scores put them in the 12th percentile they estimate themselves to be in the 62nd.

Because top performers find the tests they confront to be easy, they mistakenly assume that their peers find the tests to be equally easy. As such, their own performances seem unexceptional.  In studies, the top 25% tend to think that their skills are in the 70th–75th percentile, although their performances fall roughly in the 87th percentile.

Business Benefits

There are five distinct business areas that can benefit from measuring team performance:

Project Technology Leadership:
  • Measure returns on technology investment to eliminate risk of waste.
Business Development Team:
  • Differentiate your services and benchmark your competitive advantage to win more work.
HR Leadership:
  • Optimise the mix of people and skills via regular assessment to retain top talent.
  • Filter out poorly skilled candidates at interview to avoid failed hires saving time and money.
  • Encourage on the job training to reduce time away from the office and increase staff impact.
Learning and Development Team:
  • Train staff based on individual needs to maximize impact and raise service quality.
  • Measure returns on learning and development investments to eliminate risk of waste.
  • Make your training budget go further by improving learning and development efficiency.
Project Delivery Team:
  • Resource project teams with a balanced mix of skills to deliver high-quality services profitably.
  • Create an environment of team learning and growth to improve client service levels.

Benchmarking

Benchmarking is the process of comparing the cost, time or quality of what one organization does against what another organization does. The result is often a business case for making changes in order to make improvements. Also referred to as "best practice benchmarking" or "process benchmarking", it is a concept used in management where organizations evaluate various aspects of their processes in relation to best practice, usually within their own sector. This then allows organizations to develop plans on how to make improvements or adopt best practice, with the aim of increasing performance. 

It is important to target your teams with clear goals for advancement, as part of your wider learning & development and talent management strategy.

Here are the current (2012) benchmark performance quartiles, for the 3 disciplines of Revit, for your firm to compare results against:

Revit Architecture 2012:  69% in 1 hour 4 mins 30 secs



Revit MEP 2012:  64% in 1 hour 9 mins 30 secs



Revit Structure 2012:  62% in 1 hour 6 mins 0 secs


New Hires

According to the report “U.K. Talent Acquisition Factbook 2011” by Bersin & Associates, the new hire failure rate for new recruits is 1 in 8. Put another way, for every 8 new recruits 1 will leave inside of 12-months because they were a bad fit for the company. The same report measured the average recruitment cost to be £5,300 GBP / $8,200 USD per person.

Learning & Development Data

According to data collected from software training professionals, many trainers spend approximately 40% of the training course time revising prior training topics to assess group skill levels. This ‘Redundant Training Time’ reduces classroom productivity, increases training costs, and keeps staff away from their project teams for longer.

Skills Gaps

Based on analysis of KS results data from firms located in the UK, US, Canada, Australia and New Zealand, here is a summary of the top 20 most commonly flagged training issues and skills gaps, for each of the 3 Revit disciplines.

Revit Architecture 

ViewCube
View Range
Borrowers
Family Editor
Families
Conceptual Massing
View Properties
Element Properties
User Interface
Detail Components
Worksets
Coordinates
Rooms
Walls
Doors
Floors
Calculating Area
Shortcuts
Schedules
CAD Files


Revit MEP

Apparent Load Values
Modifying Light Fixtures
Photometric Web Files
System Inspector
Creating Power Systems
Edit Properties
Panel Circuits
Panel Schedules
Selecting Equipment
Electrical Settings
Creating Supply Systems
Duct Systems
Load Family
Pipe Systems
Spaces
Family Elements
Plumbing Fixtures
Properties
Visibility/Graphics
Worksets


Revit Structure

Beams
Components
Cut Length
Element Properties
Roofs
Families
Instance Properties
Schedules
View Parameters 
Annotation
Scope Boxes
Visibility
Structural Deck
Span Direction Symbol
Slabs
Filters
Slope Arrows
Dimensions
Repeating Details
Structural Settings

For firms involved in the adoption, rollout and training of their teams in Revit, skills assessment and benchmarking is an essential ingredient, in the overall successful deployment of this technology.

Taking a more structured, scientific approach will help AEC firms, Construction Clients and Contractors alike, to get a much better handle on who knows what, with respect to deploying Revit on a BIM project.  It will also help firms to demonstrate their BIM credentials and give users a logical (and more appropriate) path for skills development.

R