AutoCAD Test Scores Around The World

According to Wikipedia, AutoCAD is defined as 'a commercial software application for 2D and 3D computer-aided design (CAD) and drafting, available since 1982 as a desktop application and since 2010 as a mobile web and cloud-based app'.

The 2016 release marked the 30th major release of AutoCAD for Windows. The 2014 release marked the fourth consecutive year of AutoCAD for Mac.

Over the years, KnowledgeSmart has captured test scores for thousands of AutoCAD users, in multiple countries across the globe.

Here are the variances in our overall benchmark data, from 2009 to 2015:

2009
Average Score: 59.5%
Average Time: 1 hr 16 mins

2010-12
Average Score: 61.0%
Average Time: 1 hr 18 mins

2013
Average Score: 62.0%
Average Time: 1 hr 13 mins

2014
Average Score: 62.0%
Average Time: 1 hr 10 mins

2015
Average Score: 58.5%
Average Time: 1 hr 13 mins


Let's take a look at some overall aggregate score and time data on a country vs country basis. Numbers of test scores vary, so this list does not imply that one country is 'better' than another. It's interesting to see what kind of data is generated in different parts of the globe.

Country	Score (%)	Time (secs)
Australia	63.3	4777.9
Bahrain	61.8	4330.0
Canada	47.1	3395.0
China	54.6	7542.8
Hong Kong	37.7	3610.0
India	49.1	4203.8
Ireland	49.5	5573.8
Kuwait	45.7	3741.4
New Zealand	69.7	4399.8
Oman	39.3	5649.2
Philippines	50.3	4881.8
Poland	62.0	3150.0
Qatar	50.9	5003.4
Saudi Arabia	60.5	3361.3
Singapore	49.4	4752.0
South Africa	49.2	4468.0
Spain	62.7	3481.0
UAE	62.6	5112.7
UK	53.4	4572.3
USA	61.3	5511.8

We also capture data on a per State basis, for our US customers. The list below represents those States where the volume of data makes for meaningful data sharing.

State	Score (%)	Time (secs)
USA (all)	61.3	5511.8
California	63.4	5580.1
Florida	70.6	3140.9
Georgia	48.4	5096.4
Louisiana	67.3	3263.3
Nevada	75.3	3282.8
New York	52.6	5444.5
Washington	45.5	7336.9

Score and time data varies quite considerably, from country to country and between US States.

Even though the software has been commercially available for over 3 decades, there are still notable skills gaps across the overall user base. Our data shows quite clearly that AutoCAD users reach a performance 'plateau' after about 5 years and then remain at a similar skill level in subsequent years. 

When we started capturing skills data in the AEC industry, over 10 years ago, AutoCAD was the principal tool of choice for design and engineering firms. Whilst still widely used, the growth of BIM in the Construction sector has seen a rise in the number of different software tools deployed on projects  in the built environment.  Users must now learn a wider variety of software tools to do their jobs, than in years past.

R

KnowledgeSmart goes live

Well, we rolled out the new tools last week and so far, so good! It's a new direction for us in terms of the core approach to skills testing. The new web based platform allows greater flexibility in the way firms can deploy test modules and capture knowledge across a wide range of topics.

We're leaving a beta label on the system for a few more weeks; it's fully operational, but we welcome user feedback on any issues, bugs, missing data sets, or indeed anything that looks like it doesn't belong! Our next priorities are to add some more functionality to the admin dashboard; this includes some content management tools (for when question libraries get to a certain size), some file management tools (for marrying data sets to test questions in a variety of ways) and some general usability items, which have been suggested during pre-launch testing.

In addition, we have a rolling programme of new test material creation. Currently under development include the following libraries; Rhino for Architecture, AutoCAD & MicroStation for occasional users, Bentley Structural Modeller, MicroStation 3D fundamentals, Vectorworks, AEC Revit Standards, Ecotect fundamentals, Bentley InRoads and Civil 3D. These will all be making an appearance over the next few months.

KnowledgeSmart Enterprise customers will automatically see new library modules appear in their dashboard, as soon as they go live. The next challenge is to pull the live test results data into an online skills matrix tool, which administrators can use to display a range of useful metrics. Our intention is for this tool to dovetail into existing intranet environments, feeding into training and project resourcing activity, fully searchable, helping firms to ID the right people, with the right skills, at the right time.

Part of the challenge the new tools present is the variety of options available to admins when deciding just what test types to present to users. In the past, we have provided tests in any colour the customer could choose (so long as they chose black!). Now they really do have choice - and lots of it! The new 'Build Your Own' (BYO) feature enables firms to create their own test material from scratch, using an intuitive online authoring wizard to guide them through the process. AEC firms can capture knowledge across multiple topics, whether that be technical software ability, understanding and adherence to in-house standards, discipline specific knowledge, project-specific information, or indeed anything at all!

On the subject of Standards, we have partnered with the team at Evolve Consultancy to create test content for AEC (UK) CAD Standards for Layers/Levels. Next week, we'll be meeting the team at the US National CAD Standards committee to discuss a skills test for US CAD Standards.
We're running a series of web meetings over the next few weeks, to demonstrate the new system and tools on offer. To book a session, email info@knowledgesmart.net with 'Webinar' in the subject line and we'll schedule you in.

We have an ambitious programme of marketing and promotional activities planned between now and the Summer, both at home and in the US. We're sponsoring the Bentley Community UKI Winter Workshop in Oxford this month (http://www.bentleyuser.org/). We're presenting at the first WAN HR Forum in London on March 18th. And soon after that, we're heading off to Chicago, where we are sponsors at the inaugural KA-Connect knowledge management conference (http://www.ka-connect.com/).

Hope to see you online or in person in the coming weeks!

Rory