Saturday, 18 May 2013

KS Help Notes_Settings 08_Capturing Additional User Data


KS admins have the option of capturing additional user information, to gain a more rounded picture of a person’s background and experience.

Go to Settings > Test UI Options and Check the ‘Display user data capture pages’ box if you want to display the additional user information capture screens, at the start and end of a test session.


The first data capture page appears during the test login process, just before the start page.


You can present the 5 user datafields, including the option for these fields to be optional or mandatory, by checking the appropriate boxes on the Settings > User Datafields page.


You can also capture the following additional information:

- Primary Industry/Discipline
- Primary Role
- Country
- State (If USA selected)

Lastly, users have the option of providing a ‘self-rating’ of their knowledge of the topic, for which they are about to take a test.

Please rate yourself on your ability to use the software, for which you are about to take a skills assessment, on a scale of 1 to 5:

1 = Very basic knowledge; not enough to work confidently on a project
2 = Basic knowledge; can get by working on a project but could do better
3 = Good knowledge; can produce a good standard of work on projects
4 = Advanced knowledge; can teach the basics to others
5 = Expert knowledge; can perform and teach others at an advanced level

The second data capture page appears at the end of a test session, just before the results screen appears.


Here, you can capture the following additional information:

How many years have you been using BIM/CAD/Engineering software?

How often do you use BIM/CAD/Engineering software?
Regularly (daily)
Part time (weekly)
Occasionally (monthly or less)

What BIM/CAD/Engineering software do you regularly use?

How did you primarily learn to use BIM/CAD/Engineering software?
School/College/University
Formal training
On the job/self taught
Online/web based training

Where did you first learn to use BIM/CAD/Engineering software?

Plus an extra field for users to provide additional comments & feedback.

The information captured is presented at the bottom of each KS test report.


R

KS Help Notes_Invites 06_Self-Inviting to a KS Test


If you want to allow users to invite themselves to take a KS test, here is what you need to do.

Set up a new Full-admin profile for your KS account.  Go to the Accounts > Your Accounts page of your dashboard and select the 'Administrators' icon next to your test account.


Use the 'Add administrator' fields to add a new Full-admin to your account.


Use a general user name, i.e. XYZAdmin and a 'catchall' email address, such as training@xyzengineers, learning@xyzengineers, or similar.

Look out for the system mail with your new admin's login details.  Or, alternatively, re-set the password on your new admin profile.


Log in as the new administrator.  Now, hit the 'Change password' link, to create a new generic password, i.e. XYZ123.  These login details will be made available to all users, so should be easy to remember.


Last, change your new admin profile from Full-admin to Sub-admin status.  Don't forget, a Sub-admin user profile can only access a KS test from a browser.  It cannot be used to access your main KS dashboard.


Now that you have set up your new general Sub-admin profile, create some simple user instructions, so that all your users can log in and invite themselves to take a KS test.  Here is a brief guide to logging in to a test session from a browser.

R

Tuesday, 14 May 2013

KS New Release

The next release of the KS software hits the live site this month.  Here's a summary of new features and updates.

Cleaner KS login page

We have simplified and tidied up the dashboard landing page...




... and the dashboard / assessment login pages:



User data capture pages

We are keen to continue providing interesting and relevant user demographic data, for statistical and comparative analysis. A regular feature request is the ability to capture additional background information for candidates, so we added two new data information pages (one at the start and one at the end of a test session):



These additional pages are optional. KS admins can choose to display (or not display) the data capture pages, with a new dashboard setting.


The 5 user datafields can be presented on data capture page 1, with an optional/mandatory status, by selecting the relevant fields on the Settings > User Datafields page.


Improved test report

We have updated the format of the KS test report, making it easier to navigate to the relevant feedback sections, adding a new field for number of logins/logouts and a new 'Additional Information' section for candidate profiling.



Improved content management

We added a number of improvements to the Library section of the KS dashboard.  This includes adding the training tag export tool to the main KS Tests menu page:


Allowing admins to edit answer options for multiple choice / order list / pick list type questions:


We improved the KS content editing process by adding the green information panel to the 'Your questions' box and 'Your modules' box, making it easier to identify KS content.


We also included the ability to re-order questions inside KS modules and modules inside KS tests.


Improved searching & grouping options

We added a new search table to the Invites > History page, making it easier to filter the data on this page.


We added a new field for 'Test name' on the dynamic grouping table, in the Results > Data page.


Improved user records page performance

We have made KS user records fully editable, deletable and added simple pagination to accounts with extensive user lists. This has improved the performance of the users page, including the ability to export records from linked accounts.



Plus a number of smaller updates and bug fixes, including:

Improvements to test UI performance, including removing the 5-second page f'licker', when the KS software pings the server to register latest test data.
Update to question csv export, to include distractor answers for multiple choice / pick list question types.
Update to the naming convention for imported tests.
Uniform date format on the Results > Data page and related csv exports.
Update to error messaging for non-admins attempting to log in to a KS dashboard.
Update to error messaging for incorrect file uploads.
Update to error messaging for duplicate questions appearing in a test session.
Update to results searching & editing in our own KSadmin database.
Update to management of user records in our KSadmin database, including the ability to merge two user records.
Better handling of apostrophe's in KS user names, e.g. Rory O'Vance.
Bug fix to address amended KS account names not displaying correctly on invite mails.
Bug fix on administrator notification mail failure for new account setup.
Bug fix on user record deletion on the Move Users page.
Update to specification of KS Rackspace cloud server box.

We have a further software release scheduled for June, which completes the latest round of KS devs.

As always, our thanks to the KS user group for your feedback, suggestions and ideas for continual advancement and improvement of the KS system.

R

Monday, 13 May 2013

Building Information Model... Model


Saying “BIM Model”, or “Building Information Model Model”, is a tautology. Extensive research by Professor James Vandezande, supported by a leading team of linguistics scientists at HOK, have proved beyond all reasonable doubt that, when said in conjunction, the phrase causes the heart of a fluffy kitten to stop!


This affliction is sometimes referred to as RAS syndrome (short for "redundant acronym syndrome syndrome"), also known as PNS syndrome ("PIN number syndrome syndrome", which expands to "personal identification number number syndrome syndrome") or RAP phrases ("redundant acronym phrase phrases"), referring to the use of one or more of the words that make up an acronym or initialism in conjunction with the abbreviated form, thus in effect repeating one or more words.

Instead, try saying “The model”, “The BIM” or any number of other harmless phrases.

R

Thursday, 9 May 2013

BIM Show Live TopGun



Last week, we hosted the inaugural BIM TopGun skills contest, at BIM Show Live 2013.

In its third year, the conference was a huge success, with over 600 BIM-savvy souls networking, sharing and learning over two action-packed days at the Crowne Plaza in London's Westminster, just a stone's throw from Big Ben and the Houses of Parliament.

This year, KnowledgeSmart was approached by the show's organising committee to replicate the popular 'Top DAUG' competition format from Autodesk's annual user conference in Las Vegas.  Never one to shirk a challenge, we worked with the BSL committee to create a vendor-neutral, general BIM knowledge quiz, covering topics including BxP's, COBie, IFC data, file formats, what happens when you say 'BIM Model' whilst presenting on stage (see below) and other such exotic matters!


The overall quiz comprised 15 questions, plus a bonus question, to be completed in 10 minutes or less. (In fact, we generously added 3 extra minutes to allow for the in-house Wi-Fi connection, which was creaking at times!).

After a slightly tentative start, we soon had a steady stream of willing BIMMER's, all competing to be crowned the UK King (or Queen) of BIM!  As well as competing for bragging rights and the title of BSL 2013 BIM TopGun, the winner was also to be presented with a coveted BIMMY award, by the Conference Committee.  So, frankly, the stakes could not have been higher.  To add fuel to the fire, many prominent members of the world-renowned #UKBIMCrew were also in attendance, each one determined to crush his or her competitors into the dirt! (Don't let the slightly enigmatic smiles fool you, this was BIM WAR!).



Over the course of the two days, we posted 74 scores, ranging from 25% to 83%.  Here is a breakdown of the results:

Overall average score & time = 53% in 11mins 56 secs.

Average score & time for the boys = 53% in 11 mins 53 secs.

Average score & time for the girls = 53% in 12 mins 34 secs.




Here is a breakdown of the Top 10 Leader-Board, after the final results were tallied:


The Top 10 scores ranged from 83% to 71%.

And massive congratulations to our overall WINNER, Mr Dave Lee, from HDR's London office, who is now officially the UK's most prolific BIM Champion (probably).


Here is a piccie of Dave accepting his BIMMY, from BSL Chair, Rob Charlton.


It should be noted, for the record, that several #UKBIMCrew members were conspicuously absent from the list of TopGun participants, come the end.  We thought long and hard about publishing a 'Wall of Shame', but decided in the end that this might be a step too far! :)

Congratulations to everyone who took part and thanks for making it such a fun event.

R

Sunday, 24 March 2013

Learning Plateaus


At KnowledgeSmart, we spend a lot of time speaking to firms about performance improvement. So what happens when, in the pursuit of advanced learning, we experience a slow-down in our development? We hit what is sometimes referred to as a 'learning plateau'.

A learning plateau occurs when forward progress seems to have stopped while engaged in learning a new skill. These plateaus are normal and commonly experienced periodically when learning to play a musical instrument, speak a new language, or learn some other complex discipline.

Dutch author, Lodewijk van den Broek, describes hitting the plateau as, ‘the experience where you feel that no matter how hard you try, there is no progress in learning. And even though this is not entirely true, the feeling is very real’.

According to van den Broek, there are two major things happening here. The first is that you have progressed past the bend in the 'learning curve'. There are different stages in the learning curve:
  •  Beginner stage (0% to 60%)

The curve is very steep and you learn very fast.
  •  Intermediate stage (60% to 80%)

This is past the bend in the total curve. Learning speed declines and this phase takes longer than the beginner stage.
  •  Advanced stage (80% to 95%)

Learning speed declines even further and the length of the stage increases as again.
  •  Expert or Master stage (95% to 100%)

Learning speed drops to slow progress and the length of the stage stretches into eternity.

So once you hit Intermediate level, your progress slows down. And at the same time it gets increasingly difficult to measure that progress. These effects combined result in the feeling that you have hit a plateau in learning.

US authors, Brett & Kate McKay, describe a road map for overcoming Performance Plateaus. Back in the 1960’s, two psychologists, Paul Fitts and Michael Posner, set out to uncover why we plateau. They discovered that when we acquire a skill, we go through three stages.

The first stage of skill acquisition is called the cognitive phase. In this phase, we must concentrate intently on what we’re doing as we figure out strategies on how to accomplish the skill more efficiently and effectively. The cognitive phase is riddled with mistakes as we learn the ins and outs of our new pursuit.

The second phase of skill acquisition is the associative phase. During the associative phase, we make fewer mistakes. Consequently, we feel more comfortable with the skill and begin to concentrate less on what we’re doing.

The final stage is the autonomous phase, or what Joshua Foer, author of ‘Moonwalking with Einstein’, calls the “OK plateau.” We reach a skill level where we’re able to capably do the task without having to really think about it at all. Remember about how much you thought about what you were doing when you first got your driver’s license? Now driving is fairly automatic, like brushing your teeth.

People used to think that you couldn't break past these plateaus because a plateau represented the limit of your genetic ability. No amount of exertion or education would help you overcome this wall. But Fitts, Posner, and other psychologists discovered that with the right approach and a few attitude adjustments, all of us can bust through our plateaus and reach even higher.

How to Overcome Plateaus
Take risks. Growth comes when we stretch past our comfort zone. The big reason many people (especially high-achievers) plateau is because they don’t like to fail. Instead of taking on challenges that will help us grow, we stick with routines that we know we can successfully do. To protect our ego, we’d rather do the wrong things correctly, than do the right things wrongly. This aversion to risk is a recipe for plateauing.

Embrace your failure. To overcome your aversion to risk, you have to give yourself permission to fail and be mediocre. Instead of avoiding the things that are hardest for them, the greats of the world specifically focus on those things; they purposefully concentrate on the areas in which they make the most mistakes. This keeps them from getting stuck in the autonomous phase and propels their progress. So instead of seeing failure as a negative thing, think of your failures as steps to success. If you choose to learn from your failures, they can bring you closer to your goal.

Another reason we plateau is because everyone around us is telling us everything is fine. We often confide in people who tell us what we want to hear, not what we need to hear. For example, we finish a project and take it to somebody for some “constructive criticism,” when really we just want some positive affirmation on what we did. If you feel stuck in an area of your life, seek out mentors who won’t pull any punches and will give you the honest criticism you need to improve. Yes, your ego will get bruised, but that’s the price one must pay for personal and professional growth.

Practice deliberately. Fitts and Posner discovered three keys to breaking through your plateau: 
1) focus on technique, 2) stay goal oriented, and 3) and get immediate feedback on the performance. In other words, you need to practice deliberately to break through plateaus.

Get back to basics. Even when you’re advanced at something, delving back into the basics can actually give you fresh insights that help you progress even further.

Think long term. When we think short-term, we have a tendency to feel that plateaus are permanent. But when we take the big picture view of things, we start to see plateaus as temporary way-stations that we’ll eventually get past with a bit of hard work. Moreover, by thinking long term, we give ourselves more latitude to take risks and fail because we see that missteps are just momentary setbacks in the long journey of life.
To cultivate this attitude, reflect on a time where you felt you had reached the end of your development in some area, only to later bust through the plateau. If it was possible then, it’s possible now.

Psychology author, Russell A. Dewey, PhD, describes what happens with a typical learning curve.
With repetition of almost any motor task, learning occurs, and a person becomes more efficient or effective at carrying out a task. Progress in skill learning commonly follows an S-shaped curve, with some measure of skill on the Y axis and number of trials on the X-axis. Progress is slow at first, then a subject may experience a burst of learning that produces a rapid rise on the graph.



The S-shaped "learning curve" typical of complex learning

Why does an S-curve of growth eventually level off?
What people call a plateau may be a period of stability after a skill is learned as well as it can be learned. Most growth processes follow the same S-shaped curve as motor learning. In general, an S-shaped curve of growth levels off because stability is attained, a resource needed for growth is limited, or a ceiling of performance is reached. 

What phases of learning a complex skill cause the "S-curve" pattern?
The S-shaped learning curve is most obvious when someone learns a highly complex task. The initial part of the curve rises slowly as a person becomes familiar with basic components of a skill. The steep ascending phase occurs when there is enough experience with rudiments or simple components to start "putting it all together." Rapid progress follows until the skill "hits a ceiling" or stabilizes at a high level.

To put this in the context of AEC-related skills monitoring, KnowledgeSmart analyzed the results of several thousand test results, covering basic 2D CAD skills (using AutoCAD and MicroStation software).

The results were as follows:

0-1 years' experience:  53% in 87 mins

4-5 year's experience:  60% in 77 mins

8-10 years' experience:  61% in 79 mins

Many times, we hear people say, I don't need skills testing or training, because I've been using (XYZ software) for many years. Could it be that, even in the case of experienced users, a learning plateau might have been reached, and a fresh approach to learning could prove beneficial in helping to further improve performance?

R

Friday, 1 March 2013

KS user group - April 11


It's that time of year again. We have scheduled the date for the next KS user group.

Here are the details:

Location:  Smeaton Room, Buro Happold, 17 Newman Street, London, W1T 1PD
Date:  Thursday 11 April
Start:  09.00
End:  14.00
Cost:  Free (Breakfast & lunch included)

We will be reviewing the latest KS tools in some detail, including a look at what’s coming up in the next 3-6 months. Plus a guest presenter or two.  Full agenda to follow, as the date gets closer. 

Places will be limited to 25, on a first come, first served basis.

Hope to see you there!

R