Astute Technology's Net.SCORE™
Secure Internet Testing, Scoring, Data Collection, and Transmission
Introduction
In many ways, the Internet is transforming the way business is transacted
in the world today. Examining education from a business standpoint, as
a means of delivering a service (quality information) for a cost (tuition,
access fees, direct costs), it is clear that the Internet will transform
education as well. Almost all universities and most businesses are finding
the Internet an extremely cost effective medium for the transmission of
educational information. The next step after the educational material
has been disseminated is assessment. Assessment in an educational institution
usually takes the form of paper and pencil tests to determine grades for
further educational advancement. In a business model, assessment serves
as a means of employee certification, and is also used to gauge the efficacy
of the training efforts. Without assessment, the effectiveness of the
on-line educational material and the advancement of the students or employees
cannot be determined. It is thus critical to have a fully functional,
integrated solution for on-line testing, scoring, data collection and
transmission. Net.SCORE™, is the complete solution.
Product Overview
Net.SCORE™ utilizes a web-based user interface that allows end-users
to register, pay for, take tests, and have these tests scored, with the
results culled in a database and exported to a certification agency. Net.SCORE™
is component based (utilizing the Component Object Model, or COM, standard)
and is designed for easy integration in any organization's enterprise
system. The component architecture and flexible three-tier architecture
also allows for easy modifications to core Net.SCORE™ functionality.
Net.SCORE™ integrates well with Astute Technology's Conference.CAST™
technology.
Net.SCORE™ has two main modules: (I) user testing, and (II) administration,
each of which is discussed below.
User Testing Module
The user-testing module is the primary engine of the Net.SCORE™
system, and uses a web-based interface. Thus, the end-user requirements
are simply a web browser (such as Netscape Navigator and Microsoft Internet
Explorer, both of which are free and available on all popular operating
systems and platforms). The user-testing module has the following main
features:
- Help/FAQ (Frequently Asked Questions )- Extensive on-line help is
provided to assist the user in all aspects of the on-line testing
process. The help is accessible at all times.
- On-line registration and payment - A new user is able to register
on-line, according the specific established procedures, and enter
credit card information in order to pay for tests (if required). If
desired, credit card verification is performed immediately on-line.
Other payment options include coupon (see the administration module
for more details) or check (via mail). Various payment scenarios are
possible, including on a per-test basis, in packages (several tests
at a time), or as a one-time fee. User information is stored in a
secure database and the user is assigned a login so they do not need
to enter the information each time they take a test. The credit card
number is not stored in the database for privacy reasons.
- Testing - The testing module allows for multiple choice questions
or true/false questions. Each question can have only a single correct
answer additionally the test on the whole can have passing mark. The
number of times a user can take a test can be restricted by the value
of the variable. Images and figures can be integrated into the questions.
Results of the tests can be shown immediately after the test is submitted
or after each answer is submitted, and include other statistical information
about how the user's results compared with all other users. The questions
can be randomized from a pool of questions. There can be different
types of tests, including "category" tests, "individual" tests, and
"self-assessment" tests. Self-assessment tests can be taken only once
and should be taken before all other tests, individual tests are taken
after an individual lecture or topic, while category tests are taken
after a set amount of material has been covered. Tests may have expiration
dates. Users may provide feedback about the quality of the test to
the administrator through survey/evaluation forms. Users may receive
certificates (with graphics, logos, and signatures) if appropriate,
which may be printed out.
- Study material - Study materials, such as multimedia lecture content,
web resources, or documents, can be linked to specific tests (to create
"individual" or "self-assessment" tests).
- History/User Profile - User history is stored in the database so
they may review previous tests they have taken, how their results
are changing with time, notes they have taken on study materials,
tests that still need to be taken, payment history, and their profile.
The screenshot below shows the user taking a test on the right side of
the screen while viewing and listening to a lecture (using Conference.CAST™)
on the left side of the screen.
After the test is taken, the user receives some basic statistics comparing
their test score to others who have taken the same test. A sample graphic
from another Net.SCORE™ site is shown below:
The screenshot below shows a sample certificate issued to a user upon
successful test completion. Note that the identification number printed
below the user's name is unique for each user and is generated by Net.SCORE™
as a method of ensuring authenticity. The certificate appears in the user's
browser window and can then be printed and/or saved.
Administration Module
The administration module is used by the educational institution or business
in order to maintain the tests (including questions, answers, and costs),
test schedules, and all other rules and procedures (such as login requirements,
fee requirements, etc). The administration module is also web-based, with
a secure logon, which allows for remote administration. The administration
module has the following main features:
- Test administration - This feature allows the designated administrator
to enter new tests into the system (including questions and answers),
remove old tests, alter calendar and fee information, change test
types (i.e., scorable tests, non-scorable tests, group tests, test
expiration dates), and so on. The payment options are highly customizable,
and allow for different payment structures to be set up for different
categories of users (such as physicians, fellows, chairpersons, etc).
Payments can be attached to a single test or a group of tests, and
can also be attached to any study materials if appropriate. In addition,
"coupon" packets can be set up, allowing discounts for such purposes
as the purchase of groups of tests. All administration is done on-line
via a web interface.
- Data transfer - This feature allows user and test score information
to be exported from the database into the format that the certification
agency (such as a CE authority, university registrar, or human resource
office) requires for further processing.
- Statistics and reports - This feature allows for reports (including
graphical charts) and statistics describing use patterns of the tests;
average test scores, user feedback from the tests, etc. The reports
can be customized and then displayed or exported.
- Issue certificates - Certificates can be created (including logos,
graphics, and signatures) and the conditions under which they are
issued to users can be set.
The screenshot below shows the administrator entering some basic information
about a test.
Requirements
As described above, both Net.SCORE™ modules are completely web-based
and require Microsoft Internet Explorer 5.0 or better or Netscape Navigator
3.0 or better. The browser must also be Java enabled. All tests can be
taken over a 14.4k modem Internet connection or better and seamlessly
integrate with Conference.CAST™ technology. As a service to clients,
Astute Technology can provide all server side functionality, including
database maintenance, software maintenance, high-speed Internet connectivity,
and web hosting. By hosting the distance learning applications, including
Net.SCORE™, for clients, Astute Technology is able to better serve
the customer by providing quick turn-around for any requested customer-specific
modifications to the system. In addition, Astute Technology's high speed
Internet connectivity frees the customer's network for bandwidth usage
requirements due to hosting the distance learning and testing applications.
All Internet based transactions are encrypted while in transit, using
SSL technology, for further security.
Conclusion
Net.SCORE™ is a three-tier architecture, COM (component object model)
based, customizable secure Internet testing, scoring, data collection
and transmission system. Net.SCORE™ has been designed to meet the
continuing education requirements for nurses, physicians, and researchers.
Coupled with an educational content delivery application (such as Conference.CAST™),
Net.SCORE™ provides a complete solution for assessing users' response
to on-line educational content. The assessment results are stored in a
database and reports can be produced for such purposes as to issue certificates,
provide credit, and improve the effectiveness of the educational material.
back to top 
