What is a beta exam, and why are they given?
Certification programs beta-test their examinations
to validate that each question actually test what
it was written to test - that is, exam-takers who know
the material will usually answer that question correctly, while
those who don't are more likely to get it wrong - and to
set a cutoff score that passes and certifies that
portion of the population deemed deserving while failing
the rest. Because even the best-written and
best-reviewed set of questions will contain a few
"clunkers" (too easy, too hard,
unintentionally misleading, or so on), beta exams always include extra items so there are enough left in
the pool after discarding the ones that test poorly and
so don't make it into the final forms (that is,
versions) of the examination. And speaking of final
forms, most examinations (including ours) are
constructed in several equivalent forms - that is,
different sets of questions that test to the same score
- so that candidates who fail and re-take the exam don't
see the exact same set of questions the second time
around. Bottom line: a beta test contains more questions
than a regular test - as much as twice as many, or more
- and every question is important even though some (and
no one knows which ones when you take the exam) won't
count towards your final score.
All of these decisions are made on the basis of
statistics run on the beta results. We'll accept a
representative group of candidates into the beta
program. Using established psychometric statistical
analyses, we will check if the more experienced or knowledgeable folks
truly did get a particular question right more than the
less experienced or knowledgeable folks; if not, we throw it out. If everyone (or almost
everyone), regardless of experience level, gets a
question right, then it doesn't help us separate the
certifiable from the rest so we throw it out; if almost
everyone gets a question wrong, same conclusion and same
consequence for the opposite reason.
The beta exams will be administered by Pearson VUE
testing centers, using the same presentation and grading
software as used in all other OMG Certification
Programs. The differences between
the beta version and the final form are: on the beta, you
tell us about your experience when you apply; there
are more than twice as many questions; and you don't get
your grade or pass/fail result right away. (You'll get
it after everyone has taken the beta exam and we've run
and analyzed the statistics.)
Top
What's Free, How much can
I save, and What are the conditions?
OMG will select and accept a limited number of
applicants into the OCSMP Free Beta Program. In addition, a larger number of applicants
will be
accepted into the OCSMP half-price Beta
Program. There is only one application form; every applicant is automatically considered for
both programs. Please read through the entire Beta
Program description
before you apply!
Each beta candidate accepted into the
OCSMP Beta Program will receive a voucher entitling
him/her to take the first OCSMP Beta Examination
for free or half-price at a Pearson VUE testing center during
its scheduled beta period. Candidates who take the
first examination (regardless of their score) will then receive a voucher
entitling them to take the second beta examination. Those who take
the second beta examination (regardless of their score) will then receive a voucher
entitling them to take the third examination and subsequently,
beta candidates who take the third examination (regardless of
their score) will receive
a voucher entitling them to take
the fourth examination.
You can save US$800
or more! When the OCSMP program becomes publicly
available during the fourth quarter of 2010, the price to take each
examination in the United States and other
English-speaking countries will be $200 or about the
equivalent in local currency. (The price will be
slightly higher in non-English speaking countries.) This means that, if you qualify for the Free
Beta Program and take all four examinations, you will
save US$800 or more! And, in the Beta Program, just
taking an examination at a lower level qualifies you for
a voucher at the next
higher level - you don't have to pass. (This doesn't
change the requirements for certification, of
course - you must pass all of lower-level
exams to qualify for certification.)
When beta testing for an OCSMP level is complete, we
will conduct our statistical analysis and construct
final forms of the examinations for that level from the
larger set of questions on the beta test, and assign the
cutoff (passing) score. We will then calculate a score
and pass/fail result for each beta applicant based on
how well he/she did on the questions that were selected
for the final form of the examination, and notify
candidates of their result. Candidates who qualify for
OCSMP certification on the basis of their performance on
beta examinations will receive certificates bearing low
certificate numbers reserved for this group.
Conditions:
This is not a contest, and the
free examinations are
not prizes. We are conducting a statistical study of the
four OCSMP examinations and are subsidizing the
examination fees for a group of candidates whose results
will give us the data we need, so our decisions on whom
to accept are final. The Beta Program
represents a considerable investment for OCSMP, since we
have to pay a fee to Pearson VUE every time a program
participant takes a "free" examination. Please
study and prepare just as you would if you were paying
the full $200 fee to take each examination yourself. We
appreciate every candidates' study and preparation, and
your efforts to do well at testing time.
Top
What's
the schedule for the beta exams?
The OCSMP Beta Schedule
will be updated as we move through the Beta Program.
Please bookmark it and come back as we progress through
the program.
Top
Do
I get OCSMP Certified by taking the beta exams?
If you pass the required exam(s), of
course you do! As part of our statistical analysis, we
will calculate every beta tester's score on the subset
of questions selected for the final form of their exam,
and compare it to our official cutoff score. If your
score is equal to or greater than the cutoff, we record
in our database that you've passed that exam. Then we
check your record against our Certification requirements
and award your certification if you qualify, based on
this set of requirements:
The OCSMP program will consists of four levels, arranged
in a single hierarchy. The first
level, OCSMP Model User, covers a wide range of essential MBSE
and SysML knowledge and skills and so enhances the résumé of those who
contribute to a model-based systems engineering project. Building on
this foundation, are three levels targeted at model builders and advanced
model users. These levels, termed OCSMP Model Builder -
Fundamental, Intermediate, and Advanced, cover advanced topics with an
emphasis on the interconnectedness among the different model viewpoints
that gives MBSE its advantage over conventional engineering methods. To be
certified at a higher level, you have to pass that
level's exam plus all of the lower level exams.
Each exam that you take stays on your record forever.
We'll send you certificates for all of the
certifications you earn - that is, for the levels of the
exams that you passed without any gaps in the hierarchy.
For example, a pass score on the First
and Second levels will earn you certifications for
First and Second levels. If you pass the First and
Third level Beta exams, but fail the Second, you will receive your
certificate for First level, and we'll keep in our
records that you passed the Third level exam. When the
OCSMP program publishes, you can take the Second level
exam in its standard form (at cost). If you pass, you'll receive certification at
both Second and Third level.
Beta candidates will be given every result and amenity
that paying candidates receive when they take the
standard-form exams as we complete the analysis of each
level. Regardless of whether you pass or
fail, you'll get a results sheet with your score on each
major exam section and your final score compared to the
cutoff. If you qualify for certification, you'll get a
certificate suitable for framing, permission to use the
OCSMP Certified Professional logo, and an invitation to opt-in to OMG's Certified
Professionals Directory.
Top
Where do I sign up?
The OCSMP Beta
Program Application Form can be found here,
along with additional information about the Beta
Program. Please review the detailed information about
the OCSMP Beta Program BEFORE submitting an application. Top
Can I sign up my entire crew/department for free
certification?
If you're a group leader and want to take advantage
of our Beta Program, we'd be pleased to work with you
since a pre-existing workgroup is likely to reflect the
distribution of knowledge and experience that we need
for good statistics. Please send an email with a brief company description and number of crew/department members
to certificationinfo@omg.org.
Top
Any questions?
Please review the detailed information on the
OCSMP
FAQ page. If your
question wasn't found, you can send us an email at certificationinfo@omg.org.
Top
|
