Cognitive Exams - General Information
About the NREMT Cognitive Exams
Candidates seeking National EMS Certification at the Emergency Medical Responder, Emergency Medical Technician and Paramedic take Computer Adaptive Tests (CAT). An adaptive test is an variable length, algorithm-delivered exam. This means the computer is programmed to select items in a specific, logical manner. The decision regarding passing or failing an algorithm exam is the same as with paper and pencil examinations: has the candidate reached the level of entry-level competency (passed) or has the candidate not yet reached entry-level competency (failed)?
Candidates seeking National EMS Certification as an Advanced-EMT take Computer Based Linear Tests (CBT). A linear CBT exam is a fixed length, computer version of a paper and pencil exam.
This same method is used to develop all NREMT test items. First, an item (or question) is drafted. Then it is pilot tested in a high stakes atmosphere by being placed in live exam test pools. The test pool is a ‘bank’ of test questions that the computer can draw from when delivering an exam. Pilot items are placed in test pools to be calibrated, determining where on the scale of difficulty they will be placed. When the drafted item is being pilot tested, it does not count towards the pass/fail score of the candidate being examined. In order for an item to be placed in a “live” (when the items counts toward pass/fail) test pool, it must meet strict calibration requirements. The difficulty statistic of an item identifies the “ability” necessary to answer an item correctly. Some items require a low ability to answer correctly while others may require moderate or high level of ability.
During NREMT exams, every candidate receives pilot questions that are indistinguishable from ‘live’ items. However, pilot questions are not factored into a candidate's performance. The number of 'pilot items' included on each each exam are detailed below:
- EMR: 30 items
- EMT: 10 items
- AEMT: 35 items
- Paramedic: 20 items
Pearson VUE: The NREMT Test Provider
The NREMT utilizes Pearson VUE as its exclusive test provider. Pearson VUE is one of the world's largest assessment and testing businesses. They have an extensive network of testing centers and extensive experience in delivering high-stakes computer based tests. You will take the exam at one of two types of Pearson VUE testing centers:
- Pearson VUE Professional Centers (PPCs) are testing centers that are owned and operated by Pearson. They are located in most urban areas.
- Pearson VUE Testing Centers (PVTCs) have a contractual relationship with Pearson VUE and are typically found in smaller towns and rural areas. PVTCs are used to increase the access to EMS testing in rural areas.
In some cases, the closest Pearson VUE test center is located in another state. Candidates can test at any authorized Pearson VUE test center in the United States at a convenient date, time and location. The exam delivery process is the same regardless of where it is taken.
Computer Adaptive Tests
Since CAT exams are delivered in a completely different manner than pencil-paper exams, they will “feel” more difficult. Candidates should not be concerned about the ability level of an item on the exam because their ability is being ‘measured’ in a different manner. This works by placing all items on a standard scale in order to identify where the candidate falls within the scale. As a result, candidates should answer all items to the best of their ability. Let’s use an example to explain this:
Suppose that a middle-school athlete is trying out to be a member of the high jump team of the track team. The coach, after many years of experience as a middle-school coach, knows that in order to score any points at a middle-school track meet, his individual jumpers need to jump over a bar placed at four feet above the ground. This is the “competency” standard. If he enters jumpers who can jump three feet, he knows these jumpers will rarely-- if ever--score points for his team during a track meet. Those who jump four feet on the first day of try-outs, after training and coaching, can not only jump four feet (the minimum) but; later may, through additional education, learn to jump five or more feet. The coach knows that it will be worth his time and effort to coach these try-out jumpers to greater heights. Therefore, he tells those who jump over four feet at try-outs that they are members of the high jump team (because they have met the entry-level or competency standard).
Since the coach knows the competency standard, he can hold a try-out to see who meets the entry-level competency. The coach will likely set the bar at or near 3 feet 6 inches for the first jump attempt. Those who make it over this bar will then progress to perhaps 3 feet 9 inches to test their ability at that height. After a group has passed 3 feet 9 inches the coach will again raise the bar to 4 feet and have the successful jumpers attempt to clear it., A smart coach will likely not tell the team the necessary height so that he can learn the maximum ability of each try-out jumper. At the 4 foot level, the coach may find that seven of ten athletes clear the bar. He will then raise the bar to 4 feet 3 inches and later to 4 feet 6 inches. He will increase the height of the bar until he determines the maximum individual ability of each try-out jumper. If he has four slots on his team, he will select the top four or five jumpers and begin the coaching process to help them reach even greater heights. In this manner, the coach has learned about the ability of the try-out jumpers based upon a standard scale (feet and inches). The coach then sets a standard (4 feet) for membership on the team, based upon his knowledge of what is necessary to score points at track meets (the competency standard).
How A CAT Exam Works
The above high-jump illustration can describe the way a CAT exam works. Every item within a live item pool has been calibrated to determine its level of difficulty. As each candidate takes an exam, the computer adaptive test must learn the ability level of the candidate.
The test typically starts with an item being administered that is slightly below the passing standard. The item may be from any subject area in the test plan:
- Airway, Respiration & Ventilation
- Cardiology & Resuscitation
- EMS Operations
After the candidate gets a short series of items correct, the computer will choose items of a higher ability, perhaps near entry-level competency. These items will also be taken from a variety of content areas of the test plan. If the candidate answers most of the questions in this series of items correctly, then the computer will choose new items that are at a higher ability level. Again, if the candidate answers many of these items correctly the computer will again present the candidate with items of an even higher ability level. Eventually, every candidate will reach his or her maximum ability level (and answer questions incorrectly). The computer then determines whether or not the individual is above the standard (entry-level competency) in these content areas, and the examination ends.
A 95% Confidence is Necessary to Pass or Fail a CAT Exam
The high achiever who is able to answer most of the questions correctly will find that the computer ends the exam. A candidate may worry that something is wrong because the exam was so short, when in reality, the computer was able to determine that the candidate jumped far higher than the standard level—or was well above the level of competency In a CAT exam.
The computer stops the exam when it is 95% confident that the individual candidate has reached the level of competency, is 95% confident the individual cannot reach the level of competency, or has reached the maximum allotted time. Thus, the length of a CAT exam is variable. Sometimes a candidate can demonstrate a level of competency in as few as 60 test items. Sometimes, after 60 questions, the candidate has shown to be close to entry-level competency but the computer has not determined within the 95% confidence requirement that the candidate is either above or below the entry-level competency standard. In cases when the computer is not 95% confident, the test continues to provide additional items. Each additional test item provides more information to determine whether or not a candidate meets the entry-level of competency. Regardless of the length of the test, items will still vary over the content domain (Airway/Oxygenation/Ventilation, Cardiology, Medical, Trauma, and Operations).
When (and if) the candidate reaches the maximum length of an examination, the ability estimate of that candidate will be most precise. Using the high jumper example, the computer will be able to determine those who jump 3 feet 11 inches from those who jump 4 feet 1 inch. Those who clear 4 feet more times than they miss 4 feet will pass. Those who jump 3 feet 11 inches but fail to clear 4 feet enough times will fail and are required to repeat the test. Some candidates won’t even be able to jump close to four feet. These candidates are below or well below the entry-level of competency. This too can be determined fairly quickly, and these candidates may have their examination ended quickly. When the examination is near 70 questions (for EMTs, or 90 for EMRs) and a candidate fails, he or she has demonstrated within 95% confidence that he or she cannot reach the entry-level of competency.
In a CAT exam, it is important that the candidate needs to answer every question to the best of their ability. The CAT exam provides the candidate with more than adequate opportunity to demonstrate their ability and is able to provide precision, efficiency, and confidence that a successful candidate meets the definition of entry-level competency and can be a Nationally Certified EMS provider.
Exam results are posted on the NREMT’s password-secure website through an individual’s login account usually within two business days following the completion of the examination, provided you have met all other requirements of registration. Those candidates who pass the exam are sent National EMS Certification credentials by the NREMT. Candidates who successfully demonstrate entry-level competency do not receive specific details regarding their examination results, as it is not necessary.
Candidates who fail to meet entry-level competency are provided information regarding their testing experience. This information is useful for identifying areas to concentrate future studies in preparation for their next attempt. The information indicates if a candidate is “above,” “near,” or “below,” the level of entry-level competency in the various content areas.
Candidates who are “above” the standard can be somewhat confident they have sufficient knowledge in that content area, allowing them to pass the exam. However, failure to review the material in that content area can result in failing the exam again.
Candidates who are “near” the standard can be slightly above or slightly below the standard and should certainly study these areas. Being “near” the passing standard does not indicate pass or fail; rather it can be interpreted as an area to study.
Candidates who are “below” the standard need to enhance their study in this area.
Candidates who fail the examination will have all items on the failed exam “masked.” This means a masked item will not appear on any future exams taken by that candidate.
Studying examination items to prepare is not helpful. Candidates who memorize items in hopes of 'getting them right' the next time are wasting their time. Once a candidate sees an item, the item is masked and the candidate will never see the same item again.
A CAT examination is very precise in determining a candidate’s level of competency. Candidates who fail the exam and do not study for their next attempt will most likely be measured at the same level as when they took the exam the first time. Failing candidates who do not change their ability level (be able to jump higher) will again be measured the same. The best way to improve ability is to practice—in this case, study.
Computer Based Linear Tests
Computer based linear tests are fixed length exams. The Advanced-EMT exam and the Intermediate/99 Assessment exam are currently Computer Based Linear Tests.
Unlike CAT exams, candidates who take a linear exam can skip questions, mark questions for review, and go back and change their answers provided time has not expired. There is no penalty for guessing. Any questions that are left blank are scored as incorrect.
Exam results are posted on the NREMT’s password-secure website through an individual’s login account usually within two business days following the completion of the examination provided you have met all other requirements of registration. Those candidates who pass the exam are sent National EMS Certification credentials by the NREMT. Candidates who successfully demonstrate entry-level competency do not receive specific details regarding their examination results, as it is not necessary.
Candidates who fail to meet entry-level competency are provided information regarding their testing experience. Studying examination items to prepare to do the job of an EMT is not helpful. Studying the tasks and the job of an EMT provides the best preparation. Candidates who memorize items in hopes of “getting them right,” the next time are wasting their time because masking items prevents them from seeing the same item again.
What is included on the exam? The "Test Plan"
NREMT examinations are developed to measure the important aspects of out-of-hospital care practice. Examination items are developed in relation to tasks identified in the practice analysis. The domain of practice that limits therapy addressed in an item is based upon National EMS Scope of Practice Model and the NREMT Practice Analysis.
EMS education programs are encouraged to review the current NREMT practice analysis when teaching courses and as a part of the final review of the abilities of students to properly deliver the tasks necessary for competent patient practice.
Based on the 2014 Practice Analysis, the current National EMS Certification Examinations cover five content areas:
- Airway, Respiration & Ventilation
- Cardiology & Resuscitation
- EMS Operations
|Airway, Respiration & Ventilation||18%-22%||18%-22%||18%-22%||18%-22%|
|Cardiology & Resuscitation||20%-24%||20%-24%||21%-25%||22%-26%|
National EMS Practice Analysis
The goal of licensure and certification is to assure the public that individuals who work in a particular profession have met certain standards and are qualified to engage in practice (American Educational Research Association, American Psychological Association, and National Council on Measurement in Education, 1999). To meet this goal, the requirements for certification and licensure must be based on the ability to practice safely and effectively (Kane, 1982). The practice analysis is a critical component in the development of a legally defensible and psychometrically sound credentialing process.
The primary purpose of a practice analysis is to develop a clear and accurate picture of the current practice of a job or profession, in this case the provision of emergency medical care in the out-of-hospital environment. The results of the practice analysis are used throughout the entire National Registry of Emergency Medical Technicians (NREMT) examination development process, which helps to ensure a connection between the examination content and actual practice. The practice analysis helps to answer the questions, "What are the most important aspects of practice?" and "What constitutes safe and effective care?" It also enables the NREMT to develop examinations that reflect contemporary, real-life practice of out-of-hospital emergency medicine.
The NREMT conducted its first practice analysis in 1994 and at five year intervals. The most recent practice analysis was conducted in 2014. After the data is collected, an analysis is conducted that accounts for frequency and criticality. This weighted importance score is then combined for each of the five domains on the NREMT examinations: Airway, Respiration & Ventilation, Cardiology & Resuscitation; Medical & OB/Gyn, Trauma, and EMS Operations. After the weighted importance scores are calculated, the proportion represented by each area is used to set the blueprint for the next five years of NREMT examinations. A copy of the 2014 Practice Analysis can be purchased via the NREMT Store.
To help you understand what to expect from exam questions, we have provided examples of the types of questions entry level providers are expected to answer on the exam. These three questions range in difficulty but are all either at the passing standard or above the passing standard.
Your patient fell while skateboarding and has a painful, swollen, deformed lower arm. You are unable to palpate the radial pulse. You should immediately
- apply cold packs.
- align the arm with gentle traction.
- splint the arm in the position found.
- ask the patient to try moving the arm.
Your patient is a disoriented 86 year old male
who has a history of terminal brain cancer. He
fell out of bed and complains of severe right hip
pain. His wife called 9-1-1 for assistance in
putting him back to bed. She tells you that he
has DNR orders and that she does not want him
transported. You should initially
- explain why he needs to be transported.
- ask to see the DNR orders
- have her sign a refusal form.
- call for law enforcement back-up.
You are called to a scene where law enforcement
officers have detained a man who they thought
was drunk. They called you because he has a
history of diabetes. You administer oral glucose
and within a minute the patient becomes
unresponsive. You should
- remain at the scene under law enforcement authority and request ALS back-up.
- leave the glucose in place, complete a primary survey and transport.
- open his airway with an oropharyngeal airway and ventilate him.
- suction his mouth and begin transport.
Where do the test questions (items) come from?
The National Registry of EMTs (NREMT) follows an extensive process to develop/create cognitive exam items (questions). Each exam question takes approximately one year to create. The estimated cost to create one valid test question is approximately $1600. The item development process is the same for all four levels of National EMS Certification: Emergency Medical Responder (EMR), Emergency Medical Technician (EMT), Advanced Emergency Medical Technician (AEMT) and Paramedic (NRP).
Computer based cognitive examinations consist of items drawn from the NREMT's item banks. NREMT computer based exams are constructed to ensure that each candidate receives a distribution of items from five categories:
- Airway, Respiration & Ventilation
- Cardiology & Resuscitation
- EMS Operations
Individual examination items are developed by members of the EMS community serving on Item Writing Committees convened by the NREMT. Item Writing Committees typically have nine to ten national EMS experts as members (physicians, state regulators, educators and providers). They meet over several days to review, rewrite, and reconstruct drafted items. Consensus by the committee must be gained for each item. This ensures that every question is in direct reference to the tasks in the practice analysis; that the correct answer is the one and only correct answer; that each distracter option has some plausibility; and the answer can be found within commonly available EMS textbooks. Controversial questions are discarded and not placed within the pilot item pools. Items are also reviewed for the appropriate reading level and to ensure no bias exists related to race, gender or ethnicity.
Following completion of the item-writing phase, all items are pilot tested. Pilot items are administered to all candidates during the computer based cognitive exams. To the candidates, pilot items are indistinguishable from scored items; however, they do not count for or against the candidate. Extensive analysis of the performance of the pilot items is conducted with those functioning properly, under high stakes pilot testing. When the item analysis is complete, the items are determined to be functioning properly and are psychometrically sound; they are placed in “live” item pools.
The NREMT conducts differential statistical analysis of items in pre-test item pools and live item pools on an annual basis. Panels are then convened to review the items that show differential statistics and decisions are made regarding maintenance of any items within the pools.
All exam items evaluate your ability to apply knowledge from your course and textbook to the types of tasks and situations that are expected of entry-level EMS professionals. Questions that are answered incorrectly on the exam mean you could choose the wrong assessment or treatment in the field. There are some general concepts to remember about the cognitive exam:
- There is only one best answer. The items are written to determine how you would respond when providing patient care. Incorrect responses may be misunderstandings, common mistakes or inefficient approaches that represent less-than-optimal care.
- Examination content reflects the National EMS Educational Standards, not local or state protocols. The NREMT avoids questions on specific details that have regional differences. Some topics in EMS are controversial, and experts disagree on the single best approach to some situations. The NREMT avoids testing over controversial areas.
- NREMT exams focus on what providers should do in the field. The exam is not taken from any single textbook or source. The exams are intended to reflect the current accepted practices of EMS. Fortunately, most textbooks are up-to-date and written to a similar standard; however, no single source thoroughly prepares you for the exam. You are encouraged to consult multiple references, especially in areas in which you are having difficulty.
- You do not need to be an experienced computer user or be able to type to take the computer based exam. The computer testing system has been designed so that it can be used by those with even minimal computer experience and typing skills. A tutorial is available to each candidate at the testing center prior to taking the examination.
Here are a few simple suggestions that will help you to perform to the best of your ability on the examination:
- Study your textbook thoroughly and consider using the accompanying workbooks to help you master the material.
- Thoroughly review the current American Heart Association’s Guidelines for Cardiopulmonary Resuscitation and Emergency Cardiovascular Care. You will be tested on this material at the level of the exam you are taking.
- The NREMT does not recommend a particular study guide but recognizes that they can be useful. Study guides may help you identify your weaknesses, but should be used carefully. Some study guides have many easy questions leading some candidates to believe that they are prepared for the exam when more study is warranted. If you choose to use a study guide, we suggest that you do so a few weeks before your actual exam. You can obtain these from your local bookstore or library. Use the score to identify your areas of strength and weakness. Re-read and study your notes and materials for the areas you did not do well in.
- The NREMT is not able to provide candidates information about their specific deficiencies.
The Night Before The Exam
- Do not try to study the night before the exam. If you come across a topic you do not think you know well, there will not be enough time to study. This will only create a stressful situation.
- Get a good night’s sleep
The Day of the Exam
- Eat a well-balanced meal.
- Arrive at the test center at least 30 minutes before the scheduled testing time. The identification and examination preparation process takes time. You may also need this time to review the tutorial on taking a computer based test. Arriving early will reduce stress.
- Be sure to have the proper identification as outlined in your confirmation materials before you head to the test center
- You will not be able to take the exam if you do not have the proper form of identification.
- Relax, thorough preparation and confidence are the best ways to reduce test anxiety
During the Exam
- Take your time and read each question carefully. The exam is constructed so most people will have plenty of time to finish. Most successful candidates spend about 30 – 60 seconds per item reading each question carefully and thinking it through.
- Less than 1% of the candidates are unable to finish the exam. Your risk of misreading a question is far greater than your risk of running out of time.
- Don’t get frustrated. Because of the adaptive nature of the exam, everyone will think their exam is difficult. The CAT algorithm is adjusting the exam to your maximum ability level, so you may feel that all the items are difficult. Focus on one question at a time, do your best on that question and move on.
After The Exam
- Examination results are not released at the test center or over the telephone.
- Your examination results will be posted to your NREMT account usually within 2 business days following the completion of the examination provided you have met all other requirements of registration.
- Log into your account and click on "Dashboard" or "My Application -> Application Status" to view your exam results.
The NREMT complies with the Americans with Disabilities Act (ADA) of 1990 and offers reasonable accommodations for individuals with disabilities. Pearson VUE test centers are also ADA compliant. Complete information about the NREMT Accommodations Disability Policy can be found here.