CompTIA Performance Based Testing
Performance based testing is one of the biggest changes in CompTIA certification exams. If you’re planning on taking the A+, Network+, or Security+ exams, you can expect to see these types of questions.
What is Performance Based Testing?
Performance based testing requires you to actually perform a task or solve a problem to answer a question. When you start the question, you’ll be in a simulated environment such as a command prompt or Windows environment. You will perform the task and then click Done to complete the question.
In the past, most CompTIA questions have been multiple choice where you pick one or more answers from a list of valid choices. Multiple choice questions are good to test certain types of knowledge but they aren’t the best if you want to verify that a person can perform a task.
Imagine if the police or military tested sharp shooters with a multiple choice exam. It just doesn’t work. Instead, sharp shooters are required to demonstrate their skills on a shooting range, by firing live bullets at a target.
Similarly, there are many technical skills that can’t be accurately tested with multiple choice questions. Instead, many certification exams require you to perform a specific task in a simulated environment.
Performance Based Testing Example
In demos I’ve seen by CompTIA personnel, they describe a scenario where you are given a task such as this:
“You need to navigate to the c:\data folder and then change the study.txt file to read-only using appropriate commands.”
You are then prompted to click a button to launch a simulated environment. When you click it, you’ll see a command prompt similar to Figure 1.
Figure 1. Simulated command prompt window.
The first challenge is changing the current folder (or directory) and you’ll need to know that you use the cd (change directory) command to do so, and you’ll also need to know the proper syntax. The following command shows how:
Alternatively, you can also use this command:
It’s important to understand there are different ways to accomplish a task because there are many times when a simulation will only accept one method. In other words, even though both commands will work in the real world, they won’t necessarily work in the simulated environment.
The screen now looks like Figure 2. Notice that the prompt shows c:\data as the current directory.
Figure 2. Command prompt after changing the directory.
After changing the directory with the cd command, the next challenge is to change the file’s attributes from the command prompt.
You might know how to do this from Windows Explorer, but you won’t have access to Windows Explorer. Instead, you’ll have to use the attrib command.
In this case, you’ll need to know that you use a minus (-) to remove an attribute and a plus (+) to set the attribute. You’ll also need to know that the attribute you need to change is the read-only attribute and that the command used to change the read-only attribute is r.
The format of the command to set the read-only attribute is: attrib +r filename. The file name is study.txt so the actual command is:
attrib +r study.txt
After entering the command, the screen will look similar to Figure 3.
Figure 3. Command prompt after changing the attribute.
At this point, you have successfully answered the question. You’ll be able to click the “Done” button and you can move on to the next question.
You might have noticed that the attrib command doesn’t give you any feedback when you enter it successfully. If you enter it incorrectly, you’ll see an error, but when you enter it correctly, it simply performs the command and returns the same prompt.
In real life, you can use the attrib command by itself to see the attributes for all the files in the current directory as shown in Figure 4. However, supporting the attrib command usage like this requires additional programming for the simulation, so it might work in the simulated environment and it might not. It depends on how much detail they choose to add to the simulation.
Figure 4. Command prompt showing attributes.
In the graphic, you can see that the R attribute is set indicating the file is set to read-only. The A attribute is the archive attribute indicating that the file has not been archived (backed up) or has been modified since the last back up.
Security+ Practice Test Questions
Security+ Practice Test QuestionsFull bank of 468 realistic practice test questions with in-depth explanations. All questions include explanations so you'll know why the correct answers are correct, and why the incorrect answers are incorrect. This way no matter how CompTIA words the questions, you'll be able to answer them correctly. These questions are from the CompTIA Security+: Get Certified Get Ahead: SY0-301 Study Guide. Multiple quiz formats to let you use these questions based on the way you learn.
- Learn mode - randomized. View each of the questions in random order. Learn mode allows you to keep selecting answers until you select the correct answer. Once you select the correct answer, you'll see the explanation. Click here to see how learn mode works.
- Learn mode - not randomized. View each of the questions in the same order. Use this if you want to make sure that you see all of the questions. Learn mode allows you to keep selecting answers until you select the correct answer. Once you select the correct answer, you'll see the explanation. Click here to see how learn mode works.
- Test mode - randomized. View each of the questions in random order. In test mode, you can only see the correct answers and explanations after you complete the test. Click here to see how test mode works.
- Test mode - not randomized.View each of the questions in the same order. In test mode, you can only see the correct answers and explanations after you complete the test. Click here to see how test mode works.
- Test mode - 100 random questions. View 100 random questions from the full test bank similar to how the Security+ exam has a potential maximum of 100 multiple choice questions. In test mode, you can only see the correct answers and explanations after you complete the test. Click here to see how test mode works.
|30 Day Access||60 Day Access|
|Normally $29.99||Normally $39.99|
Now Only $14.99
Now Only $19.99
Bonus - Performance Based Questions
Additional Security+ questions to help you prepare for the new performance based questions. These are included with the full bank of Security+ practice test questions and are divided into different sections. For example, you'll have access to the following links:
- Performance Based Question - Set 1You'll see a graphic explaining what you might be required to do on the actual exam to match different types of security to mobile devices and servers in a data center. You'll then have two questions that test your knowledge and ability to correctly answer the questions. This question also includes a link to a graphic showing the end solution for the overall performance based question simulation.
- Performance Based Question - Set 2You'll see a graphic explaining what you might be required to do on the actual exam to match different types of attacks with the name of the attack type. You'll then have five questions that test your knowledge and ability to correctly answer the questions. This question also includes a link to a graphic showing the end solution for the overall performance based question simulation.
- Performance Based Question - Set 3You'll see a graphic showing a network with computers and servers separated by a firewall. The firewall is used to control traffic between the computers and users using rules within an access control list (ACL). You'll have three questions that test your knowledge and ability to correctly identify the relevant components of the rule. The incorrect answers and explanation provide you with insight into how to correctly answer this type of question on the actual exam.
- Performance Based Question - Set 4You'll see a graphic explaining what you might be required to do on the actual exam related to what a forensic analyst would do during an investigation. You'll then have two questions that test your knowledge and ability to correctly answer the questions. This question also includes a link to a graphic showing the end solution for the overall performance based question simulation.
- Performance Based Question - Set 5You'll see a graphic explaining what you might be required to do on the actual exam to match protocols and ports. You'll then have seven questions that test your knowledge and ability to correctly answer the questions. This question also includes a link to a graphic showing the end solution for the overall performance based question simulation.
Read the Question
As with any test question, it’s important that you read the wording of the question carefully. For example, the previous question indicated that you needed to perform two tasks:
- Navigate to the c:\data folder
- Set the attribute to read-only
In real life, you could achieve the same result in one command like this:
attrib +r c:\data\study.txt
Using this command, you’ll achieve the correct result. However, it’s very likely the question would be graded as incorrect because you didn’t do it as two steps.
Similarly, this would also be marked as incorrect:
attrib -r study.txt
This command clears (instead of sets) the read-only attribute.
How Many Performance Based Questions Should I Expect?
These questions take a lot more effort for CompTIA to create than a typical multiple choice question. A programmer has to create the simulated environment so that it looks realistic and supports multiple actions. All of this costs time and money. With this in mind, I don’t expect to see more than about five or six questions for any exam.
Security+ Full Access Package
|Regular Price||Security+ Study Package||Security+ Full Access Package|
|Full bank of 468 Security+ practice test questions All questions include explanations so you'll know why the correct answers are correct, and why the incorrect answers are incorrect. (30 day access.) Click here for a sample.||$29.99|
|Performance Based Simulated Questions Several questions to help you understand and prepare for performance based questions. Included with the full bank of Security+ practice test questions. This includes both the Security+ Study Package and and the Security+ Full Access Package.||--|
|168 Security+ Flashcards Reinforce key testable concepts with these flashcards. (30 day access.)||$1.99|
|211 Security+ Acronyms Flashcards CompTIA frequently uses acronyms in their exams and these flashcards will help you master them. (30 day access.)||$1.99|
|214 Security+ Remember This Slides All of the Remember This text blocks from the popular CompTIA Security+: Get Certified Get Ahead: SY0-301 Study Guide. (30 day access.)||$1.99|
|Free Bonus #1 End of chapter reviews from each of the chapters in the CompTIA Security+: Get Certified Get Ahead: SY0-301 Study Guide. (30 day access.)||--|
|Security+ Remember This Audio Files Learn by Listening. Over one hour and 20 minutes of audio repeating the Remember This blocks from the popular CompTIA Security+: Get Certified Get Ahead: SY0-301 Study Guide. (MP3 downloads.)||$7.99|
|Security+ Question and Answer Audio Files Learn by Listening. Over three hours hour and 20 minutes of audio repeating questions and answers from the 11 chapters in the popular CompTIA Security+: Get Certified Get Ahead: SY0-301 Study Guide. (MP3 downloads.)||$9.99|
|Security+ Study Package||Security+ Full Access Package|
|Total when purchased separately|
Do I Get Partial Credit?
A common question people ask when taking these types of questions is if they get partial credit if they correctly perform part of the problem but not all of it. For example, if you correctly change the directory but do not change attribute, would you get any credit?
CompTIA isn’t saying, but I wouldn’t be surprised if they don’t award partial credit for these performance based questions. In other words, the question is testing your ability to complete a task and either you can, or you can’t. Think back to the sharp shooter. Perhaps he can successfully load bullets into a gun but cannot hit a target. Should he get partial credit?
How Are These Questions Graded?
CompTIA isn’t giving any specifics about how the questions are graded but you can certainly expect them to be worth more than a typical multiple choice question. These questions are much deeper and require more knowledge to answer correctly.
If a regular question is worth 8 points on a CompTIA scale of 100 to 900, a performance based question might be worth 24 points or even 32 points. You can probably afford to get one or two of these wrong but if you answer them all incorrectly, you’ll probably fail the exam.
Performance Based Testing and the Command Prompt
The command prompt is relatively easy to simulate for a performance based question. Also, the command prompt has many similarities between operating systems so it’s easier to create vendor neutral questions. Because of this, make sure you have a good understanding of any command prompt objectives for the exam you plan on taking.
Along those lines, if you’re looking for a book that has in-depth coverage of the command prompt, you might like to check out this book: Windows 7 Portable Command Guide (ISBN 978-0789747359). It provides straightforward coverage of how to use the command prompt with a wealth of examples showing exactly what to type to accomplish specific tasks.
Performance Based Testing in the CASP Exam
CompTIA first used performance based testing in the CompTIA Advanced Security Practitioner (CASP) exam when it was released in beta format. It has continued to be a part of the CASP exam since.
The CASP exam only gives you a score of pass/fail rather than a numerical score. This is different from other CompTIA exams and it’s not clear if they’re doing this because of the performance based questions or because of some other reason.
Performance Based Testing in the A+ Exam
The current version of the A+ exam has two exams (220-801 and 220-802). They were released in October 2012 and include performance based testing.
The command prompt is included in many of the objectives, so you can expect performance based questions using the command prompt on the A+ exams. Another strong possibility is usage of different Control Panel applets. For example, you might be tasked with launching the firewall through the Control Panel and enabling it. The exam objectives specifically state that you should be able to navigate the Control Panel using the icon or list view, so you should be familiar with how to change the view from Category view to one of the list views.
One way to ensure you are prepared for these types of questions is to get as much hands on as possible. The CompTIA A+ Training Kit (Exam 220-801 and Exam 220-802) (ISBN 978-0735662681) includes many different exercises written specifically with these performance based questions in mind. As you’re reading the book, go through the exercises and you’ll be better prepared to correctly complete these questions.
Performance Based Testing in the Network+ Exam
CompTIA added performance based questions to the current version of the Network+ exam (N10-005). The Network+ Performance Based Questions section of the Network+ Blog Links page includes links to some other blogs on these types of questions.
Just as with the A+ exam, there are a lot of possibilities with the command prompt for performance based testing on the Network+ exam. As a simple example, you might be tasked with removing a Dynamic Host Configuration Protocol (DHCP) lease for a client and then obtaining a new lease. When you launch the simulation, you’ll see a command prompt. You’ll then need to enter the following two commands:
The first command releases the current DHCP lease and the second command requests a new lease.
Check out these blogs for more information on performance based questions and the Network+ exam:
Performance Based Testing in the Security+ Exam
The current version of Security+ is SY0-301 and CompTIA began adding performance based testing questions to this exam in the first quarter of 2013. The Security+ Performance Based Questions section of the Security+ Blog Links page includes links to some other blogs on these types of questions.
There are many possibilities with the command prompt.
As an example, you might be asked to calculate the hash on a file and when you click the button, the simulated environment will put you into a command prompt simulation. If you type in dir and press Enter, you’ll see the files in the directory and you might have the md5sum or sha1sum executable file.
You’ll need to be familiar with how to use these programs to calculate a hash. For example, you can calculate the Message Digest 5 (MD5) hash of a file named study.txt with the following command:
The program then outputs something like this:
The first string of hexadecimal characters is the hash of the file, and the file name (study.txt) is after the star (*).
A similar example is in the CompTIA Security+: Get Certified Get Ahead: SY0-301 Study Guide (ISBN 978-1463762360) in the cryptography chapter.
Other Security+ Study Resources
- Security+ blogs organized by categories
- Security+ blogs with free practice test questions
- Security+ blogs on new performance based questions
- Mobile Apps: Apps for mobile devices running iOS or Android
- Audio Files: (Learn by listening with over 4 1/2 hours of audio on Security+ topics)
- Flashcards: 31 Security+ Topic flashcards and 17 Security+ acronyms flashcards (free samples)
- Quality Practice Test Questions: Over 475 quality Security+ practice test questions with full explanations
- Full Security+ Study Packages: Quality practice test questions, audio, and Flashcards)