Manual Functional Testing: Difference between revisions
(17 intermediate revisions by one other user not shown) | |||
Line 5: | Line 5: | ||
All the test cases share the following format. If you come up with a new test case to add please use this format. |
All the test cases share the following format. If you come up with a new test case to add please use this format. |
||
=== Test Title === |
==== Test Title ==== |
||
'''Prerequisites:''' (''This is what a test needs before it runs.'') Ex - Image plug-in enabled. Activated user account. An image available for upload |
'''Prerequisites:''' (''This is what a test needs before it runs.'') Ex - Image plug-in enabled. Activated user account. An image available for upload |
||
'''Regression:''' (''Yes if the functionality existed in the previous release otherwise it is set to no. All test cases should eventually be regression tests.'') Ex - Yes |
'''Regression:''' (''Yes if the functionality existed in the previous release otherwise it is set to no. All test cases should eventually be regression tests. Note: "yes" here means it's a regression test, not that it's a current regression.'') Ex - Yes |
||
'''Steps:''' (''These don't need to be exactly step-by-step but rather more general'') Ex - |
'''Steps:''' (''These don't need to be exactly step-by-step but rather more general'') Ex - |
||
Line 23: | Line 23: | ||
=== Copyable format === |
=== Copyable format === |
||
<nowiki>=== Title ===</nowiki> |
<nowiki>==== Title ====</nowiki> |
||
<nowiki>'''Prerequisites:''' </nowiki> |
<nowiki>'''Prerequisites:''' </nowiki> |
||
Line 39: | Line 39: | ||
=== Core === |
=== Core === |
||
==== Create Account ==== |
|||
'''Prerequisites:''' No user account created with selected username. |
|||
'''Regression:''' Yes |
|||
'''Steps:''' |
|||
# Go to Mediagoblin. |
|||
# Click on the Create account button. |
|||
# Enter a username. |
|||
# Enter a password. |
|||
# Enter a valid e-mail address. |
|||
'''Expected results:''' |
|||
* A message telling you that email verification is needed is displayed. |
|||
* If the instance is in debug mode: |
|||
** An e-mail message appears on the console. |
|||
* Else: |
|||
** You receive an e-mail. |
|||
==== Create a Pre-Existing Account ==== |
|||
'''Prerequisites:''' A username for an existing account. |
|||
'''Regression:''' Yes |
|||
'''Steps:''' |
|||
# Go to Mediagoblin. |
|||
# Click on the Create account button. |
|||
# Enter the username. |
|||
# Enter a password. |
|||
# Enter a valid e-mail address. |
|||
'''Expected results:''' |
|||
* A message telling you that a user with that name already exists. |
|||
==== Create Collection ==== |
|||
'''Prerequisites:''' Activated user account. |
|||
'''Regression:''' Yes |
|||
'''Steps:''' |
|||
# Login to MediaGoblin. |
|||
# Click on the Create new collection button. |
|||
# Give it a title and description. |
|||
# Click submit. |
|||
'''Expected results:''' |
|||
* A message stating the collection was added is displayed. |
|||
* The collection under browse collections has the title and description that you set. |
|||
==== Edit Collection ==== |
|||
'''Prerequisites:''' Activated user account. Collection created. |
|||
'''Regression:''' Yes |
|||
'''Steps:''' |
|||
# Login to MediaGoblin. |
|||
# Click on your username. |
|||
# Click on browse collections. |
|||
# Click on the collection. |
|||
# Click the edit button. |
|||
# Change the title, description, and slug. |
|||
# Click save changes. |
|||
'''Expected results:''' |
|||
* The collection's title, slug, and description changed to the new values. |
|||
==== Delete Collection ==== |
|||
'''Prerequisites:''' Activated user account. Collection created. |
|||
'''Regression:''' Yes |
|||
'''Steps:''' |
|||
# Login to MediaGoblin. |
|||
# Click on your username. |
|||
# Click on browse collections. |
|||
# Click on the collection. |
|||
# Click the delete button. |
|||
# Check the deletion confirmation check box. |
|||
# Click the delete permanently button. |
|||
'''Expected results:''' |
|||
* A message stating that the collection had been deleted was displayed. |
|||
* The collection no longer appears on your browse collection's page. |
|||
==== Cancel Deleting Collection ==== |
|||
'''Prerequisites:''' Activated user account. Collection created. |
|||
'''Regression:''' Yes |
|||
'''Steps:''' |
|||
# Login to MediaGoblin. |
|||
# Click on your username. |
|||
# Click on browse collections. |
|||
# Click on the collection. |
|||
# Click the delete button. |
|||
# Keep the confirmation check box unchecked. |
|||
# Click the delete permanently button. |
|||
'''Expected results:''' |
|||
* A message stating that the collection was not deleted was displayed. |
|||
* The collection still appears on your browse collection's page. |
|||
==== Add Media to Collection ==== |
|||
'''Prerequisites:''' Activated user account. Collection created. Media item exists. |
|||
'''Regression:''' Yes |
|||
'''Steps:''' |
|||
# Login to MediaGoblin. |
|||
# Click on a media item. |
|||
# Click on add to collection. |
|||
# Select your collection. |
|||
# Write a note. |
|||
# Press add button. |
|||
'''Expected results:''' |
|||
* A message stating that the media item had been added to the collection was displayed. |
|||
==== Edit Media Item ==== |
|||
'''Prerequisites:''' Activated user account. Media item created. |
|||
'''Regression:''' Yes |
|||
'''Steps:''' |
|||
# Login to MediaGoblin. |
|||
# Click on a media item you submitted. |
|||
# Click on the edit button |
|||
# Change the title, description, tags, slug, and license. |
|||
# Click of the save changes button. |
|||
'''Expected results:''' |
|||
* The media item's title, description, tags, slug, and license changed to the new values. |
|||
==== Delete Media Item ==== |
|||
'''Prerequisites:''' Activated user account. Media item created. |
|||
'''Regression:''' Yes |
|||
'''Steps:''' |
|||
# Login to MediaGoblin |
|||
# Click on a media item you submitted. |
|||
# Click the delete button. |
|||
# Check the confirmation box. |
|||
# Click the delete permanently button. |
|||
'''Expected results:''' |
|||
* A message stating that the media item had been deleted was displayed. |
|||
* The media item not longer shows up on the list. |
|||
==== Cancel Delete Media Item ==== |
|||
'''Prerequisites:''' Activated user account. Media item created. |
|||
'''Regression:''' Yes |
|||
'''Steps:''' |
|||
# Login to MediaGoblin |
|||
# Click on a media item you submitted. |
|||
# Click the delete button. |
|||
# Do not check the confirmation box. |
|||
# Click the delete permanently button. |
|||
'''Expected results:''' |
|||
* A message stating that the media item hadn't been deleted was displayed. |
|||
* The media item still shows up on the list. |
|||
=== Social === |
|||
==== Add a Comment ==== |
|||
'''Prerequisites:''' Activated user account. A media item without silenced comments. |
|||
'''Regression:''' Yes |
|||
'''Steps:''' |
|||
# Login to MediaGoblin. |
|||
# Select the media item. |
|||
# Click the add a comment button |
|||
# Write a comment using Markdown formatting. |
|||
# Click add this comment |
|||
'''Expected results:''' |
|||
* A preview of the comment is shown while you are authoring it. |
|||
* The comment is added to the media item by your user. |
|||
==== Check Notifications ==== |
|||
'''Prerequisites:''' Activated user account. Notifications enabled. A comment has been made on one of your media items. |
|||
'''Regression:''' Yes |
|||
'''Steps:''' |
|||
# Login to MediaGoblin. |
|||
# Click on the notification. |
|||
'''Expected results:''' |
|||
* A notification number should appear on the tool bar. |
|||
* A comment is displayed. |
|||
=== Media types === |
=== Media types === |
||
==== Images ==== |
|||
'''Prerequisites:''' Activated user account. Image plug-in enabled. |
|||
'''Regression:''' Yes |
|||
'''Steps:''' |
|||
# Login to MediaGoblin. |
|||
# Click on the Add Media button. |
|||
# Select your image file. |
|||
# Give your media item a title, description, and appropriate tags. Select a license. |
|||
# Press submit. |
|||
'''Expected results:''' |
|||
* A message telling you the item was submitted. |
|||
* The uploaded item has all of the information from step 4 (title, description, tags, license) and the image from step 3 displayed correctly when clicked on. |
|||
==== WebM Video ==== |
|||
'''Prerequisites:''' Activated user account. Video plug-in enabled. WebM VP8/Vorbis video available for upload. |
|||
'''Regression:''' Yes |
|||
'''Steps:''' |
|||
# Login to Mediagoblin. |
|||
# Click on the Add Media button. |
|||
# Select your WebM video file. |
|||
# Give your media item a title, description, and appropriate tags. Select a license. |
|||
# Press submit. |
|||
'''Expected results:''' |
|||
* A message telling you the item was submitted. |
|||
* The uploaded item has all of the information from step 4 (title, description, tags, license) and the image from step 3 displayed correctly when clicked on. |
|||
* The video should not have been transcoded. |
|||
==== Other Video ==== |
|||
'''Prerequisites:''' Activated user account. Video plug-in enabled. Video available for upload (not WebM format) |
|||
'''Regression:''' Yes |
|||
'''Steps:''' |
|||
# Login to Mediagoblin. |
|||
# Click on the Add Media button. |
|||
# Select your video file. |
|||
# Give your media item a title, description, and appropriate tags. Select a license. |
|||
# Press submit. |
|||
'''Expected results:''' |
|||
* A message telling you the item was submitted. |
|||
* The uploaded item has all of the information from step 4 (title, description, tags, license) and the image from step 3 displayed correctly when clicked on. |
|||
* The video should have been transcoded to WebM. |
|||
==== Ogg Audio ==== |
|||
'''Prerequisites:''' Activated user account. Audio plug-in enabled. Ogg/Vorbis audio file available for upload. |
|||
'''Regression:''' Yes |
|||
'''Steps:''' |
|||
# Login to Mediagoblin. |
|||
# Click on the Add Media button. |
|||
# Select your Ogg/Vorbis audio file. |
|||
# Give your media item a title, description, and appropriate tags. Select a license. |
|||
# Press submit. |
|||
'''Expected results:''' |
|||
* A message telling you the item was submitted. |
|||
* The uploaded item has all of the information from step 4 (title, description, tags, license) and the image from step 3 displayed correctly when clicked on. |
|||
* The audio file should not have been transcoded. |
|||
==== Other Audio ==== |
|||
'''Prerequisites:''' Activated user account. Audio plug-in enabled. Audio file available for upload (not Ogg/Vorbis format) |
|||
'''Regression:''' Yes |
|||
had been deleting was displayed. |
|||
'''Steps:''' |
|||
# Login to Mediagoblin. |
|||
# Click on the Add Media button. |
|||
# Select your audio file. |
|||
# Give your media item a title, description, and appropriate tags. Select a license. |
|||
# Press submit. |
|||
'''Expected results:''' |
|||
* A message telling you the item was submitted. |
|||
* The uploaded item has all of the information from step 4 (title, description, tags, license) and the image from step 3 displayed correctly when clicked on. |
|||
* The audio file should have been transcoded to Ogg/Vorbis. |
|||
== Reporting bugs from this test suite == |
== Reporting bugs from this test suite == |
||
Line 50: | Line 347: | ||
You can copy-and-paste the test steps to include with the bug report to make things easier to debug. |
You can copy-and-paste the test steps to include with the bug report to make things easier to debug. |
||
== Where to run this suite == |
|||
See: [[HackingHowto]] or http://docs.mediagoblin.org |
|||
You can run these tests on a local development instance or, if one has been made available, a test instance. If a test instance has been made available we will try to include links to them here. Details on how to set up your own development MediaGoblin instance can be found at one of the two links above. |
Latest revision as of 20:54, 16 October 2014
Manual testing is a great way to help out MediaGoblin when we're preparing for a new release. It can also help you get familiar with how MediaGoblin works and what it's all about. That is where this functional test suite comes in. Completing the tests from this suite can help us to know that our existing functionality is intact and the perspective of the new testers can help identify potential issues where ones had not previously been identified.
Test template
All the test cases share the following format. If you come up with a new test case to add please use this format.
Test Title
Prerequisites: (This is what a test needs before it runs.) Ex - Image plug-in enabled. Activated user account. An image available for upload
Regression: (Yes if the functionality existed in the previous release otherwise it is set to no. All test cases should eventually be regression tests. Note: "yes" here means it's a regression test, not that it's a current regression.) Ex - Yes
Steps: (These don't need to be exactly step-by-step but rather more general) Ex -
- Login to MediaGoblin
- Click on the Add Media button
- Select an image.
- Give it a title, description, and appropriate tags. Select a license.
- Press submit
Expected results: (This should be more specific than the steps.) Ex -
- A message telling you the item was submitted.
- The uploaded item has all of the information from step 4 (title, description, tags, license) and the image from step 3 displayed correctly when clicked on.
Copyable format
==== Title ==== '''Prerequisites:''' '''Regression:''' '''Steps:''' # # '''Expected results:''' * *
Test suite
Core
Create Account
Prerequisites: No user account created with selected username.
Regression: Yes
Steps:
- Go to Mediagoblin.
- Click on the Create account button.
- Enter a username.
- Enter a password.
- Enter a valid e-mail address.
Expected results:
- A message telling you that email verification is needed is displayed.
- If the instance is in debug mode:
- An e-mail message appears on the console.
- Else:
- You receive an e-mail.
Create a Pre-Existing Account
Prerequisites: A username for an existing account.
Regression: Yes
Steps:
- Go to Mediagoblin.
- Click on the Create account button.
- Enter the username.
- Enter a password.
- Enter a valid e-mail address.
Expected results:
- A message telling you that a user with that name already exists.
Create Collection
Prerequisites: Activated user account.
Regression: Yes
Steps:
- Login to MediaGoblin.
- Click on the Create new collection button.
- Give it a title and description.
- Click submit.
Expected results:
- A message stating the collection was added is displayed.
- The collection under browse collections has the title and description that you set.
Edit Collection
Prerequisites: Activated user account. Collection created.
Regression: Yes
Steps:
- Login to MediaGoblin.
- Click on your username.
- Click on browse collections.
- Click on the collection.
- Click the edit button.
- Change the title, description, and slug.
- Click save changes.
Expected results:
- The collection's title, slug, and description changed to the new values.
Delete Collection
Prerequisites: Activated user account. Collection created.
Regression: Yes
Steps:
- Login to MediaGoblin.
- Click on your username.
- Click on browse collections.
- Click on the collection.
- Click the delete button.
- Check the deletion confirmation check box.
- Click the delete permanently button.
Expected results:
- A message stating that the collection had been deleted was displayed.
- The collection no longer appears on your browse collection's page.
Cancel Deleting Collection
Prerequisites: Activated user account. Collection created.
Regression: Yes
Steps:
- Login to MediaGoblin.
- Click on your username.
- Click on browse collections.
- Click on the collection.
- Click the delete button.
- Keep the confirmation check box unchecked.
- Click the delete permanently button.
Expected results:
- A message stating that the collection was not deleted was displayed.
- The collection still appears on your browse collection's page.
Add Media to Collection
Prerequisites: Activated user account. Collection created. Media item exists.
Regression: Yes
Steps:
- Login to MediaGoblin.
- Click on a media item.
- Click on add to collection.
- Select your collection.
- Write a note.
- Press add button.
Expected results:
- A message stating that the media item had been added to the collection was displayed.
Edit Media Item
Prerequisites: Activated user account. Media item created.
Regression: Yes
Steps:
- Login to MediaGoblin.
- Click on a media item you submitted.
- Click on the edit button
- Change the title, description, tags, slug, and license.
- Click of the save changes button.
Expected results:
- The media item's title, description, tags, slug, and license changed to the new values.
Delete Media Item
Prerequisites: Activated user account. Media item created.
Regression: Yes
Steps:
- Login to MediaGoblin
- Click on a media item you submitted.
- Click the delete button.
- Check the confirmation box.
- Click the delete permanently button.
Expected results:
- A message stating that the media item had been deleted was displayed.
- The media item not longer shows up on the list.
Cancel Delete Media Item
Prerequisites: Activated user account. Media item created.
Regression: Yes
Steps:
- Login to MediaGoblin
- Click on a media item you submitted.
- Click the delete button.
- Do not check the confirmation box.
- Click the delete permanently button.
Expected results:
- A message stating that the media item hadn't been deleted was displayed.
- The media item still shows up on the list.
Social
Add a Comment
Prerequisites: Activated user account. A media item without silenced comments.
Regression: Yes
Steps:
- Login to MediaGoblin.
- Select the media item.
- Click the add a comment button
- Write a comment using Markdown formatting.
- Click add this comment
Expected results:
- A preview of the comment is shown while you are authoring it.
- The comment is added to the media item by your user.
Check Notifications
Prerequisites: Activated user account. Notifications enabled. A comment has been made on one of your media items.
Regression: Yes
Steps:
- Login to MediaGoblin.
- Click on the notification.
Expected results:
- A notification number should appear on the tool bar.
- A comment is displayed.
Media types
Images
Prerequisites: Activated user account. Image plug-in enabled.
Regression: Yes
Steps:
- Login to MediaGoblin.
- Click on the Add Media button.
- Select your image file.
- Give your media item a title, description, and appropriate tags. Select a license.
- Press submit.
Expected results:
- A message telling you the item was submitted.
- The uploaded item has all of the information from step 4 (title, description, tags, license) and the image from step 3 displayed correctly when clicked on.
WebM Video
Prerequisites: Activated user account. Video plug-in enabled. WebM VP8/Vorbis video available for upload.
Regression: Yes
Steps:
- Login to Mediagoblin.
- Click on the Add Media button.
- Select your WebM video file.
- Give your media item a title, description, and appropriate tags. Select a license.
- Press submit.
Expected results:
- A message telling you the item was submitted.
- The uploaded item has all of the information from step 4 (title, description, tags, license) and the image from step 3 displayed correctly when clicked on.
- The video should not have been transcoded.
Other Video
Prerequisites: Activated user account. Video plug-in enabled. Video available for upload (not WebM format)
Regression: Yes
Steps:
- Login to Mediagoblin.
- Click on the Add Media button.
- Select your video file.
- Give your media item a title, description, and appropriate tags. Select a license.
- Press submit.
Expected results:
- A message telling you the item was submitted.
- The uploaded item has all of the information from step 4 (title, description, tags, license) and the image from step 3 displayed correctly when clicked on.
- The video should have been transcoded to WebM.
Ogg Audio
Prerequisites: Activated user account. Audio plug-in enabled. Ogg/Vorbis audio file available for upload.
Regression: Yes
Steps:
- Login to Mediagoblin.
- Click on the Add Media button.
- Select your Ogg/Vorbis audio file.
- Give your media item a title, description, and appropriate tags. Select a license.
- Press submit.
Expected results:
- A message telling you the item was submitted.
- The uploaded item has all of the information from step 4 (title, description, tags, license) and the image from step 3 displayed correctly when clicked on.
- The audio file should not have been transcoded.
Other Audio
Prerequisites: Activated user account. Audio plug-in enabled. Audio file available for upload (not Ogg/Vorbis format)
Regression: Yes had been deleting was displayed. Steps:
- Login to Mediagoblin.
- Click on the Add Media button.
- Select your audio file.
- Give your media item a title, description, and appropriate tags. Select a license.
- Press submit.
Expected results:
- A message telling you the item was submitted.
- The uploaded item has all of the information from step 4 (title, description, tags, license) and the image from step 3 displayed correctly when clicked on.
- The audio file should have been transcoded to Ogg/Vorbis.
Reporting bugs from this test suite
See: File Bugs
Any bugs you find with this test suite should be reported at http://issues.mediagoblin.org.
In addition to following the existing issues guidelines make sure to include the word "testsuite" as a keyword on your bug report. This also will help with the search process since you can search using the keyword "testsuite" to see if your specific issue has already been reported. If it has and you have additional information to provide, leave a comment on the ticket.
You can copy-and-paste the test steps to include with the bug report to make things easier to debug.
Where to run this suite
See: HackingHowto or http://docs.mediagoblin.org
You can run these tests on a local development instance or, if one has been made available, a test instance. If a test instance has been made available we will try to include links to them here. Details on how to set up your own development MediaGoblin instance can be found at one of the two links above.