Manual Functional Testing: Difference between revisions
m (→Test suite) |
|||
Line 50: | Line 50: | ||
# Click on the Create account button. |
# Click on the Create account button. |
||
# Enter a username. |
# Enter a username. |
||
# Enter a password |
# Enter a password. |
||
# Enter a valid e-mail address |
# Enter a valid e-mail address. |
||
'''Expected results:''' |
'''Expected results:''' |
||
* A message telling you that email verification is needed is displayed. |
* A message telling you that email verification is needed is displayed. |
||
* If the instance is in debug mode: |
* If the instance is in debug mode: |
||
** An e-mail message appears on the console |
** An e-mail message appears on the console. |
||
* Else: |
* Else: |
||
** You receive an e-mail |
** You receive an e-mail. |
||
Line 70: | Line 70: | ||
# Click on the Create account button. |
# Click on the Create account button. |
||
# Enter the username. |
# Enter the username. |
||
# Enter a password |
# Enter a password. |
||
# Enter a valid e-mail address |
# Enter a valid e-mail address. |
||
'''Expected results:''' |
'''Expected results:''' |
||
Line 83: | Line 83: | ||
'''Steps:''' |
'''Steps:''' |
||
# Login to MediaGoblin |
# Login to MediaGoblin. |
||
# Click on the Create new collection button. |
# Click on the Create new collection button. |
||
# Give it a title and description |
# Give it a title and description. |
||
# Click submit |
# Click submit. |
||
'''Expected results:''' |
'''Expected results:''' |
||
Line 99: | Line 99: | ||
'''Steps:''' |
'''Steps:''' |
||
# Login to MediaGoblin |
# Login to MediaGoblin. |
||
# Click on your username. |
# Click on your username. |
||
# Click on browse collections |
# Click on browse collections. |
||
# Click on the collection. |
# Click on the collection. |
||
# Click the edit button. |
# Click the edit button. |
||
# Change the title, description, and slug. |
# Change the title, description, and slug. |
||
# Click save changes |
# Click save changes. |
||
'''Expected results:''' |
'''Expected results:''' |
||
Line 117: | Line 117: | ||
'''Steps:''' |
'''Steps:''' |
||
# Login to MediaGoblin |
# Login to MediaGoblin. |
||
# Click on your username. |
# Click on your username. |
||
# Click on browse collections |
# Click on browse collections. |
||
# Click on the collection. |
# Click on the collection. |
||
# Click the delete button. |
# Click the delete button. |
||
# Check the deletion confirmation check box |
# Check the deletion confirmation check box. |
||
# Click the delete permanently button |
# Click the delete permanently button. |
||
'''Expected results:''' |
'''Expected results:''' |
||
* A message stating that the collection had been |
* A message stating that the collection had been deleted was displayed. |
||
* The collection no longer appears on your browse collection's page. |
* The collection no longer appears on your browse collection's page. |
||
Line 136: | Line 136: | ||
'''Steps:''' |
'''Steps:''' |
||
# Login to MediaGoblin |
# Login to MediaGoblin. |
||
# Click on your username. |
# Click on your username. |
||
# Click on browse collections |
# Click on browse collections. |
||
# Click on the collection. |
# Click on the collection. |
||
# Click the delete button. |
# Click the delete button. |
||
# Keep the confirmation check box unchecked |
# Keep the confirmation check box unchecked. |
||
# Click the delete permanently button |
# Click the delete permanently button. |
||
'''Expected results:''' |
'''Expected results:''' |
||
Line 155: | Line 155: | ||
'''Steps:''' |
'''Steps:''' |
||
# Login to MediaGoblin |
# Login to MediaGoblin. |
||
# Click on a media item. |
# Click on a media item. |
||
# Click on add to collection |
# Click on add to collection. |
||
# Select your collection |
# Select your collection. |
||
# Write a note |
# Write a note. |
||
# Press add button |
# Press add button. |
||
'''Expected results:''' |
'''Expected results:''' |
||
* A message stating that the media item had been added to the collection was displayed. |
* A message stating that the media item had been added to the collection was displayed. |
||
==== Edit Media Item ==== |
|||
'''Prerequisites:''' Activated user account. Media item created. |
|||
'''Regression:''' Yes |
|||
'''Steps:''' |
|||
# Login to MediaGoblin. |
|||
# Click on a media item you submitted. |
|||
# Click on the edit button |
|||
# Change the title, description, tags, slug, and license. |
|||
# Click of the save changes button. |
|||
'''Expected results:''' |
|||
* The media item's title, description, tags, slug, and license changed to the new values. |
|||
==== Delete Media Item ==== |
|||
'''Prerequisites:''' Activated user account. Media item created. |
|||
'''Regression:''' Yes |
|||
'''Steps:''' |
|||
# Login to MediaGoblin |
|||
# Click on a media item you submitted. |
|||
# Click the delete button. |
|||
# Check the confirmation box. |
|||
# Click the delete permanently button. |
|||
'''Expected results:''' |
|||
* A message stating that the media item had been deleted was displayed. |
|||
* The media item not longer shows up on the list. |
|||
==== Cancel Delete Media Item ==== |
|||
'''Prerequisites:''' Activated user account. Media item created. |
|||
'''Regression:''' Yes |
|||
'''Steps:''' |
|||
# Login to MediaGoblin |
|||
# Click on a media item you submitted. |
|||
# Click the delete button. |
|||
# Do not check the confirmation box. |
|||
# Click the delete permanently button. |
|||
'''Expected results:''' |
|||
* A message stating that the media item hadn't been deleted was displayed. |
|||
* The media item still shows up on the list. |
|||
=== Social === |
|||
Line 174: | Line 228: | ||
'''Steps:''' |
'''Steps:''' |
||
# Login to MediaGoblin |
# Login to MediaGoblin. |
||
# Click on the Add Media button |
# Click on the Add Media button. |
||
# Select your image file. |
# Select your image file. |
||
# Give your media item a title, description, and appropriate tags. Select a license. |
# Give your media item a title, description, and appropriate tags. Select a license. |
||
# Press submit |
# Press submit. |
||
'''Expected results:''' |
'''Expected results:''' |
||
Line 191: | Line 245: | ||
'''Steps:''' |
'''Steps:''' |
||
# Login to Mediagoblin |
# Login to Mediagoblin. |
||
# Click on the Add Media button |
# Click on the Add Media button. |
||
# Select your WebM video file |
# Select your WebM video file. |
||
# Give your media item a title, description, and appropriate tags. Select a license. |
# Give your media item a title, description, and appropriate tags. Select a license. |
||
# Press submit |
# Press submit. |
||
'''Expected results:''' |
'''Expected results:''' |
||
Line 209: | Line 263: | ||
'''Steps:''' |
'''Steps:''' |
||
# Login to Mediagoblin |
# Login to Mediagoblin. |
||
# Click on the Add Media button |
# Click on the Add Media button. |
||
# Select your video file |
# Select your video file. |
||
# Give your media item a title, description, and appropriate tags. Select a license. |
# Give your media item a title, description, and appropriate tags. Select a license. |
||
# Press submit |
# Press submit. |
||
'''Expected results:''' |
'''Expected results:''' |
||
* A message telling you the item was submitted. |
* A message telling you the item was submitted. |
||
* The uploaded item has all of the information from step 4 (title, description, tags, license) and the image from step 3 displayed correctly when clicked on. |
* The uploaded item has all of the information from step 4 (title, description, tags, license) and the image from step 3 displayed correctly when clicked on. |
||
* The video should have been transcoded to WebM |
* The video should have been transcoded to WebM. |
||
Line 227: | Line 281: | ||
'''Steps:''' |
'''Steps:''' |
||
# Login to Mediagoblin |
# Login to Mediagoblin. |
||
# Click on the Add Media button |
# Click on the Add Media button. |
||
# Select your Ogg/Vorbis audio file |
# Select your Ogg/Vorbis audio file. |
||
# Give your media item a title, description, and appropriate tags. Select a license. |
# Give your media item a title, description, and appropriate tags. Select a license. |
||
# Press submit |
# Press submit. |
||
'''Expected results:''' |
'''Expected results:''' |
||
Line 245: | Line 299: | ||
had been deleting was displayed. |
had been deleting was displayed. |
||
'''Steps:''' |
'''Steps:''' |
||
# Login to Mediagoblin |
# Login to Mediagoblin. |
||
# Click on the Add Media button |
# Click on the Add Media button. |
||
# Select your audio file |
# Select your audio file. |
||
# Give your media item a title, description, and appropriate tags. Select a license. |
# Give your media item a title, description, and appropriate tags. Select a license. |
||
# Press submit |
# Press submit. |
||
'''Expected results:''' |
'''Expected results:''' |
Revision as of 19:29, 20 September 2013
Manual testing is a great way to help out MediaGoblin when we're preparing for a new release. It can also help you get familiar with how MediaGoblin works and what it's all about. That is where this functional test suite comes in. Completing the tests from this suite can help us to know that our existing functionality is intact and the perspective of the new testers can help identify potential issues where ones had not previously been identified.
Test template
All the test cases share the following format. If you come up with a new test case to add please use this format.
Test Title
Prerequisites: (This is what a test needs before it runs.) Ex - Image plug-in enabled. Activated user account. An image available for upload
Regression: (Yes if the functionality existed in the previous release otherwise it is set to no. All test cases should eventually be regression tests.) Ex - Yes
Steps: (These don't need to be exactly step-by-step but rather more general) Ex -
- Login to MediaGoblin
- Click on the Add Media button
- Select an image.
- Give it a title, description, and appropriate tags. Select a license.
- Press submit
Expected results: (This should be more specific than the steps.) Ex -
- A message telling you the item was submitted.
- The uploaded item has all of the information from step 4 (title, description, tags, license) and the image from step 3 displayed correctly when clicked on.
Copyable format
==== Title ==== '''Prerequisites:''' '''Regression:''' '''Steps:''' # # '''Expected results:''' * *
Test suite
Core
Create Account
Prerequisites: No user account created with selected username.
Regression: Yes
Steps:
- Go to Mediagoblin.
- Click on the Create account button.
- Enter a username.
- Enter a password.
- Enter a valid e-mail address.
Expected results:
- A message telling you that email verification is needed is displayed.
- If the instance is in debug mode:
- An e-mail message appears on the console.
- Else:
- You receive an e-mail.
Create a Pre-Existing Account
Prerequisites: A username for an existing account.
Regression: Yes
Steps:
- Go to Mediagoblin.
- Click on the Create account button.
- Enter the username.
- Enter a password.
- Enter a valid e-mail address.
Expected results:
- A message telling you that a user with that name already exists.
Create Collection
Prerequisites: Activated user account.
Regression: Yes
Steps:
- Login to MediaGoblin.
- Click on the Create new collection button.
- Give it a title and description.
- Click submit.
Expected results:
- A message stating the collection was added is displayed.
- The collection under browse collections has the title and description that you set.
Edit Collection
Prerequisites: Activated user account. Collection created.
Regression: Yes
Steps:
- Login to MediaGoblin.
- Click on your username.
- Click on browse collections.
- Click on the collection.
- Click the edit button.
- Change the title, description, and slug.
- Click save changes.
Expected results:
- The collection's title, slug, and description changed to the new values.
Delete Collection
Prerequisites: Activated user account. Collection created.
Regression: Yes
Steps:
- Login to MediaGoblin.
- Click on your username.
- Click on browse collections.
- Click on the collection.
- Click the delete button.
- Check the deletion confirmation check box.
- Click the delete permanently button.
Expected results:
- A message stating that the collection had been deleted was displayed.
- The collection no longer appears on your browse collection's page.
Cancel Deleting Collection
Prerequisites: Activated user account. Collection created.
Regression: Yes
Steps:
- Login to MediaGoblin.
- Click on your username.
- Click on browse collections.
- Click on the collection.
- Click the delete button.
- Keep the confirmation check box unchecked.
- Click the delete permanently button.
Expected results:
- A message stating that the collection was not deleted was displayed.
- The collection still appears on your browse collection's page.
Add Media to Collection
Prerequisites: Activated user account. Collection created. Media item exists.
Regression: Yes
Steps:
- Login to MediaGoblin.
- Click on a media item.
- Click on add to collection.
- Select your collection.
- Write a note.
- Press add button.
Expected results:
- A message stating that the media item had been added to the collection was displayed.
Edit Media Item
Prerequisites: Activated user account. Media item created.
Regression: Yes
Steps:
- Login to MediaGoblin.
- Click on a media item you submitted.
- Click on the edit button
- Change the title, description, tags, slug, and license.
- Click of the save changes button.
Expected results:
- The media item's title, description, tags, slug, and license changed to the new values.
Delete Media Item
Prerequisites: Activated user account. Media item created.
Regression: Yes
Steps:
- Login to MediaGoblin
- Click on a media item you submitted.
- Click the delete button.
- Check the confirmation box.
- Click the delete permanently button.
Expected results:
- A message stating that the media item had been deleted was displayed.
- The media item not longer shows up on the list.
Cancel Delete Media Item
Prerequisites: Activated user account. Media item created.
Regression: Yes
Steps:
- Login to MediaGoblin
- Click on a media item you submitted.
- Click the delete button.
- Do not check the confirmation box.
- Click the delete permanently button.
Expected results:
- A message stating that the media item hadn't been deleted was displayed.
- The media item still shows up on the list.
Social
Media types
Images
Prerequisites: Activated user account. Image plug-in enabled.
Regression: Yes
Steps:
- Login to MediaGoblin.
- Click on the Add Media button.
- Select your image file.
- Give your media item a title, description, and appropriate tags. Select a license.
- Press submit.
Expected results:
- A message telling you the item was submitted.
- The uploaded item has all of the information from step 4 (title, description, tags, license) and the image from step 3 displayed correctly when clicked on.
WebM Video
Prerequisites: Activated user account. Video plug-in enabled. WebM VP8/Vorbis video available for upload.
Regression: Yes
Steps:
- Login to Mediagoblin.
- Click on the Add Media button.
- Select your WebM video file.
- Give your media item a title, description, and appropriate tags. Select a license.
- Press submit.
Expected results:
- A message telling you the item was submitted.
- The uploaded item has all of the information from step 4 (title, description, tags, license) and the image from step 3 displayed correctly when clicked on.
- The video should not have been transcoded.
Other Video
Prerequisites: Activated user account. Video plug-in enabled. Video available for upload (not WebM format)
Regression: Yes
Steps:
- Login to Mediagoblin.
- Click on the Add Media button.
- Select your video file.
- Give your media item a title, description, and appropriate tags. Select a license.
- Press submit.
Expected results:
- A message telling you the item was submitted.
- The uploaded item has all of the information from step 4 (title, description, tags, license) and the image from step 3 displayed correctly when clicked on.
- The video should have been transcoded to WebM.
Ogg Audio
Prerequisites: Activated user account. Audio plug-in enabled. Ogg/Vorbis audio file available for upload.
Regression: Yes
Steps:
- Login to Mediagoblin.
- Click on the Add Media button.
- Select your Ogg/Vorbis audio file.
- Give your media item a title, description, and appropriate tags. Select a license.
- Press submit.
Expected results:
- A message telling you the item was submitted.
- The uploaded item has all of the information from step 4 (title, description, tags, license) and the image from step 3 displayed correctly when clicked on.
- The audio file should not have been transcoded.
Other Audio
Prerequisites: Activated user account. Audio plug-in enabled. Audio file available for upload (not Ogg/Vorbis format)
Regression: Yes had been deleting was displayed. Steps:
- Login to Mediagoblin.
- Click on the Add Media button.
- Select your audio file.
- Give your media item a title, description, and appropriate tags. Select a license.
- Press submit.
Expected results:
- A message telling you the item was submitted.
- The uploaded item has all of the information from step 4 (title, description, tags, license) and the image from step 3 displayed correctly when clicked on.
- The audio file should have been transcoded to Ogg/Vorbis.
Reporting bugs from this test suite
See: File Bugs
Any bugs you find with this test suite should be reported at http://issues.mediagoblin.org.
In addition to following the existing issues guidelines make sure to include the word "testsuite" as a keyword on your bug report. This also will help with the search process since you can search using the keyword "testsuite" to see if your specific issue has already been reported. If it has and you have additional information to provide, leave a comment on the ticket.
You can copy-and-paste the test steps to include with the bug report to make things easier to debug.
Where to run this suite
See: HackingHowto or http://docs.mediagoblin.org
You can run these tests on a local development instance or, if one has been made available, a test instance. If a test instance has been made available we will try to include links to them here. Details on how to set up your own development MediaGoblin instance can be found at one of the two links above.