Manual Functional Testing: Difference between revisions

From GNU MediaGoblin Wiki
Jump to navigation Jump to search
 
(5 intermediate revisions by one other user not shown)
Line 9: Line 9:
'''Prerequisites:''' (''This is what a test needs before it runs.'') Ex - Image plug-in enabled. Activated user account. An image available for upload
'''Prerequisites:''' (''This is what a test needs before it runs.'') Ex - Image plug-in enabled. Activated user account. An image available for upload


'''Regression:''' (''Yes if the functionality existed in the previous release otherwise it is set to no. All test cases should eventually be regression tests.'') Ex - Yes
'''Regression:''' (''Yes if the functionality existed in the previous release otherwise it is set to no. All test cases should eventually be regression tests. Note: "yes" here means it's a regression test, not that it's a current regression.'') Ex - Yes


'''Steps:''' (''These don't need to be exactly step-by-step but rather more general'') Ex -
'''Steps:''' (''These don't need to be exactly step-by-step but rather more general'') Ex -
Line 50: Line 50:
# Click on the Create account button.
# Click on the Create account button.
# Enter a username.
# Enter a username.
# Enter a password
# Enter a password.
# Enter a valid e-mail address
# Enter a valid e-mail address.


'''Expected results:'''
'''Expected results:'''
* A message telling you that email verification is needed is displayed.
* A message telling you that email verification is needed is displayed.
* If the instance is in debug mode:
* If the instance is in debug mode:
** An e-mail message appears on the console
** An e-mail message appears on the console.
* Else:
* Else:
** You receive an e-mail
** You receive an e-mail.




Line 70: Line 70:
# Click on the Create account button.
# Click on the Create account button.
# Enter the username.
# Enter the username.
# Enter a password
# Enter a password.
# Enter a valid e-mail address
# Enter a valid e-mail address.


'''Expected results:'''
'''Expected results:'''
Line 83: Line 83:


'''Steps:'''
'''Steps:'''
# Login to MediaGoblin
# Login to MediaGoblin.
# Click on the Create new collection button.
# Click on the Create new collection button.
# Give it a title and description
# Give it a title and description.
# Click submit
# Click submit.


'''Expected results:'''
'''Expected results:'''
Line 99: Line 99:


'''Steps:'''
'''Steps:'''
# Login to MediaGoblin
# Login to MediaGoblin.
# Click on your username.
# Click on your username.
# Click on browse collections
# Click on browse collections.
# Click on the collection.
# Click on the collection.
# Click the edit button.
# Click the edit button.
# Change the title, description, and slug.
# Change the title, description, and slug.
# Click save changes
# Click save changes.


'''Expected results:'''
'''Expected results:'''
Line 117: Line 117:


'''Steps:'''
'''Steps:'''
# Login to MediaGoblin
# Login to MediaGoblin.
# Click on your username.
# Click on your username.
# Click on browse collections
# Click on browse collections.
# Click on the collection.
# Click on the collection.
# Click the delete button.
# Click the delete button.
# Check the deletion confirmation check box
# Check the deletion confirmation check box.
# Click the delete permanently button
# Click the delete permanently button.


'''Expected results:'''
'''Expected results:'''
* A message stating that the collection had been deleting was displayed.
* A message stating that the collection had been deleted was displayed.
* The collection no longer appears on your browse collection's page.
* The collection no longer appears on your browse collection's page.


Line 136: Line 136:


'''Steps:'''
'''Steps:'''
# Login to MediaGoblin
# Login to MediaGoblin.
# Click on your username.
# Click on your username.
# Click on browse collections
# Click on browse collections.
# Click on the collection.
# Click on the collection.
# Click the delete button.
# Click the delete button.
# Keep the confirmation check box unchecked
# Keep the confirmation check box unchecked.
# Click the delete permanently button
# Click the delete permanently button.


'''Expected results:'''
'''Expected results:'''
Line 155: Line 155:


'''Steps:'''
'''Steps:'''
# Login to MediaGoblin
# Login to MediaGoblin.
# Click on a media item.
# Click on a media item.
# Click on add to collection
# Click on add to collection.
# Select your collection
# Select your collection.
# Write a note
# Write a note.
# Press add button
# Press add button.


'''Expected results:'''
'''Expected results:'''
* A message stating that the media item had been added to the collection was displayed.
* A message stating that the media item had been added to the collection was displayed.


==== Edit Media Item ====
'''Prerequisites:''' Activated user account. Media item created.

'''Regression:''' Yes

'''Steps:'''
# Login to MediaGoblin.
# Click on a media item you submitted.
# Click on the edit button
# Change the title, description, tags, slug, and license.
# Click of the save changes button.

'''Expected results:'''
* The media item's title, description, tags, slug, and license changed to the new values.


==== Delete Media Item ====
'''Prerequisites:''' Activated user account. Media item created.

'''Regression:''' Yes

'''Steps:'''
# Login to MediaGoblin
# Click on a media item you submitted.
# Click the delete button.
# Check the confirmation box.
# Click the delete permanently button.

'''Expected results:'''
* A message stating that the media item had been deleted was displayed.
* The media item not longer shows up on the list.


==== Cancel Delete Media Item ====
'''Prerequisites:''' Activated user account. Media item created.

'''Regression:''' Yes

'''Steps:'''
# Login to MediaGoblin
# Click on a media item you submitted.
# Click the delete button.
# Do not check the confirmation box.
# Click the delete permanently button.

'''Expected results:'''
* A message stating that the media item hadn't been deleted was displayed.
* The media item still shows up on the list.


=== Social ===

==== Add a Comment ====
'''Prerequisites:''' Activated user account. A media item without silenced comments.

'''Regression:''' Yes

'''Steps:'''
# Login to MediaGoblin.
# Select the media item.
# Click the add a comment button
# Write a comment using Markdown formatting.
# Click add this comment

'''Expected results:'''
* A preview of the comment is shown while you are authoring it.
* The comment is added to the media item by your user.


==== Check Notifications ====
'''Prerequisites:''' Activated user account. Notifications enabled. A comment has been made on one of your media items.

'''Regression:''' Yes

'''Steps:'''
# Login to MediaGoblin.
# Click on the notification.

'''Expected results:'''
* A notification number should appear on the tool bar.
* A comment is displayed.




Line 174: Line 257:


'''Steps:'''
'''Steps:'''
# Login to MediaGoblin
# Login to MediaGoblin.
# Click on the Add Media button
# Click on the Add Media button.
# Select your image file.
# Select your image file.
# Give your media item a title, description, and appropriate tags. Select a license.
# Give your media item a title, description, and appropriate tags. Select a license.
# Press submit
# Press submit.


'''Expected results:'''
'''Expected results:'''
Line 191: Line 274:


'''Steps:'''
'''Steps:'''
# Login to Mediagoblin
# Login to Mediagoblin.
# Click on the Add Media button
# Click on the Add Media button.
# Select your WebM video file
# Select your WebM video file.
# Give your media item a title, description, and appropriate tags. Select a license.
# Give your media item a title, description, and appropriate tags. Select a license.
# Press submit
# Press submit.


'''Expected results:'''
'''Expected results:'''
Line 209: Line 292:


'''Steps:'''
'''Steps:'''
# Login to Mediagoblin
# Login to Mediagoblin.
# Click on the Add Media button
# Click on the Add Media button.
# Select your video file
# Select your video file.
# Give your media item a title, description, and appropriate tags. Select a license.
# Give your media item a title, description, and appropriate tags. Select a license.
# Press submit
# Press submit.


'''Expected results:'''
'''Expected results:'''
* A message telling you the item was submitted.
* A message telling you the item was submitted.
* The uploaded item has all of the information from step 4 (title, description, tags, license) and the image from step 3 displayed correctly when clicked on.
* The uploaded item has all of the information from step 4 (title, description, tags, license) and the image from step 3 displayed correctly when clicked on.
* The video should have been transcoded to WebM
* The video should have been transcoded to WebM.




Line 227: Line 310:


'''Steps:'''
'''Steps:'''
# Login to Mediagoblin
# Login to Mediagoblin.
# Click on the Add Media button
# Click on the Add Media button.
# Select your Ogg/Vorbis audio file
# Select your Ogg/Vorbis audio file.
# Give your media item a title, description, and appropriate tags. Select a license.
# Give your media item a title, description, and appropriate tags. Select a license.
# Press submit
# Press submit.


'''Expected results:'''
'''Expected results:'''
Line 245: Line 328:
had been deleting was displayed.
had been deleting was displayed.
'''Steps:'''
'''Steps:'''
# Login to Mediagoblin
# Login to Mediagoblin.
# Click on the Add Media button
# Click on the Add Media button.
# Select your audio file
# Select your audio file.
# Give your media item a title, description, and appropriate tags. Select a license.
# Give your media item a title, description, and appropriate tags. Select a license.
# Press submit
# Press submit.


'''Expected results:'''
'''Expected results:'''

Latest revision as of 20:54, 16 October 2014

Manual testing is a great way to help out MediaGoblin when we're preparing for a new release. It can also help you get familiar with how MediaGoblin works and what it's all about. That is where this functional test suite comes in. Completing the tests from this suite can help us to know that our existing functionality is intact and the perspective of the new testers can help identify potential issues where ones had not previously been identified.

Test template

All the test cases share the following format. If you come up with a new test case to add please use this format.

Test Title

Prerequisites: (This is what a test needs before it runs.) Ex - Image plug-in enabled. Activated user account. An image available for upload

Regression: (Yes if the functionality existed in the previous release otherwise it is set to no. All test cases should eventually be regression tests. Note: "yes" here means it's a regression test, not that it's a current regression.) Ex - Yes

Steps: (These don't need to be exactly step-by-step but rather more general) Ex -

  1. Login to MediaGoblin
  2. Click on the Add Media button
  3. Select an image.
  4. Give it a title, description, and appropriate tags. Select a license.
  5. Press submit

Expected results: (This should be more specific than the steps.) Ex -

  • A message telling you the item was submitted.
  • The uploaded item has all of the information from step 4 (title, description, tags, license) and the image from step 3 displayed correctly when clicked on.

Copyable format

==== Title ====
'''Prerequisites:''' 

'''Regression:''' 

'''Steps:''' 
# 
# 

'''Expected results:''' 
* 
*

Test suite

Core

Create Account

Prerequisites: No user account created with selected username.

Regression: Yes

Steps:

  1. Go to Mediagoblin.
  2. Click on the Create account button.
  3. Enter a username.
  4. Enter a password.
  5. Enter a valid e-mail address.

Expected results:

  • A message telling you that email verification is needed is displayed.
  • If the instance is in debug mode:
    • An e-mail message appears on the console.
  • Else:
    • You receive an e-mail.


Create a Pre-Existing Account

Prerequisites: A username for an existing account.

Regression: Yes

Steps:

  1. Go to Mediagoblin.
  2. Click on the Create account button.
  3. Enter the username.
  4. Enter a password.
  5. Enter a valid e-mail address.

Expected results:

  • A message telling you that a user with that name already exists.


Create Collection

Prerequisites: Activated user account.

Regression: Yes

Steps:

  1. Login to MediaGoblin.
  2. Click on the Create new collection button.
  3. Give it a title and description.
  4. Click submit.

Expected results:

  • A message stating the collection was added is displayed.
  • The collection under browse collections has the title and description that you set.


Edit Collection

Prerequisites: Activated user account. Collection created.

Regression: Yes

Steps:

  1. Login to MediaGoblin.
  2. Click on your username.
  3. Click on browse collections.
  4. Click on the collection.
  5. Click the edit button.
  6. Change the title, description, and slug.
  7. Click save changes.

Expected results:

  • The collection's title, slug, and description changed to the new values.


Delete Collection

Prerequisites: Activated user account. Collection created.

Regression: Yes

Steps:

  1. Login to MediaGoblin.
  2. Click on your username.
  3. Click on browse collections.
  4. Click on the collection.
  5. Click the delete button.
  6. Check the deletion confirmation check box.
  7. Click the delete permanently button.

Expected results:

  • A message stating that the collection had been deleted was displayed.
  • The collection no longer appears on your browse collection's page.


Cancel Deleting Collection

Prerequisites: Activated user account. Collection created.

Regression: Yes

Steps:

  1. Login to MediaGoblin.
  2. Click on your username.
  3. Click on browse collections.
  4. Click on the collection.
  5. Click the delete button.
  6. Keep the confirmation check box unchecked.
  7. Click the delete permanently button.

Expected results:

  • A message stating that the collection was not deleted was displayed.
  • The collection still appears on your browse collection's page.


Add Media to Collection

Prerequisites: Activated user account. Collection created. Media item exists.

Regression: Yes

Steps:

  1. Login to MediaGoblin.
  2. Click on a media item.
  3. Click on add to collection.
  4. Select your collection.
  5. Write a note.
  6. Press add button.

Expected results:

  • A message stating that the media item had been added to the collection was displayed.


Edit Media Item

Prerequisites: Activated user account. Media item created.

Regression: Yes

Steps:

  1. Login to MediaGoblin.
  2. Click on a media item you submitted.
  3. Click on the edit button
  4. Change the title, description, tags, slug, and license.
  5. Click of the save changes button.

Expected results:

  • The media item's title, description, tags, slug, and license changed to the new values.


Delete Media Item

Prerequisites: Activated user account. Media item created.

Regression: Yes

Steps:

  1. Login to MediaGoblin
  2. Click on a media item you submitted.
  3. Click the delete button.
  4. Check the confirmation box.
  5. Click the delete permanently button.

Expected results:

  • A message stating that the media item had been deleted was displayed.
  • The media item not longer shows up on the list.


Cancel Delete Media Item

Prerequisites: Activated user account. Media item created.

Regression: Yes

Steps:

  1. Login to MediaGoblin
  2. Click on a media item you submitted.
  3. Click the delete button.
  4. Do not check the confirmation box.
  5. Click the delete permanently button.

Expected results:

  • A message stating that the media item hadn't been deleted was displayed.
  • The media item still shows up on the list.


Social

Add a Comment

Prerequisites: Activated user account. A media item without silenced comments.

Regression: Yes

Steps:

  1. Login to MediaGoblin.
  2. Select the media item.
  3. Click the add a comment button
  4. Write a comment using Markdown formatting.
  5. Click add this comment

Expected results:

  • A preview of the comment is shown while you are authoring it.
  • The comment is added to the media item by your user.


Check Notifications

Prerequisites: Activated user account. Notifications enabled. A comment has been made on one of your media items.

Regression: Yes

Steps:

  1. Login to MediaGoblin.
  2. Click on the notification.

Expected results:

  • A notification number should appear on the tool bar.
  • A comment is displayed.


Media types

Images

Prerequisites: Activated user account. Image plug-in enabled.

Regression: Yes

Steps:

  1. Login to MediaGoblin.
  2. Click on the Add Media button.
  3. Select your image file.
  4. Give your media item a title, description, and appropriate tags. Select a license.
  5. Press submit.

Expected results:

  • A message telling you the item was submitted.
  • The uploaded item has all of the information from step 4 (title, description, tags, license) and the image from step 3 displayed correctly when clicked on.


WebM Video

Prerequisites: Activated user account. Video plug-in enabled. WebM VP8/Vorbis video available for upload.

Regression: Yes

Steps:

  1. Login to Mediagoblin.
  2. Click on the Add Media button.
  3. Select your WebM video file.
  4. Give your media item a title, description, and appropriate tags. Select a license.
  5. Press submit.

Expected results:

  • A message telling you the item was submitted.
  • The uploaded item has all of the information from step 4 (title, description, tags, license) and the image from step 3 displayed correctly when clicked on.
  • The video should not have been transcoded.


Other Video

Prerequisites: Activated user account. Video plug-in enabled. Video available for upload (not WebM format)

Regression: Yes

Steps:

  1. Login to Mediagoblin.
  2. Click on the Add Media button.
  3. Select your video file.
  4. Give your media item a title, description, and appropriate tags. Select a license.
  5. Press submit.

Expected results:

  • A message telling you the item was submitted.
  • The uploaded item has all of the information from step 4 (title, description, tags, license) and the image from step 3 displayed correctly when clicked on.
  • The video should have been transcoded to WebM.


Ogg Audio

Prerequisites: Activated user account. Audio plug-in enabled. Ogg/Vorbis audio file available for upload.

Regression: Yes

Steps:

  1. Login to Mediagoblin.
  2. Click on the Add Media button.
  3. Select your Ogg/Vorbis audio file.
  4. Give your media item a title, description, and appropriate tags. Select a license.
  5. Press submit.

Expected results:

  • A message telling you the item was submitted.
  • The uploaded item has all of the information from step 4 (title, description, tags, license) and the image from step 3 displayed correctly when clicked on.
  • The audio file should not have been transcoded.


Other Audio

Prerequisites: Activated user account. Audio plug-in enabled. Audio file available for upload (not Ogg/Vorbis format)

Regression: Yes had been deleting was displayed. Steps:

  1. Login to Mediagoblin.
  2. Click on the Add Media button.
  3. Select your audio file.
  4. Give your media item a title, description, and appropriate tags. Select a license.
  5. Press submit.

Expected results:

  • A message telling you the item was submitted.
  • The uploaded item has all of the information from step 4 (title, description, tags, license) and the image from step 3 displayed correctly when clicked on.
  • The audio file should have been transcoded to Ogg/Vorbis.

Reporting bugs from this test suite

See: File Bugs

Any bugs you find with this test suite should be reported at http://issues.mediagoblin.org.

In addition to following the existing issues guidelines make sure to include the word "testsuite" as a keyword on your bug report. This also will help with the search process since you can search using the keyword "testsuite" to see if your specific issue has already been reported. If it has and you have additional information to provide, leave a comment on the ticket.

You can copy-and-paste the test steps to include with the bug report to make things easier to debug.

Where to run this suite

See: HackingHowto or http://docs.mediagoblin.org


You can run these tests on a local development instance or, if one has been made available, a test instance. If a test instance has been made available we will try to include links to them here. Details on how to set up your own development MediaGoblin instance can be found at one of the two links above.