Manual Functional Testing: Difference between revisions

From GNU MediaGoblin Wiki
Jump to navigation Jump to search
(Adding formatting paragraph, started structure test suite.)
 
(22 intermediate revisions by one other user not shown)
Line 4: Line 4:


All the test cases share the following format. If you come up with a new test case to add please use this format.
All the test cases share the following format. If you come up with a new test case to add please use this format.

==== Test Title ====


'''Prerequisites:''' (''This is what a test needs before it runs.'') Ex - Image plug-in enabled. Activated user account. An image available for upload
'''Prerequisites:''' (''This is what a test needs before it runs.'') Ex - Image plug-in enabled. Activated user account. An image available for upload


'''Regression:''' (''Yes if the functionality existed in the previous release otherwise it is set to no. All test cases should eventually be regression tests.'') Ex - Yes
'''Regression:''' (''Yes if the functionality existed in the previous release otherwise it is set to no. All test cases should eventually be regression tests. Note: "yes" here means it's a regression test, not that it's a current regression.'') Ex - Yes


'''Steps:''' (''These don't need to be exactly step-by-step but rather more general'') Ex -
'''Steps:''' (''These don't need to be exactly step-by-step but rather more general'') Ex -
Line 21: Line 23:
=== Copyable format ===
=== Copyable format ===


<nowiki>==== Title ====</nowiki>

'''Prerequisites:'''
<nowiki>'''Prerequisites:''' </nowiki>
'''Regression:'''
<nowiki>'''Regression:''' </nowiki>
'''Steps:'''
<nowiki>'''Steps:''' </nowiki>
#
#
#
#
'''Expected results:'''
<nowiki>'''Expected results:''' </nowiki>
*
*
*
*
Line 37: Line 39:


=== Core ===
=== Core ===


==== Create Account ====
'''Prerequisites:''' No user account created with selected username.

'''Regression:''' Yes

'''Steps:'''
# Go to Mediagoblin.
# Click on the Create account button.
# Enter a username.
# Enter a password.
# Enter a valid e-mail address.

'''Expected results:'''
* A message telling you that email verification is needed is displayed.
* If the instance is in debug mode:
** An e-mail message appears on the console.
* Else:
** You receive an e-mail.


==== Create a Pre-Existing Account ====
'''Prerequisites:''' A username for an existing account.

'''Regression:''' Yes

'''Steps:'''
# Go to Mediagoblin.
# Click on the Create account button.
# Enter the username.
# Enter a password.
# Enter a valid e-mail address.

'''Expected results:'''
* A message telling you that a user with that name already exists.


==== Create Collection ====
'''Prerequisites:''' Activated user account.

'''Regression:''' Yes

'''Steps:'''
# Login to MediaGoblin.
# Click on the Create new collection button.
# Give it a title and description.
# Click submit.

'''Expected results:'''
* A message stating the collection was added is displayed.
* The collection under browse collections has the title and description that you set.


==== Edit Collection ====
'''Prerequisites:''' Activated user account. Collection created.

'''Regression:''' Yes

'''Steps:'''
# Login to MediaGoblin.
# Click on your username.
# Click on browse collections.
# Click on the collection.
# Click the edit button.
# Change the title, description, and slug.
# Click save changes.

'''Expected results:'''
* The collection's title, slug, and description changed to the new values.


==== Delete Collection ====
'''Prerequisites:''' Activated user account. Collection created.

'''Regression:''' Yes

'''Steps:'''
# Login to MediaGoblin.
# Click on your username.
# Click on browse collections.
# Click on the collection.
# Click the delete button.
# Check the deletion confirmation check box.
# Click the delete permanently button.

'''Expected results:'''
* A message stating that the collection had been deleted was displayed.
* The collection no longer appears on your browse collection's page.


==== Cancel Deleting Collection ====
'''Prerequisites:''' Activated user account. Collection created.

'''Regression:''' Yes

'''Steps:'''
# Login to MediaGoblin.
# Click on your username.
# Click on browse collections.
# Click on the collection.
# Click the delete button.
# Keep the confirmation check box unchecked.
# Click the delete permanently button.

'''Expected results:'''
* A message stating that the collection was not deleted was displayed.
* The collection still appears on your browse collection's page.


==== Add Media to Collection ====
'''Prerequisites:''' Activated user account. Collection created. Media item exists.

'''Regression:''' Yes

'''Steps:'''
# Login to MediaGoblin.
# Click on a media item.
# Click on add to collection.
# Select your collection.
# Write a note.
# Press add button.

'''Expected results:'''
* A message stating that the media item had been added to the collection was displayed.


==== Edit Media Item ====
'''Prerequisites:''' Activated user account. Media item created.

'''Regression:''' Yes

'''Steps:'''
# Login to MediaGoblin.
# Click on a media item you submitted.
# Click on the edit button
# Change the title, description, tags, slug, and license.
# Click of the save changes button.

'''Expected results:'''
* The media item's title, description, tags, slug, and license changed to the new values.


==== Delete Media Item ====
'''Prerequisites:''' Activated user account. Media item created.

'''Regression:''' Yes

'''Steps:'''
# Login to MediaGoblin
# Click on a media item you submitted.
# Click the delete button.
# Check the confirmation box.
# Click the delete permanently button.

'''Expected results:'''
* A message stating that the media item had been deleted was displayed.
* The media item not longer shows up on the list.


==== Cancel Delete Media Item ====
'''Prerequisites:''' Activated user account. Media item created.

'''Regression:''' Yes

'''Steps:'''
# Login to MediaGoblin
# Click on a media item you submitted.
# Click the delete button.
# Do not check the confirmation box.
# Click the delete permanently button.

'''Expected results:'''
* A message stating that the media item hadn't been deleted was displayed.
* The media item still shows up on the list.


=== Social ===

==== Add a Comment ====
'''Prerequisites:''' Activated user account. A media item without silenced comments.

'''Regression:''' Yes

'''Steps:'''
# Login to MediaGoblin.
# Select the media item.
# Click the add a comment button
# Write a comment using Markdown formatting.
# Click add this comment

'''Expected results:'''
* A preview of the comment is shown while you are authoring it.
* The comment is added to the media item by your user.


==== Check Notifications ====
'''Prerequisites:''' Activated user account. Notifications enabled. A comment has been made on one of your media items.

'''Regression:''' Yes

'''Steps:'''
# Login to MediaGoblin.
# Click on the notification.

'''Expected results:'''
* A notification number should appear on the tool bar.
* A comment is displayed.



=== Media types ===
=== Media types ===

==== Images ====
'''Prerequisites:''' Activated user account. Image plug-in enabled.

'''Regression:''' Yes

'''Steps:'''
# Login to MediaGoblin.
# Click on the Add Media button.
# Select your image file.
# Give your media item a title, description, and appropriate tags. Select a license.
# Press submit.

'''Expected results:'''
* A message telling you the item was submitted.
* The uploaded item has all of the information from step 4 (title, description, tags, license) and the image from step 3 displayed correctly when clicked on.


==== WebM Video ====
'''Prerequisites:''' Activated user account. Video plug-in enabled. WebM VP8/Vorbis video available for upload.

'''Regression:''' Yes

'''Steps:'''
# Login to Mediagoblin.
# Click on the Add Media button.
# Select your WebM video file.
# Give your media item a title, description, and appropriate tags. Select a license.
# Press submit.

'''Expected results:'''
* A message telling you the item was submitted.
* The uploaded item has all of the information from step 4 (title, description, tags, license) and the image from step 3 displayed correctly when clicked on.
* The video should not have been transcoded.


==== Other Video ====
'''Prerequisites:''' Activated user account. Video plug-in enabled. Video available for upload (not WebM format)

'''Regression:''' Yes

'''Steps:'''
# Login to Mediagoblin.
# Click on the Add Media button.
# Select your video file.
# Give your media item a title, description, and appropriate tags. Select a license.
# Press submit.

'''Expected results:'''
* A message telling you the item was submitted.
* The uploaded item has all of the information from step 4 (title, description, tags, license) and the image from step 3 displayed correctly when clicked on.
* The video should have been transcoded to WebM.


==== Ogg Audio ====
'''Prerequisites:''' Activated user account. Audio plug-in enabled. Ogg/Vorbis audio file available for upload.

'''Regression:''' Yes

'''Steps:'''
# Login to Mediagoblin.
# Click on the Add Media button.
# Select your Ogg/Vorbis audio file.
# Give your media item a title, description, and appropriate tags. Select a license.
# Press submit.

'''Expected results:'''
* A message telling you the item was submitted.
* The uploaded item has all of the information from step 4 (title, description, tags, license) and the image from step 3 displayed correctly when clicked on.
* The audio file should not have been transcoded.


==== Other Audio ====
'''Prerequisites:''' Activated user account. Audio plug-in enabled. Audio file available for upload (not Ogg/Vorbis format)

'''Regression:''' Yes
had been deleting was displayed.
'''Steps:'''
# Login to Mediagoblin.
# Click on the Add Media button.
# Select your audio file.
# Give your media item a title, description, and appropriate tags. Select a license.
# Press submit.

'''Expected results:'''
* A message telling you the item was submitted.
* The uploaded item has all of the information from step 4 (title, description, tags, license) and the image from step 3 displayed correctly when clicked on.
* The audio file should have been transcoded to Ogg/Vorbis.


== Reporting bugs from this test suite ==
== Reporting bugs from this test suite ==
See: [[File Bugs]]

Any bugs you find with this test suite should be reported at http://issues.mediagoblin.org.

In addition to following the existing issues guidelines make sure to include the word "testsuite" as a keyword on your bug report. This also will help with the search process since you can search using the keyword "testsuite" to see if your specific issue has already been reported. If it has and you have additional information to provide, leave a comment on the ticket.

You can copy-and-paste the test steps to include with the bug report to make things easier to debug.

== Where to run this suite ==

See: [[HackingHowto]] or http://docs.mediagoblin.org



You can run these tests on a local development instance or, if one has been made available, a test instance. If a test instance has been made available we will try to include links to them here. Details on how to set up your own development MediaGoblin instance can be found at one of the two links above.
TODO: add stuff about issues.mediagoblin.org

Latest revision as of 20:54, 16 October 2014

Manual testing is a great way to help out MediaGoblin when we're preparing for a new release. It can also help you get familiar with how MediaGoblin works and what it's all about. That is where this functional test suite comes in. Completing the tests from this suite can help us to know that our existing functionality is intact and the perspective of the new testers can help identify potential issues where ones had not previously been identified.

Test template

All the test cases share the following format. If you come up with a new test case to add please use this format.

Test Title

Prerequisites: (This is what a test needs before it runs.) Ex - Image plug-in enabled. Activated user account. An image available for upload

Regression: (Yes if the functionality existed in the previous release otherwise it is set to no. All test cases should eventually be regression tests. Note: "yes" here means it's a regression test, not that it's a current regression.) Ex - Yes

Steps: (These don't need to be exactly step-by-step but rather more general) Ex -

  1. Login to MediaGoblin
  2. Click on the Add Media button
  3. Select an image.
  4. Give it a title, description, and appropriate tags. Select a license.
  5. Press submit

Expected results: (This should be more specific than the steps.) Ex -

  • A message telling you the item was submitted.
  • The uploaded item has all of the information from step 4 (title, description, tags, license) and the image from step 3 displayed correctly when clicked on.

Copyable format

==== Title ====
'''Prerequisites:''' 

'''Regression:''' 

'''Steps:''' 
# 
# 

'''Expected results:''' 
* 
*

Test suite

Core

Create Account

Prerequisites: No user account created with selected username.

Regression: Yes

Steps:

  1. Go to Mediagoblin.
  2. Click on the Create account button.
  3. Enter a username.
  4. Enter a password.
  5. Enter a valid e-mail address.

Expected results:

  • A message telling you that email verification is needed is displayed.
  • If the instance is in debug mode:
    • An e-mail message appears on the console.
  • Else:
    • You receive an e-mail.


Create a Pre-Existing Account

Prerequisites: A username for an existing account.

Regression: Yes

Steps:

  1. Go to Mediagoblin.
  2. Click on the Create account button.
  3. Enter the username.
  4. Enter a password.
  5. Enter a valid e-mail address.

Expected results:

  • A message telling you that a user with that name already exists.


Create Collection

Prerequisites: Activated user account.

Regression: Yes

Steps:

  1. Login to MediaGoblin.
  2. Click on the Create new collection button.
  3. Give it a title and description.
  4. Click submit.

Expected results:

  • A message stating the collection was added is displayed.
  • The collection under browse collections has the title and description that you set.


Edit Collection

Prerequisites: Activated user account. Collection created.

Regression: Yes

Steps:

  1. Login to MediaGoblin.
  2. Click on your username.
  3. Click on browse collections.
  4. Click on the collection.
  5. Click the edit button.
  6. Change the title, description, and slug.
  7. Click save changes.

Expected results:

  • The collection's title, slug, and description changed to the new values.


Delete Collection

Prerequisites: Activated user account. Collection created.

Regression: Yes

Steps:

  1. Login to MediaGoblin.
  2. Click on your username.
  3. Click on browse collections.
  4. Click on the collection.
  5. Click the delete button.
  6. Check the deletion confirmation check box.
  7. Click the delete permanently button.

Expected results:

  • A message stating that the collection had been deleted was displayed.
  • The collection no longer appears on your browse collection's page.


Cancel Deleting Collection

Prerequisites: Activated user account. Collection created.

Regression: Yes

Steps:

  1. Login to MediaGoblin.
  2. Click on your username.
  3. Click on browse collections.
  4. Click on the collection.
  5. Click the delete button.
  6. Keep the confirmation check box unchecked.
  7. Click the delete permanently button.

Expected results:

  • A message stating that the collection was not deleted was displayed.
  • The collection still appears on your browse collection's page.


Add Media to Collection

Prerequisites: Activated user account. Collection created. Media item exists.

Regression: Yes

Steps:

  1. Login to MediaGoblin.
  2. Click on a media item.
  3. Click on add to collection.
  4. Select your collection.
  5. Write a note.
  6. Press add button.

Expected results:

  • A message stating that the media item had been added to the collection was displayed.


Edit Media Item

Prerequisites: Activated user account. Media item created.

Regression: Yes

Steps:

  1. Login to MediaGoblin.
  2. Click on a media item you submitted.
  3. Click on the edit button
  4. Change the title, description, tags, slug, and license.
  5. Click of the save changes button.

Expected results:

  • The media item's title, description, tags, slug, and license changed to the new values.


Delete Media Item

Prerequisites: Activated user account. Media item created.

Regression: Yes

Steps:

  1. Login to MediaGoblin
  2. Click on a media item you submitted.
  3. Click the delete button.
  4. Check the confirmation box.
  5. Click the delete permanently button.

Expected results:

  • A message stating that the media item had been deleted was displayed.
  • The media item not longer shows up on the list.


Cancel Delete Media Item

Prerequisites: Activated user account. Media item created.

Regression: Yes

Steps:

  1. Login to MediaGoblin
  2. Click on a media item you submitted.
  3. Click the delete button.
  4. Do not check the confirmation box.
  5. Click the delete permanently button.

Expected results:

  • A message stating that the media item hadn't been deleted was displayed.
  • The media item still shows up on the list.


Social

Add a Comment

Prerequisites: Activated user account. A media item without silenced comments.

Regression: Yes

Steps:

  1. Login to MediaGoblin.
  2. Select the media item.
  3. Click the add a comment button
  4. Write a comment using Markdown formatting.
  5. Click add this comment

Expected results:

  • A preview of the comment is shown while you are authoring it.
  • The comment is added to the media item by your user.


Check Notifications

Prerequisites: Activated user account. Notifications enabled. A comment has been made on one of your media items.

Regression: Yes

Steps:

  1. Login to MediaGoblin.
  2. Click on the notification.

Expected results:

  • A notification number should appear on the tool bar.
  • A comment is displayed.


Media types

Images

Prerequisites: Activated user account. Image plug-in enabled.

Regression: Yes

Steps:

  1. Login to MediaGoblin.
  2. Click on the Add Media button.
  3. Select your image file.
  4. Give your media item a title, description, and appropriate tags. Select a license.
  5. Press submit.

Expected results:

  • A message telling you the item was submitted.
  • The uploaded item has all of the information from step 4 (title, description, tags, license) and the image from step 3 displayed correctly when clicked on.


WebM Video

Prerequisites: Activated user account. Video plug-in enabled. WebM VP8/Vorbis video available for upload.

Regression: Yes

Steps:

  1. Login to Mediagoblin.
  2. Click on the Add Media button.
  3. Select your WebM video file.
  4. Give your media item a title, description, and appropriate tags. Select a license.
  5. Press submit.

Expected results:

  • A message telling you the item was submitted.
  • The uploaded item has all of the information from step 4 (title, description, tags, license) and the image from step 3 displayed correctly when clicked on.
  • The video should not have been transcoded.


Other Video

Prerequisites: Activated user account. Video plug-in enabled. Video available for upload (not WebM format)

Regression: Yes

Steps:

  1. Login to Mediagoblin.
  2. Click on the Add Media button.
  3. Select your video file.
  4. Give your media item a title, description, and appropriate tags. Select a license.
  5. Press submit.

Expected results:

  • A message telling you the item was submitted.
  • The uploaded item has all of the information from step 4 (title, description, tags, license) and the image from step 3 displayed correctly when clicked on.
  • The video should have been transcoded to WebM.


Ogg Audio

Prerequisites: Activated user account. Audio plug-in enabled. Ogg/Vorbis audio file available for upload.

Regression: Yes

Steps:

  1. Login to Mediagoblin.
  2. Click on the Add Media button.
  3. Select your Ogg/Vorbis audio file.
  4. Give your media item a title, description, and appropriate tags. Select a license.
  5. Press submit.

Expected results:

  • A message telling you the item was submitted.
  • The uploaded item has all of the information from step 4 (title, description, tags, license) and the image from step 3 displayed correctly when clicked on.
  • The audio file should not have been transcoded.


Other Audio

Prerequisites: Activated user account. Audio plug-in enabled. Audio file available for upload (not Ogg/Vorbis format)

Regression: Yes had been deleting was displayed. Steps:

  1. Login to Mediagoblin.
  2. Click on the Add Media button.
  3. Select your audio file.
  4. Give your media item a title, description, and appropriate tags. Select a license.
  5. Press submit.

Expected results:

  • A message telling you the item was submitted.
  • The uploaded item has all of the information from step 4 (title, description, tags, license) and the image from step 3 displayed correctly when clicked on.
  • The audio file should have been transcoded to Ogg/Vorbis.

Reporting bugs from this test suite

See: File Bugs

Any bugs you find with this test suite should be reported at http://issues.mediagoblin.org.

In addition to following the existing issues guidelines make sure to include the word "testsuite" as a keyword on your bug report. This also will help with the search process since you can search using the keyword "testsuite" to see if your specific issue has already been reported. If it has and you have additional information to provide, leave a comment on the ticket.

You can copy-and-paste the test steps to include with the bug report to make things easier to debug.

Where to run this suite

See: HackingHowto or http://docs.mediagoblin.org


You can run these tests on a local development instance or, if one has been made available, a test instance. If a test instance has been made available we will try to include links to them here. Details on how to set up your own development MediaGoblin instance can be found at one of the two links above.