You are currently viewing a snapshot of www.mozilla.org taken on April 21, 2008. Most of this content is highly out of date (some pages haven't been updated since the project began in 1998) and exists for historical purposes only. If there are any pages on this archive site that you think should be added back to www.mozilla.org, please file a bug.

Skip to main content

You are here: Mozilla MailNews Functional / UI Tests > Mail & News: Junk Mail Controls

Feature Test Spec: Mail and News Component

Mail and News Component: Junk Mail Controls

Written by Esther Goes

References

UI Specification
Bugzillaquery for summary with "junk"

UI Components and Access Methods

Verify all the components are present, visually presented according to spec and that all controls,widgets, mnemonics are functional.

  1. Menu items listed under Tools
    1. Junk Mail Controls...
    2. Mark Selected Messages as Junk
    3. Mark Selected Messages as Not Junk
    4. Run Junk Mail Controls on Selected Messages...
  2. Toolbar Button "Junk"
  3. Viewing Junk Control icon
    1. Thread pane column
      1. Display view widget in column header
      2. Menu item "Junk Status" listed under View|Sort by
    2. Message header
  4. Junk Folders:
    1. Default- Special "Junk"
    2. User Created
  5. Junk Mail Controls... dialog
    1. Account dropdown list
    2. Junk Log button
    3. Descriptive Text
    4. Checkbox to Enable Junk Controls
    5. Checkbox for selecting exclusion criteria per Address Book entry with Address Book dropdown list
    6. Checkbox for moving incoming junk messages:
      1. Radio button for selecting default "Junk" folder on account server with dropdown list of mail accounts and folders
      2. Radio button for user designated "Other" folder with dropdown list of mail accounts and folders
    7. Checkbox for "Automatically deleting messages marked as junk mail after [] days"
    8. OK, Cancel and Help buttons
  6. Junk Mail Log dialog
    1. Checkbox for enabling the Log
    2. Clear Log button
    3. Text area for displaying log
    4. OK button

Default or "Out of the box" state of Junk Controls

List of default status for UI components - check with spec for updates:

Name Criteria
Menu-Junk Mail Controls... Enabled when All types of Mail Accounts selected
Menu-Mark Selected Messages as Junk Enabled when All types of Mail Accounts selected
Menu-Mark Selected Messages as Not Junk Enabled when All types of Mail Accounts selected
Menu-Run Junk Controls on Selected Messages Enabled when All types of Mail Accounts selected
Toolbar - "Junk Enabled when Thread pane has focus
Thread View- Junk Status column Visible
Junk Mail Contols dialog Mail Account dropdown list enabled, Junk Log button enabled. Checkbox for "Enable Junk Controls" checked- all other options pertaining to these controls disabled. OK, Cancel and Help buttons enabled.
Junk Mail Controls dialog The default mail account is listed as the default mail account for "Account" and "Junk" folder on:
Junk Mail Controls dialog The Personal Address Book is the default listed address book for the option to not mark certain messages as junk.
Junk Log Check box "The Junk Mail log is a file which documents junk mail control activity. Use the checkbox below to enable logging" is enabled. The Clear Log and OK buttons are enabled. Log text area is empty.

Junk Mail Controls

Junk Mail Controls (JMC) functionality is based on training a file to recognize "Junk" mail based on the users actions. As training happens, the Junk Controls (JC) will have a higher percentage of correctly marking incoming mail as junk/not junk. Training is accomplished by user marking messages as Junk and removing the Junk status if a mail message is erroneously marked as Junk. The training does not compare message to message or sender to sender but collects information and combinations of information to create the training file. Therefore in testing this feature, we're looking for the Junk Mail Control to get better at evaluating Junk mail within a profile as usage goes up.

Mail Junk Controls- Basic UI functionality IMAP, POP & Other

  1. Verify all default states listed above:
    1. Verify all Default states are correct for a New Profile
    2. Verify all Default states are correct for Existing 7.x profile
    3. Verify all Default states are correct for Migrated 4.7 profile
  2. Verify correct functionality of Junk Control dialog UI:
    1. Verify you can turn Junk Control On /Off by checking/unchecking the option and it holds the state through exit and relaunch.
    2. Verify the list of accounts is complete with all the mail accounts you have listed in the folder pane (Local Folders should not be listed).
    3. Verify newly added mail accounts are listed and the junk controls are in the Default state.
    4. Verify you can turn on/off the option to exclude as junk mail, senders who are in in a selected address book, by checking/unchecking the option.
    5. Verify you can select any Address book listed in the dropdown (no ABook lists or Directories should be listed), and the selection holds through exit and relaunch.
    6. Verify you can turn on/off the option to Move incoming Junk messages to a designated folder, by checking/unchecking the option.
    7. Verify AOL mail accounts are not listed in the Move Junk Mail option dropdown
    8. Verify you can designate any existing mail folder (including folders in Local Folders) as the designated folder for moving to Junk.
    9. Verify the designated folder, is moved to the top of the folder list and becomes a "Special" folder complete w/icon.
    10. Verify you can toggle between the auto created Junk folder [default mail server] or user specified (Other) location.
    11. Verify you can turn on/off the automatic option for deleting junk messages after a certain period and you can change the numeric value for "days".
    12. Verify you have a training.dat file in the .slt directory of the profile you are using. (At this time you don't get one until Junk Control is turned on, but it will be on by default for the release therefore the .dat file should be created after adding a mail account.
  3. Verify "Junk" folder creation & classification as "special" per mail account:
    1. IMAP, if no Junk folder exists, we create one and make it "special"
    2. IMAP, if a Junk folder exists, we make it "special"
    3. POP, we create the Junk folder and make it "special"
    4. User created folder, designated as the junk folder, we make it "special", remove "special" status of default Junk folder.
    5. Designated junk folders (default or user created) can not be deleted.
    6. Default Junk folders that are no longer "special" can be deleted.

Marking messages As Junk - IMAP, POP & Other

  1. Verify correct functionality of Junk Mail Controls onIMAP account:Junk Mail Control is enabled, Move is not enabled.
    1. Mark message/s as junk, verify the Junk status holds during exit and relaunch.
      1. Click on the dot in the JM column in the thread pane
      2. Select a message/s, select the menu item "Mark Selected Message as Junk"
      3. Select a message/s, click on the Junk button in toolbar
      4. Messages arrived and was marked as Junk
    2. Remove junk status from message/s, verify junk status hold during exit and relaunch.
      1. Click on the JM icon in the thread pane
      2. Select a message/s, select the menu item "Mark Selected Message As Not Junk"
      3. Select a message/s, click on the Junk button in toolbar
    2. Move a junk message/s to another IMAP folder, verify the junk status holds during the move, then the exit and relaunch.
    3. Move a junk message/s to a local folder, verify the junk status holds during the move, then the exit and relaunch.
  2. Verify correct functionality of Junk Mail Control onPOP mail account:Junk Mail Control is enabled, Move is not enabled.
    1. Mark message/s as junk, verify the Junk status holds during exit and relaunch.
      1. Click on the dot in the JM column in the thread pane
      2. Select a message/s, select the menu item Mark Selected Message as Junk
      3. Select a message/s, click on the Junk button in toolbar
      4. Messages arrived and was marked as Junk
    2. Remove junk status from message/s, verify junk status hold during exit and relaunch.
      1. Click on the JM icon in the thread pane
      2. Select a message/s, select the menu item Mark Selected Message As Not Junk
      3. Select a message/s, click on the Junk button in toolbar
    3. Move a junk message/s to an IMAP folder, verify the junk status holds during the move, then the exit and relaunch.
    4. Move a junk message/s to a local folder, verify the junk status holds during the move, then the exit and relaunch.

New mail- Junk Mail automatically Moves - IMAP, POP & Other

  1. Verify correct functionality of Junk Mail Control-Move to designated folder.Junk Mail Contol is enabled and trained. Move todefault Junk folder in mail account is on and selected.
    1. Get Msg in IMAP mail account that receives junk. Verify new message/s recognized as junk are moved to the default Junk folder in that account
    2. Get Msg in POP mail account that receives junk. Verify new message/s recognized as junk are moved to the default Junk folder in that account.
  2. Verify correct functionality of Junk Mail Control-Move to designated folder.Junk Mail Contol is enabled and trained. Move touser defined Junk folder in mail account is on and selected
    1. Get Msg in IMAP mail account that receives junk. Verify new message/s recognized as junk are moved to the designated Junk folder in that account
    2. Get Msg in POP mail account that receives junk. Verify new message/s recognized as junk are moved to the designated Junk folder in that account.
  3. Verify correct functionality of Junk Mail Control-Move to designated folder.Junk Mail Contol is enabled and trained. Move todesignated Other Junk folder in Local Folders is on and selected.
    1. Get Msg in IMAP mail account that receives junk. Verify new message/s recognized as junk are moved to the designated local Junk folder.
    2. Get Msg in POP mail account that receives junk. Verify new message/s recognized as junk are moved to the designated local Junk folder.

Exclusion of Address Book sender as Junk Mail - IMAP, POP & Other

  1. Verify correct functionality of Junk Mail Control-Exclude senders in address bookJunk Mail Contol is enabled and trained. Move to designated folder is off . Do not mark messages as junk mail if sender is in my address book" is on and set it according to tests below.
    1. Get Msg in a mail account that receives junk. Verify New message/s from someone in yourPersonal Address book are not flagged as junk.
    2. Get Msg in a mail account that receives junk. Verify new message/s from someone in auser created & designated address book are not flagged as junk.

Training Mail Junk Controls - IMAP, POP & Other

  1. Verify correct training of Junk Mail Controls :Setup-Enable Junk Controls=checked. Do not mark messages as junk mail if the sender is in my address book=unchecked. Move Incoming messages determined to be junk mail to: "Junk" folder on: [Default IMAP account]=unchecked.Automatically delete messages marked as junk mail after [14] days=unchecked. Create a profile adding a mail account that has a good amount (50+) of "Junk" mail already in the Inbox and will continue receiving junk mail. (For IMAP, I used an IMAP account that collects junk mail regularly and has several folders that contain both junk and not junk mail . IMAP accounts used for this test should not be active on any other system because each message on the server is flagged with the junk status.).
    1. Junk Mail Control (initial training 0-50 messages identified)
      1. Get new messages, scan through the thread list, marking 10 or so messages as Junk. Verify the junk icon displays in the column for each one you marked as junk. Verify the status bar shows activity which indicates the training.dat file is being accessed. Exit, relaunch and get new messages, verify the messages are still listed as Junk. (Note, if you have received new Junk mail more than likely it will not be detected as Junk yet, the training file is still to new, mark it as junk manually to train)
      2. Continue with step "a." until you have manually marked 50+ messages as Junk and have changed the Junk status of some messages that were incorrectly labeled. Exit and relaunch, verify the Mail Junk Control is correctly identifying Junk/Not Junk at about 20%= accuracy.
    2. Junk Mail Control (moderately trained 50-100 messages identified)
      1. Get new messages, mark an additional 50 junk messages. Exit, relaunch and get new messages, verify that JMC is correctly identifying Junk/Not Junk at about 50%= accuracy
    3. Junk Mail Control (well trained 100+ messages identified)
      1. Get new messages, mark an additional 50 junk messages. Exit, relaunch and get new messages, verify that JMC is correctly identifying Junk/Not Junk at about 80%= accuracy

Marking Mail as Junk/Not Junk After the Fact - IMAP, POP & Other

  1. Verify menu option "Run Junk Mail Controls on Selected Messages".Setup-Enable Junk Controls=checked. Do not mark messages as junk mail if the sender is in my address book=unchecked. Move Incoming messages determined to be junk mail to: "Junk" folder on: [Default IMAP account]=unchecked.Automatically delete messages marked as junk mail after [14] days=unchecked. Use a profile with a mail account that has a well trained JMC.
    1. Get new messages, let JMC finish evaluating new mail. Change to a folder that contains a variety of Junk/Not Junk mail and Select All the messages. Using Menu item "Run Junk Mail Controls on Selected Messages". Verify, most of the messages you expected would be marked as Junk are marked as Junk. Exit and relaunch to verify they are all still marked as Junk.
    2. Get new messages, let JMC finish evaluating new mail. Review messages and select all new junk mail that did get evaluated as Junk. Using menu item "Mark Selected Messages as Junk". Verify all the selected messages are now marked as junk. Exit and relauch to verify they are still marked as Junk.
    3. Get New messages, let JMC finish evaluating new mail. Review messages and select all new mail that was incorrectly evaluated as Junk. Using menu item "Mark Selected Messages as Not Junk". Verify all the selected messages are no longer marked as Junk. Exit and relaunch to verify they are still not marked as Junk.

Automatic Deleting of Junk - IMAP, POP & Other

  1. Verify Junk Control option "Run Junk Mail Controls on Selected Messages".Setup-Enable Junk Controls=checked. Do not mark messages as junk mail if the sender is in my address book=unchecked. Move Incoming messages determined to be junk mail to: "Junk" folder on: [Default IMAP account]=checked.Automatically delete messages marked as junk mail after [1] days=checked. Use a profile with a mail account that has a well trained JMC
    1. Get new messages, let JMC finish evaluating new mail. Verify messages that were moved to your designated Junk folder that were older than 24 hrs have been deleted per standard Delete outside of this feature.
      1. IMAP delete model- Move to Trash and designated Junk folder=Trash. Verify the messages immediately deleted, no longer on server.
      2. IMAP delete model- Move to Trash and designated Junk folder=Junk or other folder not Trash. Verify the messages are move to the Trash folder
      3. IMAP delete model- Mark it as Deleted and designated Junk folder=Junk or other folder not Trash. Verify the messages are marked as deleted and are not moved.
      4. IMAP delete model- Remove Immediately and designated Junk folder=Junk or other folder not Trash. Verify the messages are removed and are not located in any other folder.
      5. POP account, designated Junk folder=Trash. Verifiy the messages are removed and are not located in any other folder.
      6. POP account, designated Junk folder=Junk or other folder not Trash. Verifiy the messages are removed and are not located in any other folder
    2. Verify only Junk mail messages are deleted from the Trash when using Trash as the destination Junk folder.

Mail Filters interaction with Junk Controls - IMAP, POP & Other

  1. Verify Message Filters take precedence over Junk Mail Controls.Setup-Enable Junk Controls=checked. Do not mark messages as junk mail if the sender is in my address book=unchecked. Move Incoming messages determined to be junk mail to: "Junk" folder on: [Default IMAP account]=unchecked.Automatically delete messages marked as junk mail after [14] days=unchecked. Use a profile with a mail account that has a well trained JMC. Have a Mail Filter set up with a criteria that would match that of a junk mail. (For easy testing of this, you could set up the criteria "Sender contains @" this would basically put all incoming messages into the designated filter folder)
    1. Get new messages, let JMC finish evaluating new mail. Verify all messages that fit the Message Filter critereia you set, were moved to your designated Filter folder and were not flagged as Junk. Exit and relaunch, verify the messages are still in the designated message filter folder and are not marked as Junk.
    2. Set the option to move Junk mail to the Junk folder. Exit and relaunch. Get new messages, let JMC finish evaluating new mail. Verify all messages that fit the Message Filter critereia you set, were moved to your designated Filter folder (not the Junk folder) were not flagged as Junk.

Junk Mail Log

Other issues

  1. Junk Mail Control training.dat file is Profile related. However, Enabling JMC is per mail account.
    1. Set up a Profile with multiple Mail accounts and set all to enable JMC. Verify it works on all accounts within the profile.
    2. Set up a Profile with multiple Mail accounts and set 1/2 of the accounts to enable JMC. Verify only those accounts with JMC enabled are evaulating incoming mail as Junk.
    3. Set up a Profile with multiple Mail accounts various types (IMAP, POP & Other), set all to enable JMC. Verify it works on all accounts within the profile