Difference between revisions of "Bug testing workbench"

From Audacity Wiki
Jump to: navigation, search
(#315: HGale notes - bug is a little more prevalent than the title suggests so promoted to P3 and changed title and REOPENED it)
(The Bugs I have tested so far and that look to be good to go so far on W10 and Mac El Capitan are:: marked those that arestill to be tested on Linux)
Line 9: Line 9:
  
 
==The Bugs I have tested so far and that look to be good to go so far on W10 and Mac El Capitan are:==
 
==The Bugs I have tested so far and that look to be good to go so far on W10 and Mac El Capitan are:==
*[http://bugzilla.audacityteam.org/show_bug.cgi?id=52 52]  Truncate Silence should cater for the common use case of per-track operation - tests OK on W10 & MAC-EC
+
*[http://bugzilla.audacityteam.org/show_bug.cgi?id=52 52]  Truncate Silence should cater for the common use case of per-track operation - tests OK on W10 & MAC-EC - <font color="red">'''still to be tested on Linux'''</font>
*[http://bugzilla.audacityteam.org/show_bug.cgi?id=30 30]    Transport shortcuts write label at cursor position when label track has focus - tests OK on W10 & MAC-EC
+
*[http://bugzilla.audacityteam.org/show_bug.cgi?id=30 30]    Transport shortcuts write label at cursor position when label track has focus - tests OK on W10 & MAC-EC - <font color="red">'''still to be tested on Linux'''</font>
*[http://bugzilla.audacityteam.org/show_bug.cgi?id=389 389]    Left-click to merge a stereo clip can move other clips if track was made from mono - tests OK on W10 & MAC-EC
+
*[http://bugzilla.audacityteam.org/show_bug.cgi?id=389 389]    Left-click to merge a stereo clip can move other clips if track was made from mono - tests OK on W10 & MAC-EC - <font color="red">'''still to be tested on Linux'''</font>
*[http://bugzilla.audacityteam.org/show_bug.cgi?id=1307 1307]  Misbehavior pasting mono into stereo - tests OK on W10 & MAC-EC
+
*[http://bugzilla.audacityteam.org/show_bug.cgi?id=1307 1307]  Misbehavior pasting mono into stereo - tests OK on W10 & MAC-EC - <font color="red">'''still to be tested on Linux'''</font>
*[http://bugzilla.audacityteam.org/show_bug.cgi?id=1310 1310]  Expanding cutline in stereo channel leaves incorrect undo history - tests OK on W10 & MAC-EC
+
*[http://bugzilla.audacityteam.org/show_bug.cgi?id=1310 1310]  Expanding cutline in stereo channel leaves incorrect undo history - tests OK on W10 & MAC-EC - <font color="red">'''still to be tested on Linux'''</font>
*[http://bugzilla.audacityteam.org/show_bug.cgi?id=671 671]    Crash when joining splits with mouse - tests OK on W10 & MAC-EC
+
*[http://bugzilla.audacityteam.org/show_bug.cgi?id=671 671]    Crash when joining splits with mouse - tests OK on W10 & MAC-EC - <font color="red">'''still to be tested on Linux'''</font>
*[http://bugzilla.audacityteam.org/show_bug.cgi?id=389 389]    Left-click to merge a stereo clip can move other clips if track was made from mono - tests OK on W10 & MAC-EC
+
*[http://bugzilla.audacityteam.org/show_bug.cgi?id=389 389]    Left-click to merge a stereo clip can move other clips if track was made from mono - tests OK on W10 & MAC-EC - <font color="red">'''still to be tested on Linux'''</font>
*[http://bugzilla.audacityteam.org/show_bug.cgi?id=1239 1239]  Importing multiple files into new project windows produces waveform, but incorrect length on Timeline - tests OK on W10 & MAC-EC
+
*[http://bugzilla.audacityteam.org/show_bug.cgi?id=1239 1239]  Importing multiple files into new project windows produces waveform, but incorrect length on Timeline - tests OK on W10 & MAC-EC - <font color="red">'''still to be tested on Linux'''</font>
 
===not right on Mac El Capitan===
 
===not right on Mac El Capitan===
 
*[http://bugzilla.audacityteam.org/show_bug.cgi?id=1217 1217]  "Other uncompressed files" exports saved with incorrect extension - ok on Linux too - exported file ok but <font color="red">'''dialog wrong on Mac-EC'''</font>
 
*[http://bugzilla.audacityteam.org/show_bug.cgi?id=1217 1217]  "Other uncompressed files" exports saved with incorrect extension - ok on Linux too - exported file ok but <font color="red">'''dialog wrong on Mac-EC'''</font>

Revision as of 13:36, 16 February 2016

Peter 27Jan16: As it appears that we seem to have consensus that the primary target for the 2.1.3 release is to fix as many of the bugs as possible we need also to ensure that we on QA are as swift as the develpers by testing and closing (if appropriate) the fixes that they make.

Otherwise we will find ouselves later down the road with an intimidating amount of bug fixes to test and evaluate.

Paul and Steve have already put their shoulders to wheel and have generated an committed fixes for a fair number of bugs - and Leland is preparing to take up the struggle.

In order to assist this process I am preparing to allocate time to testing bug fixes on W10 as soon as possible after they become available in a nightly. This of course only tests on one Windows platform and I am not empowered to close bugs.

The Bugs I have tested so far and that look to be good to go so far on W10 and Mac El Capitan are:

  • 52 Truncate Silence should cater for the common use case of per-track operation - tests OK on W10 & MAC-EC - still to be tested on Linux
  • 30 Transport shortcuts write label at cursor position when label track has focus - tests OK on W10 & MAC-EC - still to be tested on Linux
  • 389 Left-click to merge a stereo clip can move other clips if track was made from mono - tests OK on W10 & MAC-EC - still to be tested on Linux
  • 1307 Misbehavior pasting mono into stereo - tests OK on W10 & MAC-EC - still to be tested on Linux
  • 1310 Expanding cutline in stereo channel leaves incorrect undo history - tests OK on W10 & MAC-EC - still to be tested on Linux
  • 671 Crash when joining splits with mouse - tests OK on W10 & MAC-EC - still to be tested on Linux
  • 389 Left-click to merge a stereo clip can move other clips if track was made from mono - tests OK on W10 & MAC-EC - still to be tested on Linux
  • 1239 Importing multiple files into new project windows produces waveform, but incorrect length on Timeline - tests OK on W10 & MAC-EC - still to be tested on Linux

not right on Mac El Capitan

  • 1217 "Other uncompressed files" exports saved with incorrect extension - ok on Linux too - exported file ok but dialog wrong on Mac-EC

Tested changes on audacity-win-r12a2d06-2.1.3-alpha-28-jan-16 (since precvious 17c9369)- all test ok on W10

  • 1282 Tracks > Stereo To Mono is not removed from menu if disabled in Plug-in Manager but is disabled for session and crashes if used - tests OK on W10 & MAC-EC & Linux
    • But Gale reopened this bug with a not-the-same but related issue "disabling Stereo to Mono does not persist after restarting Audacity".
      • Steve agrees with me that this is a separate bug - and that this initial bug should be closed
  • 1288 "Simplified" language no longer supported and crashes Audacity
    • I can't test this on Mac El Capitan - as there doen't appear to be a Languages folder
  • 1299 (tested By David Bailes) Track loses focus after applying a Chain to the project - tests OK on W10 (David Bailes) & MAC-EC

Tested on audacity-win-rd6b8080-2.1.3-alpha-30-jan-16 - all test ok on W10

  • 1197 Extreme zoomed in levels move view, losing cursor or selection - tested ok on all 3 platforms
    • Actually still not ok on Mac EC for ten-hour and one-hour projects.
  • 1320 Contrast window miscalculation: Tracks with identical contents give different RMS values

Tested on audacity-win-ra0d78b9-2.1.3-alpha-02-feb-16

  • 1315 AIFF extension added for WAV file after saving project - ok on W10 but not on Linux
    • Gale in Bugzilla: The bug is a little more prevalent than the title suggests so promoted to P3 and changed title and added release note.


Auto update

IDPStatusSummary (18 tasks)
1282P2RESOLVEDTracks > Stereo To Mono is not removed from menu if disabled in Plug-in Manager but is disabled for session and crashes if used.
1299P2RESOLVEDTrack loses focus after applying a Chain to the project.
1197?P2RESOLVEDExtreme zoomed in levels move view, losing cursor or selection.
1239P2RESOLVEDImporting multiple files into new project windows produces waveform, but incorrect length on Timeline.
1169P2RESOLVEDSpectrogram scale range setting only applied for linear scale
1217P2RESOLVED"Other uncompressed files" exports saved with incorrect extension.
1315P3RESOLVEDAIFF extension always added for Other uncompressed files (or for any export format on Linux) after saving project or importing file
52P3RESOLVEDTruncate Silence should cater for the common use case of per-track operation.
30P3RESOLVEDTransport shortcuts write label at cursor position when label track has focus
389P3RESOLVEDLeft-click to merge a stereo clip can move other clips if track was made from mono
1288P4REOPENEDENH: "Simplified" language not currently supported
1320P4RESOLVEDContrast window miscalculation: Tracks with identical contents give different RMS values
671P4RESOLVEDCrash when joining splits with mouse
1310P4RESOLVEDExpanding cutline in stereo channel leaves incorrect undo history
1312P4RESOLVEDDescription message is wrong in Leveller
1317P4RESOLVEDDescription message is confusing in Analyze>Find Clipping
1307P4RESOLVEDMisbehavior pasting mono into stereo
1311P4RESOLVEDDescription message is ungrammatical in Normalize

FIX-FULLY-TESTED

  • 1311 Description message is ungrammatical in Normalize - tests ok on W10, Mac El Capitan and Linux
  • 1312 Description message is wrong in Leveller - tests ok on W10, Mac El Capitan and Linux
  • 1169 Spectrogram scale range setting only applied for linear scale - ok on Linux too - and tests ok on El Capitan
  • 1317 Description message is confusing in Analyze>Find Clipping - tests ok on W10, Mac El Capitan and Linux

Resolved/Fixed

  • 1306 Tracks > Align Tracks and > Move Selection when Aligning shortcuts no longer work
  • 1313 Inconsistency in naming of Metadata Tags editor
  • 1104 Incorrect playback of stereo tracks when channels different lengths - ok on W10 & Linux
  • 1272 Mixdown export shows no progress if one or more tracks are much shorter than the others
  • 1199 Export multiple by labels when offset tracks exist adds silence to exported files