Difference between revisions of "Bug testing workbench"

From Audacity Wiki
Jump to: navigation, search
(52 resolved)
(Tested changes on audacity-win-r12a2d06-2.1.3-alpha-28-jan-16 (since precvious 17c9369)- all test ok on W10: cruft removal)
Line 19: Line 19:
  
 
==Tested changes on audacity-win-r12a2d06-2.1.3-alpha-28-jan-16 (since precvious 17c9369)- all test ok on W10==
 
==Tested changes on audacity-win-r12a2d06-2.1.3-alpha-28-jan-16 (since precvious 17c9369)- all test ok on W10==
**<font color="red">But Gale reopened this bug with a not-the-same but related issue "disabling Stereo to Mono does not persist after restarting Audacity".</font>
 
***Steve agrees with me that this is a separate bug - and that this initial bug should be closed
 
 
*[http://bugzilla.audacityteam.org/show_bug.cgi?id=1288 1288]  "Simplified" language no longer supported and crashes Audacity
 
*[http://bugzilla.audacityteam.org/show_bug.cgi?id=1288 1288]  "Simplified" language no longer supported and crashes Audacity
**<font color="red">I can't test this on Mac El Capitan - as there doen't appear to be a Languages folder</font>  
+
**<font color="red">I can't test this on Mac El Capitan - as there doen't appear to be a Languages folder</font>
  
 
==Tested on audacity-win-rd6b8080-2.1.3-alpha-30-jan-16 - all test ok on W10==
 
==Tested on audacity-win-rd6b8080-2.1.3-alpha-30-jan-16 - all test ok on W10==

Revision as of 10:04, 2 June 2016

Peter 27Jan16: As it appears that we seem to have consensus that the primary target for the 2.1.3 release is to fix as many of the bugs as possible we need also to ensure that we on QA are as swift as the develpers by testing and closing (if appropriate) the fixes that they make.

Otherwise we will find ouselves later down the road with an intimidating amount of bug fixes to test and evaluate.

Paul and Steve have already put their shoulders to wheel and have generated an committed fixes for a fair number of bugs - and Leland is preparing to take up the struggle.

In order to assist this process I am preparing to allocate time to testing bug fixes on W10 as soon as possible after they become available in a nightly. This of course only tests on one Windows platform and I am not empowered to close bugs.

  • As of 13Feb16 I now have a Macbook Pro (El Capitan) available for testing - so now can cover two platforms Windows and OS X.

The Bugs I have tested so far and that look to be good to go so far on W10 and Mac El Capitan are:

  • 30 Transport shortcuts write label at cursor position when label track has focus - tests OK on W10 & MAC-EC - still to be tested on Linux
  • 389 Left-click to merge a stereo clip can move other clips if track was made from mono - tests OK on W10 & MAC-EC - still to be tested on Linux
  • 1307 Misbehavior pasting mono into stereo - tests OK on W10 & MAC-EC - still to be tested on Linux
  • 1310 Expanding cutline in stereo channel leaves incorrect undo history - tests OK on W10 & MAC-EC - still to be tested on Linux
  • 671 Crash when joining splits with mouse - tests OK on W10 & MAC-EC - still to be tested on Linux
  • 389 Left-click to merge a stereo clip can move other clips if track was made from mono - tests OK on W10 & MAC-EC - still to be tested on Linux

Tested changes on audacity-win-r12a2d06-2.1.3-alpha-28-jan-16 (since precvious 17c9369)- all test ok on W10

  • 1288 "Simplified" language no longer supported and crashes Audacity
    • I can't test this on Mac El Capitan - as there doen't appear to be a Languages folder

Tested on audacity-win-rd6b8080-2.1.3-alpha-30-jan-16 - all test ok on W10

  • 1197 Extreme zoomed in levels move view, losing cursor or selection - tested ok on all 3 platforms
    • Actually still not ok on Mac EC for ten-hour and one-hour projects.
  • 1320 Contrast window miscalculation: Tracks with identical contents give different RMS values - tests OK on W10 & MAC-EC - still to be tested on Linux

Tested on audacity-win-ra0d78b9-2.1.3-alpha-02-feb-16

  • 1315 AIFF extension added for WAV file after saving project - ok on W10 but not on Linux
    • Gale in Bugzilla: The bug is a little more prevalent than the title suggests so promoted to P3 and changed title and added release note.

18Feb16: Testing outstanding DEVEL - FIX MADE bugs from 2015

  • 202 "Audacity is already running" prevents opening further files - tests OK on W10 & MAC-EC - still to be tested on Linux
  • 828 Contrast dialog misbehaves when selection includes gaps between clips - tests OK on W10 & MAC-EC - still to be tested on Linux
  • 1044 Choosing Spectral Selection log(f) or Pitch (EAC) Default View Mode breaks waveform creation in 2.1.0 or earlier - tests OK on W10 & MAC-EC - still to be tested on Linux
  • 829 Bug with vertical time shift and differing track rates - tests OK on W10 & MAC-EC - still to be tested on Linux
  • 1137 ESC key stopped working - tests OK on W10 & MAC-EC - still to be tested on Linux
  • 972 Recording starts mid-screen - tests OK on W10 & MAC-EC - still to be tested on Linux
  • 1208 Spectrogram vertical zoom-in is limited to ten bins - tests OK on W10 & MAC-EC - still to be tested on Linux
  • 683 Bass and Treble: Excessive amplification produces Nan's - tests OK on W10 & MAC-EC - still to be tested on Linux
  • 1049 Spectral edit effects fail on 0 Hz low frequency - tests OK on W10 & MAC-EC - still to be tested on Linux
  • 1278 Spectral edit parametric EQ gives incorrect results if frequency content of track exceeds Nyquist frequency - tests OK on W10 & MAC-EC - still to be tested on Linux

20Feb16: Testing outstanding DEVEL - FIX MADE bugs from 2016 prior to 2.1.2

  • 605 snd-const function with a negative duration causes Audacity to crash - tests OK on W10 & MAC-EC - still to be tested on Linux
  • 661 A few shipped Nyquist plug-ins fail with comma as decimal separator - tests OK on W10 & MAC-EC - still to be tested on Linux
  • 1290 "Split New" clips cannot be dragged back into the track they came from - tests OK on W10 & MAC-EC - still to be tested on Linux
  • 1303 Solo button behaviour "Simple" would be a better default - tests OK on W10 & MAC-EC - still to be tested on Linux
  • 1241 Change Speed effect is not sample accurate - tests OK on W10 & MAC-EC - still to be tested on Linux
  • 768 TRegular Interval Labels may return fewer labels than requested - tests OK on W10 & MAC-EC - still to be tested on Linux
  • 955 Sliding Time Scale preview incorrect - tests OK on W10 & MAC-EC - still to be tested on Linux

29Mar16: Testing on W10 audacity-win-r484f23d-2.1.3-alpha-29-mar-16

  • 814 Using the Play and Stop buttons in a Project-2 interrupts on-going recording in Project-1 - tests OK on W10 - still to be tested on Linux & MAC-EC

Auto update

IDPStatusSummary (31 tasks)
1169P2RESOLVEDSpectrogram scale range setting only applied for linear scale
1197?P2RESOLVEDExtreme zoomed in levels move view, losing cursor or selection.
1315P3RESOLVEDAIFF extension always added for Other uncompressed files (or for any export format on Linux) after saving project or importing file
661P3RESOLVEDA few shipped Nyquist plug-ins fail with comma as decimal separator
30P3RESOLVEDTransport shortcuts write label at cursor position when label track has focus
389P3RESOLVEDLeft-click to merge a stereo clip can move other clips if track was made from mono
1290P3RESOLVED"Split New" clips cannot be dragged back into the track they came from.
202P3RESOLVED"Audacity is already running" prevents opening further files
829P3RESOLVEDBug with vertical time shift and differing track rates
1288P4REOPENEDENH: "Simplified" language not currently supported
1241P4RESOLVEDChange Speed effect is not sample accurate
440P4RESOLVEDMetadata Editor: Tags without values can't be added
972P4RESOLVEDRecording starts mid-screen
1049P4RESOLVEDSpectral edit effects fail on 0 Hz low frequency.
1320P4RESOLVEDContrast window miscalculation: Tracks with identical contents give different RMS values
1303P4RESOLVEDSolo button behaviour "Simple" would be a better default
1310P4RESOLVEDExpanding cutline in stereo channel leaves incorrect undo history
828P4RESOLVEDContrast: Measuring white space gives cryptic value
1208P4RESOLVEDSpectrogram vertical zoom-in is limited to ten bins
955P4RESOLVEDSliding Time Scale preview incorrect.
1312P4RESOLVEDDescription message is wrong in Leveller
1278P4RESOLVEDSpectral edit parametric EQ gives incorrect results if frequency content of track exceeds Nyquist frequency.
605P4RESOLVEDsnd-const function with a negative duration causes Audacity to crash
1044P4RESOLVEDChoosing Spectral Selection log(f) or Pitch (EAC) Default View Mode breaks waveform creation in 2.1.0 or earlier
1317P4RESOLVEDDescription message is confusing in Analyze>Find Clipping
671P4RESOLVEDCrash when joining splits with mouse
1137P4RESOLVEDESC key stopped working
1307P4RESOLVEDMisbehavior pasting mono into stereo
768P4RESOLVEDRegular Interval Labels may return fewer labels than requested.
1311P4RESOLVEDDescription message is ungrammatical in Normalize
683P5CLOSEDBass and Treble: Excessive amplification produces Nan's.

FIX-FULLY-TESTED

  • 1311 Description message is ungrammatical in Normalize - tests ok on W10, Mac El Capitan and Linux
  • 1312 Description message is wrong in Leveller - tests ok on W10, Mac El Capitan and Linux
  • 1169 Spectrogram scale range setting only applied for linear scale - ok on Linux too - and tests ok on El Capitan
  • 1317 Description message is confusing in Analyze>Find Clipping - tests ok on W10, Mac El Capitan and Linux

Resolved/Fixed

  • 1306 Tracks > Align Tracks and > Move Selection when Aligning shortcuts no longer work
  • 1313 Inconsistency in naming of Metadata Tags editor
  • 1104 Incorrect playback of stereo tracks when channels different lengths - ok on W10 & Linux
  • 1272 Mixdown export shows no progress if one or more tracks are much shorter than the others
  • 1199 Export multiple by labels when offset tracks exist adds silence to exported files
  • 1299 (tested By David Bailes) Track loses focus after applying a Chain to the project
  • 1239 Importing multiple files into new project windows produces waveform, but incorrect length on Timeline
  • 1217 "Other uncompressed files" exports saved with incorrect extension
  • 915 Audacity creates a folder called Plug-Ins.
  • 1357 pasting in effect controls does not update linked controls, sliders or linked OK/Preview. - tests OK on W10 & MAC-EC - still to be tested on Linux
  • 513 Contrast tool fails if selection is beyond the end of a previous track.
  • 144 Lyrics Window makes things slow, when many labels.
  • 440 etadata Editor: Tags without values can't be added to xml templates or set default
  • 1282 Tracks > Stereo To Mono is not removed from menu if disabled in Plug-in Manager but is disabled for session and crashes if used
  • 52 Truncate Silence should cater for the common use case of per-track operation