Bug testing workbench

From Audacity Wiki
Revision as of 16:22, 18 February 2016 by PeterSampson (talk | contribs) (18Feb16: Testing outstanding DEVEL - FIX MADE bugs from 2015)
Jump to: navigation, search

Peter 27Jan16: As it appears that we seem to have consensus that the primary target for the 2.1.3 release is to fix as many of the bugs as possible we need also to ensure that we on QA are as swift as the develpers by testing and closing (if appropriate) the fixes that they make.

Otherwise we will find ouselves later down the road with an intimidating amount of bug fixes to test and evaluate.

Paul and Steve have already put their shoulders to wheel and have generated an committed fixes for a fair number of bugs - and Leland is preparing to take up the struggle.

In order to assist this process I am preparing to allocate time to testing bug fixes on W10 as soon as possible after they become available in a nightly. This of course only tests on one Windows platform and I am not empowered to close bugs.

  • As of 13Feb16 I now have a Macbook Pro (El Capitan) available for testing - so now can cover two platforms Windows and OS X.

The Bugs I have tested so far and that look to be good to go so far on W10 and Mac El Capitan are:

  • 52 Truncate Silence should cater for the common use case of per-track operation - tests OK on W10 & MAC-EC - still to be tested on Linux
  • 30 Transport shortcuts write label at cursor position when label track has focus - tests OK on W10 & MAC-EC - still to be tested on Linux
  • 389 Left-click to merge a stereo clip can move other clips if track was made from mono - tests OK on W10 & MAC-EC - still to be tested on Linux
  • 1307 Misbehavior pasting mono into stereo - tests OK on W10 & MAC-EC - still to be tested on Linux
  • 1310 Expanding cutline in stereo channel leaves incorrect undo history - tests OK on W10 & MAC-EC - still to be tested on Linux
  • 671 Crash when joining splits with mouse - tests OK on W10 & MAC-EC - still to be tested on Linux
  • 389 Left-click to merge a stereo clip can move other clips if track was made from mono - tests OK on W10 & MAC-EC - still to be tested on Linux
  • 1239 Importing multiple files into new project windows produces waveform, but incorrect length on Timeline - tests OK on W10 & MAC-EC - still to be tested on Linux

not right on Mac El Capitan

  • 1217 "Other uncompressed files" exports saved with incorrect extension - ok on Linux too - exported file ok but dialog wrong on Mac-EC

Tested changes on audacity-win-r12a2d06-2.1.3-alpha-28-jan-16 (since precvious 17c9369)- all test ok on W10

  • 1282 Tracks > Stereo To Mono is not removed from menu if disabled in Plug-in Manager but is disabled for session and crashes if used - tests OK on W10 & MAC-EC & Linux
    • But Gale reopened this bug with a not-the-same but related issue "disabling Stereo to Mono does not persist after restarting Audacity".
      • Steve agrees with me that this is a separate bug - and that this initial bug should be closed
  • 1288 "Simplified" language no longer supported and crashes Audacity
    • I can't test this on Mac El Capitan - as there doen't appear to be a Languages folder
  • 1299 (tested By David Bailes) Track loses focus after applying a Chain to the project - tests OK on W10 (David Bailes) & MAC-EC - still to be tested on Linux

Tested on audacity-win-rd6b8080-2.1.3-alpha-30-jan-16 - all test ok on W10

  • 1197 Extreme zoomed in levels move view, losing cursor or selection - tested ok on all 3 platforms
    • Actually still not ok on Mac EC for ten-hour and one-hour projects.
  • 1320 Contrast window miscalculation: Tracks with identical contents give different RMS values - tests OK on W10 & MAC-EC - still to be tested on Linux

Tested on audacity-win-ra0d78b9-2.1.3-alpha-02-feb-16

  • 1315 AIFF extension added for WAV file after saving project - ok on W10 but not on Linux
    • Gale in Bugzilla: The bug is a little more prevalent than the title suggests so promoted to P3 and changed title and added release note.

18Feb16: Testing outstanding DEVEL - FIX MADE bugs from 2015

  • 202 "Audacity is already running" prevents opening further files - tests OK on W10 & MAC-EC - still to be tested on Linux
  • 828 Contrast dialog misbehaves when selection includes gaps between clips - tests OK on W10 & MAC-EC - still to be tested on Linux
  • 1044 Choosing Spectral Selection log(f) or Pitch (EAC) Default View Mode breaks waveform creation in 2.1.0 or earlier - tests OK on W10 & MAC-EC - still to be tested on Linux
  • 829 Bug with vertical time shift and differing track rates - tests OK on W10 & MAC-EC - still to be tested on Linux
  • 1137 ESC key stopped working - tests OK on W10 & MAC-EC - still to be tested on Linux
  • 972 Recording starts mid-screen - tests OK on W10 & MAC-EC - still to be tested on Linux
  • 915 Audacity creates a folder called Plug-Ins - tests OK on W10 & MAC-EC - still to be tested on Linux
  • 1208 Spectrogram vertical zoom-in is limited to ten bins - tests OK on W10 & MAC-EC - still to be tested on Linux
  • 683 Bass and Treble: Excessive amplification produces Nan's - tests OK on W10 & MAC-EC - still to be tested on Linux
  • 1049 Spectral edit effects fail on 0 Hz low frequency - tests OK on W10 & MAC-EC - still to be tested on Linux
  • 1278 Spectral edit parametric EQ gives incorrect results if frequency content of track exceeds Nyquist frequency - tests OK on W10 & MAC-EC - still to be tested on Linux

Auto update

IDPStatusSummary (29 tasks)
1299P2RESOLVEDTrack loses focus after applying a Chain to the project.
1197?P2RESOLVEDExtreme zoomed in levels move view, losing cursor or selection.
1217P2RESOLVED"Other uncompressed files" exports saved with incorrect extension.
1169P2RESOLVEDSpectrogram scale range setting only applied for linear scale
1239P2RESOLVEDImporting multiple files into new project windows produces waveform, but incorrect length on Timeline.
1282P2RESOLVEDTracks > Stereo To Mono is not removed from menu if disabled in Plug-in Manager but is disabled for session and crashes if used.
829P3RESOLVEDBug with vertical time shift and differing track rates
30P3RESOLVEDTransport shortcuts write label at cursor position when label track has focus
202P3RESOLVED"Audacity is already running" prevents opening further files
52P3RESOLVEDTruncate Silence should cater for the common use case of per-track operation.
1315P3RESOLVEDAIFF extension always added for Other uncompressed files (or for any export format on Linux) after saving project or importing file
389P3RESOLVEDLeft-click to merge a stereo clip can move other clips if track was made from mono
1288P4REOPENEDENH: "Simplified" language not currently supported
1137P4RESOLVEDESC key stopped working
1320P4RESOLVEDContrast window miscalculation: Tracks with identical contents give different RMS values
1310P4RESOLVEDExpanding cutline in stereo channel leaves incorrect undo history
972P4RESOLVEDRecording starts mid-screen
1312P4RESOLVEDDescription message is wrong in Leveller
1278P4RESOLVEDSpectral edit parametric EQ gives incorrect results if frequency content of track exceeds Nyquist frequency.
1049P4RESOLVEDSpectral edit effects fail on 0 Hz low frequency.
1317P4RESOLVEDDescription message is confusing in Analyze>Find Clipping
671P4RESOLVEDCrash when joining splits with mouse
828P4RESOLVEDContrast: Measuring white space gives cryptic value
1307P4RESOLVEDMisbehavior pasting mono into stereo
1208P4RESOLVEDSpectrogram vertical zoom-in is limited to ten bins
915P4RESOLVEDAudacity creates a folder called Plug-Ins
1311P4RESOLVEDDescription message is ungrammatical in Normalize
1044P4RESOLVEDChoosing Spectral Selection log(f) or Pitch (EAC) Default View Mode breaks waveform creation in 2.1.0 or earlier
683P5CLOSEDBass and Treble: Excessive amplification produces Nan's.

FIX-FULLY-TESTED

  • 1311 Description message is ungrammatical in Normalize - tests ok on W10, Mac El Capitan and Linux
  • 1312 Description message is wrong in Leveller - tests ok on W10, Mac El Capitan and Linux
  • 1169 Spectrogram scale range setting only applied for linear scale - ok on Linux too - and tests ok on El Capitan
  • 1317 Description message is confusing in Analyze>Find Clipping - tests ok on W10, Mac El Capitan and Linux

Resolved/Fixed

  • 1306 Tracks > Align Tracks and > Move Selection when Aligning shortcuts no longer work
  • 1313 Inconsistency in naming of Metadata Tags editor
  • 1104 Incorrect playback of stereo tracks when channels different lengths - ok on W10 & Linux
  • 1272 Mixdown export shows no progress if one or more tracks are much shorter than the others
  • 1199 Export multiple by labels when offset tracks exist adds silence to exported files