Bug testing workbench

From Audacity Wiki
Revision as of 17:20, 21 June 2016 by PeterSampson (talk | contribs) (To be tested: added 1409)
Jump to: navigation, search


Peter 27Jan16: As it appears that we seem to have consensus that the primary target for the 2.1.3 release is to fix as many of the bugs as possible we need also to ensure that we on QA are as swift as the developers by testing and closing (if appropriate) the fixes that they make.

Otherwise we will find ouselves later down the road with an intimidating amount of bug fixes to test and evaluate.

Paul and Steve have already put their shoulders to wheel and have generated and committed fixes for a fair number of bugs.

In order to assist this process I am preparing to allocate time to testing bug fixes on W10 as soon as possible after they become available in a nightly. This of course only tests on one Windows platform and I am not empowered to close bugs.

  • As of 13Feb16 I now have a Macbook Pro (El Capitan) available for testing - so now can cover two platforms Windows and OS X.

To be tested

  • 122 P4: Cursor no longer moves when dragging a selected point label - fix not in W10 21Jun16 nightly
  • 1408 P4: Abandoning Help in Timer Record with no installed Manual causes odd window to appear - fix not in W10 21Jun16 nightly
  • 868 P3: Can't navigate through docked toolbars using "move through active windows" shortcuts - fix not in Mac 21Jun16 nightly
  • 1409 P4: On Mac: Contrast: Closing "Help on the Internet" returns focus to main window on W10:Abandoning Help in Timer Record with no installed Manual causes odd window to appear - fix not in W10 or Mac 21Jun16 nightlies

FIX-FULLY-TESTED

  • 1169 P2: Spectrogram scale range setting only applied for linear scale - ok on Linux 02Feb16 too - and tests ok on El Capitan 16Feb16 and on W10 28Jan16
  • 1277 P2: Undoing edits made in Spectrogram view with spectral content present undoes track spectrogram settings. - tests ok on Linux 20Jun16, on Mac 21Jun16 and W10 21Jun16
  • 66 P4: (On Mac) About box not modeless - Looks to work ok on Mac El Capitan d6187f6 21Jun16 - But fixing this may have caused Bug #1408 on Windows - tested ok on Mac 21Jun16 (and only affected Mac)
  • 1407 P3: Freezing help dialog in Timer Record - tested ok on Mac 21Jun16 (and only affected Mac)
  • 1353 P4: Plot Spectrum assertion error and crash in Debug builds - tested ok on Mac 21Jun16 debug DMG (and only affected Mac)
  • 1222 P4: Scrollbar areas flicker when recording or scroll-scrubbing - tested ok on Mac 21Jun16 debug DMG (and only affected Mac)

The Bugs I have tested so far and that look to be good to go so far on W10 and Mac El Capitan still to be tested on Linux

P2

None

P3

  • 30 P3: Transport shortcuts write label at cursor position when label track has focus - tests OK on W10 26Jan16 & MAC-EC 15Feb16
  • 389 P3: Left-click to merge a stereo clip can move other clips if track was made from mono - tests OK on W10 27Jan16 & MAC-EC 15Feb16
  • 389 P3: Left-click to merge a stereo clip can move other clips if track was made from mono - tests OK on W10 27Jan16 & MAC-EC 15Feb16
  • 202 P3: "Audacity is already running" prevents opening further files - tests OK on W10 18Feb16 & MAC-EC 18Feb16
  • 829 P3: Bug with vertical time shift and differing track rates - tests OK on W10 18Feb16 & MAC-EC 18Feb16
  • 661 P3: A few shipped Nyquist plug-ins fail with comma as decimal separator - tests OK on W10 20Feb16 & MAC-EC 20Feb16
  • & cgi?id=119 119 P3: Export Multiple: "/", "*" and "?" in label or track name handled incorrectly - tests OK on MAC-EC 21Jun16 & W10 21Jun16

P4

  • 1307 P4: Misbehavior pasting mono into stereo - tests OK on W10 & MAC-EC 1310] Expanding cutline in stereo channel leaves incorrect undo history - tests OK on W10 26Jan16 & MAC-EC 15Feb16
  • 671 P4: Crash when joining splits with mouse - tests OK on W10 26Jan16 & MAC-EC 15Feb16
  • 828 P4: Contrast dialog misbehaves when selection includes gaps between clips - tests OK on W10 18Feb16 & MAC-EC 18Feb16
  • 1137 P4: ESC key stopped working - tests OK on W10 18Feb16 & MAC-EC 18Feb16
  • 972 P4: Recording starts mid-screen -- tests OK on W10 18Feb16 & MAC-EC 18Feb16
  • 1208 P4: Spectrogram vertical zoom-in is limited to ten bins - tests OK on W10 18Feb16 & MAC-EC 18Feb16
  • 1049 P4: Spectral edit effects fail on 0 Hz low frequency - tests OK on W10 18Feb16 & MAC-EC 18Feb16
  • 605 P4: snd-const function with a negative duration causes Audacity to crash - tests OK on W10 20Feb16 & MAC-EC 20Feb16
  • 1241 P4: Change Speed effect is not sample accurate - tests OK on W10 23Jan16 & MAC-EC 20Feb16
  • 768 P4: TRegular Interval Labels may return fewer labels than requested - tests OK on W10 20Feb16 & MAC-EC 20Feb16
  • 955 P4: Sliding Time Scale preview incorrect - tests OK on W10 20Feb16 & MAC-EC 20Feb16
  • 814 P4: Using the Play and Stop buttons in a Project-2 interrupts on-going recording in Project-1 - tests OK on W10 29Mar16 - tests OK on W10 29Mar16 & MAC-EC 21Jun16

P5

  • 683 P5: Bass and Treble: Excessive amplification produces Nan's - tests OK on W10 18Feb16 & MAC-EC 18Feb16

Tested on audacity-win-rd6b8080-2.1.3-alpha-30-jan-16 - all test ok on W10

  • 1197 P2: Extreme zoomed in levels move view, losing cursor or selection - tested ok on all 3 platforms
    • Actually still not ok on Mac EC for ten-hour and one-hour projects.


Auto update

IDPStatusSummary (23 tasks)
1169P2RESOLVEDSpectrogram scale range setting only applied for linear scale
1197?P2RESOLVEDExtreme zoomed in levels move view, losing cursor or selection.
202P3RESOLVED"Audacity is already running" prevents opening further files
30P3RESOLVEDTransport shortcuts write label at cursor position when label track has focus
829P3RESOLVEDBug with vertical time shift and differing track rates
389P3RESOLVEDLeft-click to merge a stereo clip can move other clips if track was made from mono
1290P3RESOLVED"Split New" clips cannot be dragged back into the track they came from.
661P3RESOLVEDA few shipped Nyquist plug-ins fail with comma as decimal separator
1310P4RESOLVEDExpanding cutline in stereo channel leaves incorrect undo history
828P4RESOLVEDContrast: Measuring white space gives cryptic value
1208P4RESOLVEDSpectrogram vertical zoom-in is limited to ten bins
955P4RESOLVEDSliding Time Scale preview incorrect.
1278P4RESOLVEDSpectral edit parametric EQ gives incorrect results if frequency content of track exceeds Nyquist frequency.
605P4RESOLVEDsnd-const function with a negative duration causes Audacity to crash
1044P4RESOLVEDChoosing Spectral Selection log(f) or Pitch (EAC) Default View Mode breaks waveform creation in 2.1.0 or earlier
1307P4RESOLVEDMisbehavior pasting mono into stereo
671P4RESOLVEDCrash when joining splits with mouse
1137P4RESOLVEDESC key stopped working
768P4RESOLVEDRegular Interval Labels may return fewer labels than requested.
1241P4RESOLVEDChange Speed effect is not sample accurate
972P4RESOLVEDRecording starts mid-screen
1049P4RESOLVEDSpectral edit effects fail on 0 Hz low frequency.
683P5CLOSEDBass and Treble: Excessive amplification produces Nan's.

Resolved/Fixed

  • 1306 Tracks > Align Tracks and > Move Selection when Aligning shortcuts no longer work
  • 1313 Inconsistency in naming of Metadata Tags editor
  • 1104 Incorrect playback of stereo tracks when channels different lengths - ok on W10 & Linux
  • 1272 Mixdown export shows no progress if one or more tracks are much shorter than the others
  • 1199 Export multiple by labels when offset tracks exist adds silence to exported files
  • 1299 (tested By David Bailes) Track loses focus after applying a Chain to the project
  • 1239 Importing multiple files into new project windows produces waveform, but incorrect length on Timeline
  • 1217 "Other uncompressed files" exports saved with incorrect extension
  • 915 Audacity creates a folder called Plug-Ins.
  • 1357 pasting in effect controls does not update linked controls, sliders or linked OK/Preview. - tests OK on W10 & MAC-EC - still to be tested on Linux
  • 513 Contrast tool fails if selection is beyond the end of a previous track.
  • 144 Lyrics Window makes things slow, when many labels.
  • 1282 Tracks > Stereo To Mono is not removed from menu if disabled in Plug-in Manager but is disabled for session and crashes if used
  • 52 Truncate Silence should cater for the common use case of per-track operation
  • 1311 Description message is ungrammatical in Normalize
  • 1312 Description message is wrong in Leveller
  • 1317 Description message is confusing in Analyze>Find Clipping
  • 440 Metadata Editor: Tags without values can't be added to xml templates or set default
  • 1303 Solo button behaviour "Simple" would be a better default
  • 1390 Enabled Snap To crashes on new project or Audacity launch
  • 1400 Timer Record dialog for Timer Recording Disk Space Warning is inconsistent
  • 1395 P4: On Mac TQP playhead stops when dropdown menu is invoked - but play continues