Difference between revisions of "Bug testing workbench"

From Audacity Wiki
Jump to: navigation, search
(Resolved/Fixed: 1395 resolved/fixed)
(cruft removal)
Line 56: Line 56:
 
*[http://bugzilla.audacityteam.org/show_bug.cgi?id=814 814] P4: Using the Play and Stop buttons in a Project-2 interrupts on-going recording in Project-1 - tests OK on W10 29Mar16 - <font color="red">'''still to be tested on Linux & MAC-EC'''</font>
 
*[http://bugzilla.audacityteam.org/show_bug.cgi?id=814 814] P4: Using the Play and Stop buttons in a Project-2 interrupts on-going recording in Project-1 - tests OK on W10 29Mar16 - <font color="red">'''still to be tested on Linux & MAC-EC'''</font>
  
==Re-opened==
 
*[http://bugzilla.audacityteam.org/show_bug.cgi?id=1320 1320]  Contrast window miscalculation: Tracks with identical contents give different RMS values - tests OK on W10 & MAC-EC - REOPENED because a similar case that exactly fits the bug title gives different results for original and rendered track.
 
  
 
==Auto update==
 
==Auto update==
 
{{#bugzilla:
 
{{#bugzilla:
|id=30,389,1307,1310,671,389,1288,1169,1197,1320,1315,202,828,1044,829,1137,972,1208,683,1049,1278,605,661,1290,1241,768,955
+
|id=30,389,1307,1310,671,389,1169,1197,202,828,1044,829,1137,972,1208,683,1049,1278,605,661,1290,1241,768,955
 
|status=*
 
|status=*
 
|columns=id,priority,status,summary
 
|columns=id,priority,status,summary

Revision as of 09:11, 21 June 2016

Peter 27Jan16: As it appears that we seem to have consensus that the primary target for the 2.1.3 release is to fix as many of the bugs as possible we need also to ensure that we on QA are as swift as the developers by testing and closing (if appropriate) the fixes that they make.

Otherwise we will find ouselves later down the road with an intimidating amount of bug fixes to test and evaluate.

Paul and Steve have already put their shoulders to wheel and have generated and committed fixes for a fair number of bugs.

In order to assist this process I am preparing to allocate time to testing bug fixes on W10 as soon as possible after they become available in a nightly. This of course only tests on one Windows platform and I am not empowered to close bugs.

  • As of 13Feb16 I now have a Macbook Pro (El Capitan) available for testing - so now can cover two platforms Windows and OS X.

To be tested

  • 1277 P2: Undoing edits made in Spectrogram view with spectral content present undoes track spectrogram settings. - tests ok on Linux
  • 122 P4: Cursor no longer moves when dragging a selected point label
  • 119 P3: Export Multiple: "/", "*" and "?" in label or track name handled incorrectly
  • 66 P4: (On Mac) About box not modeless
  • 1407 P3: Freezing help dialog in Timer Record
  • 1353 P4: Plot Spectrum assertion error and crash in Debug builds

FIX-FULLY-TESTED

  • 1169 P2: Spectrogram scale range setting only applied for linear scale - ok on Linux 02Feb16 too - and tests ok on El Capitan 16Feb16 and on W10 28Jan16

The Bugs I have tested so far and that look to be good to go so far on W10 and Mac El Capitan still to be tested on Linux

P2

None

P3

  • 30 P3: Transport shortcuts write label at cursor position when label track has focus - tests OK on W10 26Jan16 & MAC-EC 15Feb16
  • 389 P3: Left-click to merge a stereo clip can move other clips if track was made from mono - tests OK on W10 27Jan16 & MAC-EC 15Feb16
  • 389 P3: Left-click to merge a stereo clip can move other clips if track was made from mono - tests OK on W10 27Jan16 & MAC-EC 15Feb16
  • 202 P3: "Audacity is already running" prevents opening further files - tests OK on W10 18Feb16 & MAC-EC 18Feb16
  • 829 P3: Bug with vertical time shift and differing track rates - tests OK on W10 18Feb16 & MAC-EC 18Feb16
  • 661 P3: A few shipped Nyquist plug-ins fail with comma as decimal separator - tests OK on W10 20Feb16 & MAC-EC 20Feb16

P4

  • 1307 P4: Misbehavior pasting mono into stereo - tests OK on W10 & MAC-EC 1310] Expanding cutline in stereo channel leaves incorrect undo history - tests OK on W10 26Jan16 & MAC-EC 15Feb16
  • 671 P4: Crash when joining splits with mouse - tests OK on W10 26Jan16 & MAC-EC 15Feb16
  • 828 P4: Contrast dialog misbehaves when selection includes gaps between clips - tests OK on W10 18Feb16 & MAC-EC 18Feb16
  • 1137 P4: ESC key stopped working - tests OK on W10 18Feb16 & MAC-EC 18Feb16
  • 972 P4: Recording starts mid-screen -- tests OK on W10 18Feb16 & MAC-EC 18Feb16
  • 1208 P4: Spectrogram vertical zoom-in is limited to ten bins - tests OK on W10 18Feb16 & MAC-EC 18Feb16
  • 1049 P4: Spectral edit effects fail on 0 Hz low frequency - tests OK on W10 18Feb16 & MAC-EC 18Feb16
  • 605 P4: snd-const function with a negative duration causes Audacity to crash - tests OK on W10 20Feb16 & MAC-EC 20Feb16
  • 1241 P4: Change Speed effect is not sample accurate - tests OK on W10 23Jan16 & MAC-EC 20Feb16
  • 768 P4: TRegular Interval Labels may return fewer labels than requested - tests OK on W10 20Feb16 & MAC-EC 20Feb16
  • 955 P4: Sliding Time Scale preview incorrect - tests OK on W10 20Feb16 & MAC-EC 20Feb16

P5

  • 683 P5: Bass and Treble: Excessive amplification produces Nan's - tests OK on W10 18Feb16 & MAC-EC 18Feb16

Tested on audacity-win-rd6b8080-2.1.3-alpha-30-jan-16 - all test ok on W10

  • 1197 P2: Extreme zoomed in levels move view, losing cursor or selection - tested ok on all 3 platforms
    • Actually still not ok on Mac EC for ten-hour and one-hour projects.

29Mar16: Testing on W10 audacity-win-r484f23d-2.1.3-alpha-29-mar-16

  • 814 P4: Using the Play and Stop buttons in a Project-2 interrupts on-going recording in Project-1 - tests OK on W10 29Mar16 - still to be tested on Linux & MAC-EC


Auto update

IDPStatusSummary (23 tasks)
1169P2RESOLVEDSpectrogram scale range setting only applied for linear scale
1197?P2RESOLVEDExtreme zoomed in levels move view, losing cursor or selection.
202P3RESOLVED"Audacity is already running" prevents opening further files
30P3RESOLVEDTransport shortcuts write label at cursor position when label track has focus
829P3RESOLVEDBug with vertical time shift and differing track rates
389P3RESOLVEDLeft-click to merge a stereo clip can move other clips if track was made from mono
1290P3RESOLVED"Split New" clips cannot be dragged back into the track they came from.
661P3RESOLVEDA few shipped Nyquist plug-ins fail with comma as decimal separator
1310P4RESOLVEDExpanding cutline in stereo channel leaves incorrect undo history
828P4RESOLVEDContrast: Measuring white space gives cryptic value
1208P4RESOLVEDSpectrogram vertical zoom-in is limited to ten bins
955P4RESOLVEDSliding Time Scale preview incorrect.
1278P4RESOLVEDSpectral edit parametric EQ gives incorrect results if frequency content of track exceeds Nyquist frequency.
605P4RESOLVEDsnd-const function with a negative duration causes Audacity to crash
1044P4RESOLVEDChoosing Spectral Selection log(f) or Pitch (EAC) Default View Mode breaks waveform creation in 2.1.0 or earlier
1307P4RESOLVEDMisbehavior pasting mono into stereo
671P4RESOLVEDCrash when joining splits with mouse
1137P4RESOLVEDESC key stopped working
768P4RESOLVEDRegular Interval Labels may return fewer labels than requested.
1241P4RESOLVEDChange Speed effect is not sample accurate
972P4RESOLVEDRecording starts mid-screen
1049P4RESOLVEDSpectral edit effects fail on 0 Hz low frequency.
683P5CLOSEDBass and Treble: Excessive amplification produces Nan's.

Resolved/Fixed

  • 1306 Tracks > Align Tracks and > Move Selection when Aligning shortcuts no longer work
  • 1313 Inconsistency in naming of Metadata Tags editor
  • 1104 Incorrect playback of stereo tracks when channels different lengths - ok on W10 & Linux
  • 1272 Mixdown export shows no progress if one or more tracks are much shorter than the others
  • 1199 Export multiple by labels when offset tracks exist adds silence to exported files
  • 1299 (tested By David Bailes) Track loses focus after applying a Chain to the project
  • 1239 Importing multiple files into new project windows produces waveform, but incorrect length on Timeline
  • 1217 "Other uncompressed files" exports saved with incorrect extension
  • 915 Audacity creates a folder called Plug-Ins.
  • 1357 pasting in effect controls does not update linked controls, sliders or linked OK/Preview. - tests OK on W10 & MAC-EC - still to be tested on Linux
  • 513 Contrast tool fails if selection is beyond the end of a previous track.
  • 144 Lyrics Window makes things slow, when many labels.
  • 1282 Tracks > Stereo To Mono is not removed from menu if disabled in Plug-in Manager but is disabled for session and crashes if used
  • 52 Truncate Silence should cater for the common use case of per-track operation
  • 1311 Description message is ungrammatical in Normalize
  • 1312 Description message is wrong in Leveller
  • 1317 Description message is confusing in Analyze>Find Clipping
  • 440 Metadata Editor: Tags without values can't be added to xml templates or set default
  • 1303 Solo button behaviour "Simple" would be a better default
  • 1390 Enabled Snap To crashes on new project or Audacity launch
  • 1400 Timer Record dialog for Timer Recording Disk Space Warning is inconsistent
  • 1395 P4: On Mac TQP playhead stops when dropdown menu is invoked - but play continues