source: tags/ms_ra2q56/arb_CHANGES.txt

Last change on this file was 18148, checked in by westram, 4 years ago
  • update
  • Property svn:eol-style set to native
  • Property svn:keywords set to Author Date Id Revision
File size: 24.1 KB
Line 
1ARB change log
2
3Major changes for next release:
4
5 - ARB PARSIMONY
6   * topology optimization
7     - now (by default) strictly restricted to marked/visible parts of the tree (#640)
8     - restriction now customizable (marked/all; visible/all)
9     - tree costs for protein-data were not independent from root-position (as expected by model; #633).
10       Caused infinite running optimization under some circumstances.
11     - optimize-modes now strictly restrict to clicked subtrees. single/repeated optimization possible.
12     - KL-optimizer
13       * static path reduction slightly changed meaning. changed default settings.
14       * removed randomness (was just covering some bugs)
15       * improved general optimization speed
16   * branchlength calculation
17     - "forgot" to recalculate lengths under some conditions. fixed.
18     - is now independent of tree-root position (#641)
19   * adding species
20     - 'add partial species' failed if two partial species had NO overlap (#609). fixed.
21     - in 'add species + NNI' local optimization quality depended on insert position. fixed.
22     - insertion of multiple species is now done independently (=unordered)
23     - performance improved (esp. for many added species/big trees)
24   * generally improved combine performance (using SSE)
25   * generally reduced the number of performed combines (skipping many useless)
26   * added function to randomize (parts of) the tree
27   * warns about insufficient sequence data (e.g. as result of too restrictive filtering; #631)
28   * fixed 'RESTORE' (crashed after deleting species from tree; #528)
29   * corrected handling of dots ('.') while combining ancestor sequences
30   * fixed a bunch of internal bugs (#620, #627, ...)
31   * added species-info mode
32 - added missing translation tables (genetic codes 24-31)
33 - added amino acid code Xle(=J), which means Ile(=I) or Leu(=L)
34 - DNA realigner
35   * several unjustified failures will no longer happen (fixes #419 and most likely #145)
36     - correctly re-syncs after 'X' (if possible at all)
37     - no longer fails for 'B', 'J' and 'Z'
38     - accepts 3 or more consecutive IUPAC codes in DNA
39   * added option to cut-off DNA sequence (was done at end of sequence by old version. fixed)
40   * fixed several minor bugs
41 - ARB probeSpec: visualisation of probe set specificity (thanks to Paavo Jumppanen, CSIRO)
42 - species selections (editor configurations):
43   * visualisation of multiple selections in standard tree view (#658; example in database demo.arb)
44   * order can be changed; each configuration has a comment
45 - import/export (species,sequence):
46   * manage/edit/test import-/export-filter-definitions from inside ARB (#691)
47   * import can store configuration of imported species (#607)
48   * field transfer sets (#562) may be used to customize import/export behavior (also usable from arb merge-tool)
49   * corrected EMBL export filter (numbers at seq.data)
50 - Tree shading (#443)
51   * according to values stored in database
52   * according to given topology (useful when comparing topologies)
53 - support for extra database compression (using gzip, bzip2, xz); databases cannot be opened by arb versions before 6.1.x
54 - ARB_EDIT4:
55   * display selected database fields as flags (allowing to toggle their value; #261).
56     Example use: easily mark sequence as "curated" after manually checking its alignment.
57   * allow to load missing SAIs
58   * "view differences" to a reference sequence:
59      - customizable:
60        * char used for "equality" (i.e. what is displayed where a sequence is equal to selected sequence)
61        * case-sensitivity
62        * ignore different gap-types
63      - equal data also gets hidden in consensus
64      - refresh differences of all displayed sequences, when data of selected sequences changes
65      - change reference sequence using CTRL-R or automatically let it follow the cursor
66      - added hotkey to toggle mode: CTRL-D
67      - fixed minor bugs
68   * consensus calculation in ARB_EDIT4 and calculation of CONSENSUS SAI
69     - now both calculations are strictly consistent:
70       * gaps are now ignored while deciding whether to simplify using IUPAC ambiguity codes
71       * IUPAC ambiguity codes encountered in sequence data are now counted proportionally (=> fewer 'N's occur in consensus)
72     - added sliders to consensus definition windows
73     - user defined consensus settings exchangable between both consensus setups
74     - fixed and updated documentation
75   * added species-info mode + database save
76   * predefined SAI color translation for PVP
77 - changes to SAI generation
78   * MAX_FREQUENCY:
79     - considers IUPAC ambiguity codes proportionally
80     - amino acids: if MAX_FREQUENCY is below 10% SAI now shows '1' (prev. it did show '0', i.e. 100%)
81   * POS_VAR_BY_PARSIMONY (PVP):
82     - now (again) works with amino acid data
83 - expand zombies in tree (unfold groups)
84 - compare taxonomy (and mark differences; #651)
85 - search&query for taxonomic groups (#652)
86   - many search criteria (name, size, marked, nesting-level, ingroup-distance, ...)
87   - search multiple trees, detect duplicate and missing groups
88   - operations on found groups (delete, rename, fold, mark)
89 - added concept of "inverse groups" (aka "keeled groups")
90 - group transfer between trees:
91   - penalties can be customized in detail
92   - quality reports (to log and optionally to target name)
93 - external (command line) aligners:
94   * fixed incorrect handling of 'T' vs 'U': now all aligned sequences will contain the correct base depending on alignment type
95   * preserve gap-type ('-' vs '.') and upper-/lower-case of original alignment
96   * no longer ask what to do with aligned sequence, just overwrite it
97     - only warn about real sequence changes (so please do NOT ignore from now on!)
98 - config-managers:
99   * possibility to restore factory defaults
100   * added comment field for configurations
101   * added them throughout arb (#647)
102 - added slide controls throughout arb (#656)
103 - tree (display) options:
104   * fine grained scaling
105   * add threshold for visible support values
106   * group display (shading, customizable counters, triangle clades, name display position)
107   * bootstrap values (filter by upper/lower limits, display position/styles, on/off toggle)
108   * diagonal branch style
109   * parent branch position
110   * all options are now also supported by ARB_PARSIMONY
111   * improved auto-jump; now also works for groups
112   * added optional auto-unfolding (to selected group/species)
113   * select group on fold/unfold/create/move/..
114   * draw selected group in cursor-color
115   * added keys for tree-traversal (moving selected species or group)
116 - synchronized tree scrolling (#683)
117 - colorsets were invalidated by generating new IDs (#660). fixed.
118 - added alternate RAxML (DNA only; version 8.2.8)
119   - multicore support (automatically activates recommended number of threads)
120   - evaluation, optimization and extension of existing trees with RAxML
121 - fix performance of "format sequences" (broken in arb-6.0.x series; #702)
122 - ACI
123   - added boolean operators, numeric comparisons, floating point arithmetic and several other new commands
124   - allow access to other species via ID or accession number (findspec, ...)
125   - improved ACI debugging: more verbose tracing (console log accessible from inside ARB)
126 - NDS optionally uses only visible definitions
127 - Search&Query (sort results numerically, improved macro compatibility)
128 - Species info (improved detachment, field selection + macro compatibility)
129 - updated integrated documentation
130
131Fixes for arb-6.0.5 (4 May 2016):
132
133 - fixes for ubuntu 16.04 build
134
135Fixes for arb-6.0.4 (2 May 2016):
136
137 - fixes for OSX build (SIP, accepted compilers)
138
139Fixes for arb-6.0.3 (19 Nov 2015):
140
141 - fixes permission problems when multiple users share databases or ptservers (thx to Alan McCulloch)
142
143Fixes for arb-6.0.2 (8 Aug 2014):
144
145 - compile issues on Snow Leopard (OSX 10.6)
146 - merge Debian security fix for CVE-2008-5378
147 - small changes to build system for Debian
148 - add desktop integration files
149
150Fixes for arb-6.0.1 (22 Jul 2014):
151
152 - arb_parsimony
153   - skip unwanted automatic branchlength recalculations (e.g. by unfolding a group)
154   - corrected branchlength calculation for "Add marked partial species"
155   - dots were treated as gaps for protein sequences (now treated as 'X'; analog to DNA treating gaps as 'N'). thx to Yan Shi for detecting that problem!
156 - print
157   - preview failed (showed empty postscript file)
158   - print to file now always saves in user home
159 - raxml (import tree with bootstrap values)
160
161Major changes for arb-6.0 (4 Jun 2014):
162
163 - merge databases allows to
164   - merge from an existing database into the database loaded in ARB_NT
165   - merge to existing databases from the database loaded in ARB_NT
166 - ARB can now
167   - be restarted with another database and
168   - a second instance of ARB can be opened
169 - ARB_DIST
170   - Detect clusters of species with similar sequences (OTUs)
171   - allow automatic recalculation of matrix and/or tree whenever some parameter or
172     data changes (only makes sense for smaller species sets)
173   - extract distance matrix from tree
174 - Rewrote chimera check. Allows filtering
175 - added RNACMA (computes clusters of correlated positions)
176 - PT-Server
177   - changed behavior
178     - no longer report less hits for a part of a probe than for the probe itself (occurred at 3'-end of alignment)
179     - reports previously missing hits in joined genes
180     - reports more hits at 3'-end of alignment (when using mismatches the PT-server now reports possible
181       matches that go beyond the end of the sequence)
182     - dots in the middle of the alignment act like the sequence ends there
183     - minimum probe length reduced to 2 (was 6)
184     - allow up to 50% of probe to mismatch
185   - performance
186     - optimized memory-estimation (will build in fewer passes)
187     - uses any number of passes (not only 1, 5, 25, ...)
188     - allows to define used memory by setting environment variable ARB_MEMORY
189     - reduced memory needed to build/run ptserver (approx. 50%)
190     - reduced size of indexfile (.pt) to ~50%
191     - fast startup of existing ptservers
192   - probe design
193     - faster in many cases
194     - allow to design probes of length 8 (previously 10)
195     - allow to design probes with different lengths (specifying min/max length)
196     - fixed number of outgroup hits reported when decreasing temperature
197       (now each outgroup member only occurs once)
198     - show possible reasons why no probes could be designed
199   - probe match (allow any number of mismatches)
200   - next relative search
201     - can be restricted to column ranges (needs a PT-Server calculated from aligned sequences)
202     - corrected and improved scaling of relative scores
203     - more accurate scores (due to fixes in PT-Server; see below)
204     - faster in many cases
205   - show errors from ptserver build in ARB
206 - fast-aligner
207   - searches next-relatives based on selected column-block
208   - align multiple column-blocks based on SAI
209 - Rewrote alignment adaption during merge
210 - Insert/delete columns using a SAI to define affected columns
211 - ARB_EDIT4
212   - improved support for using multiple edit-windows
213   - smoother refreshes
214   - tweaked ORF display
215 - tree importer/exporter
216   - ARBs extended newick format (with bootstrap values) handled more restrictive now
217   - fixed several bugs; improved errors/warnings
218 - consensus trees
219   - calculate from multiple existing trees (also allows to merge not completely overlapping trees)
220   - fixed NJ-bootstrapping (no longer drops species)
221 - tree display
222   - Show brackets on open groups (dendrogram tree only)
223   - rewrote IRS (folded) display
224   - fixed tree key-bindings (mark, fold, ...)
225   - improved several tree-commands (move, rotate, spread, length, width)
226 - added a branch analysis tool
227   - groups several functions previously available via menuitems (e.g. mark long branches, etc.)
228   - added leaf-distance analysis
229 - other tree functionality
230   - treelist sortable now
231   - new beautify-tree modes (radial tree / according to other tree)
232   - function to remove marked/zombies from ALL trees
233   - create multifurcations (by branchlength/bootstrap limit)
234   - toggle 100% bootstrap values
235 - tweaked printing (interface, overlapping)
236 - if YOU edit a helpfile it will be automatically packed into an archive ready to be sent to ARB developers
237 - probe design:
238   - added LOAD to result window
239 - automation
240   - macro recording works in ARB client applications (ARB_EDIT4, ARB_PARS, ARB_MERGE, ..)
241   - arb_ntree can execute macro from command line
242   - added "Never ask again" to modal question boxes (for better compatibility with macros)
243   - a macro can be called for all marked species (once for each)
244   - macros can be nested (i.e. can call other macros)
245 - support for user-specific customization:
246   - of GDE menus (in ~/.arb_prop/gde)
247   - of import/export filters (in ~/.arb_prop/filter)
248 - ACI (some new commands, bugfixes)
249 - updated/added external tools:
250   - added FastTree (version 2.1.7)
251   - added MAFFT (version 7.055)
252   - added MrBayes (version 3.2.1)
253   - added MUSCLE (version 3.8.31)
254   - added PHYML (2013/07/08; also kept old version 2.4.5)
255   - added PROBCONS (version 1.12)
256   - updated RAxML (version 7.7.2)
257 - load/save for window specific settings (e.g. allows to share parts of configuration with other users)
258 - Support for mouse-wheel
259 - many unlisted bugfixes
260 - many internal refactorings
261
262
263Fixes for arb_5.5 (15 Nov 2012):
264
265 * arb_5.4 was broken (several external tools missing)
266
267
268Fixes for arb_5.4 (14 Nov 2012):
269
270 * make it obvious when probe matches are truncated. Truncate all hits beyond 1 million (was 100000)
271 * fixed realigner (better interaction with fields 'transl_table' and 'codon_start'; improved error handling)
272 * fixed several compilation issues (OSX; recent distro releases)
273
274
275Fixes for arb_5.3 (10 Nov 2011):
276
277 - bugfixes
278   - fixed wrong absolute/ecoli position reported for some designed probes
279   - decompression error handling (pt-server build issues)
280   - fixed 'codon_start' generated with wrong type
281   - fixed a buffer overflow in ACI
282   - report failures to write to /tmp
283 - changes
284   - markSpecies.pl:
285     mark by accession number
286     partial/ambiguous matches
287 - internal fixes
288   - compilation fixes for OSX
289   - some patches for debian version (removed refs to xview, textedit, removed molphy(protml))
290   - removed obsolete dependency from libXp
291
292
293Fixes for arb_5.2 (5 Sep 2010):
294
295 - bugfixes
296   - quicksave did silently do nothing (especially not save anything) if an error occurred
297   - ARB_EDIT4: crashed when using config with MANY unknown species
298   - ARB_SECEDIT: crashed when trying to paint strand w/o any base
299   - ARB_NTREE/ARB_PARS: crashed when clicking on inner tree node w/o groupinfo
300 - changes
301   - ARB uses xdg-open to display web-pages
302 - internal fixes
303   - karmic koala (gcc 4.4.1)
304   - installation script
305   - arb build process uses xsltproc instead of sablotron
306
307
308Fixes for arb_5.1 (1 Oct 2009):
309
310 - fixed a bug in 'Create species from consensus' (created sequence was corrupted)
311 - fixed 2 bugs in optimize DB (alignment w/o data, missing transaction)
312 - updated installation instructions, fixed install script, added OSX instruction (thx to Matt Cottrell)
313 - fixed broken demo.arb
314
315
316Major changes for arb_5.00 (4 Sep 2009):
317
318 - ARB 64bit version
319 - new genome importer
320 - search for next relatives improved (normal search and fast-aligner)
321   - new parameters to precise search
322   - improved speed
323   - partial sequence reach normal scores
324 - search&query
325   - supports regular expressions and ACI
326   - track hit information
327   - result sorting
328 - Nameservers with add.field have to be started with default value
329   You need to correct parameter -f in lib/arb_tcp.dat (according to lib/arb_tcp_org.dat)
330 - multiple PT-servers may be used in parallel
331 - fixed multiprobe
332 - type-conversion for DB fields
333 - SILVA compatible import filters
334 - Newick tree export:
335   - optionally save in human-readable format (big)
336   - closer to newick standard format (quoting style, comment, special chars in data)
337 - Upgraded RAxML to 7.0.3 (many features now usable from ARB interface)
338 - Fixed sequence quality calculation
339 - Secondary structures for proteins (DSSP)
340 - Distance matrix (arb_dist): mark by distance to selected
341 - ARB core
342   - many bugfixes and improvements to reliability
343   - faster sorting (general speedup)
344   - improved sequence compression (avoid worse trees, better ratio)
345   - improved handling of temporary files (permission/removal)
346   - prints backtraces in userland
347   - regular expression are POSIX standard now
348 - macro record/playback
349   - fixed several bugs
350   - you need to re-record your old macros!
351 - GUI:
352   - disabled auto-focus, you need to click now
353   - auto-raise windows on access
354 - Minor things:
355   - Ubuntu: packet installation for ARB
356   - Fixed novice/expert mode
357   - Mark deep/degenerated branches
358   - Increased NDS entries
359 - up-to-date Mac port (thx to Matt Cottrell)
360
361Major changes in ARB 07.12.07org (7 Dec 2007):
362
363 - rewrote secondary structure editor
364 - Sequence quality check
365 - Nameserver may use one field additional to 'acc' (useful to keep multiple species with same acc)
366 - tweaked base frequency filter generation
367 - Normal export (not using readseq) improved:
368   - supports filters and gap removal
369   - optimized for big amount of data
370   - reworked export filters
371 - Display translation with different ORFs in EDIT4
372 - ARB exports in FIG 3.2 format (optionally in colors). Thanks to Elmar Pruesse.
373 - added PHYML 2.4.5 (thanks to Stephane Guidon for the permission to distribute that great tool)
374 - more compact display in EDIT4
375 - capable to use iso10646 fonts
376 - supports various gcc versions (2.95.3 - 4.1.1)
377 - fixed a bug in DB optimization (occurred when fields had bigger protection than current)
378 - Bootstrap circles may be displayed as ellipses; upper size limit configurable; uses
379   different color for size-limited circles; fixed xfig-export-bug
380 - Allows Branchlength <-> Bootstrap value transfer (lossy!)
381 - fixed several scaling bugs in "folded tree"-mode
382 - improved import-filter error-messages
383 - NDS-display of groups (e.g. in tree) is now handled by ACI-command 'taxonomy'. This gives
384   several new possibilities:
385   - export taxonomy via 'Export NDS list'
386   - display taxonomy in Editor etc.
387   - display of cascaded taxonomies
388   - display taxonomy of tree_1 in tree_2
389   - allows to write taxonomy into database field of species
390   - compare taxonomies of two trees
391   - ...
392 - ACI:
393   - many new ACI commands
394   - unified handling of binary ACI-operators
395   - tracing of ACI actions for debugging purpose
396 - ARB Neighbour joining:
397   - bootstrap limit configurable
398   - bugfix: when aborting bootstrap calculation, sometimes no tree was generated
399 - EDIT4:
400   - added unalign right (block-op)
401   - added 'Save loaded properties'
402 - GENE MAP:
403   - multiple views possible at the same time
404   - origin now at "12 o'clock"
405   - implemented 'jump to gene'
406 - tweaked file selection
407 - Enhanced Search Depth for Probe Match --> max 20 MM
408 - CLUSTALW:
409   - separated menus for fast and slow alignment
410   - most parameters accessible from inside ARB now
411 - upgraded to PHYLIP 3.6 (adds PROML)
412 - external programs may be called parallel (e.g. several treeing programs)
413 - fixed bugs in protml and integration of protml
414 - rewrote ASCII database import
415 - arb_repair for databases of any size (script for database repair)
416 - fixed bug in data compression
417 - increased internal cache size (alignments up to 400.000bp possible w/o performance collapse)
418 - ARBparsimony: increase hardcoded species limit (50.000 -> 250.000)
419 - GDE menus cleanup
420 - translation/re-alignment tweaked
421 - unalign right (EDIT4)
422 - visualization of SAIs in Probe Match Results
423 - changed formatting of probe match results; increase # of allowed matches to 100.000;
424   warn if results are truncated
425 - PT server for genes
426 - Probe design performance optimized
427 - fixed NEXUS export format
428 - exports group names into Newick format
429 - import XML tree files
430 - help for external tools now properly shown inside ARB
431
432Major changes in Beta 2003_08_22 (22 Aug 2003):
433
434 - automatic formatting of alignments
435 - SECEDIT may use EDIT4 colors
436 - fixed bootstrapping (DNAPARS, PROTPARS, PROTML(experimental!))
437 - updated clustalw to version 1.83
438 - Restore window sizes for ALL windows (too small sizes are ignored)
439 - new algorithm to add partial sequences to an existing tree
440 - PROT-parsimony was completely redesigned and works now most similar to DNA/RNA-parsimony
441 - Top area of ARB_NTREE may be reduced to maximize display area
442 - All arb menus may be detached (click dashed line at top of menu)
443 - visualization of SAIs (as background color behind Sequences)
444 - ARB_EDIT4 may save/use alignment-specific and alignment-type-specific properties
445 - PT-server occupies more memory => does less passes; more diagnostic output
446 - small changes to status window (unhide behavior/time estimation)
447 - menus and menu-hotkeys reorganized
448 - colored buttons in color config windows
449 - alignment concatenation (e.g. several different genes)
450 - merging data of similar species (according selected database field)
451 - keyboard commands for ARB_NTREE (mark/unmark/invert, collapse/expand)
452 - expanded sellists
453 - save/load fixed for multi probes
454 - Binary SAIs are editable in ARB_EDIT4
455 - Information windows are detachable (allows to have multiple windows showing different items)
456 - Scanning for hidden/unknown database fields improved and separated;
457   possibility to remove unused fields.
458 - new tabbed format in 'Export NDS' and 'Export matrix' (useful for star-calc/excel/etc.)
459 - updated fastDNAml to 1.2.2
460 - added AxML (accelerated fastDNAml 1.2.2)
461 - Field transfer definitions for exporting gene-species
462 - File Selection: - recursive search available
463 - The ARB_NTREE macro recording/execution has been fixed
464 - Colorize species (see demo.arb)
465 - Fixed missing-character-bug in Xfig, Print and Edit4-Info-Display
466 - 'IslandHopper' -- a new integrated aligner (beta)
467 - Many improvements and bugfixes to secondary structure editor:
468   - highlighting of search (i.e for probes) like in EDIT4
469   - interactive constraint editing (stretch/compress)
470   - probe info
471   - editing secondary structure in XFIG now possible
472   - visualization of SAIs
473 - import reads Unix, DOS, and MAC linefeeds
474 - NTREE/SAI/Etc/GnuPlot: calls gnuplot directly; more plotting features; basic help
475 - tree and sequence export to XML ( DTDs are provided in ./lib/dtd )
476   (reloading of these XML files is planned for the future)
477 - fixed problems with phylip-tree import/export (bootstrap values,comments,...)
478 - search in all database fields possible ('[all fields]')
479 - up to 10 quicksaves are kept
480 - new ACI functions: upper, lower, caps, eval
481 - variables for import filter programming
482 - extract gene-species: creates acc; extraction to existing alignments
483 - sequence of selected gene is mirrored in ARB_EDIT4/local_signature
484   (=> selected gene can be highlighted in primary editor)
485 - PCR primer-design for single genes
486 - when selecting a gene, the corresponding gene-species is selected (if found)
487 - save configuration for several windows (e.g. Search&Query, WWW, NDS, ...)
488 - file selection box in import window
489 - mark item with double click works in all search&query windows
490 - User masks: create new; 'edit enable' and 'marked' toggles (like in info window)
491 - Fixed command line help for all Arb-modules
492 - Fixed problem parsing fonts (should fix display problems with default fonts)
493 - Mark mode now works in list-view as well (ARB_NTREE)
494 - Fixed appearance of 'tiny little boxes' (everywhere)
495 - Redesign of ARB help:
496     - a HTML version is in $ARBHOME/lib/help_html
497     - a text version is in $ARBHOME/lib/help (like before, but now generated)
498
499Major changes in Beta 2001_11_07 (7 Nov 2001):
500
501 - design probes to maximum length of 60 nucleotides
502 - fastAligner1.03 bug fixed (chooses best match now in 'auto search' mode)
503 - import default changed to foreign data format, ali name '16s'
504 - printing of multi-page-trees works again
505 - implemented user defineable masks to access database fields
506 - fixed bugs in pt-server (lockup, unknown species just after building pt-server)
507 - improved performance during pt-server-build
508 - several programs coming along with ARB where updated (PHYLIP,...)
509 - reads EMBL genom files
510 - support for experiments (genom databases only)
511
512Major changes in Beta 2001_07_24 (24 Jul 2001):
513
514 - basic support for genoms (Gene Map, reads Genebank files)
515 - ported to libc6
Note: See TracBrowser for help on using the repository browser.