source: trunk/GDE/CLUSTALW/clustalw.txt

Last change on this file was 19575, checked in by westram, 44 hours ago
  • reintegrates 'help' into 'trunk'
    • preformatted text gets checked for width now (to enforce it fits into the arb help window).
    • fixed help following these checks, using the following steps:
      • ignore problems in foreign documentation.
      • increase default help window width.
      • introduce control comments to
        • accept oversized preformatted sections.
        • enforce preformatted style for whole sections.
        • simply define single-line preformatted sections
          Used intensive for definition of internal script languages.
    • fixed several non-related problems found in documentation.
    • minor layout changes for HTML version of arb help (more compacted; highlight anchored/all sections).
    • refactor system interface (GUI version) and use it from help module.
  • adds: log:branches/help@19532:19574
  • Property svn:eol-style set to native
  • Property svn:keywords set to Author Date Id Revision
File size: 32.9 KB
Line 
1README for Clustal W version 1.7  June 1997
2
3             Clustal W version 1.7 Documentation
4
5This file provides some notes on the latest changes, installation and usage
6of the Clustal W multiple sequence alignment program.
7
8
9
10Julie Thompson (Thompson@EMBL-Heidelberg.DE)
11Toby Gibson    (Gibson@EMBL-Heidelberg.DE)
12
13European Molecular Biology Laboratory
14Meyerhofstrasse 1
15D 69117 Heidelberg
16Germany
17
18
19Des Higgins (Higgins@ucc.ie)
20
21University of County Cork
22Cork
23Ireland
24
25
26Please e-mail bug reports/complaints/suggestions (polite if possible)
27to Toby Gibson or Des Higgins. 
28
29
30
31Thompson, J.D., Higgins, D.G. and Gibson, T.J. (1994)
32CLUSTAL W: improving the sensitivity of progressive multiple sequence alignment
33through sequence weighting, positions-specific gap penalties and weight matrix
34choice.  Nucleic Acids Research, 22:4673-4680.
35
36--------------------------------------------------------------
37
38What's New (June 1997) in Version 1.7 (since version 1.6).
39
40
411. The static arrays used by clustalw for storing the alignment data have been
42replaced by dynamically allocated memory. There is now no limit on the number
43or length of sequences which can be input.
44
452. The alignment of DNA sequences now offers a new hard-coded matrix, as well
46as the identity matrix used previously. The new matrix is the default scoring
47matrix used by the BESTFIT program of the GCG package for the comparison of
48nucleic acid sequences. X's and N's are treated as matches to any IUB ambiguity
49symbol. All matches score 1.9; all mismatches for IUB symbols score 0.0.
50
513. The transition weight option for aligning nucleotide sequences has been
52changed from an on/off toggle to a weight between 0 and 1.  A weight of zero
53means that the transitions are scored as mismatches; a weight of 1 gives
54transitions the full match score. For distantly related DNA sequences, the
55weight should be near to zero; for closely related sequences it can be useful
56to assign a higher score.
57
584. The RSF sequence alignment file format used by GCG Version 9 can now be
59read.
60
615. The clustal sequence alignment file format has been changed to allow
62sequence names longer than 10 characters. The maximum length allowed is set in
63clustalw.h by the statement:
64
65        #define MAXNAMES        10
66
67For the fasta format, the name is taken as the first string after the '>'
68character, stopping at the first white space. (Previously, the first 10
69characters were taken, replacing blanks by underscores).
70
716. The bootstrap values written in the phylip tree file format can be assigned
72either to branches or nodes. The default is to write the values on the nodes,
73as this can be read by several commonly-used tree display programs. But note
74that this can lead to confusion if the tree is rooted and the bootstraps may
75be better attached to the internal branches: Software developers should ensure
76they can read the branch label format.
77
787. The sequence weighting used during sequence to profile alignments has been
79changed. The tree weight is now multiplied by the percent identity of the
80new sequence compared with the most closely related sequence in the profile.
81
828. The sequence weighting used during profile to profile alignments has been
83changed. A guide tree is now built for each profile separately and the
84sequence weights calculated from the two trees. The weights for each
85sequence are then multiplied by the percent identity of the sequence compared
86with the most closely related sequence in the opposite profile.
87
889. The adjustment of the Gap Opening and Gap Extension Penalties for sequences
89of unequal length has been improved.
90
9110. The default order of the sequences in the output alignment file has been
92changed. Previously the default was to output the sequences in the same order
93as the input file. Now the default is to use the order in which the sequences
94were aligned (from the guide tree/dendrogram), thus automatically grouping
95closely related sequences.
96
9711. The option to 'Reset Gaps between alignments' has been switched off by
98default.
99
10012. The conservation line output in the clustal format alignment file has been
101changed. Three characters are now used:
102
103        '*' indicates positions which have a single, fully conserved residue
104
105        ':' indicates that one of the following 'strong' groups is fully conserved:-
106
107                 STA
108                 NEQK
109                 NHQK
110                 NDEQ
111                 QHRK
112                 MILV
113                 MILF
114                 HY
115                 FYW
116
117        '.' indicates that one of the following 'weaker' groups is fully conserved:-
118
119                 CSA
120                 ATV
121                 SAG
122                 STNK
123                 STPA
124                 SGND
125                 SNDEQK
126                 NDEQHK
127                 NEQHRK
128                 FVLIM
129                 HFY
130
131These are all the positively scoring groups that occur in the Gonnet Pam250
132matrix. The strong and weak groups are defined as strong score >0.5 and weak
133score =<0.5 respectively.
134
13513. A bug in the modification of the Myers and Miller alignment algorithm
136for residue-specific gap penalites has been fixed. This occasionally caused
137new gaps to be opened a few residues away from the optimal position.
138
13914. The GCG/MSF input format no longer needs the word PILEUP on the first
140line. Several versions can now be recognised:-
141      1.  The word PILEUP as the first word in the file
142      2.  The word !!AA_MULTIPLE_ALIGNMENT or !!NA_MULTIPLE_ALIGNMENT
143          as the first word in the file
144      3.  The characters MSF on the first line in the line, and the
145          characters .. at the end of the line.
146
14715. The standard command line separator for UNIX systems has been changed from
148'/' to '-'. ie. to give options on the command line, you now type
149
150     clustalw input.aln -gapopen=8.0
151
152instead of
153
154     clustalw input.aln /gapopen=8.0
155
156
157                      ATTENTION SOFTWARE DEVELOPERS!!
158                      -------------------------------
159
160The CLUSTAL sequence alignment output format has been modified:
161
1621. Names longer than 10 chars are now allowed. (The maximum is specified in
163clustalw.h by '#define MAXNAMES'.)
164
1652. The consensus line now consists of three characters: '*',':' and '.'. (Only
166the '*' and '.' were previously used.)
167
1683. An option (not the default) has been added, allowing the user to print out
169sequence numbers at the end of each line of the alignment output.
170
1714. Both RNA bases (U) and base ambiguities are now supported in nucleic acid
172sequences. In the past, all characters (upper or lower case) other than
173a,c,g,t or u were converted to N. Now the following characters are recognised
174and retained in the alignment output: ABCDGHKMNRSTUVWXY (upper or lower case).
175
1765. A Blank line inadvertently added in the version 1.6 header has been taken
177out again.
178
179
180--------------------------------------------------------------
181
182What's New (March 1996) in Version 1.6 (since version 1.5).
183
184
1851) Improved handling of sequences of unequal length.  Previously, we
186increased the gap extension penalties for both sequences if the two sequences
187(or groups of previously aligned sequences) were of different lengths. 
188Now, we increase the gap opening and extension penalties for the shorter
189sequence only.   This helps prevent short sequences being stretched out
190along longer ones.
191
1922) Added the "Gonnet" series of weight matrices (from Gaston Gonnet and
193co-workers at the ETH in Zurich).  Fixed a bug in the matrix
194choice menu; now PAM matrices can be selected ok.
195
1963) Added secondary structure/gap penalty masks.  These allow you to
197include, in an alignment, a position specific set of gap penalties. 
198You can either set a gap opening penalty at each position or specify
199the secondary strcuture (if protein; alpha helix, beta strand or loop)
200and have gap penalties set automatically.   This, basically, is used to make
201gaps harder to open inside helices or strands. 
202
203These masks are only used in the "profile alignment" menu.  They may be read in
204as part of an alignment in a special format (see the on-line help for
205details) or associated with each sequence, if the sequences are in Swiss Prot
206format and secondary structure information is given.   All of the mask
207parameters can be set from the profile alignment menu.  Basically, the
208mask is made up of a series of numbers between 1 and 9, one per position.
209The gap opening penalty at a position is calculated as the starting penalty
210multipleied by the mask value at that site.
211
2124) Added command line options /profile and /sequences.
213These allow uses to choose between normal profile alignment where the
214two profiles (pre-existing alignments specified in the files
215/profile1= and /profile2=) are merged/aligned with each other (/profile)
216and the case where the individual sequences in /profile2 are aligned
217sequentially with the alignment in /profile1 (/sequences).
218
2195) Fixed bug in modified Myers and Miller algorithm - gap penalty score
220was not always calculated properly for type 2 midpoints.  This is the core
221alignment algorithm.
222
2236) Only allows one output file format to be selected from command line
224- ie. multiple output alignment files are not allowed.
225
2267) Fixed 'bad calls to ckfree' error during calculation of phylip distance
227matrix.
228
2298) Fixed command line options /gapopen /gapext /type=protein /negative.
230
2319) Allowed user to change command line separator on UNIX from '/' to '-'.
232This allows unix users to use the more conventinal '-' symbol
233for seperating command line options.  "/" can then be used in unix
234file names on the command line.   The symbol that is used,
235is specified in the file clustalw.h which must be edited if you
236wish to change it (and the program must then be recompiled).   Find the
237block of code in clustalw.h that corrsponds to the operating system you
238are using.  These blocks are started by one of the following:
239
240#ifdef VMS
241#elif MAC
242#elif MSDOS
243#elif UNIX
244
245On the next line after each is the line:
246
247#define COMMANDSEP '/'
248
249Change this in the appropriate block of code (e.g. the UNIX block) to
250
251#define COMMANDSEP '-'
252
253if you wish to use the "-" character as command seperator.
254 
255
256       
257--------------------------------------------------------------
258
259What's New (April 1995) in Version 1.5 (since version 1.3).
260
2611) ported to MAC and PC.  These versions are quite slow unless you
262have a nice beefy machine.  On a Power Mac or a Pentium box
263it is nice and fast.  Two precompiled versions are supplied for Macs
264(Power mac and old mac versions).
265
266Mac:       1500 residues by 100 sequences
267Power Mac  3000    "     "   "     "
268PC         1500    "     "   "     "
269
2702) alignment of new sequences to an alignment.  Fixed a serious bug
271which assigned weights to the wrong sequences.  Now also, weights
272sequences according to distance from the incoming sequence.  The
273new weights are: tree weights * similarity to incoming sequence.
274The tree weights are the old weights that we derive from the tree
275connecting all the sequences in the existing alignment.
276
2773) for all platforms, output linelength = 60.
278
2794) Bootstrap files (*.phb): the "final" node (arbitrary trichotomy
280at the end of the neighbor-joining process) is labelled as
281TRICHOTOMY in the bootstrap output files.  This is to help
282link bootstrap figures with nodes when you reroot the tree.
283
2845) Command line /bootstrap option now more robust.
285
286--------------------------------------------------------------
287INTRODUCTION
288
289
290
291This document gives some BRIEF notes about usage of the Clustal W
292multiple alignment program for UNIX and VMS machines.  Clustal W
293is a major update and rewrite of the Clustal V program which
294was described in:
295
296Higgins, D.G., Bleasby, A.J. and Fuchs, R. (1992)
297CLUSTAL V: improved software for multiple sequence alignment.
298Computer Applications in the Biosciences (CABIOS), 8(2):189-191.
299
300The main new features are a greatly improved (more sensitive)
301multiple alignment procedure for proteins and improved support
302for different file formats.  This software was described in:
303
304Thompson, J.D., Higgins, D.G. and Gibson, T.J. (1994)
305CLUSTAL W: improving the sensitivity of progressive multiple
306sequence alignment through sequence weighting, position specific
307gap penalties and weight matrix choice.
308Nucleic Acids Research, 22(22):4673-4680.
309
310
311The usage of Clustal W is largely the same as for
312Clustal V details of which are described in clustalv.txt.  Details of the
313new alignment algorithms are described in the manuscript by
314Thompson et. al. above, an ascii/text version of which is included
315(clustalw.ms). This file lists some of the details not covered by either
316of the above documents.
317
318
319There are brief notes on the following topics:
320
3211) Installation for VMS and UNIX and MAC and PC
3222) File input
3233) file output
3244) changes to the alignment algorithms
3255) minor modifications to the phylogenetic tree and bootstrapping methods
3266) summary of the command line usage.
327
328-------------------------------------------------------------------
329
3301) INSTALLATION    (for Unix, VAX/VMS, PC and MAC)
331
332
333
334*****IMPORTANT*****
335If you wish to recompile the program (or compile it for the first
336time; you will have to do this with UNIX):
337first check the file CLUSTALW.H which needs to be changed if you
338move the code from between unix and vms machines.  At the top
339of the file are four lines which define one of VMS, MSDOS, MAC or
340UNIX to be 1.  All of these EXCEPT one must be commented out
341using enclosed /* ... */. 
342*******************
343
344
345Unix
346-----
347
348Make files are supplied for unix machines.  The code was compiled and
349tested using Decstation (Ultrix), SUN (Gnu C compiler/gcc), Silicon
350Graphics (IRIX) and DEC/Alpha (OSF1).  We have not tested the code on any other
351systems.  Just use makefile to make on most systems.  For Sun, you need to
352have the Gnuc C (gcc) compiler installed ... use the file makefile.sun in this
353case.  You make the program with:
354make  (or make -f makefile.sun)
355
356This produces the file clustalw which can be run by typing clustalw and
357pressing return.  The help file is called clustalw_help
358
359
360VMS
361----
362
363There is a small DCL command file (VMSLINK.COM) to compile and link the
364code for VMS machines (vax or alpha).  This procedure just compiles the
365source files and links using default settings.  Run it using:
366$ @vmslink
367This produces Clustalw.exe which can be run using the run command:
368$ run clustalw
369
370The intermediate object files can be deleted with:
371$ del *.obj;
372
373There is an extensive command line facility.  To use this, you must
374create a symbol to run the program (and put this in your login.com file).
375e.g.
376$ clustalw :== $$drive:[dir.dir]clustalw
377where $drive is the drive on which the executable file is stored (clustalw.exe)
378and [dir.dir] is the full directory specification.  NOTE THE EXTRA DOLLAR SIGN.
379Then the program can be run using the command:
380$ clustalw
381
382
383PC
384__
385
386We supply an executable file (Clustalw.exe) which will run using MSDOS.
387It will also run under windows (as a DOS application)
388*** IF you have a maths coprocessor***.  If you do not have a maths chip
389(e.g. 80387), the program can only be run under MSDOS.  In the latter case,
390you must have the file EMU387.exe in the same directory as CLUSTALW.EXE. 
391This file emulates a maths chip if you do not have one. 
392
393
394We generated the executable file using gnu c for MSDOS.
395It will also compile (with about 10,000 warning messages)
396using Microsoft C but we have not tested it and there appear to be problems
397with the executable.
398
399You will need to use a "memory extender" to allow the program to get at more
400than 640kb of memory.
401
402
403
404MAC
405---
406
407The code compiles for Power Mac and older macs using Metroworks Codewarrior
408C compiler.  We supply 2 executable programs (one each for PowerMac and
409older mac): ClustalwPPC and Clustalw68k).  These need up to
41010mb of memory to run which needs to be adjusted with the Get Info (%I)
411command from the Finder if you have problems.  Just double click the
412executable file name or icon and off you go (we hope).
413
414As a special treat for Mac users, we supply an executable and brief readme
415file for NJPLOT.   This is a really nice program by Manolo Gouy
416(University of Lyon, France) that allows you to import the trees
417made by Clustal W and display them/manipulate them.  It will properly
418display the bootstrap figures from the *.phb files.  It can export the
419trees in PICT format which can then be used by MacDraw for example.
420
421
422-------------------------------------------------------------------------
423
4242) FILE INPUT (sequences to be aligned)
425
426
427
428The sequences must all be in one file (or two files for a "profile alignment")
429in ONE of the following formats:
430
431FASTA (Pearson), NBRF/PIR, EMBL/Swiss Prot, GDE, CLUSTAL, GCG/MSF, GCG9/RSF.
432
433The program tries to "guess" which format is being used and whether
434the sequences are nucleic acid (DNA/RNA) or amino acid (proteins).  The
435format is recognised by the first characters in the file.  This is kind
436of stupid/crude but works most of the time and it is difficult
437to do reliably, any other way.
438
439
440Format           First non blank word or character in the file.
441...............................................................
442FASTA            >
443NBRF             >P1;  or >D1;
444EMBL/SWISS       ID
445GDE protein      %
446GDE nucleotide   #
447CLUSTAL          CLUSTAL (blocked multiple alignments)
448GCG/MSF          PILEUP  or !!AA_MULTIPLE_ALIGNMENT or !!NA_MULTIPLE_ALIGNMENT
449                 or MSF on the first line, and '..' at the end of line
450GCG9/RSF         !!RICH_SEQUENCE
451
452Note, that the only way of spotting that a file is MSF format is if
453the word PILEUP appears at the very beginning of the file.  If you
454produce this format from software other than the GCG pileup program,
455then you will have to insert the word PILEUP at the start of the file.
456Similarly, if you use clustal format, the word CLUSTAL must appear first.
457
458All of these formats can be used to read in AN EXISTING FULL ALIGNMENT.
459With CLUSTAL format, this is just the same as the output format of this
460program and Clustal V.  If you use PILEUP or CLUSTAL format, all sequences
461must be the same length, INCLUDING GAPS ("-" in clustal format; "." in MSF).
462With the other formats, sequences can be gapped with "-" characters.  If you
463read in any gaps these are kept during any later alignments.  You can use
464this facility to read in an alignment in order to calculate a phylogenetic
465tree OR to output the same alignment in a different format (from the
466output format options menu of the multiple alignment menu) e.g. read
467in a GCG/MSF format alignment and output a PHYLIP format alignment. This is
468also useful to read in one reference alignment and to add one or more new
469sequences to it using the "profile alignment" facilities.
470
471DNA vs. PROTEIN:  the program will count the number of A,C,G,T,U and N
472charcters.  If 85% or more of the characters in a sequence are as above,
473then DNA/RNA is assumed, protein otherwise. 
474
475-------------------------------------------------------------------------
476
477
4783) FILE OUTPUT
479
480
481        1) the alignments.
482
483        In the multiple alignment and profile alignment menus, there is a menu
484        item to control the output format(s).
485
486        The alignment output format can be set to any (or all) of:
487        CLUSTAL  (a self explanatory blocked alignment)
488        NBRF/PIR (same as input format but with "-" characters for gaps)
489        MSF      (the main GCG package multiple alignment format)
490        PHYLIP   (Joe Felsenstein's phylogeny inference package.  Gaps are set to
491                 "-" characters.  For some programs (e.g. PROTPARS/DNAPARS) these
492                 should be changed to "?" characters for unknown residues.
493        GDE      (Used by Steven Smith's GDE package)
494
495        You can also choose between having the sequences in the same order as in
496        the input file or writing them out in an order that more closely matches the
497        order used to carry out the multiple alignment.
498       
499       
500        2) The trees.
501       
502        Believe it or not, we now use the New Hampshire (nested parentheses)
503        format as default for our trees.  This format is compatible with e.g. the
504        PHYLIP package.  If you want to view a tree, you can use the RETREE or
505        DRAWGRAM/DRAWTREE programs of PHYLIP.  This format is used for all our
506        trees, even the initial guide trees for deciding the order of multiple
507        alignment.  The output trees from the phylogenetic tree menu can also be
508        requested in our old verbose/cryptic format.  This may be more useful
509        if, for example, you wish to see the bootstrap figures.  The bootstrap
510        trees in the default New Hampshire format give the bootstrap figures
511        as extra labels which can be viewed very easily using TREETOOL which is
512        available as part of the GDE package.  TREETOOL is available from the
513        RDP project by ftp from rdp.life.uiuc.edu. 
514       
515        The New Hampshire format is only useful if you have software to display or
516        manipulate the trees.  The PHYLIP package is highly recommended if you intend
517        to do much work with trees and includes programs for doing this.  If you do
518        not have such software, request the trees in the older clustal format
519        and see the documentation for Clustal V (clustalv.txt).  WE DO NOT PROVIDE
520        ANY DIRECT MEANS FOR VIEWING TREES GRAPHICALLY.
521
522-------------------------------------------------------------------------
523
5244) THE ALIGNMENT ALGORITHMS
525
526
527The basic algorithm is the same as for Clustal V and is described in some
528detail in clustalv.txt.  The new modifications are described in detail in
529clustalw.ms.  Here we just list some notes to help answer some of the most
530obvious questions.
531
532
533Terminal Gaps
534
535In the original Clustal V program, terminal gaps were penalised the same
536as all other gaps.  This caused some ugly side effects e.g.
537
538acgtacgtacgtacgt                              acgtacgtacgtacgt
539a----cgtacgtacgt  gets the same score as      ----acgtacgtacgt
540
541NOW, terminal gaps are free.  This is better on average and stops silly
542effects like single residues jumping to the edge of the alignment.  However,
543it is not perfect.  It does mean that if there should be a gap near the end
544of the alignment, the program may be reluctant to insert it i.e.
545
546cccccgggccccc                                              cccccgggccccc
547ccccc---ccccc  may be considered worse (lower score) than  cccccccccc---
548
549In the right hand case above, the terminal gap is free and may score higher
550than the laft hand alignment.  This can be prevented by lowering the gap
551opening and extension penalties.   It is difficult to get this right all the
552time.  Please watch the ends of your alignments.
553
554
555
556Speed of the initial (pairwise) alignments (fast approximate/slow accurate)
557
558By default, the initial pairwise alignments are now carried out using a full
559dynamic programming algorithm.  This is more accurate than the older hash/
560k-tuple based alignments (Wilbur and Lipman) but is MUCH slower.  On a fast
561workstation you may not notice but on a slow box, the difference is extreme.
562You can set the alignment method from the menus easily to the older, faster
563method.
564
565
566
567Delaying alignment of distant sequences
568
569The user can set a cut off to delay the alignment of the most divergent
570sequences in a data set until all other sequences have been aligned.  By
571default, this is set to 40% which means that if a sequence is less than 40%
572identical to any other sequence, its alignment will be delayed. 
573
574
575
576Iterative realignment/Reset gaps between alignments
577
578By default, if you align a set of sequences a second time (e.g. with changed
579gap penalties), the gaps from the first alignment are discarded.  You can
580set this from the menus so that older gaps will be kept between alignments,
581This can sometimes give better alignments by keeping the gaps (do not reset
582them) and doing the full multiple alignment a second time.  Sometimes, the
583alignment will converge on a better solution; sometimes the new alignment will
584be the same as the first.  There can be a strange side effect: you can get
585columns of nothing but gaps introduced. 
586
587Any gaps that are read in from the input file are always kept, regardless
588of the setting of this switch.  If you read in a full multiple alignment, the "reset
589gaps" switch has no effect.  The old gaps will remain and if you carry out
590a multiple alignment, any new gaps will be added in.  If you wish to carry out
591a full new alignment of a set of sequences that are already aligned in a file
592you must input the sequences without gaps.
593
594
595
596Profile alignment
597
598By profile alignment, we simply mean the alignment of old alignments/sequences.
599In this context, a profile is just an existing alignment (or even a set of
600unaligned sequences; see below).  This allows you to
601read in an old alignment (in any of the allowed input formats) and align
602one or more new sequences to it.  From the profile alignment menu, you
603are allowed to read in 2 profiles.  Either profile can be a full alignment
604OR a single sequence.  In the simplest mode, you simply align the two profiles
605to each other. This is useful if you want to gradually build up a full
606multiple alignment. 
607
608A second option is to align the sequences from the second profile, one at
609a time to the first profile.  This is done, taking the underlying tree between
610the sequences into account.  This is useful if you have a set of new sequences
611(not aligned) and you wish to add them all to an older alignment.
612
613----------------------------------------------------------------------------
614
6155) CHANGES TO THE PHYLOGENTIC TREE CALCULATIONS AND SOME HINTS.
616
617
618
619IMPROVED DISTANCE CALCULATIONS FOR PROTEIN TREES
620
621
622The phylogenetic trees in Clustal W (the real trees that you calculate
623AFTER alignment; not the guide trees used to decide the branching order
624for multiple alignment) use the Neighbor-Joining method of Saitou and
625Nei based on a matrix of "distances" between all sequences.  These distances
626can be corrected for "multiple hits".  This is normal practice when accurate
627trees are needed.  This correction stretches distances (especially large ones)
628to try to correct for the fact that OBSERVED distances (mean number of
629differences per site) greatly underestimate the actual number that happened
630during evolution. 
631
632In Clustal V we used a simple formula to convert an observed distance to one
633that is corrected for multiple hits.  The observed distance is the mean number
634of differences per site in an alignment (ignoring sites with a gap) and is
635therefore always between 0.0 (for ientical sequences) an 1.0 (no residues the
636same at any site).  These distances can be multiplied by 100 to give percent
637difference values.  100 minus percent difference gives percent identity.
638The formula we use to correct for multiple hits is from Motoo Kimura
639(Kimura, M. The neutral Theory of Molecular Evolution, Camb.Univ.Press, 1983,
640page 75) and is:
641
642K = -Ln(1 - D - (D.D)/5)  where D is the observed distance and K is       
643                              corrected distance.
644
645This formula gives mean number of estimated substitutions per site and, in
646contrast to D (the observed number), can be greater than 1 i.e. more than
647one substitution per site, on average.  For example, if you observe 0.8
648differences per site (80% difference; 20% identity), then the above formula
649predicts that there have been 2.5 substitutions per site over the course
650of evolution since the 2 sequences diverged.  This can also be expressed in
651PAM units by multiplying by 100 (mean number of substitutions per 100 residues).
652The PAM scale of evolution and its derivation/calculation comes from the
653work of Margaret Dayhoff and co workers (the famous Dayhoff PAM series
654of weight matrices also came from this work).  Dayhoff et al constructed
655an elaborate model of protein evolution based on observed frequencies
656of substitution between very closely related proteins.  Using this model,
657they derived a table relating observed distances to predicted PAM distances.
658Kimura's formula, above, is just a "curve fitting" approximation to this table.
659It is very accurate in the range 0.75 > D > 0.0 but becomes increasingly
660unaccurate at high D (>0.75) and fails completely at around D = 0.85.
661
662To circumvent this problem, we calculated all the values for K corresponding
663to D above 0.75 directly using the Dayhoff model and store these in an
664internal table, used by Clustal W.  This table is declared in the file dayhoff.h and
665gives values of K for all D between 0.75 and 0.93 in intervals of 0.001 i.e.
666for D = 0.750, 0.751, 0.752 ...... 0.929, 0.930.   For any observed D
667higher than 0.930, we arbitrarily set K to 10.0.  This sounds drastic but
668with real sequences, distances of 0.93 (less than 7% identity) are rare.
669If your data set includes sequences with this degree of divergence, you
670will have great difficulty getting accurate trees by ANY method; the alignment
671itself will be very difficult (to construct and to evaluate).
672
673There are some important
674things to note.  Firstly, this formula works well if your sequences are
675of average amino acid composition and if the amino acids substitute according
676to the original Dayhoff model.  In other cases, it may be misleading.  Secondly,
677it is based only on observed percent distance i.e. it does not DIRECTLY
678take conservative substitutions into account.  Thirdly, the error on the
679estimated PAM distances may be VERY great for high distances; at very high
680distance (e.g. over 85%) it may give largely arbitrary corrected distances.
681In most cases, however, the correction is still worth using; the trees will
682be more accurate and the branch lengths will be more realistic. 
683
684A far more sophisticated distance correction based on a full Dayhoff
685model which DOES take conservative substitutions and actual amino acid
686composition into account, may be found in the PROTDIST program of the
687PHYLIP package.  For serious tree makers, this program is highly recommended.
688
689
690
691TWO NOTES ON BOOTSTRAPPING...
692
693When you use the BOOTSTRAP in Clustal W to estimate the reliability of parts
694of a tree, many of the uncorrected distances may randomly exceed the arbitrary cut
695off of 0.93 (sequences only 7% identical) if the sequences are distantly
696related.  This will happen randomly i.e. even if none of the pairs of
697sequences are less than 7% identical, the bootstrap samples may contain pairs
698of sequences that do exceed this cut off.
699If this happens, you will be warned.  In practice, this can
700happen with many data sets.  It is not a serious problem if it happens rarely.
701If it does happen (you are warned when it happens and told how often the
702problem occurs), you should consider removing the most distantly
703related sequences and/or using the PHYLIP package instead.
704
705
706A further problem arises in almost exactly the opposite situation: when
707you bootstrap a data set which contains 3 or more sequences that are identical
708or almost identical.  Here, the sets of identical sequences should be shown
709as a multifurcation (several sequences joing at the same part of the tree).
710Because the Neighbor-Joining method only gives strictly dichotomous trees
711(never more than 2 sequences join at one time), this cannot be exactly
712represented.  In practice, this is NOT a problem as there will be some
713internal branches of zero length seperating the sequences.  If you
714display the tree with all branch lengths, you will still see a multifurcation. 
715However, when you bootstrap
716the tree, only the branching orders are stored and counted.  In the case
717of multifurcations, the exact branching order is arbitrary but the program
718will always get the same branching order, depending only on the input order
719of the sequences.  In practice, this is only a problem in situations where
720you have a set of sequences where all of them are VERY similar.  In this case,
721you can find very high support for some groupings which will disappear if you
722run the analysis with a different input order.  Again, the PHYLIP package
723deals with this by offering a JUMBLE option to shuffle the input order
724of your sequences between each bootstrap sample. 
725
726----------------------------------------------------------------------------
727
7286) SUMMARY OF THE COMMAND LINE USAGE
729
730Clustal W is designed to be run interactively.  However, there are many
731situations where it is convenient to run it from the command line, especially
732if you wish to run it from another piece of software (e.g. SeqApp or GDE).
733All parameters can be set from the command line by giving options after the
734clustalw command. On UNIX options should be preceded by '-', all other systems
735use the '/' character.
736
737If anything is put on the command line, the program will (attempt to) carry
738out whatever is requested and will exit.  If you wish to use the command
739line to set some parameters and then go into interactive mode, use the
740command line switch: interactive .... e.g.
741
742clustalw -quicktree -interactive    on UNIX
743or
744clustalw /quicktree /interactive    on VMS,MAC and PC
745
746will set the default initial alignment mode to fast/approximate and will then
747go to the main menu.
748
749
750To see a list of all the command line parameters, type:
751
752clustalw -options           on UNIX
753or
754clustalw /options           on VMS,MAC and PC
755
756and you will see a list with no explanation.
757
758
759To get (VERY BRIEF) help on command line usage, use the /HELP or /CHECK
760(-help or -check on UNIX systems) options.  Otherwise, the command line
761usage is self explanatory or is explained in clustalv.txt.  The defaults
762for all parameters are set in the file param.h which can be changed easily
763(remember to recompile the program afterwards :-).
764
765------------------------------------------------------------------------------
Note: See TracBrowser for help on using the repository browser.