+353-1-416-8900REST OF WORLD
+44-20-3973-8888REST OF WORLD
1-917-300-0470EAST COAST U.S
1-800-526-8630U.S. (TOLL FREE)

Algorithms in Bioinformatics. Theory and Implementation. Edition No. 1

  • Book

  • 528 Pages
  • August 2021
  • John Wiley and Sons Ltd
  • ID: 5840457
ALGORITHMS IN BIOINFORMATICS

Explore a comprehensive and insightful treatment of the practical application of bioinformatic algorithms in a variety of fields

Algorithms in Bioinformatics: Theory and Implementation delivers a fulsome treatment of some of the main algorithms used to explain biological functions and relationships. It introduces readers to the art of algorithms in a practical manner which is linked with biological theory and interpretation. The book covers many key areas of bioinformatics, including global and local sequence alignment, forced alignment, detection of motifs, Sequence logos, Markov chains or information entropy. Other novel approaches are also described, such as Self-Sequence alignment, Objective Digital Stains (ODSs) or Spectral Forecast and the Discrete Probability Detector (DPD) algorithm.

The text incorporates graphical illustrations to highlight and emphasize the technical details of computational algorithms found within, to further the reader’s understanding and retention of the material. Throughout, the book is written in an accessible and practical manner, showing how algorithms can be implemented and used in JavaScript on Internet Browsers. The author has included more than 120 open-source implementations of the material, as well as 33 ready-to-use presentations. The book contains original material that has been class-tested by the author and numerous cases are examined in a biological and medical context. Readers will also benefit from the inclusion of: - A thorough introduction to biological evolution, including the emergence of life, classifications and some known theories and molecular mechanisms- A detailed presentation of new methods, such as Self-sequence alignment, Objective Digital Stains and Spectral Forecast- A treatment of sequence alignment, including local sequence alignment, global sequence alignment and forced sequence alignment with full implementations- Discussions of position-specific weight matrices, including the count, weight, relative frequencies, and log-likelihoods matrices- A detailed presentation of the methods related to Markov Chains as well as a description of their implementation in Bioinformatics and adjacent fields- An examination of information and entropy, including sequence logos and explanations related to their meaning- An exploration of the current state of bioinformatics, including what is known and what issues are usually avoided in the field- A chapter on philosophical transactions that allows the reader a broader view of the prediction process- Native computer implementations in the context of the field of Bioinformatics- Extensive worked examples with detailed case studies that point out the meaning of different results

Perfect for professionals and researchers in biology, medicine, engineering, and information technology, as well as upper level undergraduate students in these fields, Algorithms in Bioinformatics: Theory and Implementation will also earn a place in the libraries of software engineers who wish to understand how to implement bioinformatic algorithms in their products.

Table of Contents

Preface   xv

About the Companion Website xvii

1              The Tree of Life (I)  1

1.1          Introduction 1

1.2          Emergence of Life 1

1.2.1      Timeline Disagreements 3

1.3          Classifications and Mechanisms 4

1.4          Chromatin Structure 5

1.5          Molecular Mechanisms 9

1.5.1      Precursor Messenger RNA 9

1.5.2      Precursor Messenger RNA to Messenger RNA 10

1.5.3      Classes of Introns 10

1.5.4      Messenger RNA 10

1.5.5      mRNA to Proteins 11

1.5.6      Transfer RNA 12

1.5.7      Small RNA 12

1.5.8      The Transcriptome 13

1.5.9      Gene Networks and Information Processing 13

1.5.10    Eukaryotic vs. Prokaryotic Regulation 14

1.5.11    What Is Life? 14

1.6          Known Species 14

1.7          Approaches for Compartmentalization 15

1.7.1      Two Main Approaches for Organism Formation 16

1.7.2      Size and Metabolism 16

1.8          Sizes in Eukaryotes 16

1.8.1      Sizes in Unicellular Eukaryotes 17

1.8.2      Sizes in Multicellular Eukaryotes 17

1.9          Sizes in Prokaryotes 17

1.10        Virus Sizes 18

1.10.1    Viruses vs. the Spark of Metabolism 20

1.11        The Diffusion Coefficient 20

1.12        The Origins of Eukaryotic Cells 21

1.12.1    Endosymbiosis Theory 21

1.12.2    DNA and Organelles 22

1.12.3    Membrane-bound Organelles with DNA 23

1.12.4    Membrane-bound Organelles Without DNA 23

1.12.5    Control and Division of Organelles 24

1.12.6    The Horizontal Gene Transfer 24

1.12.7    On the Mechanisms of Horizontal Gene Transfer 25

1.13        Origins of Eukaryotic Multicellularity 26

1.13.1    Colonies Inside an Early Unicellular Common Ancestor 26

1.13.2    Colonies of Early Unicellular Common Ancestors 26

1.13.3    Colonies of Inseparable Early Unicellular Common Ancestors

1.13.4    Chimerism and Mosaicism 28

1.14        Conclusions 29

2              Tree of Life: Genomes (II)   31

2.1          Introduction 31

2.2          Rules of Engagement 31

2.3          Genome Sizes in the Tree of Life 32

2.3.1      Alternative Methods 33

2.3.2      The Weaving of Scales 33

2.3.3      Computations on the Average Genome Size 36

2.3.4      Observations on Data 38

2.4          Organellar Genomes 40

2.4.1      Chloroplasts 40

2.4.2      Apicoplasts 40

2.4.3      Chromatophores 42

2.4.4      Cyanelles 42

2.4.5      Kinetoplasts 42

2.4.6      Mitochondria 43

2.5          Plasmids 43

2.6          Virus Genomes 44

2.7          Viroids and Their Implications 46

2.8          Genes vs. Proteins in the Tree of Life 47

2.9          Conclusions 49

3              Sequence Alignment (I)   51

3.1          Introduction 51

3.2          Style and Visualization 51

3.3          Initialization of the Score Matrix 54

3.4          Calculation of Scores 57

3.4.1      Initialization of the Score Matrix for Global Alignment 57

3.4.2      Initialization of the Score Matrix for Local Alignment 62

3.4.3      Optimization of the Initialization Steps 65

3.4.4      Curiosities 66

3.5          Traceback   71

3.6          Global Alignment 75

3.7          Local Alignment 79

3.8          Alignment Layout 84

3.9          Local Sequence Alignment - The Final Version 87

3.10        Complementarity 91

3.11        Conclusions 97

4              Forced Alignment (II)   99

4.1          Introduction 99

4.2          Global and Local Sequence Alignment 100

4.2.1      Short Notes 100

4.2.2      Understanding the Technology 101

4.2.3      Main Objectives 102

4.3          Experiments and Discussions 102

4.3.1      Alignment Layout 106

4.3.2      Forced Alignment Regime 106

4.3.3      Alignment Scores and Significance 109

4.3.4      Optimal Alignments 110

4.3.5      The Main Significance Scores 110

4.3.6      The Information Content 110

4.3.7      The Match Percentage 112

4.3.8      Significance vs. Chance 113

4.3.9      The Importance of Randomness 113

4.3.10    Sequence Quality and the Score Matrix 114

4.3.11    The Significance Threshold 115

4.3.12    Optimal Alignments by Numbers 116

4.3.13    Chaos Theory on Sequence Alignment 116

4.3.14    Image-Encoding Possibilities 116

4.4          Advanced Features and Methods 117

4.4.1      Sequence Detector 117

4.4.2      Parameters 117

4.4.3      Heatmap 118

4.4.4      Text Visualization 123

4.4.5      Graphics for Manuscript Figures and Didactic Presentations 124

4.4.6      Dynamics 124

4.4.7      Independence 125

4.4.8      Limits 125

4.4.9      Local Storage 125

4.5          Conclusions 128

5              Self-Sequence Alignment (I)  129

5.1          Introduction 129

5.2          True Randomness 130

5.3          Information and Compression Algorithms 130

5.4          White Noise and Biological Sequences 131

5.5          The Mathematical Model 131

5.5.1      A Concrete Example 132

5.5.2      Model Dissection 133

5.5.3      Conditions for Maxima and Minima 136

5.6          Noise vs. Redundancy 137

5.7          Global and Local Information Content 137

5.8          Signal Sensitivity 138

5.9          Implementation 140

5.9.1      Global Self-Sequence Alignment 140

5.9.2      Local Self-Sequence Alignment 144

5.10        A Complete Scanner for Information Content 147

5.11        Conclusions 149

6              Frequencies and Percentages (II)   151

6.1          Introduction 151

6.2          Base Composition 152

6.3          Percentage of Nucleotide Combinations 152

6.4          Implementation 153

6.5          A Frequency Scanner 156

6.6          Examples of Known Significance 158

6.7          Observation vs. Expectation 160

6.8          A Frequency Scanner with a Threshold 161

6.9          Conclusions 163

7              Objective Digital Stains (III)  165

7.1          Introduction 165

7.2          Information and Frequency 166

7.3          The Objective Digital Stain 169

7.3.1      A 3D Representation Over a 2D Plane 173

7.3.2      ODSs Relative to the Background 177

7.4          Interpretation of ODSs 181

7.5          The Significance of the Areas in the ODS 183

7.6          Discussions 184

7.6.1      A Similarity Between Dissimilar Sequences 186

7.7          Conclusions 186

8              Detection of Motifs (I)   187

8.1          Introduction 187

8.2          DNA Motifs 187

8.2.1      DNA-binding Proteins vs. Motifs and Degeneracy 188

8.2.2      Concrete Examples of DNA Motifs 188

8.3          Major Functions of DNA Motifs 191

8.3.1      RNA Splicing and DNA Motifs 191

8.4          Conclusions 195

9              Representation of Motifs (II)   197

9.1          Introduction 197

9.2          The Training Data 197

9.3          A Visualization Function 198

9.4          The Alignment Matrix 200

9.5          Alphabet Detection 203

9.6          The Position-Specific Scoring Matrix (PSSM) Initialization 206

9.7          The Position Frequency Matrix (PFM)  207

9.8          The Position Probability Matrix (PPM)  208

9.8.1      A Kind of PPM Pseudo-Scanner 209

9.9          The Position Weight Matrix (PWM) 212

9.10        The Background Model 215

9.11        The Consensus Sequence 218

9.11.1    The Consensus - Not Necessarily Functional 219

9.12        Mutational Intolerance 221

9.13        From Motifs to PWMs 222

9.14        Pseudo-Counts and Negative Infinity 226

9.15        Conclusions 229

10           The Motif Scanner (III)   231

10.1        Introduction 231

10.2        Looking for Signals 232

10.3        A Functional Scanner 235

10.4        The Meaning of Scores 239

10.4.1    A Score Value Above Zero 239

10.4.2    A Score Value Below Zero  241

10.4.3    A Score Value of Zero 241

10.5        Conclusions 242

11           Understanding the Parameters (IV)   243

11.1        Introduction 243

11.2        Experimentation 243

11.2.1    A Scanner Implementation Based on Pseudo-Counts 244

11.2.2    A Scanner Implementation Based on Propagation of Zero Counts 246

11.3        Signal Discrimination 249

11.4        False-Positive Results 250

11.5        Sensitivity Adjustments 251

11.6        Beyond Bioinformatics 252

11.7        A Scanner That Uses a Known PWM 253

11.8        Signal Thresholds 256

11.8.1    Implementation and Filter Testing 258

11.9        Conclusions 262

12           Dynamic Backgrounds (V)   263

12.1        Introduction 263

12.2        Toward a Scanner with Two PFMs 263

12.2.1    The Implementation of Dynamic PWMs 264

12.2.2    Issues and Corrections for Dynamic PWMs 271

12.2.3    Solutions for Aberrant Positive Likelihood Values 274

12.3        A Scanner with Two PFMs 280

12.4        Information and Background Frequencies on Score Values 283

12.5        Dynamic Background vs. Null Model 285

12.6        Conclusions 285

13           Markov Chains: The Machine (I)   287

13.1        Introduction 287

13.2        Transition Matrices 287

13.3        Discrete Probability Detector 292

13.3.1    Alphabet Detection 292

13.3.2    Matrix Initialization  293

13.3.3    Frequency Detection  295

13.3.4    Calculation of Transition Probabilities 297

13.3.5    Particularities in Calculating the Transition Probabilities 306

13.4        Markov Chains Generators 307

13.4.1    The Experiment 308

13.4.2    The Implementation 312

13.4.3    Simulation of Transition Probabilities 315

13.4.4    The Markov machine  315

13.4.5    Result Verification  317

13.5        Conclusions 318

14           Markov Chains: Log Likelihood (II)  319

14.1        Introduction 319

14.2        The Log-Likelihood Matrix 319

14.2.1    A Log-Likelihood Matrix Based on the Null Model 320

14.2.2    A Log-Likelihood Matrix Based on Two Models 322

14.3        Interpretation and Use of the Log-Likelihood Matrix  326

14.4        Construction of a Markov Scanner 328

14.5        A Scanner That Uses a Known LLM 337

14.6        The Meaning of Scores 340

14.7        Beyond Bioinformatics 344

14.8        Conclusions 345

15           Spectral Forecast (I)   347

15.1        Introduction 347

15.2        The Spectral Forecast Model 347

15.3        The Spectral Forecast Equation 349

15.4        The Spectral Forecast Inner Workings 350

15.4.1    Each Part on a Single Matrix  351

15.4.2    Both Parts on a Single Matrix  352

15.4.3    Both Parts on Separate Matrices 353

15.4.4    Concrete Example 1  354

15.4.5    Concrete Example 2  357

15.4.6    Concrete Example 3  359

15.5        Implementations 360

15.5.1    Spectral Forecast for Signals 362

15.5.2    What Does the Value of d Mean? 364

15.5.3    Spectral Forecast for Matrices 368

15.6        The Spectral Forecast Model for Predictions 372

15.6.1    The Spectral Forecast Model for Signals 372

15.6.2    Experiments on the Similarity Index Values 381

15.6.3    The Spectral Forecast Model for Matrices 384

15.7        Conclusions 389

16           Entropy vs. Content (I)   391

16.1        Introduction 391

16.2        Information Entropy 391

16.3        Implementation 395

16.4        Information Content vs. Information Entropy 400

16.4.1    Implementation 403

16.4.2    Additional Considerations 409

16.5        Conclusions 409

17           Philosophical Transactions    411

17.1        Introduction 411

17.2        The Frame of Reference 411

17.2.1    The Fundamental Layer of Complexity 412

17.2.2    On the Complexity of Life 414

17.3        Random vs. Pseudo-random 415

17.4        Random Numbers and Noise 418

17.5        Determinism and Chaos 419

17.5.1    Chaos Without Noise 420

17.5.2    Chaos with Noise 427

17.5.3    Limits of Prediction 430

17.5.4    On the Wings of Chaos 431

17.6        Free Will and Determinism 431

17.6.1    The Greatest Disappointment 432

17.6.2    The Most Powerful Processor in Existence 433

17.6.3    Certainty vs. Interpretation 435

17.6.4    A Wisdom that Applies 436

17.7        Conclusions 439

Appendix A         441

A.1         Association of Numerical Values with Letters 441

A.2         Sorting Values on Columns 443

A.3         The Implementation of a Sequence Logo 446

A.4         Sequence Logos Based on Maximum Values 451

A.5         Using Logarithms to Build Sequence Logos 455

A.6         From a Motif Set to a Sequence Logo 459

References   467

Index   489

Authors

Paul A. Gagniuc