Evaluating functional network inference using simulations of complex biological systems

Motivation: Although many network inference algorithms have been presented in the bioinformatics literature, no suitable approach has been formulated for evaluating their effectiveness at recovering models of complex biological systems from limited data. To overcome this limitation, we propose an ap...

Full description

Saved in:
Bibliographic Details
Published in:Bioinformatics Vol. 18; no. suppl_1; pp. S216 - S224
Main Authors: Smith, V. Anne, Jarvis, Erich D., Hartemink, Alexander J.
Format: Journal Article
Language:English
Published: England Oxford Publishing Limited (England) 01.07.2002
Subjects:
ISSN:1367-4803, 1367-4811, 1460-2059
Online Access:Get full text
Tags: Add Tag
No Tags, Be the first to tag this record!
Description
Summary:Motivation: Although many network inference algorithms have been presented in the bioinformatics literature, no suitable approach has been formulated for evaluating their effectiveness at recovering models of complex biological systems from limited data. To overcome this limitation, we propose an approach to evaluate network inference algorithms according to their ability to recover a complex functional network from biologically reasonable simulated data. Results: We designed a simulator to generate data representing a complex biological system at multiple levels of organization: behaviour, neural anatomy, brain electrophysiology, and gene expression of songbirds. About 90% of the simulated variables are unregulated by other variables in the system and are included simply as distracters. We sampled the simulated data at intervals as one would sample from a biological system in practice, and then used the sampled data to evaluate the effectiveness of an algorithm we developed for functional network inference. We found that our algorithm is highly effective at recovering the functional network structure of the simulated system—including the irrelevance of unregulated variables—from sampled data alone. To assess the reproducibility of these results, we tested our inference algorithm on 50 separately simulated sets of data and it consistently recovered almost perfectly the complex functional network structure underlying the simulated data. To our knowledge, this is the first approach for evaluating the effectiveness of functional network inference algorithms at recovering models from limited data. Our simulation approach also enables researchers a priori to design experiments and data-collection protocols that are amenable to functional network inference. Availability: Source code and simulated data are available upon request. Contact: amink@cs.duke.eduasmith@neuro.duke.edujarvis@neuro.duke.edu
Bibliography:ObjectType-Article-1
SourceType-Scholarly Journals-1
content type line 14
ObjectType-Article-2
ObjectType-Feature-1
content type line 23
ObjectType-Feature-2
ObjectType-Undefined-1
ObjectType-Feature-3
ISSN:1367-4803
1367-4811
1460-2059
DOI:10.1093/bioinformatics/18.suppl_1.S216