Quantifying the multi-scale performance of network inference algorithms

Graphical models are widely used to study complex multivariate biological systems. Network inference algorithms aim to reverse-engineer such models from noisy experimental data. It is common to assess such algorithms using techniques from classifier analysis. These metrics, based on ability to corre...

Full description

Saved in:
Bibliographic Details
Published in:Statistical applications in genetics and molecular biology Vol. 13; no. 5; p. 611
Main Authors: Oates, Chris J, Amos, Richard, Spencer, Simon E F
Format: Journal Article
Language:English
Published: Germany 01.10.2014
Subjects:
Algorithms
Models, Theoretical
ISSN:1544-6115, 1544-6115
Online Access:Get more information
Tags: Add Tag
No Tags, Be the first to tag this record!
Abstract Graphical models are widely used to study complex multivariate biological systems. Network inference algorithms aim to reverse-engineer such models from noisy experimental data. It is common to assess such algorithms using techniques from classifier analysis. These metrics, based on ability to correctly infer individual edges, possess a number of appealing features including invariance to rank-preserving transformation. However, regulation in biological systems occurs on multiple scales and existing metrics do not take into account the correctness of higher-order network structure. In this paper novel performance scores are presented that share the appealing properties of existing scores, whilst capturing ability to uncover regulation on multiple scales. Theoretical results confirm that performance of a network inference algorithm depends crucially on the scale at which inferences are to be made; in particular strong local performance does not guarantee accurate reconstruction of higher-order topology. Applying these scores to a large corpus of data from the DREAM5 challenge, we undertake a data-driven assessment of estimator performance. We find that the "wisdom of crowds" network, that demonstrated superior local performance in the DREAM5 challenge, is also among the best performing methodologies for inference of regulation on multiple length scales.
AbstractList Graphical models are widely used to study complex multivariate biological systems. Network inference algorithms aim to reverse-engineer such models from noisy experimental data. It is common to assess such algorithms using techniques from classifier analysis. These metrics, based on ability to correctly infer individual edges, possess a number of appealing features including invariance to rank-preserving transformation. However, regulation in biological systems occurs on multiple scales and existing metrics do not take into account the correctness of higher-order network structure. In this paper novel performance scores are presented that share the appealing properties of existing scores, whilst capturing ability to uncover regulation on multiple scales. Theoretical results confirm that performance of a network inference algorithm depends crucially on the scale at which inferences are to be made; in particular strong local performance does not guarantee accurate reconstruction of higher-order topology. Applying these scores to a large corpus of data from the DREAM5 challenge, we undertake a data-driven assessment of estimator performance. We find that the "wisdom of crowds" network, that demonstrated superior local performance in the DREAM5 challenge, is also among the best performing methodologies for inference of regulation on multiple length scales.Graphical models are widely used to study complex multivariate biological systems. Network inference algorithms aim to reverse-engineer such models from noisy experimental data. It is common to assess such algorithms using techniques from classifier analysis. These metrics, based on ability to correctly infer individual edges, possess a number of appealing features including invariance to rank-preserving transformation. However, regulation in biological systems occurs on multiple scales and existing metrics do not take into account the correctness of higher-order network structure. In this paper novel performance scores are presented that share the appealing properties of existing scores, whilst capturing ability to uncover regulation on multiple scales. Theoretical results confirm that performance of a network inference algorithm depends crucially on the scale at which inferences are to be made; in particular strong local performance does not guarantee accurate reconstruction of higher-order topology. Applying these scores to a large corpus of data from the DREAM5 challenge, we undertake a data-driven assessment of estimator performance. We find that the "wisdom of crowds" network, that demonstrated superior local performance in the DREAM5 challenge, is also among the best performing methodologies for inference of regulation on multiple length scales.
Graphical models are widely used to study complex multivariate biological systems. Network inference algorithms aim to reverse-engineer such models from noisy experimental data. It is common to assess such algorithms using techniques from classifier analysis. These metrics, based on ability to correctly infer individual edges, possess a number of appealing features including invariance to rank-preserving transformation. However, regulation in biological systems occurs on multiple scales and existing metrics do not take into account the correctness of higher-order network structure. In this paper novel performance scores are presented that share the appealing properties of existing scores, whilst capturing ability to uncover regulation on multiple scales. Theoretical results confirm that performance of a network inference algorithm depends crucially on the scale at which inferences are to be made; in particular strong local performance does not guarantee accurate reconstruction of higher-order topology. Applying these scores to a large corpus of data from the DREAM5 challenge, we undertake a data-driven assessment of estimator performance. We find that the "wisdom of crowds" network, that demonstrated superior local performance in the DREAM5 challenge, is also among the best performing methodologies for inference of regulation on multiple length scales.
Author Amos, Richard
Oates, Chris J
Spencer, Simon E F
Author_xml – sequence: 1
  givenname: Chris J
  surname: Oates
  fullname: Oates, Chris J
– sequence: 2
  givenname: Richard
  surname: Amos
  fullname: Amos, Richard
– sequence: 3
  givenname: Simon E F
  surname: Spencer
  fullname: Spencer, Simon E F
BackLink https://www.ncbi.nlm.nih.gov/pubmed/25153244$$D View this record in MEDLINE/PubMed
BookMark eNpNj81LAzEUxINU7IeevckevUTzstl0e5SiVSiIoOcl2b600d2kJlmk_70RK3iaH8O84c2UjJx3SMglsBuooLqNattryhkIyhjwEzKBSggqAarRPx6TaYzvjHHgJTsjY55vSy7EhKxeBuWSNQfrtkXaYdEPXbI0tqrDYo_B-NAr12LhTeEwffnwUVhnMOCPqbqtDzbt-nhOTo3qIl4cdUbeHu5fl490_bx6Wt6taVvWIlGVn5HA51hrJfQCuVIStGRG1bKVJSqxEEazVm6AQyYj-AKxYkZn4FDzGbn-7d0H_zlgTE1vY4tdpxz6ITa5Pg9mUsxz9OoYHXSPm2YfbK_Cofkbz78BrS9eYw
CitedBy_id crossref_primary_10_1016_j_coisb_2021_03_008
crossref_primary_10_1126_science_aac9505
crossref_primary_10_1016_j_jfranklin_2022_08_023
crossref_primary_10_1016_j_cels_2017_08_014
crossref_primary_10_1515_sagmb_2014_0055
crossref_primary_10_1038_s41540_019_0116_1
crossref_primary_10_1515_sagmb_2018_0042
ContentType Journal Article
DBID CGR
CUY
CVF
ECM
EIF
NPM
7X8
DOI 10.1515/sagmb-2014-0012
DatabaseName Medline
MEDLINE
MEDLINE (Ovid)
MEDLINE
MEDLINE
PubMed
MEDLINE - Academic
DatabaseTitle MEDLINE
Medline Complete
MEDLINE with Full Text
PubMed
MEDLINE (Ovid)
MEDLINE - Academic
DatabaseTitleList MEDLINE - Academic
MEDLINE
Database_xml – sequence: 1
  dbid: NPM
  name: PubMed
  url: http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed
  sourceTypes: Index Database
– sequence: 2
  dbid: 7X8
  name: MEDLINE - Academic
  url: https://search.proquest.com/medline
  sourceTypes: Aggregation Database
DeliveryMethod no_fulltext_linktorsrc
Discipline Biology
EISSN 1544-6115
ExternalDocumentID 25153244
Genre Research Support, Non-U.S. Gov't
Journal Article
GroupedDBID ---
-~S
0R~
123
1WD
4.4
9-L
AAAEU
AAAVF
AACIX
AAFPC
AAGVJ
AAILP
AAKRG
AALGR
AAONY
AAOWA
AAPJK
AAQCX
AASQH
AASQN
AAWFC
AAXCG
AAXMT
ABABW
ABAOT
ABAQN
ABFKT
ABIQR
ABJNI
ABLVI
ABMIY
ABPLS
ABRDF
ABRQL
ABUVI
ABVMU
ABWLS
ABXMZ
ABYBW
ACDEB
ACEFL
ACGFO
ACGFS
ACHNZ
ACMKP
ACONX
ACPMA
ACRPL
ACXLN
ACZBO
ADALX
ADEQT
ADGQD
ADGYE
ADNMO
ADOZN
ADUQZ
AEDGQ
AEGVQ
AEICA
AEJQW
AEKEB
AEMOE
AENEX
AEQDQ
AEQLX
AERZL
AEXIE
AFAUI
AFBAA
AFBDD
AFBQV
AFCXV
AFGNR
AFQUK
AFSHE
AFYRI
AGBEV
AGGNV
AGQYU
AGWTP
AHCWZ
AHVWV
AHXUK
AIAGR
AIERV
AIKXB
AIWOI
AJATJ
AJPIC
AKXKS
ALMA_UNASSIGNED_HOLDINGS
ALUKF
ALWYM
AMAVY
ASPBG
ASYPN
AVWKF
AZFZN
AZMOX
BAKPI
BBCWN
BBDJO
BCIFA
BDLBQ
CAG
CGR
CKPZI
COF
CS3
CUY
CVF
DASCH
DU5
EBS
ECM
EIF
EJD
EMOBN
F5P
FEDTE
FSTRU
H13
HVGLF
HZ~
IY9
J9A
K.~
KDIRW
LG7
LVMAB
MV1
NPM
NQBSW
O9-
P2P
QD8
ROL
RYL
SA.
SLJYH
T2Y
UK5
WTRAM
~Z8
7X8
ABDRH
ACUND
ACYCL
ADNPR
AECWL
DSRVY
ID FETCH-LOGICAL-c384t-a1156127e8ba4b9e2aa61b60fa86c63ea494fb0c6d1214fbf429ee50fb4292182
IEDL.DBID 7X8
ISICitedReferencesCount 9
ISICitedReferencesURI http://www.webofscience.com/api/gateway?GWVersion=2&SrcApp=Summon&SrcAuth=ProQuest&DestLinkType=CitingArticles&DestApp=WOS_CPL&KeyUT=000343113200006&url=https%3A%2F%2Fcvtisr.summon.serialssolutions.com%2F%23%21%2Fsearch%3Fho%3Df%26include.ft.matches%3Dt%26l%3Dnull%26q%3D
ISSN 1544-6115
IngestDate Thu Sep 04 18:59:55 EDT 2025
Thu Apr 03 07:08:32 EDT 2025
IsPeerReviewed true
IsScholarly true
Issue 5
Language English
LinkModel DirectLink
MergedId FETCHMERGED-LOGICAL-c384t-a1156127e8ba4b9e2aa61b60fa86c63ea494fb0c6d1214fbf429ee50fb4292182
Notes ObjectType-Article-1
SourceType-Scholarly Journals-1
ObjectType-Feature-2
content type line 23
PMID 25153244
PQID 1566110647
PQPubID 23479
ParticipantIDs proquest_miscellaneous_1566110647
pubmed_primary_25153244
PublicationCentury 2000
PublicationDate 2014-10-01
PublicationDateYYYYMMDD 2014-10-01
PublicationDate_xml – month: 10
  year: 2014
  text: 2014-10-01
  day: 01
PublicationDecade 2010
PublicationPlace Germany
PublicationPlace_xml – name: Germany
PublicationTitle Statistical applications in genetics and molecular biology
PublicationTitleAlternate Stat Appl Genet Mol Biol
PublicationYear 2014
SSID ssj0021230
Score 2.0544589
Snippet Graphical models are widely used to study complex multivariate biological systems. Network inference algorithms aim to reverse-engineer such models from noisy...
SourceID proquest
pubmed
SourceType Aggregation Database
Index Database
StartPage 611
SubjectTerms Algorithms
Models, Theoretical
Title Quantifying the multi-scale performance of network inference algorithms
URI https://www.ncbi.nlm.nih.gov/pubmed/25153244
https://www.proquest.com/docview/1566110647
Volume 13
WOSCitedRecordID wos000343113200006&url=https%3A%2F%2Fcvtisr.summon.serialssolutions.com%2F%23%21%2Fsearch%3Fho%3Df%26include.ft.matches%3Dt%26l%3Dnull%26q%3D
hasFullText
inHoldings 1
isFullTextHit
isPrint
link http://cvtisr.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwpV1LS8NAEB7UKnjx_agvVvC6tJtssslJRKxeLBUUegu72d1asEk1reC_d3aT2pMgeAm5hITZLzPf7MzsB3CVJwHTVqY0Epib8FxrKpVOaRJqEZtUaGW1F5sQ_X4yHKaDZsOtatoqFz7RO2pd5m6PvOPyDAxVMRfX03fqVKNcdbWR0FiFVuioDOJZDH-qCM4r-4HIiHNMkVjUHO2DIbxTydFEIUQYpy7i_84vfZzpbf_3C3dgq2GY5KaGxC6smGIPNmrNya99uH-aS9cg5MabCLI_4lsKaYVrZch0OUZASkuKukecjBdTgUS-jfCVs9dJdQAvvbvn2wfaqCnQPEz4jEo0ANIZYRIluUpNIGXMVNy1MonzODSSp9yqbh5rFjC8sxipjIm6VjlFK0xDDmGtKAtzDMSKyERMyFDrkBskaJYpgVxOipQFhus2XC4slCFaXQlCFqacV9nSRm04qs2cTetjNTJkWhHSO37yh6dPYdOvne-qO4OWxX_VnMN6_jkbVx8XHgZ47Q8evwGruL3N
linkProvider ProQuest
openUrl ctx_ver=Z39.88-2004&ctx_enc=info%3Aofi%2Fenc%3AUTF-8&rfr_id=info%3Asid%2Fsummon.serialssolutions.com&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=Quantifying+the+multi-scale+performance+of+network+inference+algorithms&rft.jtitle=Statistical+applications+in+genetics+and+molecular+biology&rft.au=Oates%2C+Chris+J&rft.au=Amos%2C+Richard&rft.au=Spencer%2C+Simon+E+F&rft.date=2014-10-01&rft.issn=1544-6115&rft.eissn=1544-6115&rft.volume=13&rft.issue=5&rft.spage=611&rft_id=info:doi/10.1515%2Fsagmb-2014-0012&rft.externalDBID=NO_FULL_TEXT
thumbnail_l http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/lc.gif&issn=1544-6115&client=summon
thumbnail_m http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/mc.gif&issn=1544-6115&client=summon
thumbnail_s http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/sc.gif&issn=1544-6115&client=summon