Position control of an acoustic cavitation bubble by reinforcement learning

Reinforcement Learning (RL) is employed to develop control techniques for manipulating acoustic cavitation bubbles. This paper presents a proof of concept in which an RL agent is trained to discover a policy that allows precise control of bubble positions within a dual-frequency standing acoustic wa...

Celý popis

Uloženo v:
Podrobná bibliografie
Vydáno v:Ultrasonics sonochemistry Ročník 115; s. 107290
Hlavní autoři: Klapcsik, Kálmán, Gyires-Tóth, Bálint, Rosselló, Juan Manuel, Hegedűs, Ferenc
Médium: Journal Article
Jazyk:angličtina
Vydáno: Netherlands Elsevier B.V 01.04.2025
Elsevier
Témata:
ISSN:1350-4177, 1873-2828, 1873-2828
On-line přístup:Získat plný text
Tagy: Přidat tag
Žádné tagy, Buďte první, kdo vytvoří štítek k tomuto záznamu!
Abstract Reinforcement Learning (RL) is employed to develop control techniques for manipulating acoustic cavitation bubbles. This paper presents a proof of concept in which an RL agent is trained to discover a policy that allows precise control of bubble positions within a dual-frequency standing acoustic wave field by adjusting the pressure amplitude values. The agent is rewarded for driving the bubble to a target position in the shortest possible time. The results demonstrate that the agent exploits the nonlinear behaviour of the bubble and, in specific cases, identifies solutions that cannot be addressed using the linear theory of the primary Bjerknes force. The RL agent performs well under domain randomization, indicating that the RL approach generalizes effectively and produces models robust against noise, which could arise in real-world applications.
AbstractList Reinforcement Learning (RL) is employed to develop control techniques for manipulating acoustic cavitation bubbles. This paper presents a proof of concept in which an RL agent is trained to discover a policy that allows precise control of bubble positions within a dual-frequency standing acoustic wave field by adjusting the pressure amplitude values. The agent is rewarded for driving the bubble to a target position in the shortest possible time. The results demonstrate that the agent exploits the nonlinear behaviour of the bubble and, in specific cases, identifies solutions that cannot be addressed using the linear theory of the primary Bjerknes force. The RL agent performs well under domain randomization, indicating that the RL approach generalizes effectively and produces models robust against noise, which could arise in real-world applications.
Reinforcement Learning (RL) is employed to develop control techniques for manipulating acoustic cavitation bubbles. This paper presents a proof of concept in which an RL agent is trained to discover a policy that allows precise control of bubble positions within a dual-frequency standing acoustic wave field by adjusting the pressure amplitude values. The agent is rewarded for driving the bubble to a target position in the shortest possible time. The results demonstrate that the agent exploits the nonlinear behaviour of the bubble and, in specific cases, identifies solutions that cannot be addressed using the linear theory of the primary Bjerknes force. The RL agent performs well under domain randomization, indicating that the RL approach generalizes effectively and produces models robust against noise, which could arise in real-world applications.Reinforcement Learning (RL) is employed to develop control techniques for manipulating acoustic cavitation bubbles. This paper presents a proof of concept in which an RL agent is trained to discover a policy that allows precise control of bubble positions within a dual-frequency standing acoustic wave field by adjusting the pressure amplitude values. The agent is rewarded for driving the bubble to a target position in the shortest possible time. The results demonstrate that the agent exploits the nonlinear behaviour of the bubble and, in specific cases, identifies solutions that cannot be addressed using the linear theory of the primary Bjerknes force. The RL agent performs well under domain randomization, indicating that the RL approach generalizes effectively and produces models robust against noise, which could arise in real-world applications.
ArticleNumber 107290
Author Gyires-Tóth, Bálint
Hegedűs, Ferenc
Klapcsik, Kálmán
Rosselló, Juan Manuel
Author_xml – sequence: 1
  givenname: Kálmán
  orcidid: 0000-0002-8928-5473
  surname: Klapcsik
  fullname: Klapcsik, Kálmán
  email: kklapcsik@hds.bme.hu
  organization: Department of Hydrodynamic Systems, Faculty of Mechanical Engineering, Budapest University of Technology and Economics, Mű,egyetem rkp. 3., H-1111 Budapest, Hungary
– sequence: 2
  givenname: Bálint
  orcidid: 0000-0003-1059-9822
  surname: Gyires-Tóth
  fullname: Gyires-Tóth, Bálint
  email: toth.b@tmit.bme.hu
  organization: Department of Telecommunications and Media Informatics, Faculty of Electrical Engineering and Informatics, Budapest University of Technology and Economics, Mű,egyetem rkp. 3., H-1111 Budapest, Hungary
– sequence: 3
  givenname: Juan Manuel
  orcidid: 0000-0001-7005-9452
  surname: Rosselló
  fullname: Rosselló, Juan Manuel
  email: jrossello.research@gmail.com
  organization: Faculty of Mechanical Engineering, University of Ljubljana, Aškerčeva 6, 1000 Ljubljana, Slovenia
– sequence: 4
  givenname: Ferenc
  orcidid: 0000-0002-8693-1660
  surname: Hegedűs
  fullname: Hegedűs, Ferenc
  email: fhegedus@hds.bme.hu
  organization: Department of Hydrodynamic Systems, Faculty of Mechanical Engineering, Budapest University of Technology and Economics, Mű,egyetem rkp. 3., H-1111 Budapest, Hungary
BackLink https://www.ncbi.nlm.nih.gov/pubmed/40058020$$D View this record in MEDLINE/PubMed
BookMark eNqFUctu1DAUjVARfcAvVFmyyeBH4oeEBKjiUVEJFrC2nJubqUceu9jJSP37epoZRNl0Zev6PK7POa9OQgxYVZeUrCih4t1mNfspxwC3K0ZYV4aSafKiOqNK8oYppk7KnXekaamUp9V5zhtCCNeMvKpOW0I6RRg5q77_jNlNLoYaYphS9HUcaxtqC3HOk4Ma7M5N9hHRz33vse7v64QujDEBbjFMtUebggvr19XL0fqMbw7nRfX7y-dfV9-amx9fr68-3TTQcTU1nPXcqtYqpTWztLOWKwGEWdHLXnA-CkBKJaEDCBSjhqElDDsksgMGmvCL6nrRHaLdmLvktjbdm2ideRzEtDY2ld09GqkV9AMCAcZbMVolSgaodKv0qAfZFq0Pi9bd3G9xgPKfZP0T0acvwd2addwZSjUvG-23eXtQSPHPjHkyW5cBvbcBS4aGU9mJErZmBXr5r9lfl2MdBfB-AUCKOSccDRzCL97OG0rMvn2zMcf2zb59s7Rf6OI_-tHhWeLHhYiltp3DZDI4DICDSwhTydU9J_EAO4POiw
CitedBy_id crossref_primary_10_1063_5_0273479
crossref_primary_10_1002_dac_70250
crossref_primary_10_1016_j_ultsonch_2025_107349
Cites_doi 10.1016/j.ultsonch.2020.105070
10.1016/j.ultras.2013.03.012
10.1016/j.jhazmat.2009.08.115
10.1016/j.ijhydene.2015.01.150
10.1016/j.ultsonch.2015.08.022
10.1016/j.ultsonch.2004.01.037
10.1016/j.ultsonch.2009.02.009
10.1038/s41378-023-00595-z
10.1103/PhysRevLett.96.114301
10.1016/j.actaastro.2005.01.032
10.1103/PhysRevApplied.15.034033
10.1016/j.ultsonch.2016.10.022
10.1103/PhysRevE.77.066309
10.1016/j.ultsonch.2012.12.003
10.1121/1.380614
10.1016/j.ultsonch.2021.105474
10.1063/1.5005599
10.1038/s44172-023-00113-z
10.1016/j.ultsonch.2020.105405
10.1103/PhysRevLett.116.184501
10.1038/s41598-020-61328-0
10.1021/jp404886h
10.1016/j.ultsonch.2015.10.010
10.1063/1.869582
10.1021/acs.jpcb.5b10221
10.1016/j.cej.2009.07.021
10.1016/j.ultsonch.2015.02.005
10.1016/j.apacoust.2008.09.016
10.1103/PhysRevE.82.026321
10.1016/j.ultsonch.2007.09.015
10.1103/PhysRevE.55.3747
10.1016/S0009-2509(02)00271-3
10.1063/1.3076932
10.1063/1.868520
10.1017/S0022112003006220
10.1063/5.0032766
10.1016/j.ultrasmedbio.2008.01.020
10.1016/j.ultrasmedbio.2014.08.018
10.1016/S1350-4177(98)00025-X
10.1063/1.1458597
10.1016/j.ultsonch.2022.106253
10.1016/j.ultsonch.2010.03.004
10.1121/1.1768255
10.3390/w2010028
10.1063/1.869996
10.1016/j.cej.2008.10.004
10.1103/PhysRevE.78.036322
10.1063/1.868039
10.1016/j.ultsonch.2023.106319
10.1016/j.sna.2017.07.023
10.1103/PhysRevE.56.2924
10.1063/1.4936980
10.1016/j.ultsonch.2009.11.009
10.1103/PhysRevLett.75.954
10.1016/j.ultsonch.2017.10.004
10.1121/1.1502899
10.1121/1.420065
10.1016/j.ijhydene.2019.04.115
10.1109/ACCESS.2020.2969277
10.1063/1.2227047
10.1121/1.384720
10.1063/1.4816750
10.1016/j.ultsonch.2014.06.003
10.1016/j.ultsonch.2020.105089
10.1038/nature14236
10.1088/0960-1317/23/12/125026
10.1016/j.ultsonch.2014.02.027
10.1146/annurev.fluid.32.1.659
10.1016/j.seppur.2017.11.009
10.1017/S0022112091002926
10.1299/jsmeb.41.472
10.1039/C2CS35282F
10.1063/1.3227903
10.1016/j.ultsonch.2018.08.024
10.1103/PhysRevE.62.2158
10.1016/S0894-1777(02)00197-8
10.1016/j.chemphys.2018.11.019
10.1016/j.ultsonch.2016.02.013
10.1016/j.jsv.2020.115723
ContentType Journal Article
Copyright 2025 The Authors
Copyright © 2025 The Authors. Published by Elsevier B.V. All rights reserved.
2025 The Authors 2025
Copyright_xml – notice: 2025 The Authors
– notice: Copyright © 2025 The Authors. Published by Elsevier B.V. All rights reserved.
– notice: 2025 The Authors 2025
DBID 6I.
AAFTH
AAYXX
CITATION
NPM
7X8
5PM
DOA
DOI 10.1016/j.ultsonch.2025.107290
DatabaseName ScienceDirect Open Access Titles
Elsevier:ScienceDirect:Open Access
CrossRef
PubMed
MEDLINE - Academic
PubMed Central (Full Participant titles)
DOAJ Directory of Open Access Journals
DatabaseTitle CrossRef
PubMed
MEDLINE - Academic
DatabaseTitleList
MEDLINE - Academic
PubMed


Database_xml – sequence: 1
  dbid: DOA
  name: DOAJ Directory of Open Access Journals
  url: https://www.doaj.org/
  sourceTypes: Open Website
– sequence: 2
  dbid: NPM
  name: PubMed
  url: http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed
  sourceTypes: Index Database
– sequence: 3
  dbid: 7X8
  name: MEDLINE - Academic
  url: https://search.proquest.com/medline
  sourceTypes: Aggregation Database
DeliveryMethod fulltext_linktorsrc
Discipline Chemistry
Physics
EISSN 1873-2828
ExternalDocumentID oai_doaj_org_article_798cbdec0c2346fa86003e89489f9d74
PMC11930750
40058020
10_1016_j_ultsonch_2025_107290
S1350417725000690
Genre Journal Article
GroupedDBID ---
--K
--M
.DC
.~1
0R~
1B1
1RT
1~.
1~5
29Q
4.4
457
4G.
53G
5VS
6I.
7-5
71M
8P~
9JN
AACTN
AAEDT
AAEDW
AAFTH
AAFWJ
AAIKJ
AAKOC
AALRI
AAOAW
AAQFI
AAQXK
AARLI
AATTM
AAXKI
AAXUO
ABEFU
ABFNM
ABJNI
ABLJU
ABMAC
ABNEU
ABTAH
ABWVN
ABXDB
ACDAQ
ACFVG
ACGFS
ACNNM
ACRLP
ACRPL
ADBBV
ADECG
ADEZE
ADMUD
ADNMO
ADVLN
AEBSH
AEIPS
AEKER
AENEX
AFFNX
AFJKZ
AFPKN
AFTJW
AFXIZ
AFZHZ
AGHFR
AGQPQ
AGUBO
AGYEJ
AHHHB
AIEXJ
AIKHN
AITUG
AIVDX
AJSZI
AKRWK
ALMA_UNASSIGNED_HOLDINGS
AMRAJ
ANKPU
APXCP
ASPBG
AVWKF
AXJTR
AZFZN
BBWZM
BKOJK
BLXMC
BNPGV
CS3
DU5
EBS
EFJIC
EJD
EO8
EO9
EP2
EP3
F5P
FDB
FEDTE
FGOYB
FIRID
FLBIZ
FNPLU
FYGXN
G-Q
GBLVA
GROUPED_DOAJ
HMV
HVGLF
HZ~
IHE
J1W
KOM
M38
M41
MO0
N9A
NDZJH
O-L
O9-
OAUVE
OGIMB
OK1
OZT
P-8
P-9
P2P
PC.
Q38
R2-
RIG
RNS
ROL
RPM
RPZ
SCB
SDF
SDG
SES
SEW
SPC
SPD
SPG
SSH
SSK
SSQ
SSZ
T5K
WUQ
XPP
ZMT
ZY4
~02
~G-
9DU
AAYWO
AAYXX
ACLOT
ACVFH
ADCNI
AEUPX
AFPUW
AIGII
AIIUN
AKBMS
AKYEP
CITATION
EFKBS
EFLBG
~HD
NPM
7X8
5PM
ID FETCH-LOGICAL-c538t-32b3a84a88992a15aa386c02a6b7b633f6ce11701dc6e6f9cd402e5e075c2c903
IEDL.DBID DOA
ISICitedReferencesCount 4
ISICitedReferencesURI http://www.webofscience.com/api/gateway?GWVersion=2&SrcApp=Summon&SrcAuth=ProQuest&DestLinkType=CitingArticles&DestApp=WOS_CPL&KeyUT=001443083400001&url=https%3A%2F%2Fcvtisr.summon.serialssolutions.com%2F%23%21%2Fsearch%3Fho%3Df%26include.ft.matches%3Dt%26l%3Dnull%26q%3D
ISSN 1350-4177
1873-2828
IngestDate Fri Oct 03 12:51:07 EDT 2025
Tue Sep 30 17:05:11 EDT 2025
Sun Sep 28 08:46:16 EDT 2025
Mon Apr 07 02:12:11 EDT 2025
Sat Nov 29 06:50:41 EST 2025
Tue Nov 18 22:35:42 EST 2025
Sat Apr 12 15:21:31 EDT 2025
IsDoiOpenAccess true
IsOpenAccess true
IsPeerReviewed true
IsScholarly true
Keywords Bubble dynamics
GPU programming
Bubble position control
Reinforcement learning
Language English
License This is an open access article under the CC BY-NC-ND license.
Copyright © 2025 The Authors. Published by Elsevier B.V. All rights reserved.
This is an open access article under the CC BY-NC-ND license (http://creativecommons.org/licenses/by-nc-nd/4.0/).
LinkModel DirectLink
MergedId FETCHMERGED-LOGICAL-c538t-32b3a84a88992a15aa386c02a6b7b633f6ce11701dc6e6f9cd402e5e075c2c903
Notes ObjectType-Article-1
SourceType-Scholarly Journals-1
ObjectType-Feature-2
content type line 23
ORCID 0000-0002-8693-1660
0000-0003-1059-9822
0000-0002-8928-5473
0000-0001-7005-9452
OpenAccessLink https://doaj.org/article/798cbdec0c2346fa86003e89489f9d74
PMID 40058020
PQID 3175680292
PQPubID 23479
ParticipantIDs doaj_primary_oai_doaj_org_article_798cbdec0c2346fa86003e89489f9d74
pubmedcentral_primary_oai_pubmedcentral_nih_gov_11930750
proquest_miscellaneous_3175680292
pubmed_primary_40058020
crossref_citationtrail_10_1016_j_ultsonch_2025_107290
crossref_primary_10_1016_j_ultsonch_2025_107290
elsevier_sciencedirect_doi_10_1016_j_ultsonch_2025_107290
PublicationCentury 2000
PublicationDate 2025-04-01
PublicationDateYYYYMMDD 2025-04-01
PublicationDate_xml – month: 04
  year: 2025
  text: 2025-04-01
  day: 01
PublicationDecade 2020
PublicationPlace Netherlands
PublicationPlace_xml – name: Netherlands
PublicationTitle Ultrasonics sonochemistry
PublicationTitleAlternate Ultrason Sonochem
PublicationYear 2025
Publisher Elsevier B.V
Elsevier
Publisher_xml – name: Elsevier B.V
– name: Elsevier
References Crum (b49) 1975; 57
Mettin (b102) 2005
Versluis, Goertz, Palanchon, Heitman, van der Meer, Dollet, de Jong, Lohse (b28) 2010; 82
Doinikov (b100) 2004; 116
Garbin, Dollet, Overvelde, Cojoc, Di Fabrizio, van Wijngaarden, Prosperetti, de Jong, Lohse, Versluis (b23) 2009; 21
Keller, Miksis (b47) 1980; 68
Jiao, He, Leong, Kentish, Ashokkumar, Manasseh, Lee (b60) 2013; 117
Matas, James, Davison (b40) 2018
Sojahrood, Haghi, Karshafian, Kolios (b79) 2021; 33
Bai, Xu, Deng, Li, Xu, Gao (b29) 2014; 21
Magnaudet, Eames (b55) 2000; 32
Rosselló, Dellavale, Bonetto (b20) 2015; 22
Suo, Govind, Zhang, Jing (b42) 2018; 41
Zupanc, Kosjek, Petkovšek, Dular, Kompare, Širok, Bla[̌z]eka, Heath (b72) 2013; 20
Doinikov (b26) 2004; 501
Feng, Leal (b25) 1995; 7
Hegedűs (b98) 2020
Tatake, Pandit (b41) 2002; 57
Sojahrood, Haghi, Li, Porter, Karshafian, Kolios (b76) 2020; 66
Buckey, Knaus, Alvarenga, Kenton, Magari (b58) 2005; 56
Merouani, Hamdaoui, Rezgui, Guemini (b93) 2015; 40
Mettin, Ohl, Lauterborn (b104) 1999
Hao, Prosperetti (b83) 1999; 11
Peng, Andrychowicz, Zaremba, Abbeel (b38) 2018
Kandemir, Beelen, Wagterveld, Yntema, Keesman (b13) 2021; 490
Mettin, Luther, Ohl, Lauterborn (b103) 1999; 6
Pradhan, Gogate (b6) 2010; 173
Mettin, Doinikov (b27) 2009; 70
Hegedűs (b99) 2019
Lalanne, Chebel, Vejražka, Tanguy, Masbernat, Risso (b85) 2015; 27
Vuillermet, Gires, Casset, Poulain (b15) 2016; 116
Acconcia, Leung, Hynynen, Goertz (b75) 2013; 103
Bader, Gruber, Holland (b74) 2015; 41
Schulman (b106) 2017
Latifi, Kopitca, Zhou (b14) 2020; 8
Doinikov (b46) 2002; 14
Reddy, Szeri (b53) 2002; 112
Lee, Ashokkumar, Yasui, Tuziuti, Kozuka, Towata, Iida (b18) 2011; 18
Islam, Paul, Burheim, Pollet (b68) 2019; 59
Sivasankar, Moholkar (b4) 2009; 16
Masson, Ranchod, Konidaris (b95) 2015
Mettin (b101) 2007
Shaw (b86) 2006; 18
Ng, Coates, Diel, Ganapathi, Schulte, Tse, Berger, Liang (b37) 2006
Sivasankar, Moholkar (b3) 2009; 149
Mei, Zhou (b24) 1991; 229
Community (b67) 2022
Tomiyama, Kataoka, Zun, Sakaguchi (b51) 1998; 41
Akhatov, Mettin, Ohl, Parlitz, Lauterborn (b65) 1997; 55
Brenner, Lohse, Dupont (b80) 1995; 75
Dron, Aider (b12) 2013; 53
Sojahrood, Li, Haghi, Karshafian, Porter, Kolios (b10) 2023; 95
Kerboua, Hamdaoui (b94) 2019; 519
Zhang, Billson, Li (b45) 2015; 66
Mei, Klausner, Lawrence (b54) 1994; 6
Rosselló, Dellavale, Bonetto (b19) 2016; 31
Lillicrap (b34) 2016
Toegel, Luther, Lohse (b56) 2006; 96
Yasui (b1) 2018
Mnih (b33) 2015
Liao, Lin, Chuang, Tsai, Lin, Wang, Shih, Liu (b59) 2020; 10
Gole, Fishgold, Sierra-Alvarez, Deymier, Keswani (b5) 2018; 194
Maeda, Maxwell (b17) 2021; 15
Louisnard (b66) 2008; 78
Pflieger, Chave, Vite, Jouve, Nikitenko (b90) 2015; 26
Koch, Krefting, Mettin, Lauterborn (b105) 2003; vol. 2
Silver, Lever, Heess, Degris, Wierstra, Riedmiller (b62) 2014
Rashwan, Dincer, Mohany, Pollet (b69) 2019; 44
Rusu, Vecerik, Rothörl, Heess, Pascanu, Hadsell (b36) 2018
Park, Jung, Kim, Park, Jang, Kim, Baek, Lee (b57) 2023; 9
Rudin, Hoeller, Reist, Hutter (b35) 2022
van Iersel, Benes, Keurentjes (b9) 2008; 15
Matula, Cordry, Roy, Crum (b64) 1997; 102
Bogoyavlenskiy (b81) 2000; 62
Holzfuss (b84) 2008; 77
Klapcsik, Hegedűs (b61) 2023; 92
Mettin, Akhatov, Parlitz, Ohl, Lauterborn (b63) 1997; 56
Sutkar, Gogate (b8) 2009; 155
Doinikov (b48) 2005; 661
Xu, Zeiger, Suslick (b2) 2013; 42
Zhang, Zhang, Li (b43) 2016; 29
Esclapez, Sáez, nez, Tudela, Louisnard, González-García (b71) 2010; 17
Chen, Hu, Jin, Li, Wang (b39) 2022
Ouerhani, Pflieger, Ben Messaoud, Nikitenko (b91) 2015; 119
Dular, Griessler-Bulc, Gutierrez-Aguirre, Heath, Kosjek, Krivograd Klemenčič, Oder, Petkovšek, Rački, Ravnikar, Šarc, Širok, Zupanc, Žitnik, Kompare (b73) 2016; 29
Sojahrood, Haghi, Karshafian, Kolios (b78) 2021; 72
Sriphutkiat, Zhou (b11) 2017; 263
Shaw (b88) 2017; 29
Islam, Burheim, Hihn, Pollet (b89) 2021; 73
Chabouh, Mokbel, van Elburg, Versluis, Segers, Aland, Quilliet, Coupier (b22) 2023; 2
Mnih, Kavukcuoglu, Silver, Graves, Antonoglou, Wierstra, Riedmiller (b32) 2013
Levich (b50) 1962
Islam, Burheim, Pollet (b92) 2019; 51
González-García, Sáez, Tudela, Díez-Garcia, Deseada Esclapez, Louisnard (b70) 2010; 2
Gedanken (b7) 2004; 11
Heess, TB, Sriram, Lemmon, Merel, Wayne, Tassa, Erez, Wang, Eslami, Riedmiller, Silver (b107) 2017
Magnaudet, Legendre (b52) 1998; 10
Sutton, Barto (b30) 2018
Sojahrood, Haghi, Karshafian, Kolios (b77) 2020; 66
Dollet, van der Meer, Garbin, de Jong, Lohse, Versluis (b82) 2008; 34
Delalleau, Peter, Alonso, Logut (b96) 2019
Goldowsky, Mastrangeli, Jacot-Descombes, Gullo, Mermoud, Brugger, Martinoli, Nelson, Knapp (b16) 2013; 23
Fan, Su, Zhang, Yu (b97) 2019
Jean-François, Mangassarian, Kumaran (b31) 2003
Zhang, Zhang, Li (b44) 2017; 35
Shaw (b87) 2009; 21
Abe, Kawaji, Watanabe (b21) 2002; 26
Gedanken (10.1016/j.ultsonch.2025.107290_b7) 2004; 11
Ouerhani (10.1016/j.ultsonch.2025.107290_b91) 2015; 119
Hegedűs (10.1016/j.ultsonch.2025.107290_b99) 2019
Pflieger (10.1016/j.ultsonch.2025.107290_b90) 2015; 26
Lillicrap (10.1016/j.ultsonch.2025.107290_b34) 2016
Zhang (10.1016/j.ultsonch.2025.107290_b44) 2017; 35
Maeda (10.1016/j.ultsonch.2025.107290_b17) 2021; 15
Sutkar (10.1016/j.ultsonch.2025.107290_b8) 2009; 155
Bader (10.1016/j.ultsonch.2025.107290_b74) 2015; 41
Sojahrood (10.1016/j.ultsonch.2025.107290_b79) 2021; 33
Sojahrood (10.1016/j.ultsonch.2025.107290_b10) 2023; 95
Tomiyama (10.1016/j.ultsonch.2025.107290_b51) 1998; 41
González-García (10.1016/j.ultsonch.2025.107290_b70) 2010; 2
Peng (10.1016/j.ultsonch.2025.107290_b38) 2018
Doinikov (10.1016/j.ultsonch.2025.107290_b100) 2004; 116
Doinikov (10.1016/j.ultsonch.2025.107290_b26) 2004; 501
Doinikov (10.1016/j.ultsonch.2025.107290_b48) 2005; 661
Mettin (10.1016/j.ultsonch.2025.107290_b101) 2007
Hao (10.1016/j.ultsonch.2025.107290_b83) 1999; 11
Bai (10.1016/j.ultsonch.2025.107290_b29) 2014; 21
Shaw (10.1016/j.ultsonch.2025.107290_b86) 2006; 18
Islam (10.1016/j.ultsonch.2025.107290_b92) 2019; 51
Sivasankar (10.1016/j.ultsonch.2025.107290_b4) 2009; 16
Reddy (10.1016/j.ultsonch.2025.107290_b53) 2002; 112
Rashwan (10.1016/j.ultsonch.2025.107290_b69) 2019; 44
Delalleau (10.1016/j.ultsonch.2025.107290_b96) 2019
Park (10.1016/j.ultsonch.2025.107290_b57) 2023; 9
Matula (10.1016/j.ultsonch.2025.107290_b64) 1997; 102
Bogoyavlenskiy (10.1016/j.ultsonch.2025.107290_b81) 2000; 62
Mettin (10.1016/j.ultsonch.2025.107290_b102) 2005
Masson (10.1016/j.ultsonch.2025.107290_b95) 2015
Mettin (10.1016/j.ultsonch.2025.107290_b27) 2009; 70
Merouani (10.1016/j.ultsonch.2025.107290_b93) 2015; 40
Zupanc (10.1016/j.ultsonch.2025.107290_b72) 2013; 20
Yasui (10.1016/j.ultsonch.2025.107290_b1) 2018
Acconcia (10.1016/j.ultsonch.2025.107290_b75) 2013; 103
Tatake (10.1016/j.ultsonch.2025.107290_b41) 2002; 57
Brenner (10.1016/j.ultsonch.2025.107290_b80) 1995; 75
Mettin (10.1016/j.ultsonch.2025.107290_b63) 1997; 56
Toegel (10.1016/j.ultsonch.2025.107290_b56) 2006; 96
Islam (10.1016/j.ultsonch.2025.107290_b89) 2021; 73
Shaw (10.1016/j.ultsonch.2025.107290_b87) 2009; 21
Kerboua (10.1016/j.ultsonch.2025.107290_b94) 2019; 519
Doinikov (10.1016/j.ultsonch.2025.107290_b46) 2002; 14
Sojahrood (10.1016/j.ultsonch.2025.107290_b78) 2021; 72
Shaw (10.1016/j.ultsonch.2025.107290_b88) 2017; 29
Islam (10.1016/j.ultsonch.2025.107290_b68) 2019; 59
Sojahrood (10.1016/j.ultsonch.2025.107290_b76) 2020; 66
Rudin (10.1016/j.ultsonch.2025.107290_b35) 2022
Kandemir (10.1016/j.ultsonch.2025.107290_b13) 2021; 490
Silver (10.1016/j.ultsonch.2025.107290_b62) 2014
Crum (10.1016/j.ultsonch.2025.107290_b49) 1975; 57
Dular (10.1016/j.ultsonch.2025.107290_b73) 2016; 29
Liao (10.1016/j.ultsonch.2025.107290_b59) 2020; 10
Mettin (10.1016/j.ultsonch.2025.107290_b104) 1999
Sriphutkiat (10.1016/j.ultsonch.2025.107290_b11) 2017; 263
Zhang (10.1016/j.ultsonch.2025.107290_b43) 2016; 29
Jean-François (10.1016/j.ultsonch.2025.107290_b31) 2003
Versluis (10.1016/j.ultsonch.2025.107290_b28) 2010; 82
Jiao (10.1016/j.ultsonch.2025.107290_b60) 2013; 117
Louisnard (10.1016/j.ultsonch.2025.107290_b66) 2008; 78
Dron (10.1016/j.ultsonch.2025.107290_b12) 2013; 53
Koch (10.1016/j.ultsonch.2025.107290_b105) 2003; vol. 2
Buckey (10.1016/j.ultsonch.2025.107290_b58) 2005; 56
Garbin (10.1016/j.ultsonch.2025.107290_b23) 2009; 21
Mnih (10.1016/j.ultsonch.2025.107290_b32) 2013
Fan (10.1016/j.ultsonch.2025.107290_b97) 2019
Mei (10.1016/j.ultsonch.2025.107290_b24) 1991; 229
Esclapez (10.1016/j.ultsonch.2025.107290_b71) 2010; 17
Abe (10.1016/j.ultsonch.2025.107290_b21) 2002; 26
Levich (10.1016/j.ultsonch.2025.107290_b50) 1962
Rosselló (10.1016/j.ultsonch.2025.107290_b20) 2015; 22
Rusu (10.1016/j.ultsonch.2025.107290_b36) 2018
Xu (10.1016/j.ultsonch.2025.107290_b2) 2013; 42
Sivasankar (10.1016/j.ultsonch.2025.107290_b3) 2009; 149
Matas (10.1016/j.ultsonch.2025.107290_b40) 2018
Rosselló (10.1016/j.ultsonch.2025.107290_b19) 2016; 31
Holzfuss (10.1016/j.ultsonch.2025.107290_b84) 2008; 77
Gole (10.1016/j.ultsonch.2025.107290_b5) 2018; 194
Zhang (10.1016/j.ultsonch.2025.107290_b45) 2015; 66
Sojahrood (10.1016/j.ultsonch.2025.107290_b77) 2020; 66
Pradhan (10.1016/j.ultsonch.2025.107290_b6) 2010; 173
Community (10.1016/j.ultsonch.2025.107290_b67) 2022
Schulman (10.1016/j.ultsonch.2025.107290_b106) 2017
Keller (10.1016/j.ultsonch.2025.107290_b47) 1980; 68
Mei (10.1016/j.ultsonch.2025.107290_b54) 1994; 6
Hegedűs (10.1016/j.ultsonch.2025.107290_b98) 2020
Lee (10.1016/j.ultsonch.2025.107290_b18) 2011; 18
Magnaudet (10.1016/j.ultsonch.2025.107290_b52) 1998; 10
Ng (10.1016/j.ultsonch.2025.107290_b37) 2006
Mnih (10.1016/j.ultsonch.2025.107290_b33) 2015
Feng (10.1016/j.ultsonch.2025.107290_b25) 1995; 7
Suo (10.1016/j.ultsonch.2025.107290_b42) 2018; 41
Akhatov (10.1016/j.ultsonch.2025.107290_b65) 1997; 55
Chabouh (10.1016/j.ultsonch.2025.107290_b22) 2023; 2
Chen (10.1016/j.ultsonch.2025.107290_b39) 2022
Dollet (10.1016/j.ultsonch.2025.107290_b82) 2008; 34
Lalanne (10.1016/j.ultsonch.2025.107290_b85) 2015; 27
Mettin (10.1016/j.ultsonch.2025.107290_b103) 1999; 6
Vuillermet (10.1016/j.ultsonch.2025.107290_b15) 2016; 116
Goldowsky (10.1016/j.ultsonch.2025.107290_b16) 2013; 23
Klapcsik (10.1016/j.ultsonch.2025.107290_b61) 2023; 92
van Iersel (10.1016/j.ultsonch.2025.107290_b9) 2008; 15
Heess (10.1016/j.ultsonch.2025.107290_b107) 2017
Magnaudet (10.1016/j.ultsonch.2025.107290_b55) 2000; 32
Latifi (10.1016/j.ultsonch.2025.107290_b14) 2020; 8
Sutton (10.1016/j.ultsonch.2025.107290_b30) 2018
References_xml – volume: 40
  start-page: 4056
  year: 2015
  end-page: 4064
  ident: b93
  article-title: Mechanism of the sonochemical production of hydrogen
  publication-title: Int. J. Hydrog. Energy
– volume: 661
  start-page: 95
  year: 2005
  end-page: 143
  ident: b48
  article-title: Bjerknes forces and translational bubble dynamics
  publication-title: Bubble Part. Dyn. Acoust. Fields: Mod. Trends Appl.
– volume: 14
  start-page: 1420
  year: 2002
  end-page: 1425
  ident: b46
  article-title: Translational motion of a spherical bubble in an acoustic standing wave of high intensity
  publication-title: Phys. Fluids
– volume: 155
  start-page: 26
  year: 2009
  end-page: 36
  ident: b8
  article-title: Design aspects of sonochemical reactors: Techniques for understanding cavitational activity distribution and effect of operating parameters
  publication-title: Chem. Eng. J.
– volume: 56
  start-page: 2924
  year: 1997
  end-page: 2931
  ident: b63
  article-title: Bjerknes forces between small cavitation bubbles in a strong acoustic field
  publication-title: Phys. Rev. E
– volume: 55
  start-page: 3747
  year: 1997
  end-page: 3750
  ident: b65
  article-title: Bjerknes force threshold for stable single bubble sonoluminescence
  publication-title: Phys. Rev. E
– volume: 10
  start-page: 550
  year: 1998
  end-page: 554
  ident: b52
  article-title: The viscous drag force on a spherical bubble with a time-dependent radius
  publication-title: Phys. Fluids
– volume: 29
  start-page: 129
  year: 2016
  end-page: 145
  ident: b43
  article-title: The secondary Bjerknes force between two gas bubbles under dual-frequency acoustic excitation
  publication-title: Ultrason. Sonochem.
– volume: 490
  year: 2021
  ident: b13
  article-title: Dynamic acoustic fields for size selective particle separation on centimeter scale
  publication-title: J. Sound Vib.
– volume: 68
  start-page: 628
  year: 1980
  end-page: 633
  ident: b47
  article-title: Bubble oscillations of large amplitude
  publication-title: J. Acoust. Soc. Am.
– year: 2018
  ident: b30
  article-title: Reinforcement Learning: An Introduction
– volume: 66
  year: 2020
  ident: b77
  article-title: Critical corrections to models of nonlinear power dissipation of ultrasonically excited bubbles
  publication-title: Ultrason. Sonochem.
– volume: 15
  year: 2021
  ident: b17
  article-title: Controlling the dynamics of cloud cavitation bubbles through acoustic feedback
  publication-title: Phys. Rev. Appl.
– volume: 57
  start-page: 1363
  year: 1975
  end-page: 1370
  ident: b49
  article-title: Bjerknes forces on bubbles in a stationary sound field
  publication-title: J. Acoust. Soc. Am.
– volume: 501
  start-page: 1
  year: 2004
  end-page: 24
  ident: b26
  article-title: Translational motion of a bubble undergoing shape oscillations
  publication-title: J. Fluid Mech.
– volume: 2
  start-page: 28
  year: 2010
  end-page: 74
  ident: b70
  article-title: Sonochemical treatment of water polluted by chlorinated organocompounds. A review
  publication-title: Water
– volume: 51
  start-page: 533
  year: 2019
  end-page: 555
  ident: b92
  article-title: Sonochemical and sonoelectrochemical production of hydrogen
  publication-title: Ultrason. Sonochem.
– year: 2018
  ident: b40
  article-title: Sim-to-real reinforcement learning for deformable object manipulation
– year: 2003
  ident: b31
  article-title: Markov Decision Processes: Concepts and Algorithms
– volume: 56
  start-page: 1041
  year: 2005
  end-page: 1047
  ident: b58
  article-title: Dual-frequency ultrasound for detecting and sizing bubbles
  publication-title: Acta Astronaut.
– volume: 116
  start-page: 821
  year: 2004
  end-page: 827
  ident: b100
  article-title: Mathematical model for collective bubble dynamics in strong ultrasound fields
  publication-title: J. Acoust. Soc. Am.
– start-page: 3803
  year: 2018
  end-page: 3810
  ident: b38
  article-title: Sim-to-real transfer of robotic control with dynamics randomization
  publication-title: 2018 IEEE International Conference on Robotics and Automation
– volume: 92
  year: 2023
  ident: b61
  article-title: Numerical investigation of the translational motion of bubbles: The comparison of capabilities of the time-resolved and the time-averaged methods
  publication-title: Ultrason. Sonochem.
– volume: 41
  start-page: 187
  year: 2015
  end-page: 196
  ident: b74
  article-title: Shaken and stirred: Mechanisms of ultrasound-enhanced thrombolysis
  publication-title: Ultrasound Med. Biol.
– start-page: 171
  year: 2007
  end-page: 198
  ident: b101
  article-title: From a single bubble to bubble structures in acoustic cavitation
  publication-title: Oscillations, Waves and Interactions: Sixty Years Drittes Physikalisches Institut ; a Festschrift
– volume: 32
  start-page: 659
  year: 2000
  end-page: 708
  ident: b55
  article-title: The motion of high-Reynolds-number bubbles in inhomogeneous flows
  publication-title: Annu. Rev. Fluid Mech.
– volume: 149
  start-page: 57
  year: 2009
  end-page: 69
  ident: b3
  article-title: Mechanistic approach to intensification of sonochemical degradation of phenol
  publication-title: Chem. Eng. J.
– volume: 78
  year: 2008
  ident: b66
  article-title: Analytical expressions for primary Bjerknes force on inertial cavitation bubbles
  publication-title: Phys. Rev. E
– volume: 95
  year: 2023
  ident: b10
  article-title: Probing the pressure dependence of sound speed and attenuation in bubbly media: Experimental observations, a theoretical model and numerical calculations
  publication-title: Ultrason. Sonochem.
– volume: 21
  year: 2009
  ident: b87
  article-title: The stability of a bubble in a weakly viscous liquid subject to an acoustic traveling wave
  publication-title: Phys. Fluids
– volume: 173
  start-page: 517
  year: 2010
  end-page: 522
  ident: b6
  article-title: Degradation of p-nitrophenol using acoustic cavitation and Fenton chemistry
  publication-title: J. Hazard. Mater.
– volume: 103
  year: 2013
  ident: b75
  article-title: Interactions between ultrasound stimulated microbubbles and fibrin clots
  publication-title: Appl. Phys. Lett.
– volume: vol. 2
  start-page: 1475
  year: 2003
  end-page: 1478
  ident: b105
  article-title: Simulation of the translational motion of few cavitation bubbles in an ultrasonic field
  publication-title: IEEE Symposium on Ultrasonics, 2003
– volume: 72
  year: 2021
  ident: b78
  article-title: Nonlinear dynamics and bifurcation structure of ultrasonically excited lipid coated microbubbles
  publication-title: Ultrason. Sonochem.
– volume: 18
  start-page: 92
  year: 2011
  end-page: 98
  ident: b18
  article-title: Development and optimization of acoustic bubble structures at high frequencies
  publication-title: Ultrason. Sonochem.
– year: 2015
  ident: b95
  article-title: Reinforcement learning with parameterized actions
– year: 2019
  ident: b97
  article-title: Hybrid actor-critic reinforcement learning in parameterized action space
– year: 2022
  ident: b67
  article-title: Numba Documentation
– start-page: 1
  year: 2005
  end-page: 36
  ident: b102
  article-title: Bubble structures in acoustic cavitation
  publication-title: Bubble and Particle Dynamics in Acoustic Fields: Modern Trends and Applications
– year: 2017
  ident: b106
  article-title: Proximal policy optimization algorithms
– volume: 59
  year: 2019
  ident: b68
  article-title: Recent developments in the sonoelectrochemical synthesis of nanomaterials
  publication-title: Ultrason. Sonochem.
– volume: 82
  year: 2010
  ident: b28
  article-title: Microbubble shape oscillations excited through ultrasonic parametric driving
  publication-title: Phys. Rev. E
– volume: 11
  start-page: 47
  year: 2004
  end-page: 55
  ident: b7
  article-title: Using sonochemistry for the fabrication of nanomaterials
  publication-title: Ultrason. Sonochem.
– year: 2022
  ident: b35
  article-title: Learning to walk in minutes using massively parallel deep reinforcement learning
– volume: 119
  start-page: 15885
  year: 2015
  end-page: 15891
  ident: b91
  article-title: Spectroscopy of sonoluminescence and sonochemistry in water saturated with N
  publication-title: J. Phys. Chem. B
– year: 2017
  ident: b107
  article-title: Emergence of locomotion behaviours in rich environments
– volume: 2
  start-page: 63
  year: 2023
  ident: b22
  article-title: Coated microbubbles swim via shell buckling
  publication-title: Commun. Eng.
– volume: 70
  start-page: 1330
  year: 2009
  end-page: 1339
  ident: b27
  article-title: Translational instability of a spherical bubble in a standing ultrasound wave
  publication-title: Appl. Acoust.
– volume: 44
  start-page: 14500
  year: 2019
  end-page: 14526
  ident: b69
  article-title: The Sono-Hydro-Gen process (Ultrasound induced hydrogen production): Challenges and opportunities
  publication-title: Int. J. Hydrog. Energy
– volume: 20
  start-page: 1104
  year: 2013
  end-page: 1112
  ident: b72
  article-title: Removal of pharmaceuticals from wastewater by biological processes, hydrodynamic cavitation and UV treatment
  publication-title: Ultrason. Sonochem.
– volume: 194
  start-page: 104
  year: 2018
  end-page: 110
  ident: b5
  article-title: Treatment of Perfluorooctane Sulfonic Acid (PFOS) using a large-scale sonochemical reactor
  publication-title: Sep. Purif. Technol
– volume: 7
  start-page: 1325
  year: 1995
  end-page: 1336
  ident: b25
  article-title: Translational instability of a bubble undergoing shape oscillations
  publication-title: Phys. Fluids
– year: 2015
  ident: b33
  article-title: Human-level control through deep reinforcement learning
  publication-title: Nature
– volume: 57
  start-page: 4987
  year: 2002
  end-page: 4995
  ident: b41
  article-title: Modelling and experimental investigation into cavity dynamics and cavitational yield: influence of dual frequency ultrasound sources
  publication-title: Chem. Eng. Sci.
– volume: 21
  start-page: 1696
  year: 2014
  end-page: 1706
  ident: b29
  article-title: Generation and control of acoustic cavitation structure
  publication-title: Ultrason. Sonochem.
– volume: 6
  start-page: 418
  year: 1994
  end-page: 420
  ident: b54
  article-title: A note on the history force on a spherical bubble at finite Reynolds number
  publication-title: Phys. Fluids
– volume: 23
  year: 2013
  ident: b16
  article-title: Acousto-fluidic system assisting in-liquid self-assembly of microcomponents
  publication-title: J. Micromech. Microeng.
– volume: 42
  start-page: 2555
  year: 2013
  end-page: 2567
  ident: b2
  article-title: Sonochemical synthesis of nanomaterials
  publication-title: Chem. Soc. Rev.
– volume: 116
  year: 2016
  ident: b15
  article-title: Chladni patterns in a liquid at microscale
  publication-title: Phys. Rev. Lett.
– start-page: 139
  year: 1999
  end-page: 144
  ident: b104
  article-title: Particle approach to structure formation in acoustic cavitation
  publication-title: Sonochemistry and Sonoluminescence
– start-page: 387
  year: 2014
  end-page: 395
  ident: b62
  article-title: Deterministic policy gradient algorithms
  publication-title: International Conference on Machine Learning
– volume: 11
  start-page: 1309
  year: 1999
  end-page: 1317
  ident: b83
  article-title: The effect of viscosity on the spherical stability of oscillating gas bubbles
  publication-title: Phys. Fluids
– volume: 9
  start-page: 122
  year: 2023
  ident: b57
  article-title: Dual-frequency piezoelectric micromachined ultrasound transducer based on polarization switching in ferroelectric thin films
  publication-title: Microsyst. Nanoeng.
– volume: 29
  start-page: 577
  year: 2016
  end-page: 588
  ident: b73
  article-title: Use of hydrodynamic cavitation in (waste)water treatment
  publication-title: Ultrason. Sonochem.
– volume: 73
  year: 2021
  ident: b89
  article-title: Sonochemical conversion of CO
  publication-title: Ultrason. Sonochem.
– volume: 35
  start-page: 431
  year: 2017
  end-page: 439
  ident: b44
  article-title: Combination and simultaneous resonances of gas bubbles oscillating in liquids under dual-frequency acoustic excitation
  publication-title: Ultrason. Sonochem.
– year: 2018
  ident: b36
  article-title: Sim-to-real robot learning from pixels with progressive nets
– volume: 75
  start-page: 954
  year: 1995
  end-page: 957
  ident: b80
  article-title: Bubble shape oscillations and the onset of sonoluminescence
  publication-title: Phys. Rev. Lett.
– start-page: 37
  year: 2018
  end-page: 97
  ident: b1
  publication-title: Acoustic Cavitation and Bubble Dynamics
– volume: 263
  start-page: 521
  year: 2017
  end-page: 529
  ident: b11
  article-title: Particle manipulation using standing acoustic waves in the microchannel at dual-frequency excitation: Effect of power ratio
  publication-title: Sens. Actuators A: Phys.
– year: 2022
  ident: b39
  article-title: Understanding domain randomization for sim-to-real transfer
– volume: 10
  start-page: 4338
  year: 2020
  ident: b59
  article-title: Low-frequency dual-frequency ultrasound-mediated microbubble cavitation for transdermal minoxidil delivery and hair growth enhancement
  publication-title: Sci. Rep.
– volume: 31
  start-page: 610
  year: 2016
  end-page: 625
  ident: b19
  article-title: Positional stability and radial dynamics of sonoluminescent bubbles under bi-harmonic driving: Effect of the high-frequency component and its relative phase
  publication-title: Ultrason. Sonochem.
– volume: 519
  start-page: 27
  year: 2019
  end-page: 37
  ident: b94
  article-title: Sonochemical production of hydrogen: Enhancement by summed harmonics excitation
  publication-title: Chem. Phys.
– year: 2020
  ident: b98
  article-title: Massively parallel GPU-ODE solver (MPGOS)
– year: 2019
  ident: b96
  article-title: Discrete and continuous action representation for practical RL in video games
– volume: 17
  start-page: 1010
  year: 2010
  end-page: 1020
  ident: b71
  article-title: Sonoelectrochemical treatment of water polluted with trichloroacetic acid: From sonovoltammetry to pre-pilot plant scale
  publication-title: Ultrason. Sonoch.
– volume: 62
  start-page: 2158
  year: 2000
  end-page: 2167
  ident: b81
  article-title: Single-bubble sonoluminescence: Shape stability analysis of collapse dynamics in a semianalytical approach
  publication-title: Phys. Rev. E
– volume: 6
  start-page: 25
  year: 1999
  end-page: 29
  ident: b103
  article-title: Acoustic cavitation structures and simulations by a particle model
  publication-title: Ultrason. Sonochem.
– volume: 18
  year: 2006
  ident: b86
  article-title: Translation and oscillation of a bubble under axisymmetric deformation
  publication-title: Phys. Fluids
– volume: 27
  year: 2015
  ident: b85
  article-title: Non-linear shape oscillations of rising drops and bubbles: Experiments and simulations
  publication-title: Phys. Fluids
– volume: 29
  year: 2017
  ident: b88
  article-title: Nonspherical sub-millimeter gas bubble oscillations: Parametric forcing and nonlinear shape mode coupling
  publication-title: Phys. Fluids
– volume: 26
  start-page: 169
  year: 2015
  end-page: 175
  ident: b90
  article-title: Effect of operational conditions on sonoluminescence and kinetics of H
  publication-title: Ultrason. Sonochem.
– year: 2019
  ident: b99
  article-title: MPGOS: GPU Accelerated Integrator for Large Number of Independent Ordinary Differential Equation Systems
– volume: 16
  start-page: 769
  year: 2009
  end-page: 781
  ident: b4
  article-title: Physical insights into the sonochemical degradation of recalcitrant organic pollutants with cavitation bubble dynamics
  publication-title: Ultrason. Sonochem.
– volume: 53
  start-page: 1280
  year: 2013
  end-page: 1287
  ident: b12
  article-title: Varying the agglomeration position of particles in a micro-channel using acoustic radiation force beyond the resonance condition
  publication-title: Ultrasonics
– start-page: 363
  year: 2006
  end-page: 372
  ident: b37
  article-title: Autonomous inverted helicopter flight via reinforcement learning
  publication-title: Experimental Robotics IX
– volume: 66
  start-page: 16
  year: 2015
  end-page: 20
  ident: b45
  article-title: Influences of pressure amplitudes and frequencies of dual-frequency acoustic excitation on the mass transfer across interfaces of gas bubbles
  publication-title: Int. J. Heat Mass Transfer
– volume: 26
  start-page: 817
  year: 2002
  end-page: 826
  ident: b21
  article-title: Study on the bubble motion control by ultrasonic wave
  publication-title: Exp. Therm. Fluid Sci.
– year: 2013
  ident: b32
  article-title: Playing Atari with deep reinforcement learning
– year: 2016
  ident: b34
  article-title: Continuous control with deep reinforcement learning
– volume: 66
  year: 2020
  ident: b76
  article-title: Nonlinear power loss in the oscillations of coated and uncoated bubbles: Role of thermal, radiation and encapsulating shell damping at various excitation pressures
  publication-title: Ultrason. Sonochem.
– volume: 33
  year: 2021
  ident: b79
  article-title: Classification of the major nonlinear regimes of oscillations, oscillation properties, and mechanisms of wave energy dissipation in the nonlinear oscillations of coated and uncoated bubbles
  publication-title: Phys. Fluids
– volume: 77
  year: 2008
  ident: b84
  article-title: Surface-wave instabilities, period doubling, and an approximate universal boundary of bubble stability at the upper threshold of sonoluminescence
  publication-title: Phys. Rev. E
– volume: 8
  start-page: 20597
  year: 2020
  end-page: 20606
  ident: b14
  article-title: Model-free control for dynamic-field acoustic manipulation using reinforcement learning
  publication-title: IEEE Access
– volume: 41
  start-page: 419
  year: 2018
  end-page: 426
  ident: b42
  article-title: Numerical investigation of the inertial cavitation threshold under multi-frequency ultrasound
  publication-title: Ultrason. Sonochem.
– year: 1962
  ident: b50
  article-title: Physicochemical Hydrodynamics
– volume: 102
  start-page: 1522
  year: 1997
  end-page: 1527
  ident: b64
  article-title: Bjerknes force and bubble levitation under single-bubble sonoluminescence conditions
  publication-title: J. Acoust. Soc. Am.
– volume: 15
  start-page: 294
  year: 2008
  end-page: 300
  ident: b9
  article-title: Importance of acoustic shielding in sonochemistry
  publication-title: Ultrason. Sonochem.
– volume: 229
  start-page: 29
  year: 1991
  end-page: 50
  ident: b24
  article-title: Parametric resonance of a spherical bubble
  publication-title: J. Fluid Mech.
– volume: 41
  start-page: 472
  year: 1998
  end-page: 479
  ident: b51
  article-title: Drag coefficients of single bubbles under normal and micro gravity conditions
  publication-title: JSME Int. J. Ser. B
– volume: 117
  start-page: 12549
  year: 2013
  end-page: 12555
  ident: b60
  article-title: Experimental and theoretical studies on the movements of two bubbles in an acoustic standing wave field
  publication-title: J. Phys. Chem. B
– volume: 34
  start-page: 1465
  year: 2008
  end-page: 1473
  ident: b82
  article-title: Nonspherical oscillations of ultrasound contrast agent microbubbles
  publication-title: Ultrasound Med. Biol.
– volume: 21
  year: 2009
  ident: b23
  article-title: History force on coated microbubbles propelled by ultrasound
  publication-title: Phys. Fluids
– volume: 22
  start-page: 59
  year: 2015
  end-page: 69
  ident: b20
  article-title: Stable tridimensional bubble clusters in multi-bubble sonoluminescence (MBSL)
  publication-title: Ultrason. Sonochem.
– volume: 112
  start-page: 1346
  year: 2002
  end-page: 1352
  ident: b53
  article-title: Coupled dynamics of translation and collapse of acoustically driven microbubbles
  publication-title: J. Acoust. Soc. Am.
– volume: 96
  year: 2006
  ident: b56
  article-title: Viscosity destabilizes sonoluminescing bubbles
  publication-title: Phys. Rev. Lett.
– volume: 66
  year: 2020
  ident: 10.1016/j.ultsonch.2025.107290_b76
  article-title: Nonlinear power loss in the oscillations of coated and uncoated bubbles: Role of thermal, radiation and encapsulating shell damping at various excitation pressures
  publication-title: Ultrason. Sonochem.
  doi: 10.1016/j.ultsonch.2020.105070
– year: 2017
  ident: 10.1016/j.ultsonch.2025.107290_b107
– volume: 53
  start-page: 1280
  issue: 7
  year: 2013
  ident: 10.1016/j.ultsonch.2025.107290_b12
  article-title: Varying the agglomeration position of particles in a micro-channel using acoustic radiation force beyond the resonance condition
  publication-title: Ultrasonics
  doi: 10.1016/j.ultras.2013.03.012
– volume: 173
  start-page: 517
  issue: 1
  year: 2010
  ident: 10.1016/j.ultsonch.2025.107290_b6
  article-title: Degradation of p-nitrophenol using acoustic cavitation and Fenton chemistry
  publication-title: J. Hazard. Mater.
  doi: 10.1016/j.jhazmat.2009.08.115
– volume: 40
  start-page: 4056
  issue: 11
  year: 2015
  ident: 10.1016/j.ultsonch.2025.107290_b93
  article-title: Mechanism of the sonochemical production of hydrogen
  publication-title: Int. J. Hydrog. Energy
  doi: 10.1016/j.ijhydene.2015.01.150
– volume: 29
  start-page: 129
  year: 2016
  ident: 10.1016/j.ultsonch.2025.107290_b43
  article-title: The secondary Bjerknes force between two gas bubbles under dual-frequency acoustic excitation
  publication-title: Ultrason. Sonochem.
  doi: 10.1016/j.ultsonch.2015.08.022
– year: 1962
  ident: 10.1016/j.ultsonch.2025.107290_b50
– volume: 11
  start-page: 47
  issue: 2
  year: 2004
  ident: 10.1016/j.ultsonch.2025.107290_b7
  article-title: Using sonochemistry for the fabrication of nanomaterials
  publication-title: Ultrason. Sonochem.
  doi: 10.1016/j.ultsonch.2004.01.037
– volume: 16
  start-page: 769
  issue: 6
  year: 2009
  ident: 10.1016/j.ultsonch.2025.107290_b4
  article-title: Physical insights into the sonochemical degradation of recalcitrant organic pollutants with cavitation bubble dynamics
  publication-title: Ultrason. Sonochem.
  doi: 10.1016/j.ultsonch.2009.02.009
– volume: 9
  start-page: 122
  issue: 1
  year: 2023
  ident: 10.1016/j.ultsonch.2025.107290_b57
  article-title: Dual-frequency piezoelectric micromachined ultrasound transducer based on polarization switching in ferroelectric thin films
  publication-title: Microsyst. Nanoeng.
  doi: 10.1038/s41378-023-00595-z
– volume: 96
  year: 2006
  ident: 10.1016/j.ultsonch.2025.107290_b56
  article-title: Viscosity destabilizes sonoluminescing bubbles
  publication-title: Phys. Rev. Lett.
  doi: 10.1103/PhysRevLett.96.114301
– volume: 56
  start-page: 1041
  issn: 0094-5765
  issue: 9
  year: 2005
  ident: 10.1016/j.ultsonch.2025.107290_b58
  article-title: Dual-frequency ultrasound for detecting and sizing bubbles
  publication-title: Acta Astronaut.
  doi: 10.1016/j.actaastro.2005.01.032
– volume: 15
  year: 2021
  ident: 10.1016/j.ultsonch.2025.107290_b17
  article-title: Controlling the dynamics of cloud cavitation bubbles through acoustic feedback
  publication-title: Phys. Rev. Appl.
  doi: 10.1103/PhysRevApplied.15.034033
– volume: 35
  start-page: 431
  year: 2017
  ident: 10.1016/j.ultsonch.2025.107290_b44
  article-title: Combination and simultaneous resonances of gas bubbles oscillating in liquids under dual-frequency acoustic excitation
  publication-title: Ultrason. Sonochem.
  doi: 10.1016/j.ultsonch.2016.10.022
– year: 2022
  ident: 10.1016/j.ultsonch.2025.107290_b67
– start-page: 171
  year: 2007
  ident: 10.1016/j.ultsonch.2025.107290_b101
  article-title: From a single bubble to bubble structures in acoustic cavitation
– volume: 77
  issue: 6
  year: 2008
  ident: 10.1016/j.ultsonch.2025.107290_b84
  article-title: Surface-wave instabilities, period doubling, and an approximate universal boundary of bubble stability at the upper threshold of sonoluminescence
  publication-title: Phys. Rev. E
  doi: 10.1103/PhysRevE.77.066309
– year: 2022
  ident: 10.1016/j.ultsonch.2025.107290_b39
– volume: 20
  start-page: 1104
  issue: 4
  year: 2013
  ident: 10.1016/j.ultsonch.2025.107290_b72
  article-title: Removal of pharmaceuticals from wastewater by biological processes, hydrodynamic cavitation and UV treatment
  publication-title: Ultrason. Sonochem.
  doi: 10.1016/j.ultsonch.2012.12.003
– volume: 57
  start-page: 1363
  issue: 6
  year: 1975
  ident: 10.1016/j.ultsonch.2025.107290_b49
  article-title: Bjerknes forces on bubbles in a stationary sound field
  publication-title: J. Acoust. Soc. Am.
  doi: 10.1121/1.380614
– volume: 73
  year: 2021
  ident: 10.1016/j.ultsonch.2025.107290_b89
  article-title: Sonochemical conversion of CO2 into hydrocarbons: The sabatier reaction at ambient conditions
  publication-title: Ultrason. Sonochem.
  doi: 10.1016/j.ultsonch.2021.105474
– volume: 29
  issue: 12
  year: 2017
  ident: 10.1016/j.ultsonch.2025.107290_b88
  article-title: Nonspherical sub-millimeter gas bubble oscillations: Parametric forcing and nonlinear shape mode coupling
  publication-title: Phys. Fluids
  doi: 10.1063/1.5005599
– volume: 2
  start-page: 63
  issue: 1
  year: 2023
  ident: 10.1016/j.ultsonch.2025.107290_b22
  article-title: Coated microbubbles swim via shell buckling
  publication-title: Commun. Eng.
  doi: 10.1038/s44172-023-00113-z
– volume: 72
  year: 2021
  ident: 10.1016/j.ultsonch.2025.107290_b78
  article-title: Nonlinear dynamics and bifurcation structure of ultrasonically excited lipid coated microbubbles
  publication-title: Ultrason. Sonochem.
  doi: 10.1016/j.ultsonch.2020.105405
– volume: 116
  year: 2016
  ident: 10.1016/j.ultsonch.2025.107290_b15
  article-title: Chladni patterns in a liquid at microscale
  publication-title: Phys. Rev. Lett.
  doi: 10.1103/PhysRevLett.116.184501
– volume: 10
  start-page: 4338
  issue: 1
  year: 2020
  ident: 10.1016/j.ultsonch.2025.107290_b59
  article-title: Low-frequency dual-frequency ultrasound-mediated microbubble cavitation for transdermal minoxidil delivery and hair growth enhancement
  publication-title: Sci. Rep.
  doi: 10.1038/s41598-020-61328-0
– volume: 117
  start-page: 12549
  issue: 41
  year: 2013
  ident: 10.1016/j.ultsonch.2025.107290_b60
  article-title: Experimental and theoretical studies on the movements of two bubbles in an acoustic standing wave field
  publication-title: J. Phys. Chem. B
  doi: 10.1021/jp404886h
– volume: 29
  start-page: 577
  year: 2016
  ident: 10.1016/j.ultsonch.2025.107290_b73
  article-title: Use of hydrodynamic cavitation in (waste)water treatment
  publication-title: Ultrason. Sonochem.
  doi: 10.1016/j.ultsonch.2015.10.010
– volume: 10
  start-page: 550
  issue: 3
  year: 1998
  ident: 10.1016/j.ultsonch.2025.107290_b52
  article-title: The viscous drag force on a spherical bubble with a time-dependent radius
  publication-title: Phys. Fluids
  doi: 10.1063/1.869582
– volume: 119
  start-page: 15885
  issue: 52
  year: 2015
  ident: 10.1016/j.ultsonch.2025.107290_b91
  article-title: Spectroscopy of sonoluminescence and sonochemistry in water saturated with N2–Ar mixtures
  publication-title: J. Phys. Chem. B
  doi: 10.1021/acs.jpcb.5b10221
– volume: 155
  start-page: 26
  issue: 1
  year: 2009
  ident: 10.1016/j.ultsonch.2025.107290_b8
  article-title: Design aspects of sonochemical reactors: Techniques for understanding cavitational activity distribution and effect of operating parameters
  publication-title: Chem. Eng. J.
  doi: 10.1016/j.cej.2009.07.021
– volume: 59
  year: 2019
  ident: 10.1016/j.ultsonch.2025.107290_b68
  article-title: Recent developments in the sonoelectrochemical synthesis of nanomaterials
  publication-title: Ultrason. Sonochem.
– volume: 26
  start-page: 169
  year: 2015
  ident: 10.1016/j.ultsonch.2025.107290_b90
  article-title: Effect of operational conditions on sonoluminescence and kinetics of H2O2 formation during the sonolysis of water in the presence of Ar/O2 gas mixture
  publication-title: Ultrason. Sonochem.
  doi: 10.1016/j.ultsonch.2015.02.005
– volume: 70
  start-page: 1330
  issue: 10
  year: 2009
  ident: 10.1016/j.ultsonch.2025.107290_b27
  article-title: Translational instability of a spherical bubble in a standing ultrasound wave
  publication-title: Appl. Acoust.
  doi: 10.1016/j.apacoust.2008.09.016
– volume: 82
  issue: 2
  year: 2010
  ident: 10.1016/j.ultsonch.2025.107290_b28
  article-title: Microbubble shape oscillations excited through ultrasonic parametric driving
  publication-title: Phys. Rev. E
  doi: 10.1103/PhysRevE.82.026321
– volume: 15
  start-page: 294
  issue: 4
  year: 2008
  ident: 10.1016/j.ultsonch.2025.107290_b9
  article-title: Importance of acoustic shielding in sonochemistry
  publication-title: Ultrason. Sonochem.
  doi: 10.1016/j.ultsonch.2007.09.015
– year: 2013
  ident: 10.1016/j.ultsonch.2025.107290_b32
– volume: 55
  start-page: 3747
  year: 1997
  ident: 10.1016/j.ultsonch.2025.107290_b65
  article-title: Bjerknes force threshold for stable single bubble sonoluminescence
  publication-title: Phys. Rev. E
  doi: 10.1103/PhysRevE.55.3747
– volume: vol. 2
  start-page: 1475
  year: 2003
  ident: 10.1016/j.ultsonch.2025.107290_b105
  article-title: Simulation of the translational motion of few cavitation bubbles in an ultrasonic field
– year: 2018
  ident: 10.1016/j.ultsonch.2025.107290_b36
– volume: 57
  start-page: 4987
  issue: 22
  year: 2002
  ident: 10.1016/j.ultsonch.2025.107290_b41
  article-title: Modelling and experimental investigation into cavity dynamics and cavitational yield: influence of dual frequency ultrasound sources
  publication-title: Chem. Eng. Sci.
  doi: 10.1016/S0009-2509(02)00271-3
– year: 2020
  ident: 10.1016/j.ultsonch.2025.107290_b98
– volume: 21
  issue: 2
  year: 2009
  ident: 10.1016/j.ultsonch.2025.107290_b87
  article-title: The stability of a bubble in a weakly viscous liquid subject to an acoustic traveling wave
  publication-title: Phys. Fluids
  doi: 10.1063/1.3076932
– start-page: 363
  year: 2006
  ident: 10.1016/j.ultsonch.2025.107290_b37
  article-title: Autonomous inverted helicopter flight via reinforcement learning
– start-page: 3803
  year: 2018
  ident: 10.1016/j.ultsonch.2025.107290_b38
  article-title: Sim-to-real transfer of robotic control with dynamics randomization
– year: 2019
  ident: 10.1016/j.ultsonch.2025.107290_b96
– volume: 7
  start-page: 1325
  issue: 6
  year: 1995
  ident: 10.1016/j.ultsonch.2025.107290_b25
  article-title: Translational instability of a bubble undergoing shape oscillations
  publication-title: Phys. Fluids
  doi: 10.1063/1.868520
– volume: 501
  start-page: 1
  year: 2004
  ident: 10.1016/j.ultsonch.2025.107290_b26
  article-title: Translational motion of a bubble undergoing shape oscillations
  publication-title: J. Fluid Mech.
  doi: 10.1017/S0022112003006220
– year: 2018
  ident: 10.1016/j.ultsonch.2025.107290_b40
– volume: 33
  issue: 1
  year: 2021
  ident: 10.1016/j.ultsonch.2025.107290_b79
  article-title: Classification of the major nonlinear regimes of oscillations, oscillation properties, and mechanisms of wave energy dissipation in the nonlinear oscillations of coated and uncoated bubbles
  publication-title: Phys. Fluids
  doi: 10.1063/5.0032766
– volume: 34
  start-page: 1465
  issue: 9
  year: 2008
  ident: 10.1016/j.ultsonch.2025.107290_b82
  article-title: Nonspherical oscillations of ultrasound contrast agent microbubbles
  publication-title: Ultrasound Med. Biol.
  doi: 10.1016/j.ultrasmedbio.2008.01.020
– volume: 41
  start-page: 187
  issue: 1
  year: 2015
  ident: 10.1016/j.ultsonch.2025.107290_b74
  article-title: Shaken and stirred: Mechanisms of ultrasound-enhanced thrombolysis
  publication-title: Ultrasound Med. Biol.
  doi: 10.1016/j.ultrasmedbio.2014.08.018
– volume: 6
  start-page: 25
  issue: 1
  year: 1999
  ident: 10.1016/j.ultsonch.2025.107290_b103
  article-title: Acoustic cavitation structures and simulations by a particle model
  publication-title: Ultrason. Sonochem.
  doi: 10.1016/S1350-4177(98)00025-X
– volume: 14
  start-page: 1420
  issue: 4
  year: 2002
  ident: 10.1016/j.ultsonch.2025.107290_b46
  article-title: Translational motion of a spherical bubble in an acoustic standing wave of high intensity
  publication-title: Phys. Fluids
  doi: 10.1063/1.1458597
– volume: 92
  year: 2023
  ident: 10.1016/j.ultsonch.2025.107290_b61
  article-title: Numerical investigation of the translational motion of bubbles: The comparison of capabilities of the time-resolved and the time-averaged methods
  publication-title: Ultrason. Sonochem.
  doi: 10.1016/j.ultsonch.2022.106253
– volume: 18
  start-page: 92
  issue: 1
  year: 2011
  ident: 10.1016/j.ultsonch.2025.107290_b18
  article-title: Development and optimization of acoustic bubble structures at high frequencies
  publication-title: Ultrason. Sonochem.
  doi: 10.1016/j.ultsonch.2010.03.004
– volume: 116
  start-page: 821
  issue: 2
  year: 2004
  ident: 10.1016/j.ultsonch.2025.107290_b100
  article-title: Mathematical model for collective bubble dynamics in strong ultrasound fields
  publication-title: J. Acoust. Soc. Am.
  doi: 10.1121/1.1768255
– volume: 2
  start-page: 28
  issue: 1
  year: 2010
  ident: 10.1016/j.ultsonch.2025.107290_b70
  article-title: Sonochemical treatment of water polluted by chlorinated organocompounds. A review
  publication-title: Water
  doi: 10.3390/w2010028
– volume: 11
  start-page: 1309
  issue: 6
  year: 1999
  ident: 10.1016/j.ultsonch.2025.107290_b83
  article-title: The effect of viscosity on the spherical stability of oscillating gas bubbles
  publication-title: Phys. Fluids
  doi: 10.1063/1.869996
– volume: 149
  start-page: 57
  issue: 1
  year: 2009
  ident: 10.1016/j.ultsonch.2025.107290_b3
  article-title: Mechanistic approach to intensification of sonochemical degradation of phenol
  publication-title: Chem. Eng. J.
  doi: 10.1016/j.cej.2008.10.004
– volume: 78
  issue: 3
  year: 2008
  ident: 10.1016/j.ultsonch.2025.107290_b66
  article-title: Analytical expressions for primary Bjerknes force on inertial cavitation bubbles
  publication-title: Phys. Rev. E
  doi: 10.1103/PhysRevE.78.036322
– volume: 6
  start-page: 418
  issue: 1
  year: 1994
  ident: 10.1016/j.ultsonch.2025.107290_b54
  article-title: A note on the history force on a spherical bubble at finite Reynolds number
  publication-title: Phys. Fluids
  doi: 10.1063/1.868039
– volume: 95
  year: 2023
  ident: 10.1016/j.ultsonch.2025.107290_b10
  article-title: Probing the pressure dependence of sound speed and attenuation in bubbly media: Experimental observations, a theoretical model and numerical calculations
  publication-title: Ultrason. Sonochem.
  doi: 10.1016/j.ultsonch.2023.106319
– year: 2022
  ident: 10.1016/j.ultsonch.2025.107290_b35
– volume: 263
  start-page: 521
  year: 2017
  ident: 10.1016/j.ultsonch.2025.107290_b11
  article-title: Particle manipulation using standing acoustic waves in the microchannel at dual-frequency excitation: Effect of power ratio
  publication-title: Sens. Actuators A: Phys.
  doi: 10.1016/j.sna.2017.07.023
– volume: 56
  start-page: 2924
  issue: 3
  year: 1997
  ident: 10.1016/j.ultsonch.2025.107290_b63
  article-title: Bjerknes forces between small cavitation bubbles in a strong acoustic field
  publication-title: Phys. Rev. E
  doi: 10.1103/PhysRevE.56.2924
– volume: 27
  issue: 12
  year: 2015
  ident: 10.1016/j.ultsonch.2025.107290_b85
  article-title: Non-linear shape oscillations of rising drops and bubbles: Experiments and simulations
  publication-title: Phys. Fluids
  doi: 10.1063/1.4936980
– volume: 17
  start-page: 1010
  issue: 6
  year: 2010
  ident: 10.1016/j.ultsonch.2025.107290_b71
  article-title: Sonoelectrochemical treatment of water polluted with trichloroacetic acid: From sonovoltammetry to pre-pilot plant scale
  publication-title: Ultrason. Sonoch.
  doi: 10.1016/j.ultsonch.2009.11.009
– volume: 75
  start-page: 954
  issue: 5
  year: 1995
  ident: 10.1016/j.ultsonch.2025.107290_b80
  article-title: Bubble shape oscillations and the onset of sonoluminescence
  publication-title: Phys. Rev. Lett.
  doi: 10.1103/PhysRevLett.75.954
– volume: 41
  start-page: 419
  year: 2018
  ident: 10.1016/j.ultsonch.2025.107290_b42
  article-title: Numerical investigation of the inertial cavitation threshold under multi-frequency ultrasound
  publication-title: Ultrason. Sonochem.
  doi: 10.1016/j.ultsonch.2017.10.004
– volume: 112
  start-page: 1346
  issue: 4
  year: 2002
  ident: 10.1016/j.ultsonch.2025.107290_b53
  article-title: Coupled dynamics of translation and collapse of acoustically driven microbubbles
  publication-title: J. Acoust. Soc. Am.
  doi: 10.1121/1.1502899
– volume: 102
  start-page: 1522
  issue: 3
  year: 1997
  ident: 10.1016/j.ultsonch.2025.107290_b64
  article-title: Bjerknes force and bubble levitation under single-bubble sonoluminescence conditions
  publication-title: J. Acoust. Soc. Am.
  doi: 10.1121/1.420065
– volume: 44
  start-page: 14500
  issue: 29
  year: 2019
  ident: 10.1016/j.ultsonch.2025.107290_b69
  article-title: The Sono-Hydro-Gen process (Ultrasound induced hydrogen production): Challenges and opportunities
  publication-title: Int. J. Hydrog. Energy
  doi: 10.1016/j.ijhydene.2019.04.115
– volume: 8
  start-page: 20597
  year: 2020
  ident: 10.1016/j.ultsonch.2025.107290_b14
  article-title: Model-free control for dynamic-field acoustic manipulation using reinforcement learning
  publication-title: IEEE Access
  doi: 10.1109/ACCESS.2020.2969277
– volume: 18
  issue: 7
  year: 2006
  ident: 10.1016/j.ultsonch.2025.107290_b86
  article-title: Translation and oscillation of a bubble under axisymmetric deformation
  publication-title: Phys. Fluids
  doi: 10.1063/1.2227047
– volume: 68
  start-page: 628
  issue: 2
  year: 1980
  ident: 10.1016/j.ultsonch.2025.107290_b47
  article-title: Bubble oscillations of large amplitude
  publication-title: J. Acoust. Soc. Am.
  doi: 10.1121/1.384720
– volume: 103
  issue: 5
  year: 2013
  ident: 10.1016/j.ultsonch.2025.107290_b75
  article-title: Interactions between ultrasound stimulated microbubbles and fibrin clots
  publication-title: Appl. Phys. Lett.
  doi: 10.1063/1.4816750
– year: 2016
  ident: 10.1016/j.ultsonch.2025.107290_b34
– volume: 22
  start-page: 59
  year: 2015
  ident: 10.1016/j.ultsonch.2025.107290_b20
  article-title: Stable tridimensional bubble clusters in multi-bubble sonoluminescence (MBSL)
  publication-title: Ultrason. Sonochem.
  doi: 10.1016/j.ultsonch.2014.06.003
– volume: 66
  year: 2020
  ident: 10.1016/j.ultsonch.2025.107290_b77
  article-title: Critical corrections to models of nonlinear power dissipation of ultrasonically excited bubbles
  publication-title: Ultrason. Sonochem.
  doi: 10.1016/j.ultsonch.2020.105089
– start-page: 387
  year: 2014
  ident: 10.1016/j.ultsonch.2025.107290_b62
  article-title: Deterministic policy gradient algorithms
– year: 2015
  ident: 10.1016/j.ultsonch.2025.107290_b33
  article-title: Human-level control through deep reinforcement learning
  publication-title: Nature
  doi: 10.1038/nature14236
– year: 2019
  ident: 10.1016/j.ultsonch.2025.107290_b97
– year: 2003
  ident: 10.1016/j.ultsonch.2025.107290_b31
– volume: 23
  issue: 12
  year: 2013
  ident: 10.1016/j.ultsonch.2025.107290_b16
  article-title: Acousto-fluidic system assisting in-liquid self-assembly of microcomponents
  publication-title: J. Micromech. Microeng.
  doi: 10.1088/0960-1317/23/12/125026
– volume: 66
  start-page: 16
  year: 2015
  ident: 10.1016/j.ultsonch.2025.107290_b45
  article-title: Influences of pressure amplitudes and frequencies of dual-frequency acoustic excitation on the mass transfer across interfaces of gas bubbles
  publication-title: Int. J. Heat Mass Transfer
– year: 2015
  ident: 10.1016/j.ultsonch.2025.107290_b95
– volume: 21
  start-page: 1696
  issue: 5
  year: 2014
  ident: 10.1016/j.ultsonch.2025.107290_b29
  article-title: Generation and control of acoustic cavitation structure
  publication-title: Ultrason. Sonochem.
  doi: 10.1016/j.ultsonch.2014.02.027
– volume: 32
  start-page: 659
  issue: 2000
  year: 2000
  ident: 10.1016/j.ultsonch.2025.107290_b55
  article-title: The motion of high-Reynolds-number bubbles in inhomogeneous flows
  publication-title: Annu. Rev. Fluid Mech.
  doi: 10.1146/annurev.fluid.32.1.659
– start-page: 139
  year: 1999
  ident: 10.1016/j.ultsonch.2025.107290_b104
  article-title: Particle approach to structure formation in acoustic cavitation
– volume: 194
  start-page: 104
  year: 2018
  ident: 10.1016/j.ultsonch.2025.107290_b5
  article-title: Treatment of Perfluorooctane Sulfonic Acid (PFOS) using a large-scale sonochemical reactor
  publication-title: Sep. Purif. Technol
  doi: 10.1016/j.seppur.2017.11.009
– volume: 229
  start-page: 29
  year: 1991
  ident: 10.1016/j.ultsonch.2025.107290_b24
  article-title: Parametric resonance of a spherical bubble
  publication-title: J. Fluid Mech.
  doi: 10.1017/S0022112091002926
– start-page: 37
  year: 2018
  ident: 10.1016/j.ultsonch.2025.107290_b1
– year: 2018
  ident: 10.1016/j.ultsonch.2025.107290_b30
– volume: 41
  start-page: 472
  issue: 2
  year: 1998
  ident: 10.1016/j.ultsonch.2025.107290_b51
  article-title: Drag coefficients of single bubbles under normal and micro gravity conditions
  publication-title: JSME Int. J. Ser. B
  doi: 10.1299/jsmeb.41.472
– volume: 42
  start-page: 2555
  issue: 7
  year: 2013
  ident: 10.1016/j.ultsonch.2025.107290_b2
  article-title: Sonochemical synthesis of nanomaterials
  publication-title: Chem. Soc. Rev.
  doi: 10.1039/C2CS35282F
– volume: 21
  issue: 9
  year: 2009
  ident: 10.1016/j.ultsonch.2025.107290_b23
  article-title: History force on coated microbubbles propelled by ultrasound
  publication-title: Phys. Fluids
  doi: 10.1063/1.3227903
– volume: 51
  start-page: 533
  year: 2019
  ident: 10.1016/j.ultsonch.2025.107290_b92
  article-title: Sonochemical and sonoelectrochemical production of hydrogen
  publication-title: Ultrason. Sonochem.
  doi: 10.1016/j.ultsonch.2018.08.024
– start-page: 1
  year: 2005
  ident: 10.1016/j.ultsonch.2025.107290_b102
  article-title: Bubble structures in acoustic cavitation
– volume: 62
  start-page: 2158
  issue: 2
  year: 2000
  ident: 10.1016/j.ultsonch.2025.107290_b81
  article-title: Single-bubble sonoluminescence: Shape stability analysis of collapse dynamics in a semianalytical approach
  publication-title: Phys. Rev. E
  doi: 10.1103/PhysRevE.62.2158
– volume: 661
  start-page: 95
  year: 2005
  ident: 10.1016/j.ultsonch.2025.107290_b48
  article-title: Bjerknes forces and translational bubble dynamics
  publication-title: Bubble Part. Dyn. Acoust. Fields: Mod. Trends Appl.
– volume: 26
  start-page: 817
  issue: 6
  year: 2002
  ident: 10.1016/j.ultsonch.2025.107290_b21
  article-title: Study on the bubble motion control by ultrasonic wave
  publication-title: Exp. Therm. Fluid Sci.
  doi: 10.1016/S0894-1777(02)00197-8
– volume: 519
  start-page: 27
  year: 2019
  ident: 10.1016/j.ultsonch.2025.107290_b94
  article-title: Sonochemical production of hydrogen: Enhancement by summed harmonics excitation
  publication-title: Chem. Phys.
  doi: 10.1016/j.chemphys.2018.11.019
– volume: 31
  start-page: 610
  year: 2016
  ident: 10.1016/j.ultsonch.2025.107290_b19
  article-title: Positional stability and radial dynamics of sonoluminescent bubbles under bi-harmonic driving: Effect of the high-frequency component and its relative phase
  publication-title: Ultrason. Sonochem.
  doi: 10.1016/j.ultsonch.2016.02.013
– year: 2019
  ident: 10.1016/j.ultsonch.2025.107290_b99
– year: 2017
  ident: 10.1016/j.ultsonch.2025.107290_b106
– volume: 490
  year: 2021
  ident: 10.1016/j.ultsonch.2025.107290_b13
  article-title: Dynamic acoustic fields for size selective particle separation on centimeter scale
  publication-title: J. Sound Vib.
  doi: 10.1016/j.jsv.2020.115723
SSID ssj0003920
Score 2.4605021
Snippet Reinforcement Learning (RL) is employed to develop control techniques for manipulating acoustic cavitation bubbles. This paper presents a proof of concept in...
SourceID doaj
pubmedcentral
proquest
pubmed
crossref
elsevier
SourceType Open Website
Open Access Repository
Aggregation Database
Index Database
Enrichment Source
Publisher
StartPage 107290
SubjectTerms Bubble dynamics
Bubble position control
GPU programming
Reinforcement learning
Selected Papers from EES 2024
Title Position control of an acoustic cavitation bubble by reinforcement learning
URI https://dx.doi.org/10.1016/j.ultsonch.2025.107290
https://www.ncbi.nlm.nih.gov/pubmed/40058020
https://www.proquest.com/docview/3175680292
https://pubmed.ncbi.nlm.nih.gov/PMC11930750
https://doaj.org/article/798cbdec0c2346fa86003e89489f9d74
Volume 115
WOSCitedRecordID wos001443083400001&url=https%3A%2F%2Fcvtisr.summon.serialssolutions.com%2F%23%21%2Fsearch%3Fho%3Df%26include.ft.matches%3Dt%26l%3Dnull%26q%3D
hasFullText 1
inHoldings 1
isFullTextHit
isPrint
journalDatabaseRights – providerCode: PRVAON
  databaseName: DOAJ Directory of Open Access Journals
  customDbUrl:
  eissn: 1873-2828
  dateEnd: 99991231
  omitProxy: false
  ssIdentifier: ssj0003920
  issn: 1350-4177
  databaseCode: DOA
  dateStart: 20210101
  isFulltext: true
  titleUrlDefault: https://www.doaj.org/
  providerName: Directory of Open Access Journals
– providerCode: PRVESC
  databaseName: Elsevier SD Freedom Collection Journals 2021
  customDbUrl:
  eissn: 1873-2828
  dateEnd: 99991231
  omitProxy: false
  ssIdentifier: ssj0003920
  issn: 1350-4177
  databaseCode: AIEXJ
  dateStart: 20210101
  isFulltext: true
  titleUrlDefault: https://www.sciencedirect.com
  providerName: Elsevier
link http://cvtisr.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwrV3LbtQwFL2CCkQ3CMorLVRGYhuaxE5sL2lFhQSqugBpdpZfgalGaTWdqdS_7_UjowksZsPWecjOufY9Tm7OAfjUe9FZE7apCEHJJDWlCBKuTU17almPGSy6lvzgFxdiNpOXW1ZfoSYsyQOnB3fCpbDGeVvZhrKu1wIzNPVCMiF76XhUAq24HDdTeQ3GrJ_-D26xAzXnW_8GX31eL1bIZeOniKbFRuSX1SQtRfX-SXb6l33-XUS5lZXOX8DzTCfJlzSMl_DIDwfw7Gx0cTuAp7HE096-gu-XuT6L5PJ0ct0TPRBcEqOjF7H6Lgt2E7M2ZuGJuSdLH6VVbXyLSLLHxO_X8Ov868-zb2W2UigtrmirkjaGasG0wO1Vo-tWa4oYVY3uDDcdpX1nffCgqZ3tfNdL63Bf6VuPhMI2Vlb0DewN14N_B8RJypipuddVzySjunOaWVdr7p10VVtAOz5JZXO3g93FQo0FZVdqREAFBFRCoICTzXU3SWlj5xWnAajN2UEpOzZg_KgcP2pX_BQgR5hVJh2JTOCt5js78HGMC4Wwhk8tevAImgqsrBNVI5sC3qY42XSTBStHnBoFiEkETcYxPTLM_0Tl7xrpduB4h_9j5EewH8aSypDew95qufYf4Im9W81vl8fwmM_EcZxVD7g5JZ0
linkProvider Directory of Open Access Journals
openUrl ctx_ver=Z39.88-2004&ctx_enc=info%3Aofi%2Fenc%3AUTF-8&rfr_id=info%3Asid%2Fsummon.serialssolutions.com&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=Position+control+of+an+acoustic+cavitation+bubble+by+reinforcement+learning&rft.jtitle=Ultrasonics+sonochemistry&rft.au=Klapcsik%2C+K%C3%A1lm%C3%A1n&rft.au=Gyires-T%C3%B3th%2C+B%C3%A1lint&rft.au=Rossell%C3%B3%2C+Juan+Manuel&rft.au=Heged%C5%B1s%2C+Ferenc&rft.date=2025-04-01&rft.pub=Elsevier+B.V&rft.issn=1350-4177&rft.volume=115&rft_id=info:doi/10.1016%2Fj.ultsonch.2025.107290&rft.externalDocID=S1350417725000690
thumbnail_l http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/lc.gif&issn=1350-4177&client=summon
thumbnail_m http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/mc.gif&issn=1350-4177&client=summon
thumbnail_s http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/sc.gif&issn=1350-4177&client=summon