Position control of an acoustic cavitation bubble by reinforcement learning
Reinforcement Learning (RL) is employed to develop control techniques for manipulating acoustic cavitation bubbles. This paper presents a proof of concept in which an RL agent is trained to discover a policy that allows precise control of bubble positions within a dual-frequency standing acoustic wa...
Uloženo v:
| Vydáno v: | Ultrasonics sonochemistry Ročník 115; s. 107290 |
|---|---|
| Hlavní autoři: | , , , |
| Médium: | Journal Article |
| Jazyk: | angličtina |
| Vydáno: |
Netherlands
Elsevier B.V
01.04.2025
Elsevier |
| Témata: | |
| ISSN: | 1350-4177, 1873-2828, 1873-2828 |
| On-line přístup: | Získat plný text |
| Tagy: |
Přidat tag
Žádné tagy, Buďte první, kdo vytvoří štítek k tomuto záznamu!
|
| Abstract | Reinforcement Learning (RL) is employed to develop control techniques for manipulating acoustic cavitation bubbles. This paper presents a proof of concept in which an RL agent is trained to discover a policy that allows precise control of bubble positions within a dual-frequency standing acoustic wave field by adjusting the pressure amplitude values. The agent is rewarded for driving the bubble to a target position in the shortest possible time. The results demonstrate that the agent exploits the nonlinear behaviour of the bubble and, in specific cases, identifies solutions that cannot be addressed using the linear theory of the primary Bjerknes force. The RL agent performs well under domain randomization, indicating that the RL approach generalizes effectively and produces models robust against noise, which could arise in real-world applications. |
|---|---|
| AbstractList | Reinforcement Learning (RL) is employed to develop control techniques for manipulating acoustic cavitation bubbles. This paper presents a proof of concept in which an RL agent is trained to discover a policy that allows precise control of bubble positions within a dual-frequency standing acoustic wave field by adjusting the pressure amplitude values. The agent is rewarded for driving the bubble to a target position in the shortest possible time. The results demonstrate that the agent exploits the nonlinear behaviour of the bubble and, in specific cases, identifies solutions that cannot be addressed using the linear theory of the primary Bjerknes force. The RL agent performs well under domain randomization, indicating that the RL approach generalizes effectively and produces models robust against noise, which could arise in real-world applications. Reinforcement Learning (RL) is employed to develop control techniques for manipulating acoustic cavitation bubbles. This paper presents a proof of concept in which an RL agent is trained to discover a policy that allows precise control of bubble positions within a dual-frequency standing acoustic wave field by adjusting the pressure amplitude values. The agent is rewarded for driving the bubble to a target position in the shortest possible time. The results demonstrate that the agent exploits the nonlinear behaviour of the bubble and, in specific cases, identifies solutions that cannot be addressed using the linear theory of the primary Bjerknes force. The RL agent performs well under domain randomization, indicating that the RL approach generalizes effectively and produces models robust against noise, which could arise in real-world applications.Reinforcement Learning (RL) is employed to develop control techniques for manipulating acoustic cavitation bubbles. This paper presents a proof of concept in which an RL agent is trained to discover a policy that allows precise control of bubble positions within a dual-frequency standing acoustic wave field by adjusting the pressure amplitude values. The agent is rewarded for driving the bubble to a target position in the shortest possible time. The results demonstrate that the agent exploits the nonlinear behaviour of the bubble and, in specific cases, identifies solutions that cannot be addressed using the linear theory of the primary Bjerknes force. The RL agent performs well under domain randomization, indicating that the RL approach generalizes effectively and produces models robust against noise, which could arise in real-world applications. |
| ArticleNumber | 107290 |
| Author | Gyires-Tóth, Bálint Hegedűs, Ferenc Klapcsik, Kálmán Rosselló, Juan Manuel |
| Author_xml | – sequence: 1 givenname: Kálmán orcidid: 0000-0002-8928-5473 surname: Klapcsik fullname: Klapcsik, Kálmán email: kklapcsik@hds.bme.hu organization: Department of Hydrodynamic Systems, Faculty of Mechanical Engineering, Budapest University of Technology and Economics, Mű,egyetem rkp. 3., H-1111 Budapest, Hungary – sequence: 2 givenname: Bálint orcidid: 0000-0003-1059-9822 surname: Gyires-Tóth fullname: Gyires-Tóth, Bálint email: toth.b@tmit.bme.hu organization: Department of Telecommunications and Media Informatics, Faculty of Electrical Engineering and Informatics, Budapest University of Technology and Economics, Mű,egyetem rkp. 3., H-1111 Budapest, Hungary – sequence: 3 givenname: Juan Manuel orcidid: 0000-0001-7005-9452 surname: Rosselló fullname: Rosselló, Juan Manuel email: jrossello.research@gmail.com organization: Faculty of Mechanical Engineering, University of Ljubljana, Aškerčeva 6, 1000 Ljubljana, Slovenia – sequence: 4 givenname: Ferenc orcidid: 0000-0002-8693-1660 surname: Hegedűs fullname: Hegedűs, Ferenc email: fhegedus@hds.bme.hu organization: Department of Hydrodynamic Systems, Faculty of Mechanical Engineering, Budapest University of Technology and Economics, Mű,egyetem rkp. 3., H-1111 Budapest, Hungary |
| BackLink | https://www.ncbi.nlm.nih.gov/pubmed/40058020$$D View this record in MEDLINE/PubMed |
| BookMark | eNqFUctu1DAUjVARfcAvVFmyyeBH4oeEBKjiUVEJFrC2nJubqUceu9jJSP37epoZRNl0Zev6PK7POa9OQgxYVZeUrCih4t1mNfspxwC3K0ZYV4aSafKiOqNK8oYppk7KnXekaamUp9V5zhtCCNeMvKpOW0I6RRg5q77_jNlNLoYaYphS9HUcaxtqC3HOk4Ma7M5N9hHRz33vse7v64QujDEBbjFMtUebggvr19XL0fqMbw7nRfX7y-dfV9-amx9fr68-3TTQcTU1nPXcqtYqpTWztLOWKwGEWdHLXnA-CkBKJaEDCBSjhqElDDsksgMGmvCL6nrRHaLdmLvktjbdm2ideRzEtDY2ld09GqkV9AMCAcZbMVolSgaodKv0qAfZFq0Pi9bd3G9xgPKfZP0T0acvwd2addwZSjUvG-23eXtQSPHPjHkyW5cBvbcBS4aGU9mJErZmBXr5r9lfl2MdBfB-AUCKOSccDRzCL97OG0rMvn2zMcf2zb59s7Rf6OI_-tHhWeLHhYiltp3DZDI4DICDSwhTydU9J_EAO4POiw |
| CitedBy_id | crossref_primary_10_1063_5_0273479 crossref_primary_10_1002_dac_70250 crossref_primary_10_1016_j_ultsonch_2025_107349 |
| Cites_doi | 10.1016/j.ultsonch.2020.105070 10.1016/j.ultras.2013.03.012 10.1016/j.jhazmat.2009.08.115 10.1016/j.ijhydene.2015.01.150 10.1016/j.ultsonch.2015.08.022 10.1016/j.ultsonch.2004.01.037 10.1016/j.ultsonch.2009.02.009 10.1038/s41378-023-00595-z 10.1103/PhysRevLett.96.114301 10.1016/j.actaastro.2005.01.032 10.1103/PhysRevApplied.15.034033 10.1016/j.ultsonch.2016.10.022 10.1103/PhysRevE.77.066309 10.1016/j.ultsonch.2012.12.003 10.1121/1.380614 10.1016/j.ultsonch.2021.105474 10.1063/1.5005599 10.1038/s44172-023-00113-z 10.1016/j.ultsonch.2020.105405 10.1103/PhysRevLett.116.184501 10.1038/s41598-020-61328-0 10.1021/jp404886h 10.1016/j.ultsonch.2015.10.010 10.1063/1.869582 10.1021/acs.jpcb.5b10221 10.1016/j.cej.2009.07.021 10.1016/j.ultsonch.2015.02.005 10.1016/j.apacoust.2008.09.016 10.1103/PhysRevE.82.026321 10.1016/j.ultsonch.2007.09.015 10.1103/PhysRevE.55.3747 10.1016/S0009-2509(02)00271-3 10.1063/1.3076932 10.1063/1.868520 10.1017/S0022112003006220 10.1063/5.0032766 10.1016/j.ultrasmedbio.2008.01.020 10.1016/j.ultrasmedbio.2014.08.018 10.1016/S1350-4177(98)00025-X 10.1063/1.1458597 10.1016/j.ultsonch.2022.106253 10.1016/j.ultsonch.2010.03.004 10.1121/1.1768255 10.3390/w2010028 10.1063/1.869996 10.1016/j.cej.2008.10.004 10.1103/PhysRevE.78.036322 10.1063/1.868039 10.1016/j.ultsonch.2023.106319 10.1016/j.sna.2017.07.023 10.1103/PhysRevE.56.2924 10.1063/1.4936980 10.1016/j.ultsonch.2009.11.009 10.1103/PhysRevLett.75.954 10.1016/j.ultsonch.2017.10.004 10.1121/1.1502899 10.1121/1.420065 10.1016/j.ijhydene.2019.04.115 10.1109/ACCESS.2020.2969277 10.1063/1.2227047 10.1121/1.384720 10.1063/1.4816750 10.1016/j.ultsonch.2014.06.003 10.1016/j.ultsonch.2020.105089 10.1038/nature14236 10.1088/0960-1317/23/12/125026 10.1016/j.ultsonch.2014.02.027 10.1146/annurev.fluid.32.1.659 10.1016/j.seppur.2017.11.009 10.1017/S0022112091002926 10.1299/jsmeb.41.472 10.1039/C2CS35282F 10.1063/1.3227903 10.1016/j.ultsonch.2018.08.024 10.1103/PhysRevE.62.2158 10.1016/S0894-1777(02)00197-8 10.1016/j.chemphys.2018.11.019 10.1016/j.ultsonch.2016.02.013 10.1016/j.jsv.2020.115723 |
| ContentType | Journal Article |
| Copyright | 2025 The Authors Copyright © 2025 The Authors. Published by Elsevier B.V. All rights reserved. 2025 The Authors 2025 |
| Copyright_xml | – notice: 2025 The Authors – notice: Copyright © 2025 The Authors. Published by Elsevier B.V. All rights reserved. – notice: 2025 The Authors 2025 |
| DBID | 6I. AAFTH AAYXX CITATION NPM 7X8 5PM DOA |
| DOI | 10.1016/j.ultsonch.2025.107290 |
| DatabaseName | ScienceDirect Open Access Titles Elsevier:ScienceDirect:Open Access CrossRef PubMed MEDLINE - Academic PubMed Central (Full Participant titles) DOAJ Directory of Open Access Journals |
| DatabaseTitle | CrossRef PubMed MEDLINE - Academic |
| DatabaseTitleList | PubMed MEDLINE - Academic |
| Database_xml | – sequence: 1 dbid: DOA name: DOAJ Directory of Open Access Journals url: https://www.doaj.org/ sourceTypes: Open Website – sequence: 2 dbid: NPM name: PubMed url: http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed sourceTypes: Index Database – sequence: 3 dbid: 7X8 name: MEDLINE - Academic url: https://search.proquest.com/medline sourceTypes: Aggregation Database |
| DeliveryMethod | fulltext_linktorsrc |
| Discipline | Chemistry Physics |
| EISSN | 1873-2828 |
| ExternalDocumentID | oai_doaj_org_article_798cbdec0c2346fa86003e89489f9d74 PMC11930750 40058020 10_1016_j_ultsonch_2025_107290 S1350417725000690 |
| Genre | Journal Article |
| GroupedDBID | --- --K --M .DC .~1 0R~ 1B1 1RT 1~. 1~5 29Q 4.4 457 4G. 53G 5VS 6I. 7-5 71M 8P~ 9JN AACTN AAEDT AAEDW AAFTH AAFWJ AAIKJ AAKOC AALRI AAOAW AAQFI AAQXK AARLI AATTM AAXKI AAXUO ABEFU ABFNM ABJNI ABLJU ABMAC ABNEU ABTAH ABWVN ABXDB ACDAQ ACFVG ACGFS ACNNM ACRLP ACRPL ADBBV ADECG ADEZE ADMUD ADNMO ADVLN AEBSH AEIPS AEKER AENEX AFFNX AFJKZ AFPKN AFTJW AFXIZ AFZHZ AGHFR AGQPQ AGUBO AGYEJ AHHHB AIEXJ AIKHN AITUG AIVDX AJSZI AKRWK ALMA_UNASSIGNED_HOLDINGS AMRAJ ANKPU APXCP ASPBG AVWKF AXJTR AZFZN BBWZM BKOJK BLXMC BNPGV CS3 DU5 EBS EFJIC EJD EO8 EO9 EP2 EP3 F5P FDB FEDTE FGOYB FIRID FLBIZ FNPLU FYGXN G-Q GBLVA GROUPED_DOAJ HMV HVGLF HZ~ IHE J1W KOM M38 M41 MO0 N9A NDZJH O-L O9- OAUVE OGIMB OK1 OZT P-8 P-9 P2P PC. Q38 R2- RIG RNS ROL RPM RPZ SCB SDF SDG SES SEW SPC SPD SPG SSH SSK SSQ SSZ T5K WUQ XPP ZMT ZY4 ~02 ~G- 9DU AAYWO AAYXX ACLOT ACVFH ADCNI AEUPX AFPUW AIGII AIIUN AKBMS AKYEP CITATION EFKBS EFLBG ~HD NPM 7X8 5PM |
| ID | FETCH-LOGICAL-c538t-32b3a84a88992a15aa386c02a6b7b633f6ce11701dc6e6f9cd402e5e075c2c903 |
| IEDL.DBID | DOA |
| ISICitedReferencesCount | 4 |
| ISICitedReferencesURI | http://www.webofscience.com/api/gateway?GWVersion=2&SrcApp=Summon&SrcAuth=ProQuest&DestLinkType=CitingArticles&DestApp=WOS_CPL&KeyUT=001443083400001&url=https%3A%2F%2Fcvtisr.summon.serialssolutions.com%2F%23%21%2Fsearch%3Fho%3Df%26include.ft.matches%3Dt%26l%3Dnull%26q%3D |
| ISSN | 1350-4177 1873-2828 |
| IngestDate | Fri Oct 03 12:51:07 EDT 2025 Tue Sep 30 17:05:11 EDT 2025 Sun Sep 28 08:46:16 EDT 2025 Mon Apr 07 02:12:11 EDT 2025 Sat Nov 29 06:50:41 EST 2025 Tue Nov 18 22:35:42 EST 2025 Sat Apr 12 15:21:31 EDT 2025 |
| IsDoiOpenAccess | true |
| IsOpenAccess | true |
| IsPeerReviewed | true |
| IsScholarly | true |
| Keywords | Bubble dynamics GPU programming Bubble position control Reinforcement learning |
| Language | English |
| License | This is an open access article under the CC BY-NC-ND license. Copyright © 2025 The Authors. Published by Elsevier B.V. All rights reserved. This is an open access article under the CC BY-NC-ND license (http://creativecommons.org/licenses/by-nc-nd/4.0/). |
| LinkModel | DirectLink |
| MergedId | FETCHMERGED-LOGICAL-c538t-32b3a84a88992a15aa386c02a6b7b633f6ce11701dc6e6f9cd402e5e075c2c903 |
| Notes | ObjectType-Article-1 SourceType-Scholarly Journals-1 ObjectType-Feature-2 content type line 23 |
| ORCID | 0000-0002-8693-1660 0000-0003-1059-9822 0000-0002-8928-5473 0000-0001-7005-9452 |
| OpenAccessLink | https://doaj.org/article/798cbdec0c2346fa86003e89489f9d74 |
| PMID | 40058020 |
| PQID | 3175680292 |
| PQPubID | 23479 |
| ParticipantIDs | doaj_primary_oai_doaj_org_article_798cbdec0c2346fa86003e89489f9d74 pubmedcentral_primary_oai_pubmedcentral_nih_gov_11930750 proquest_miscellaneous_3175680292 pubmed_primary_40058020 crossref_citationtrail_10_1016_j_ultsonch_2025_107290 crossref_primary_10_1016_j_ultsonch_2025_107290 elsevier_sciencedirect_doi_10_1016_j_ultsonch_2025_107290 |
| PublicationCentury | 2000 |
| PublicationDate | 2025-04-01 |
| PublicationDateYYYYMMDD | 2025-04-01 |
| PublicationDate_xml | – month: 04 year: 2025 text: 2025-04-01 day: 01 |
| PublicationDecade | 2020 |
| PublicationPlace | Netherlands |
| PublicationPlace_xml | – name: Netherlands |
| PublicationTitle | Ultrasonics sonochemistry |
| PublicationTitleAlternate | Ultrason Sonochem |
| PublicationYear | 2025 |
| Publisher | Elsevier B.V Elsevier |
| Publisher_xml | – name: Elsevier B.V – name: Elsevier |
| References | Crum (b49) 1975; 57 Mettin (b102) 2005 Versluis, Goertz, Palanchon, Heitman, van der Meer, Dollet, de Jong, Lohse (b28) 2010; 82 Doinikov (b100) 2004; 116 Garbin, Dollet, Overvelde, Cojoc, Di Fabrizio, van Wijngaarden, Prosperetti, de Jong, Lohse, Versluis (b23) 2009; 21 Keller, Miksis (b47) 1980; 68 Jiao, He, Leong, Kentish, Ashokkumar, Manasseh, Lee (b60) 2013; 117 Matas, James, Davison (b40) 2018 Sojahrood, Haghi, Karshafian, Kolios (b79) 2021; 33 Bai, Xu, Deng, Li, Xu, Gao (b29) 2014; 21 Magnaudet, Eames (b55) 2000; 32 Rosselló, Dellavale, Bonetto (b20) 2015; 22 Suo, Govind, Zhang, Jing (b42) 2018; 41 Zupanc, Kosjek, Petkovšek, Dular, Kompare, Širok, Bla[̌z]eka, Heath (b72) 2013; 20 Doinikov (b26) 2004; 501 Feng, Leal (b25) 1995; 7 Hegedűs (b98) 2020 Tatake, Pandit (b41) 2002; 57 Sojahrood, Haghi, Li, Porter, Karshafian, Kolios (b76) 2020; 66 Buckey, Knaus, Alvarenga, Kenton, Magari (b58) 2005; 56 Merouani, Hamdaoui, Rezgui, Guemini (b93) 2015; 40 Mettin, Ohl, Lauterborn (b104) 1999 Hao, Prosperetti (b83) 1999; 11 Peng, Andrychowicz, Zaremba, Abbeel (b38) 2018 Kandemir, Beelen, Wagterveld, Yntema, Keesman (b13) 2021; 490 Mettin, Luther, Ohl, Lauterborn (b103) 1999; 6 Pradhan, Gogate (b6) 2010; 173 Mettin, Doinikov (b27) 2009; 70 Hegedűs (b99) 2019 Lalanne, Chebel, Vejražka, Tanguy, Masbernat, Risso (b85) 2015; 27 Vuillermet, Gires, Casset, Poulain (b15) 2016; 116 Acconcia, Leung, Hynynen, Goertz (b75) 2013; 103 Bader, Gruber, Holland (b74) 2015; 41 Schulman (b106) 2017 Latifi, Kopitca, Zhou (b14) 2020; 8 Doinikov (b46) 2002; 14 Reddy, Szeri (b53) 2002; 112 Lee, Ashokkumar, Yasui, Tuziuti, Kozuka, Towata, Iida (b18) 2011; 18 Islam, Paul, Burheim, Pollet (b68) 2019; 59 Sivasankar, Moholkar (b4) 2009; 16 Masson, Ranchod, Konidaris (b95) 2015 Mettin (b101) 2007 Shaw (b86) 2006; 18 Ng, Coates, Diel, Ganapathi, Schulte, Tse, Berger, Liang (b37) 2006 Sivasankar, Moholkar (b3) 2009; 149 Mei, Zhou (b24) 1991; 229 Community (b67) 2022 Tomiyama, Kataoka, Zun, Sakaguchi (b51) 1998; 41 Akhatov, Mettin, Ohl, Parlitz, Lauterborn (b65) 1997; 55 Brenner, Lohse, Dupont (b80) 1995; 75 Dron, Aider (b12) 2013; 53 Sojahrood, Li, Haghi, Karshafian, Porter, Kolios (b10) 2023; 95 Kerboua, Hamdaoui (b94) 2019; 519 Zhang, Billson, Li (b45) 2015; 66 Mei, Klausner, Lawrence (b54) 1994; 6 Rosselló, Dellavale, Bonetto (b19) 2016; 31 Lillicrap (b34) 2016 Toegel, Luther, Lohse (b56) 2006; 96 Yasui (b1) 2018 Mnih (b33) 2015 Liao, Lin, Chuang, Tsai, Lin, Wang, Shih, Liu (b59) 2020; 10 Gole, Fishgold, Sierra-Alvarez, Deymier, Keswani (b5) 2018; 194 Maeda, Maxwell (b17) 2021; 15 Louisnard (b66) 2008; 78 Pflieger, Chave, Vite, Jouve, Nikitenko (b90) 2015; 26 Koch, Krefting, Mettin, Lauterborn (b105) 2003; vol. 2 Silver, Lever, Heess, Degris, Wierstra, Riedmiller (b62) 2014 Rashwan, Dincer, Mohany, Pollet (b69) 2019; 44 Rusu, Vecerik, Rothörl, Heess, Pascanu, Hadsell (b36) 2018 Park, Jung, Kim, Park, Jang, Kim, Baek, Lee (b57) 2023; 9 Rudin, Hoeller, Reist, Hutter (b35) 2022 van Iersel, Benes, Keurentjes (b9) 2008; 15 Matula, Cordry, Roy, Crum (b64) 1997; 102 Bogoyavlenskiy (b81) 2000; 62 Holzfuss (b84) 2008; 77 Klapcsik, Hegedűs (b61) 2023; 92 Mettin, Akhatov, Parlitz, Ohl, Lauterborn (b63) 1997; 56 Sutkar, Gogate (b8) 2009; 155 Doinikov (b48) 2005; 661 Xu, Zeiger, Suslick (b2) 2013; 42 Zhang, Zhang, Li (b43) 2016; 29 Esclapez, Sáez, nez, Tudela, Louisnard, González-García (b71) 2010; 17 Chen, Hu, Jin, Li, Wang (b39) 2022 Ouerhani, Pflieger, Ben Messaoud, Nikitenko (b91) 2015; 119 Dular, Griessler-Bulc, Gutierrez-Aguirre, Heath, Kosjek, Krivograd Klemenčič, Oder, Petkovšek, Rački, Ravnikar, Šarc, Širok, Zupanc, Žitnik, Kompare (b73) 2016; 29 Sojahrood, Haghi, Karshafian, Kolios (b78) 2021; 72 Sriphutkiat, Zhou (b11) 2017; 263 Shaw (b88) 2017; 29 Islam, Burheim, Hihn, Pollet (b89) 2021; 73 Chabouh, Mokbel, van Elburg, Versluis, Segers, Aland, Quilliet, Coupier (b22) 2023; 2 Mnih, Kavukcuoglu, Silver, Graves, Antonoglou, Wierstra, Riedmiller (b32) 2013 Levich (b50) 1962 Islam, Burheim, Pollet (b92) 2019; 51 González-García, Sáez, Tudela, Díez-Garcia, Deseada Esclapez, Louisnard (b70) 2010; 2 Gedanken (b7) 2004; 11 Heess, TB, Sriram, Lemmon, Merel, Wayne, Tassa, Erez, Wang, Eslami, Riedmiller, Silver (b107) 2017 Magnaudet, Legendre (b52) 1998; 10 Sutton, Barto (b30) 2018 Sojahrood, Haghi, Karshafian, Kolios (b77) 2020; 66 Dollet, van der Meer, Garbin, de Jong, Lohse, Versluis (b82) 2008; 34 Delalleau, Peter, Alonso, Logut (b96) 2019 Goldowsky, Mastrangeli, Jacot-Descombes, Gullo, Mermoud, Brugger, Martinoli, Nelson, Knapp (b16) 2013; 23 Fan, Su, Zhang, Yu (b97) 2019 Jean-François, Mangassarian, Kumaran (b31) 2003 Zhang, Zhang, Li (b44) 2017; 35 Shaw (b87) 2009; 21 Abe, Kawaji, Watanabe (b21) 2002; 26 Gedanken (10.1016/j.ultsonch.2025.107290_b7) 2004; 11 Ouerhani (10.1016/j.ultsonch.2025.107290_b91) 2015; 119 Hegedűs (10.1016/j.ultsonch.2025.107290_b99) 2019 Pflieger (10.1016/j.ultsonch.2025.107290_b90) 2015; 26 Lillicrap (10.1016/j.ultsonch.2025.107290_b34) 2016 Zhang (10.1016/j.ultsonch.2025.107290_b44) 2017; 35 Maeda (10.1016/j.ultsonch.2025.107290_b17) 2021; 15 Sutkar (10.1016/j.ultsonch.2025.107290_b8) 2009; 155 Bader (10.1016/j.ultsonch.2025.107290_b74) 2015; 41 Sojahrood (10.1016/j.ultsonch.2025.107290_b79) 2021; 33 Sojahrood (10.1016/j.ultsonch.2025.107290_b10) 2023; 95 Tomiyama (10.1016/j.ultsonch.2025.107290_b51) 1998; 41 González-García (10.1016/j.ultsonch.2025.107290_b70) 2010; 2 Peng (10.1016/j.ultsonch.2025.107290_b38) 2018 Doinikov (10.1016/j.ultsonch.2025.107290_b100) 2004; 116 Doinikov (10.1016/j.ultsonch.2025.107290_b26) 2004; 501 Doinikov (10.1016/j.ultsonch.2025.107290_b48) 2005; 661 Mettin (10.1016/j.ultsonch.2025.107290_b101) 2007 Hao (10.1016/j.ultsonch.2025.107290_b83) 1999; 11 Bai (10.1016/j.ultsonch.2025.107290_b29) 2014; 21 Shaw (10.1016/j.ultsonch.2025.107290_b86) 2006; 18 Islam (10.1016/j.ultsonch.2025.107290_b92) 2019; 51 Sivasankar (10.1016/j.ultsonch.2025.107290_b4) 2009; 16 Reddy (10.1016/j.ultsonch.2025.107290_b53) 2002; 112 Rashwan (10.1016/j.ultsonch.2025.107290_b69) 2019; 44 Delalleau (10.1016/j.ultsonch.2025.107290_b96) 2019 Park (10.1016/j.ultsonch.2025.107290_b57) 2023; 9 Matula (10.1016/j.ultsonch.2025.107290_b64) 1997; 102 Bogoyavlenskiy (10.1016/j.ultsonch.2025.107290_b81) 2000; 62 Mettin (10.1016/j.ultsonch.2025.107290_b102) 2005 Masson (10.1016/j.ultsonch.2025.107290_b95) 2015 Mettin (10.1016/j.ultsonch.2025.107290_b27) 2009; 70 Merouani (10.1016/j.ultsonch.2025.107290_b93) 2015; 40 Zupanc (10.1016/j.ultsonch.2025.107290_b72) 2013; 20 Yasui (10.1016/j.ultsonch.2025.107290_b1) 2018 Acconcia (10.1016/j.ultsonch.2025.107290_b75) 2013; 103 Tatake (10.1016/j.ultsonch.2025.107290_b41) 2002; 57 Brenner (10.1016/j.ultsonch.2025.107290_b80) 1995; 75 Mettin (10.1016/j.ultsonch.2025.107290_b63) 1997; 56 Toegel (10.1016/j.ultsonch.2025.107290_b56) 2006; 96 Islam (10.1016/j.ultsonch.2025.107290_b89) 2021; 73 Shaw (10.1016/j.ultsonch.2025.107290_b87) 2009; 21 Kerboua (10.1016/j.ultsonch.2025.107290_b94) 2019; 519 Doinikov (10.1016/j.ultsonch.2025.107290_b46) 2002; 14 Sojahrood (10.1016/j.ultsonch.2025.107290_b78) 2021; 72 Shaw (10.1016/j.ultsonch.2025.107290_b88) 2017; 29 Islam (10.1016/j.ultsonch.2025.107290_b68) 2019; 59 Sojahrood (10.1016/j.ultsonch.2025.107290_b76) 2020; 66 Rudin (10.1016/j.ultsonch.2025.107290_b35) 2022 Kandemir (10.1016/j.ultsonch.2025.107290_b13) 2021; 490 Silver (10.1016/j.ultsonch.2025.107290_b62) 2014 Crum (10.1016/j.ultsonch.2025.107290_b49) 1975; 57 Dular (10.1016/j.ultsonch.2025.107290_b73) 2016; 29 Liao (10.1016/j.ultsonch.2025.107290_b59) 2020; 10 Mettin (10.1016/j.ultsonch.2025.107290_b104) 1999 Sriphutkiat (10.1016/j.ultsonch.2025.107290_b11) 2017; 263 Zhang (10.1016/j.ultsonch.2025.107290_b43) 2016; 29 Jean-François (10.1016/j.ultsonch.2025.107290_b31) 2003 Versluis (10.1016/j.ultsonch.2025.107290_b28) 2010; 82 Jiao (10.1016/j.ultsonch.2025.107290_b60) 2013; 117 Louisnard (10.1016/j.ultsonch.2025.107290_b66) 2008; 78 Dron (10.1016/j.ultsonch.2025.107290_b12) 2013; 53 Koch (10.1016/j.ultsonch.2025.107290_b105) 2003; vol. 2 Buckey (10.1016/j.ultsonch.2025.107290_b58) 2005; 56 Garbin (10.1016/j.ultsonch.2025.107290_b23) 2009; 21 Mnih (10.1016/j.ultsonch.2025.107290_b32) 2013 Fan (10.1016/j.ultsonch.2025.107290_b97) 2019 Mei (10.1016/j.ultsonch.2025.107290_b24) 1991; 229 Esclapez (10.1016/j.ultsonch.2025.107290_b71) 2010; 17 Abe (10.1016/j.ultsonch.2025.107290_b21) 2002; 26 Levich (10.1016/j.ultsonch.2025.107290_b50) 1962 Rosselló (10.1016/j.ultsonch.2025.107290_b20) 2015; 22 Rusu (10.1016/j.ultsonch.2025.107290_b36) 2018 Xu (10.1016/j.ultsonch.2025.107290_b2) 2013; 42 Sivasankar (10.1016/j.ultsonch.2025.107290_b3) 2009; 149 Matas (10.1016/j.ultsonch.2025.107290_b40) 2018 Rosselló (10.1016/j.ultsonch.2025.107290_b19) 2016; 31 Holzfuss (10.1016/j.ultsonch.2025.107290_b84) 2008; 77 Gole (10.1016/j.ultsonch.2025.107290_b5) 2018; 194 Zhang (10.1016/j.ultsonch.2025.107290_b45) 2015; 66 Sojahrood (10.1016/j.ultsonch.2025.107290_b77) 2020; 66 Pradhan (10.1016/j.ultsonch.2025.107290_b6) 2010; 173 Community (10.1016/j.ultsonch.2025.107290_b67) 2022 Schulman (10.1016/j.ultsonch.2025.107290_b106) 2017 Keller (10.1016/j.ultsonch.2025.107290_b47) 1980; 68 Mei (10.1016/j.ultsonch.2025.107290_b54) 1994; 6 Hegedűs (10.1016/j.ultsonch.2025.107290_b98) 2020 Lee (10.1016/j.ultsonch.2025.107290_b18) 2011; 18 Magnaudet (10.1016/j.ultsonch.2025.107290_b52) 1998; 10 Ng (10.1016/j.ultsonch.2025.107290_b37) 2006 Mnih (10.1016/j.ultsonch.2025.107290_b33) 2015 Feng (10.1016/j.ultsonch.2025.107290_b25) 1995; 7 Suo (10.1016/j.ultsonch.2025.107290_b42) 2018; 41 Akhatov (10.1016/j.ultsonch.2025.107290_b65) 1997; 55 Chabouh (10.1016/j.ultsonch.2025.107290_b22) 2023; 2 Chen (10.1016/j.ultsonch.2025.107290_b39) 2022 Dollet (10.1016/j.ultsonch.2025.107290_b82) 2008; 34 Lalanne (10.1016/j.ultsonch.2025.107290_b85) 2015; 27 Mettin (10.1016/j.ultsonch.2025.107290_b103) 1999; 6 Vuillermet (10.1016/j.ultsonch.2025.107290_b15) 2016; 116 Goldowsky (10.1016/j.ultsonch.2025.107290_b16) 2013; 23 Klapcsik (10.1016/j.ultsonch.2025.107290_b61) 2023; 92 van Iersel (10.1016/j.ultsonch.2025.107290_b9) 2008; 15 Heess (10.1016/j.ultsonch.2025.107290_b107) 2017 Magnaudet (10.1016/j.ultsonch.2025.107290_b55) 2000; 32 Latifi (10.1016/j.ultsonch.2025.107290_b14) 2020; 8 Sutton (10.1016/j.ultsonch.2025.107290_b30) 2018 |
| References_xml | – volume: 40 start-page: 4056 year: 2015 end-page: 4064 ident: b93 article-title: Mechanism of the sonochemical production of hydrogen publication-title: Int. J. Hydrog. Energy – volume: 661 start-page: 95 year: 2005 end-page: 143 ident: b48 article-title: Bjerknes forces and translational bubble dynamics publication-title: Bubble Part. Dyn. Acoust. Fields: Mod. Trends Appl. – volume: 14 start-page: 1420 year: 2002 end-page: 1425 ident: b46 article-title: Translational motion of a spherical bubble in an acoustic standing wave of high intensity publication-title: Phys. Fluids – volume: 155 start-page: 26 year: 2009 end-page: 36 ident: b8 article-title: Design aspects of sonochemical reactors: Techniques for understanding cavitational activity distribution and effect of operating parameters publication-title: Chem. Eng. J. – volume: 56 start-page: 2924 year: 1997 end-page: 2931 ident: b63 article-title: Bjerknes forces between small cavitation bubbles in a strong acoustic field publication-title: Phys. Rev. E – volume: 55 start-page: 3747 year: 1997 end-page: 3750 ident: b65 article-title: Bjerknes force threshold for stable single bubble sonoluminescence publication-title: Phys. Rev. E – volume: 10 start-page: 550 year: 1998 end-page: 554 ident: b52 article-title: The viscous drag force on a spherical bubble with a time-dependent radius publication-title: Phys. Fluids – volume: 29 start-page: 129 year: 2016 end-page: 145 ident: b43 article-title: The secondary Bjerknes force between two gas bubbles under dual-frequency acoustic excitation publication-title: Ultrason. Sonochem. – volume: 490 year: 2021 ident: b13 article-title: Dynamic acoustic fields for size selective particle separation on centimeter scale publication-title: J. Sound Vib. – volume: 68 start-page: 628 year: 1980 end-page: 633 ident: b47 article-title: Bubble oscillations of large amplitude publication-title: J. Acoust. Soc. Am. – year: 2018 ident: b30 article-title: Reinforcement Learning: An Introduction – volume: 66 year: 2020 ident: b77 article-title: Critical corrections to models of nonlinear power dissipation of ultrasonically excited bubbles publication-title: Ultrason. Sonochem. – volume: 15 year: 2021 ident: b17 article-title: Controlling the dynamics of cloud cavitation bubbles through acoustic feedback publication-title: Phys. Rev. Appl. – volume: 57 start-page: 1363 year: 1975 end-page: 1370 ident: b49 article-title: Bjerknes forces on bubbles in a stationary sound field publication-title: J. Acoust. Soc. Am. – volume: 501 start-page: 1 year: 2004 end-page: 24 ident: b26 article-title: Translational motion of a bubble undergoing shape oscillations publication-title: J. Fluid Mech. – volume: 2 start-page: 28 year: 2010 end-page: 74 ident: b70 article-title: Sonochemical treatment of water polluted by chlorinated organocompounds. A review publication-title: Water – volume: 51 start-page: 533 year: 2019 end-page: 555 ident: b92 article-title: Sonochemical and sonoelectrochemical production of hydrogen publication-title: Ultrason. Sonochem. – year: 2018 ident: b40 article-title: Sim-to-real reinforcement learning for deformable object manipulation – year: 2003 ident: b31 article-title: Markov Decision Processes: Concepts and Algorithms – volume: 56 start-page: 1041 year: 2005 end-page: 1047 ident: b58 article-title: Dual-frequency ultrasound for detecting and sizing bubbles publication-title: Acta Astronaut. – volume: 116 start-page: 821 year: 2004 end-page: 827 ident: b100 article-title: Mathematical model for collective bubble dynamics in strong ultrasound fields publication-title: J. Acoust. Soc. Am. – start-page: 3803 year: 2018 end-page: 3810 ident: b38 article-title: Sim-to-real transfer of robotic control with dynamics randomization publication-title: 2018 IEEE International Conference on Robotics and Automation – volume: 92 year: 2023 ident: b61 article-title: Numerical investigation of the translational motion of bubbles: The comparison of capabilities of the time-resolved and the time-averaged methods publication-title: Ultrason. Sonochem. – volume: 41 start-page: 187 year: 2015 end-page: 196 ident: b74 article-title: Shaken and stirred: Mechanisms of ultrasound-enhanced thrombolysis publication-title: Ultrasound Med. Biol. – start-page: 171 year: 2007 end-page: 198 ident: b101 article-title: From a single bubble to bubble structures in acoustic cavitation publication-title: Oscillations, Waves and Interactions: Sixty Years Drittes Physikalisches Institut ; a Festschrift – volume: 32 start-page: 659 year: 2000 end-page: 708 ident: b55 article-title: The motion of high-Reynolds-number bubbles in inhomogeneous flows publication-title: Annu. Rev. Fluid Mech. – volume: 149 start-page: 57 year: 2009 end-page: 69 ident: b3 article-title: Mechanistic approach to intensification of sonochemical degradation of phenol publication-title: Chem. Eng. J. – volume: 78 year: 2008 ident: b66 article-title: Analytical expressions for primary Bjerknes force on inertial cavitation bubbles publication-title: Phys. Rev. E – volume: 95 year: 2023 ident: b10 article-title: Probing the pressure dependence of sound speed and attenuation in bubbly media: Experimental observations, a theoretical model and numerical calculations publication-title: Ultrason. Sonochem. – volume: 21 year: 2009 ident: b87 article-title: The stability of a bubble in a weakly viscous liquid subject to an acoustic traveling wave publication-title: Phys. Fluids – volume: 173 start-page: 517 year: 2010 end-page: 522 ident: b6 article-title: Degradation of p-nitrophenol using acoustic cavitation and Fenton chemistry publication-title: J. Hazard. Mater. – volume: 103 year: 2013 ident: b75 article-title: Interactions between ultrasound stimulated microbubbles and fibrin clots publication-title: Appl. Phys. Lett. – volume: vol. 2 start-page: 1475 year: 2003 end-page: 1478 ident: b105 article-title: Simulation of the translational motion of few cavitation bubbles in an ultrasonic field publication-title: IEEE Symposium on Ultrasonics, 2003 – volume: 72 year: 2021 ident: b78 article-title: Nonlinear dynamics and bifurcation structure of ultrasonically excited lipid coated microbubbles publication-title: Ultrason. Sonochem. – volume: 18 start-page: 92 year: 2011 end-page: 98 ident: b18 article-title: Development and optimization of acoustic bubble structures at high frequencies publication-title: Ultrason. Sonochem. – year: 2015 ident: b95 article-title: Reinforcement learning with parameterized actions – year: 2019 ident: b97 article-title: Hybrid actor-critic reinforcement learning in parameterized action space – year: 2022 ident: b67 article-title: Numba Documentation – start-page: 1 year: 2005 end-page: 36 ident: b102 article-title: Bubble structures in acoustic cavitation publication-title: Bubble and Particle Dynamics in Acoustic Fields: Modern Trends and Applications – year: 2017 ident: b106 article-title: Proximal policy optimization algorithms – volume: 59 year: 2019 ident: b68 article-title: Recent developments in the sonoelectrochemical synthesis of nanomaterials publication-title: Ultrason. Sonochem. – volume: 82 year: 2010 ident: b28 article-title: Microbubble shape oscillations excited through ultrasonic parametric driving publication-title: Phys. Rev. E – volume: 11 start-page: 47 year: 2004 end-page: 55 ident: b7 article-title: Using sonochemistry for the fabrication of nanomaterials publication-title: Ultrason. Sonochem. – year: 2022 ident: b35 article-title: Learning to walk in minutes using massively parallel deep reinforcement learning – volume: 119 start-page: 15885 year: 2015 end-page: 15891 ident: b91 article-title: Spectroscopy of sonoluminescence and sonochemistry in water saturated with N publication-title: J. Phys. Chem. B – year: 2017 ident: b107 article-title: Emergence of locomotion behaviours in rich environments – volume: 2 start-page: 63 year: 2023 ident: b22 article-title: Coated microbubbles swim via shell buckling publication-title: Commun. Eng. – volume: 70 start-page: 1330 year: 2009 end-page: 1339 ident: b27 article-title: Translational instability of a spherical bubble in a standing ultrasound wave publication-title: Appl. Acoust. – volume: 44 start-page: 14500 year: 2019 end-page: 14526 ident: b69 article-title: The Sono-Hydro-Gen process (Ultrasound induced hydrogen production): Challenges and opportunities publication-title: Int. J. Hydrog. Energy – volume: 20 start-page: 1104 year: 2013 end-page: 1112 ident: b72 article-title: Removal of pharmaceuticals from wastewater by biological processes, hydrodynamic cavitation and UV treatment publication-title: Ultrason. Sonochem. – volume: 194 start-page: 104 year: 2018 end-page: 110 ident: b5 article-title: Treatment of Perfluorooctane Sulfonic Acid (PFOS) using a large-scale sonochemical reactor publication-title: Sep. Purif. Technol – volume: 7 start-page: 1325 year: 1995 end-page: 1336 ident: b25 article-title: Translational instability of a bubble undergoing shape oscillations publication-title: Phys. Fluids – year: 2015 ident: b33 article-title: Human-level control through deep reinforcement learning publication-title: Nature – volume: 57 start-page: 4987 year: 2002 end-page: 4995 ident: b41 article-title: Modelling and experimental investigation into cavity dynamics and cavitational yield: influence of dual frequency ultrasound sources publication-title: Chem. Eng. Sci. – volume: 21 start-page: 1696 year: 2014 end-page: 1706 ident: b29 article-title: Generation and control of acoustic cavitation structure publication-title: Ultrason. Sonochem. – volume: 6 start-page: 418 year: 1994 end-page: 420 ident: b54 article-title: A note on the history force on a spherical bubble at finite Reynolds number publication-title: Phys. Fluids – volume: 23 year: 2013 ident: b16 article-title: Acousto-fluidic system assisting in-liquid self-assembly of microcomponents publication-title: J. Micromech. Microeng. – volume: 42 start-page: 2555 year: 2013 end-page: 2567 ident: b2 article-title: Sonochemical synthesis of nanomaterials publication-title: Chem. Soc. Rev. – volume: 116 year: 2016 ident: b15 article-title: Chladni patterns in a liquid at microscale publication-title: Phys. Rev. Lett. – start-page: 139 year: 1999 end-page: 144 ident: b104 article-title: Particle approach to structure formation in acoustic cavitation publication-title: Sonochemistry and Sonoluminescence – start-page: 387 year: 2014 end-page: 395 ident: b62 article-title: Deterministic policy gradient algorithms publication-title: International Conference on Machine Learning – volume: 11 start-page: 1309 year: 1999 end-page: 1317 ident: b83 article-title: The effect of viscosity on the spherical stability of oscillating gas bubbles publication-title: Phys. Fluids – volume: 9 start-page: 122 year: 2023 ident: b57 article-title: Dual-frequency piezoelectric micromachined ultrasound transducer based on polarization switching in ferroelectric thin films publication-title: Microsyst. Nanoeng. – volume: 29 start-page: 577 year: 2016 end-page: 588 ident: b73 article-title: Use of hydrodynamic cavitation in (waste)water treatment publication-title: Ultrason. Sonochem. – volume: 73 year: 2021 ident: b89 article-title: Sonochemical conversion of CO publication-title: Ultrason. Sonochem. – volume: 35 start-page: 431 year: 2017 end-page: 439 ident: b44 article-title: Combination and simultaneous resonances of gas bubbles oscillating in liquids under dual-frequency acoustic excitation publication-title: Ultrason. Sonochem. – year: 2018 ident: b36 article-title: Sim-to-real robot learning from pixels with progressive nets – volume: 75 start-page: 954 year: 1995 end-page: 957 ident: b80 article-title: Bubble shape oscillations and the onset of sonoluminescence publication-title: Phys. Rev. Lett. – start-page: 37 year: 2018 end-page: 97 ident: b1 publication-title: Acoustic Cavitation and Bubble Dynamics – volume: 263 start-page: 521 year: 2017 end-page: 529 ident: b11 article-title: Particle manipulation using standing acoustic waves in the microchannel at dual-frequency excitation: Effect of power ratio publication-title: Sens. Actuators A: Phys. – year: 2022 ident: b39 article-title: Understanding domain randomization for sim-to-real transfer – volume: 10 start-page: 4338 year: 2020 ident: b59 article-title: Low-frequency dual-frequency ultrasound-mediated microbubble cavitation for transdermal minoxidil delivery and hair growth enhancement publication-title: Sci. Rep. – volume: 31 start-page: 610 year: 2016 end-page: 625 ident: b19 article-title: Positional stability and radial dynamics of sonoluminescent bubbles under bi-harmonic driving: Effect of the high-frequency component and its relative phase publication-title: Ultrason. Sonochem. – volume: 519 start-page: 27 year: 2019 end-page: 37 ident: b94 article-title: Sonochemical production of hydrogen: Enhancement by summed harmonics excitation publication-title: Chem. Phys. – year: 2020 ident: b98 article-title: Massively parallel GPU-ODE solver (MPGOS) – year: 2019 ident: b96 article-title: Discrete and continuous action representation for practical RL in video games – volume: 17 start-page: 1010 year: 2010 end-page: 1020 ident: b71 article-title: Sonoelectrochemical treatment of water polluted with trichloroacetic acid: From sonovoltammetry to pre-pilot plant scale publication-title: Ultrason. Sonoch. – volume: 62 start-page: 2158 year: 2000 end-page: 2167 ident: b81 article-title: Single-bubble sonoluminescence: Shape stability analysis of collapse dynamics in a semianalytical approach publication-title: Phys. Rev. E – volume: 6 start-page: 25 year: 1999 end-page: 29 ident: b103 article-title: Acoustic cavitation structures and simulations by a particle model publication-title: Ultrason. Sonochem. – volume: 18 year: 2006 ident: b86 article-title: Translation and oscillation of a bubble under axisymmetric deformation publication-title: Phys. Fluids – volume: 27 year: 2015 ident: b85 article-title: Non-linear shape oscillations of rising drops and bubbles: Experiments and simulations publication-title: Phys. Fluids – volume: 29 year: 2017 ident: b88 article-title: Nonspherical sub-millimeter gas bubble oscillations: Parametric forcing and nonlinear shape mode coupling publication-title: Phys. Fluids – volume: 26 start-page: 169 year: 2015 end-page: 175 ident: b90 article-title: Effect of operational conditions on sonoluminescence and kinetics of H publication-title: Ultrason. Sonochem. – year: 2019 ident: b99 article-title: MPGOS: GPU Accelerated Integrator for Large Number of Independent Ordinary Differential Equation Systems – volume: 16 start-page: 769 year: 2009 end-page: 781 ident: b4 article-title: Physical insights into the sonochemical degradation of recalcitrant organic pollutants with cavitation bubble dynamics publication-title: Ultrason. Sonochem. – volume: 53 start-page: 1280 year: 2013 end-page: 1287 ident: b12 article-title: Varying the agglomeration position of particles in a micro-channel using acoustic radiation force beyond the resonance condition publication-title: Ultrasonics – start-page: 363 year: 2006 end-page: 372 ident: b37 article-title: Autonomous inverted helicopter flight via reinforcement learning publication-title: Experimental Robotics IX – volume: 66 start-page: 16 year: 2015 end-page: 20 ident: b45 article-title: Influences of pressure amplitudes and frequencies of dual-frequency acoustic excitation on the mass transfer across interfaces of gas bubbles publication-title: Int. J. Heat Mass Transfer – volume: 26 start-page: 817 year: 2002 end-page: 826 ident: b21 article-title: Study on the bubble motion control by ultrasonic wave publication-title: Exp. Therm. Fluid Sci. – year: 2013 ident: b32 article-title: Playing Atari with deep reinforcement learning – year: 2016 ident: b34 article-title: Continuous control with deep reinforcement learning – volume: 66 year: 2020 ident: b76 article-title: Nonlinear power loss in the oscillations of coated and uncoated bubbles: Role of thermal, radiation and encapsulating shell damping at various excitation pressures publication-title: Ultrason. Sonochem. – volume: 33 year: 2021 ident: b79 article-title: Classification of the major nonlinear regimes of oscillations, oscillation properties, and mechanisms of wave energy dissipation in the nonlinear oscillations of coated and uncoated bubbles publication-title: Phys. Fluids – volume: 77 year: 2008 ident: b84 article-title: Surface-wave instabilities, period doubling, and an approximate universal boundary of bubble stability at the upper threshold of sonoluminescence publication-title: Phys. Rev. E – volume: 8 start-page: 20597 year: 2020 end-page: 20606 ident: b14 article-title: Model-free control for dynamic-field acoustic manipulation using reinforcement learning publication-title: IEEE Access – volume: 41 start-page: 419 year: 2018 end-page: 426 ident: b42 article-title: Numerical investigation of the inertial cavitation threshold under multi-frequency ultrasound publication-title: Ultrason. Sonochem. – year: 1962 ident: b50 article-title: Physicochemical Hydrodynamics – volume: 102 start-page: 1522 year: 1997 end-page: 1527 ident: b64 article-title: Bjerknes force and bubble levitation under single-bubble sonoluminescence conditions publication-title: J. Acoust. Soc. Am. – volume: 15 start-page: 294 year: 2008 end-page: 300 ident: b9 article-title: Importance of acoustic shielding in sonochemistry publication-title: Ultrason. Sonochem. – volume: 229 start-page: 29 year: 1991 end-page: 50 ident: b24 article-title: Parametric resonance of a spherical bubble publication-title: J. Fluid Mech. – volume: 41 start-page: 472 year: 1998 end-page: 479 ident: b51 article-title: Drag coefficients of single bubbles under normal and micro gravity conditions publication-title: JSME Int. J. Ser. B – volume: 117 start-page: 12549 year: 2013 end-page: 12555 ident: b60 article-title: Experimental and theoretical studies on the movements of two bubbles in an acoustic standing wave field publication-title: J. Phys. Chem. B – volume: 34 start-page: 1465 year: 2008 end-page: 1473 ident: b82 article-title: Nonspherical oscillations of ultrasound contrast agent microbubbles publication-title: Ultrasound Med. Biol. – volume: 21 year: 2009 ident: b23 article-title: History force on coated microbubbles propelled by ultrasound publication-title: Phys. Fluids – volume: 22 start-page: 59 year: 2015 end-page: 69 ident: b20 article-title: Stable tridimensional bubble clusters in multi-bubble sonoluminescence (MBSL) publication-title: Ultrason. Sonochem. – volume: 112 start-page: 1346 year: 2002 end-page: 1352 ident: b53 article-title: Coupled dynamics of translation and collapse of acoustically driven microbubbles publication-title: J. Acoust. Soc. Am. – volume: 96 year: 2006 ident: b56 article-title: Viscosity destabilizes sonoluminescing bubbles publication-title: Phys. Rev. Lett. – volume: 66 year: 2020 ident: 10.1016/j.ultsonch.2025.107290_b76 article-title: Nonlinear power loss in the oscillations of coated and uncoated bubbles: Role of thermal, radiation and encapsulating shell damping at various excitation pressures publication-title: Ultrason. Sonochem. doi: 10.1016/j.ultsonch.2020.105070 – year: 2017 ident: 10.1016/j.ultsonch.2025.107290_b107 – volume: 53 start-page: 1280 issue: 7 year: 2013 ident: 10.1016/j.ultsonch.2025.107290_b12 article-title: Varying the agglomeration position of particles in a micro-channel using acoustic radiation force beyond the resonance condition publication-title: Ultrasonics doi: 10.1016/j.ultras.2013.03.012 – volume: 173 start-page: 517 issue: 1 year: 2010 ident: 10.1016/j.ultsonch.2025.107290_b6 article-title: Degradation of p-nitrophenol using acoustic cavitation and Fenton chemistry publication-title: J. Hazard. Mater. doi: 10.1016/j.jhazmat.2009.08.115 – volume: 40 start-page: 4056 issue: 11 year: 2015 ident: 10.1016/j.ultsonch.2025.107290_b93 article-title: Mechanism of the sonochemical production of hydrogen publication-title: Int. J. Hydrog. Energy doi: 10.1016/j.ijhydene.2015.01.150 – volume: 29 start-page: 129 year: 2016 ident: 10.1016/j.ultsonch.2025.107290_b43 article-title: The secondary Bjerknes force between two gas bubbles under dual-frequency acoustic excitation publication-title: Ultrason. Sonochem. doi: 10.1016/j.ultsonch.2015.08.022 – year: 1962 ident: 10.1016/j.ultsonch.2025.107290_b50 – volume: 11 start-page: 47 issue: 2 year: 2004 ident: 10.1016/j.ultsonch.2025.107290_b7 article-title: Using sonochemistry for the fabrication of nanomaterials publication-title: Ultrason. Sonochem. doi: 10.1016/j.ultsonch.2004.01.037 – volume: 16 start-page: 769 issue: 6 year: 2009 ident: 10.1016/j.ultsonch.2025.107290_b4 article-title: Physical insights into the sonochemical degradation of recalcitrant organic pollutants with cavitation bubble dynamics publication-title: Ultrason. Sonochem. doi: 10.1016/j.ultsonch.2009.02.009 – volume: 9 start-page: 122 issue: 1 year: 2023 ident: 10.1016/j.ultsonch.2025.107290_b57 article-title: Dual-frequency piezoelectric micromachined ultrasound transducer based on polarization switching in ferroelectric thin films publication-title: Microsyst. Nanoeng. doi: 10.1038/s41378-023-00595-z – volume: 96 year: 2006 ident: 10.1016/j.ultsonch.2025.107290_b56 article-title: Viscosity destabilizes sonoluminescing bubbles publication-title: Phys. Rev. Lett. doi: 10.1103/PhysRevLett.96.114301 – volume: 56 start-page: 1041 issn: 0094-5765 issue: 9 year: 2005 ident: 10.1016/j.ultsonch.2025.107290_b58 article-title: Dual-frequency ultrasound for detecting and sizing bubbles publication-title: Acta Astronaut. doi: 10.1016/j.actaastro.2005.01.032 – volume: 15 year: 2021 ident: 10.1016/j.ultsonch.2025.107290_b17 article-title: Controlling the dynamics of cloud cavitation bubbles through acoustic feedback publication-title: Phys. Rev. Appl. doi: 10.1103/PhysRevApplied.15.034033 – volume: 35 start-page: 431 year: 2017 ident: 10.1016/j.ultsonch.2025.107290_b44 article-title: Combination and simultaneous resonances of gas bubbles oscillating in liquids under dual-frequency acoustic excitation publication-title: Ultrason. Sonochem. doi: 10.1016/j.ultsonch.2016.10.022 – year: 2022 ident: 10.1016/j.ultsonch.2025.107290_b67 – start-page: 171 year: 2007 ident: 10.1016/j.ultsonch.2025.107290_b101 article-title: From a single bubble to bubble structures in acoustic cavitation – volume: 77 issue: 6 year: 2008 ident: 10.1016/j.ultsonch.2025.107290_b84 article-title: Surface-wave instabilities, period doubling, and an approximate universal boundary of bubble stability at the upper threshold of sonoluminescence publication-title: Phys. Rev. E doi: 10.1103/PhysRevE.77.066309 – year: 2022 ident: 10.1016/j.ultsonch.2025.107290_b39 – volume: 20 start-page: 1104 issue: 4 year: 2013 ident: 10.1016/j.ultsonch.2025.107290_b72 article-title: Removal of pharmaceuticals from wastewater by biological processes, hydrodynamic cavitation and UV treatment publication-title: Ultrason. Sonochem. doi: 10.1016/j.ultsonch.2012.12.003 – volume: 57 start-page: 1363 issue: 6 year: 1975 ident: 10.1016/j.ultsonch.2025.107290_b49 article-title: Bjerknes forces on bubbles in a stationary sound field publication-title: J. Acoust. Soc. Am. doi: 10.1121/1.380614 – volume: 73 year: 2021 ident: 10.1016/j.ultsonch.2025.107290_b89 article-title: Sonochemical conversion of CO2 into hydrocarbons: The sabatier reaction at ambient conditions publication-title: Ultrason. Sonochem. doi: 10.1016/j.ultsonch.2021.105474 – volume: 29 issue: 12 year: 2017 ident: 10.1016/j.ultsonch.2025.107290_b88 article-title: Nonspherical sub-millimeter gas bubble oscillations: Parametric forcing and nonlinear shape mode coupling publication-title: Phys. Fluids doi: 10.1063/1.5005599 – volume: 2 start-page: 63 issue: 1 year: 2023 ident: 10.1016/j.ultsonch.2025.107290_b22 article-title: Coated microbubbles swim via shell buckling publication-title: Commun. Eng. doi: 10.1038/s44172-023-00113-z – volume: 72 year: 2021 ident: 10.1016/j.ultsonch.2025.107290_b78 article-title: Nonlinear dynamics and bifurcation structure of ultrasonically excited lipid coated microbubbles publication-title: Ultrason. Sonochem. doi: 10.1016/j.ultsonch.2020.105405 – volume: 116 year: 2016 ident: 10.1016/j.ultsonch.2025.107290_b15 article-title: Chladni patterns in a liquid at microscale publication-title: Phys. Rev. Lett. doi: 10.1103/PhysRevLett.116.184501 – volume: 10 start-page: 4338 issue: 1 year: 2020 ident: 10.1016/j.ultsonch.2025.107290_b59 article-title: Low-frequency dual-frequency ultrasound-mediated microbubble cavitation for transdermal minoxidil delivery and hair growth enhancement publication-title: Sci. Rep. doi: 10.1038/s41598-020-61328-0 – volume: 117 start-page: 12549 issue: 41 year: 2013 ident: 10.1016/j.ultsonch.2025.107290_b60 article-title: Experimental and theoretical studies on the movements of two bubbles in an acoustic standing wave field publication-title: J. Phys. Chem. B doi: 10.1021/jp404886h – volume: 29 start-page: 577 year: 2016 ident: 10.1016/j.ultsonch.2025.107290_b73 article-title: Use of hydrodynamic cavitation in (waste)water treatment publication-title: Ultrason. Sonochem. doi: 10.1016/j.ultsonch.2015.10.010 – volume: 10 start-page: 550 issue: 3 year: 1998 ident: 10.1016/j.ultsonch.2025.107290_b52 article-title: The viscous drag force on a spherical bubble with a time-dependent radius publication-title: Phys. Fluids doi: 10.1063/1.869582 – volume: 119 start-page: 15885 issue: 52 year: 2015 ident: 10.1016/j.ultsonch.2025.107290_b91 article-title: Spectroscopy of sonoluminescence and sonochemistry in water saturated with N2–Ar mixtures publication-title: J. Phys. Chem. B doi: 10.1021/acs.jpcb.5b10221 – volume: 155 start-page: 26 issue: 1 year: 2009 ident: 10.1016/j.ultsonch.2025.107290_b8 article-title: Design aspects of sonochemical reactors: Techniques for understanding cavitational activity distribution and effect of operating parameters publication-title: Chem. Eng. J. doi: 10.1016/j.cej.2009.07.021 – volume: 59 year: 2019 ident: 10.1016/j.ultsonch.2025.107290_b68 article-title: Recent developments in the sonoelectrochemical synthesis of nanomaterials publication-title: Ultrason. Sonochem. – volume: 26 start-page: 169 year: 2015 ident: 10.1016/j.ultsonch.2025.107290_b90 article-title: Effect of operational conditions on sonoluminescence and kinetics of H2O2 formation during the sonolysis of water in the presence of Ar/O2 gas mixture publication-title: Ultrason. Sonochem. doi: 10.1016/j.ultsonch.2015.02.005 – volume: 70 start-page: 1330 issue: 10 year: 2009 ident: 10.1016/j.ultsonch.2025.107290_b27 article-title: Translational instability of a spherical bubble in a standing ultrasound wave publication-title: Appl. Acoust. doi: 10.1016/j.apacoust.2008.09.016 – volume: 82 issue: 2 year: 2010 ident: 10.1016/j.ultsonch.2025.107290_b28 article-title: Microbubble shape oscillations excited through ultrasonic parametric driving publication-title: Phys. Rev. E doi: 10.1103/PhysRevE.82.026321 – volume: 15 start-page: 294 issue: 4 year: 2008 ident: 10.1016/j.ultsonch.2025.107290_b9 article-title: Importance of acoustic shielding in sonochemistry publication-title: Ultrason. Sonochem. doi: 10.1016/j.ultsonch.2007.09.015 – year: 2013 ident: 10.1016/j.ultsonch.2025.107290_b32 – volume: 55 start-page: 3747 year: 1997 ident: 10.1016/j.ultsonch.2025.107290_b65 article-title: Bjerknes force threshold for stable single bubble sonoluminescence publication-title: Phys. Rev. E doi: 10.1103/PhysRevE.55.3747 – volume: vol. 2 start-page: 1475 year: 2003 ident: 10.1016/j.ultsonch.2025.107290_b105 article-title: Simulation of the translational motion of few cavitation bubbles in an ultrasonic field – year: 2018 ident: 10.1016/j.ultsonch.2025.107290_b36 – volume: 57 start-page: 4987 issue: 22 year: 2002 ident: 10.1016/j.ultsonch.2025.107290_b41 article-title: Modelling and experimental investigation into cavity dynamics and cavitational yield: influence of dual frequency ultrasound sources publication-title: Chem. Eng. Sci. doi: 10.1016/S0009-2509(02)00271-3 – year: 2020 ident: 10.1016/j.ultsonch.2025.107290_b98 – volume: 21 issue: 2 year: 2009 ident: 10.1016/j.ultsonch.2025.107290_b87 article-title: The stability of a bubble in a weakly viscous liquid subject to an acoustic traveling wave publication-title: Phys. Fluids doi: 10.1063/1.3076932 – start-page: 363 year: 2006 ident: 10.1016/j.ultsonch.2025.107290_b37 article-title: Autonomous inverted helicopter flight via reinforcement learning – start-page: 3803 year: 2018 ident: 10.1016/j.ultsonch.2025.107290_b38 article-title: Sim-to-real transfer of robotic control with dynamics randomization – year: 2019 ident: 10.1016/j.ultsonch.2025.107290_b96 – volume: 7 start-page: 1325 issue: 6 year: 1995 ident: 10.1016/j.ultsonch.2025.107290_b25 article-title: Translational instability of a bubble undergoing shape oscillations publication-title: Phys. Fluids doi: 10.1063/1.868520 – volume: 501 start-page: 1 year: 2004 ident: 10.1016/j.ultsonch.2025.107290_b26 article-title: Translational motion of a bubble undergoing shape oscillations publication-title: J. Fluid Mech. doi: 10.1017/S0022112003006220 – year: 2018 ident: 10.1016/j.ultsonch.2025.107290_b40 – volume: 33 issue: 1 year: 2021 ident: 10.1016/j.ultsonch.2025.107290_b79 article-title: Classification of the major nonlinear regimes of oscillations, oscillation properties, and mechanisms of wave energy dissipation in the nonlinear oscillations of coated and uncoated bubbles publication-title: Phys. Fluids doi: 10.1063/5.0032766 – volume: 34 start-page: 1465 issue: 9 year: 2008 ident: 10.1016/j.ultsonch.2025.107290_b82 article-title: Nonspherical oscillations of ultrasound contrast agent microbubbles publication-title: Ultrasound Med. Biol. doi: 10.1016/j.ultrasmedbio.2008.01.020 – volume: 41 start-page: 187 issue: 1 year: 2015 ident: 10.1016/j.ultsonch.2025.107290_b74 article-title: Shaken and stirred: Mechanisms of ultrasound-enhanced thrombolysis publication-title: Ultrasound Med. Biol. doi: 10.1016/j.ultrasmedbio.2014.08.018 – volume: 6 start-page: 25 issue: 1 year: 1999 ident: 10.1016/j.ultsonch.2025.107290_b103 article-title: Acoustic cavitation structures and simulations by a particle model publication-title: Ultrason. Sonochem. doi: 10.1016/S1350-4177(98)00025-X – volume: 14 start-page: 1420 issue: 4 year: 2002 ident: 10.1016/j.ultsonch.2025.107290_b46 article-title: Translational motion of a spherical bubble in an acoustic standing wave of high intensity publication-title: Phys. Fluids doi: 10.1063/1.1458597 – volume: 92 year: 2023 ident: 10.1016/j.ultsonch.2025.107290_b61 article-title: Numerical investigation of the translational motion of bubbles: The comparison of capabilities of the time-resolved and the time-averaged methods publication-title: Ultrason. Sonochem. doi: 10.1016/j.ultsonch.2022.106253 – volume: 18 start-page: 92 issue: 1 year: 2011 ident: 10.1016/j.ultsonch.2025.107290_b18 article-title: Development and optimization of acoustic bubble structures at high frequencies publication-title: Ultrason. Sonochem. doi: 10.1016/j.ultsonch.2010.03.004 – volume: 116 start-page: 821 issue: 2 year: 2004 ident: 10.1016/j.ultsonch.2025.107290_b100 article-title: Mathematical model for collective bubble dynamics in strong ultrasound fields publication-title: J. Acoust. Soc. Am. doi: 10.1121/1.1768255 – volume: 2 start-page: 28 issue: 1 year: 2010 ident: 10.1016/j.ultsonch.2025.107290_b70 article-title: Sonochemical treatment of water polluted by chlorinated organocompounds. A review publication-title: Water doi: 10.3390/w2010028 – volume: 11 start-page: 1309 issue: 6 year: 1999 ident: 10.1016/j.ultsonch.2025.107290_b83 article-title: The effect of viscosity on the spherical stability of oscillating gas bubbles publication-title: Phys. Fluids doi: 10.1063/1.869996 – volume: 149 start-page: 57 issue: 1 year: 2009 ident: 10.1016/j.ultsonch.2025.107290_b3 article-title: Mechanistic approach to intensification of sonochemical degradation of phenol publication-title: Chem. Eng. J. doi: 10.1016/j.cej.2008.10.004 – volume: 78 issue: 3 year: 2008 ident: 10.1016/j.ultsonch.2025.107290_b66 article-title: Analytical expressions for primary Bjerknes force on inertial cavitation bubbles publication-title: Phys. Rev. E doi: 10.1103/PhysRevE.78.036322 – volume: 6 start-page: 418 issue: 1 year: 1994 ident: 10.1016/j.ultsonch.2025.107290_b54 article-title: A note on the history force on a spherical bubble at finite Reynolds number publication-title: Phys. Fluids doi: 10.1063/1.868039 – volume: 95 year: 2023 ident: 10.1016/j.ultsonch.2025.107290_b10 article-title: Probing the pressure dependence of sound speed and attenuation in bubbly media: Experimental observations, a theoretical model and numerical calculations publication-title: Ultrason. Sonochem. doi: 10.1016/j.ultsonch.2023.106319 – year: 2022 ident: 10.1016/j.ultsonch.2025.107290_b35 – volume: 263 start-page: 521 year: 2017 ident: 10.1016/j.ultsonch.2025.107290_b11 article-title: Particle manipulation using standing acoustic waves in the microchannel at dual-frequency excitation: Effect of power ratio publication-title: Sens. Actuators A: Phys. doi: 10.1016/j.sna.2017.07.023 – volume: 56 start-page: 2924 issue: 3 year: 1997 ident: 10.1016/j.ultsonch.2025.107290_b63 article-title: Bjerknes forces between small cavitation bubbles in a strong acoustic field publication-title: Phys. Rev. E doi: 10.1103/PhysRevE.56.2924 – volume: 27 issue: 12 year: 2015 ident: 10.1016/j.ultsonch.2025.107290_b85 article-title: Non-linear shape oscillations of rising drops and bubbles: Experiments and simulations publication-title: Phys. Fluids doi: 10.1063/1.4936980 – volume: 17 start-page: 1010 issue: 6 year: 2010 ident: 10.1016/j.ultsonch.2025.107290_b71 article-title: Sonoelectrochemical treatment of water polluted with trichloroacetic acid: From sonovoltammetry to pre-pilot plant scale publication-title: Ultrason. Sonoch. doi: 10.1016/j.ultsonch.2009.11.009 – volume: 75 start-page: 954 issue: 5 year: 1995 ident: 10.1016/j.ultsonch.2025.107290_b80 article-title: Bubble shape oscillations and the onset of sonoluminescence publication-title: Phys. Rev. Lett. doi: 10.1103/PhysRevLett.75.954 – volume: 41 start-page: 419 year: 2018 ident: 10.1016/j.ultsonch.2025.107290_b42 article-title: Numerical investigation of the inertial cavitation threshold under multi-frequency ultrasound publication-title: Ultrason. Sonochem. doi: 10.1016/j.ultsonch.2017.10.004 – volume: 112 start-page: 1346 issue: 4 year: 2002 ident: 10.1016/j.ultsonch.2025.107290_b53 article-title: Coupled dynamics of translation and collapse of acoustically driven microbubbles publication-title: J. Acoust. Soc. Am. doi: 10.1121/1.1502899 – volume: 102 start-page: 1522 issue: 3 year: 1997 ident: 10.1016/j.ultsonch.2025.107290_b64 article-title: Bjerknes force and bubble levitation under single-bubble sonoluminescence conditions publication-title: J. Acoust. Soc. Am. doi: 10.1121/1.420065 – volume: 44 start-page: 14500 issue: 29 year: 2019 ident: 10.1016/j.ultsonch.2025.107290_b69 article-title: The Sono-Hydro-Gen process (Ultrasound induced hydrogen production): Challenges and opportunities publication-title: Int. J. Hydrog. Energy doi: 10.1016/j.ijhydene.2019.04.115 – volume: 8 start-page: 20597 year: 2020 ident: 10.1016/j.ultsonch.2025.107290_b14 article-title: Model-free control for dynamic-field acoustic manipulation using reinforcement learning publication-title: IEEE Access doi: 10.1109/ACCESS.2020.2969277 – volume: 18 issue: 7 year: 2006 ident: 10.1016/j.ultsonch.2025.107290_b86 article-title: Translation and oscillation of a bubble under axisymmetric deformation publication-title: Phys. Fluids doi: 10.1063/1.2227047 – volume: 68 start-page: 628 issue: 2 year: 1980 ident: 10.1016/j.ultsonch.2025.107290_b47 article-title: Bubble oscillations of large amplitude publication-title: J. Acoust. Soc. Am. doi: 10.1121/1.384720 – volume: 103 issue: 5 year: 2013 ident: 10.1016/j.ultsonch.2025.107290_b75 article-title: Interactions between ultrasound stimulated microbubbles and fibrin clots publication-title: Appl. Phys. Lett. doi: 10.1063/1.4816750 – year: 2016 ident: 10.1016/j.ultsonch.2025.107290_b34 – volume: 22 start-page: 59 year: 2015 ident: 10.1016/j.ultsonch.2025.107290_b20 article-title: Stable tridimensional bubble clusters in multi-bubble sonoluminescence (MBSL) publication-title: Ultrason. Sonochem. doi: 10.1016/j.ultsonch.2014.06.003 – volume: 66 year: 2020 ident: 10.1016/j.ultsonch.2025.107290_b77 article-title: Critical corrections to models of nonlinear power dissipation of ultrasonically excited bubbles publication-title: Ultrason. Sonochem. doi: 10.1016/j.ultsonch.2020.105089 – start-page: 387 year: 2014 ident: 10.1016/j.ultsonch.2025.107290_b62 article-title: Deterministic policy gradient algorithms – year: 2015 ident: 10.1016/j.ultsonch.2025.107290_b33 article-title: Human-level control through deep reinforcement learning publication-title: Nature doi: 10.1038/nature14236 – year: 2019 ident: 10.1016/j.ultsonch.2025.107290_b97 – year: 2003 ident: 10.1016/j.ultsonch.2025.107290_b31 – volume: 23 issue: 12 year: 2013 ident: 10.1016/j.ultsonch.2025.107290_b16 article-title: Acousto-fluidic system assisting in-liquid self-assembly of microcomponents publication-title: J. Micromech. Microeng. doi: 10.1088/0960-1317/23/12/125026 – volume: 66 start-page: 16 year: 2015 ident: 10.1016/j.ultsonch.2025.107290_b45 article-title: Influences of pressure amplitudes and frequencies of dual-frequency acoustic excitation on the mass transfer across interfaces of gas bubbles publication-title: Int. J. Heat Mass Transfer – year: 2015 ident: 10.1016/j.ultsonch.2025.107290_b95 – volume: 21 start-page: 1696 issue: 5 year: 2014 ident: 10.1016/j.ultsonch.2025.107290_b29 article-title: Generation and control of acoustic cavitation structure publication-title: Ultrason. Sonochem. doi: 10.1016/j.ultsonch.2014.02.027 – volume: 32 start-page: 659 issue: 2000 year: 2000 ident: 10.1016/j.ultsonch.2025.107290_b55 article-title: The motion of high-Reynolds-number bubbles in inhomogeneous flows publication-title: Annu. Rev. Fluid Mech. doi: 10.1146/annurev.fluid.32.1.659 – start-page: 139 year: 1999 ident: 10.1016/j.ultsonch.2025.107290_b104 article-title: Particle approach to structure formation in acoustic cavitation – volume: 194 start-page: 104 year: 2018 ident: 10.1016/j.ultsonch.2025.107290_b5 article-title: Treatment of Perfluorooctane Sulfonic Acid (PFOS) using a large-scale sonochemical reactor publication-title: Sep. Purif. Technol doi: 10.1016/j.seppur.2017.11.009 – volume: 229 start-page: 29 year: 1991 ident: 10.1016/j.ultsonch.2025.107290_b24 article-title: Parametric resonance of a spherical bubble publication-title: J. Fluid Mech. doi: 10.1017/S0022112091002926 – start-page: 37 year: 2018 ident: 10.1016/j.ultsonch.2025.107290_b1 – year: 2018 ident: 10.1016/j.ultsonch.2025.107290_b30 – volume: 41 start-page: 472 issue: 2 year: 1998 ident: 10.1016/j.ultsonch.2025.107290_b51 article-title: Drag coefficients of single bubbles under normal and micro gravity conditions publication-title: JSME Int. J. Ser. B doi: 10.1299/jsmeb.41.472 – volume: 42 start-page: 2555 issue: 7 year: 2013 ident: 10.1016/j.ultsonch.2025.107290_b2 article-title: Sonochemical synthesis of nanomaterials publication-title: Chem. Soc. Rev. doi: 10.1039/C2CS35282F – volume: 21 issue: 9 year: 2009 ident: 10.1016/j.ultsonch.2025.107290_b23 article-title: History force on coated microbubbles propelled by ultrasound publication-title: Phys. Fluids doi: 10.1063/1.3227903 – volume: 51 start-page: 533 year: 2019 ident: 10.1016/j.ultsonch.2025.107290_b92 article-title: Sonochemical and sonoelectrochemical production of hydrogen publication-title: Ultrason. Sonochem. doi: 10.1016/j.ultsonch.2018.08.024 – start-page: 1 year: 2005 ident: 10.1016/j.ultsonch.2025.107290_b102 article-title: Bubble structures in acoustic cavitation – volume: 62 start-page: 2158 issue: 2 year: 2000 ident: 10.1016/j.ultsonch.2025.107290_b81 article-title: Single-bubble sonoluminescence: Shape stability analysis of collapse dynamics in a semianalytical approach publication-title: Phys. Rev. E doi: 10.1103/PhysRevE.62.2158 – volume: 661 start-page: 95 year: 2005 ident: 10.1016/j.ultsonch.2025.107290_b48 article-title: Bjerknes forces and translational bubble dynamics publication-title: Bubble Part. Dyn. Acoust. Fields: Mod. Trends Appl. – volume: 26 start-page: 817 issue: 6 year: 2002 ident: 10.1016/j.ultsonch.2025.107290_b21 article-title: Study on the bubble motion control by ultrasonic wave publication-title: Exp. Therm. Fluid Sci. doi: 10.1016/S0894-1777(02)00197-8 – volume: 519 start-page: 27 year: 2019 ident: 10.1016/j.ultsonch.2025.107290_b94 article-title: Sonochemical production of hydrogen: Enhancement by summed harmonics excitation publication-title: Chem. Phys. doi: 10.1016/j.chemphys.2018.11.019 – volume: 31 start-page: 610 year: 2016 ident: 10.1016/j.ultsonch.2025.107290_b19 article-title: Positional stability and radial dynamics of sonoluminescent bubbles under bi-harmonic driving: Effect of the high-frequency component and its relative phase publication-title: Ultrason. Sonochem. doi: 10.1016/j.ultsonch.2016.02.013 – year: 2019 ident: 10.1016/j.ultsonch.2025.107290_b99 – year: 2017 ident: 10.1016/j.ultsonch.2025.107290_b106 – volume: 490 year: 2021 ident: 10.1016/j.ultsonch.2025.107290_b13 article-title: Dynamic acoustic fields for size selective particle separation on centimeter scale publication-title: J. Sound Vib. doi: 10.1016/j.jsv.2020.115723 |
| SSID | ssj0003920 |
| Score | 2.4604237 |
| Snippet | Reinforcement Learning (RL) is employed to develop control techniques for manipulating acoustic cavitation bubbles. This paper presents a proof of concept in... |
| SourceID | doaj pubmedcentral proquest pubmed crossref elsevier |
| SourceType | Open Website Open Access Repository Aggregation Database Index Database Enrichment Source Publisher |
| StartPage | 107290 |
| SubjectTerms | Bubble dynamics Bubble position control GPU programming Reinforcement learning Selected Papers from EES 2024 |
| Title | Position control of an acoustic cavitation bubble by reinforcement learning |
| URI | https://dx.doi.org/10.1016/j.ultsonch.2025.107290 https://www.ncbi.nlm.nih.gov/pubmed/40058020 https://www.proquest.com/docview/3175680292 https://pubmed.ncbi.nlm.nih.gov/PMC11930750 https://doaj.org/article/798cbdec0c2346fa86003e89489f9d74 |
| Volume | 115 |
| WOSCitedRecordID | wos001443083400001&url=https%3A%2F%2Fcvtisr.summon.serialssolutions.com%2F%23%21%2Fsearch%3Fho%3Df%26include.ft.matches%3Dt%26l%3Dnull%26q%3D |
| hasFullText | 1 |
| inHoldings | 1 |
| isFullTextHit | |
| isPrint | |
| journalDatabaseRights | – providerCode: PRVAON databaseName: DOAJ Directory of Open Access Journals customDbUrl: eissn: 1873-2828 dateEnd: 99991231 omitProxy: false ssIdentifier: ssj0003920 issn: 1350-4177 databaseCode: DOA dateStart: 20210101 isFulltext: true titleUrlDefault: https://www.doaj.org/ providerName: Directory of Open Access Journals – providerCode: PRVESC databaseName: Elsevier SD Freedom Collection Journals 2021 customDbUrl: eissn: 1873-2828 dateEnd: 99991231 omitProxy: false ssIdentifier: ssj0003920 issn: 1350-4177 databaseCode: AIEXJ dateStart: 20210101 isFulltext: true titleUrlDefault: https://www.sciencedirect.com providerName: Elsevier |
| link | http://cvtisr.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwrV1Nb9QwEB1BBYILgvIVPiojcQ1N7Di2j1BRISFVPYC0N8ueOLDVKkXb3Ur8e8aOs9rAYS9ck9iyPWPPczx-D-B9rwxGDpbSUbgpmzrOuc5hKYVHJ3spnOmS2IS6uNCLhbnck_qKOWEjPfA4cKfKaPRdwAq5aNreaYrQImjTaNObTiUm0EqZaTOV12CK-uP9YFlRA5Tauxt89WG72hCWTUcRXNJDwpfVLCwl9v5ZdPoXff6dRLkXlc4fw6MMJ9nHsRtP4E4YjuHB2aTidgz3U4on3jyFr5c5P4vl9HR23TM3MFoSk6IXQ3ebCbuZ33q_Csz_ZuuQqFUx_UVkWWPixzP4fv7529mXMksplEgr2qYU3AunG6dpe8VdLZ0TusWKu9Yr3wrRtxiiBk3dYRva3mBH-8ogAwEK5Ggq8RyOhushvATWhqaikki19WQE6WtsHOEarqRHGXQBchpJi7nZUe5iZaeEsis7WcBGC9jRAgWc7sr9Gpk2Dpb4FA21-zoyZacH5D82-4895D8FmMnMNoOOEUxQVcuDDXg3-YUls8ajFjcEMpqNqKzVFTe8gBejn-ya2UQpR0LpBeiZB836MX8zLH8m5u-a4HbEeK_-R89fw8PYlzEN6Q0cbdbb8Bbu4e1mebM-gbtqoU_SrPoDkBUl2A |
| linkProvider | Directory of Open Access Journals |
| openUrl | ctx_ver=Z39.88-2004&ctx_enc=info%3Aofi%2Fenc%3AUTF-8&rfr_id=info%3Asid%2Fsummon.serialssolutions.com&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=Position+control+of+an+acoustic+cavitation+bubble+by+reinforcement+learning&rft.jtitle=Ultrasonics+sonochemistry&rft.au=Klapcsik%2C+K%C3%A1lm%C3%A1n&rft.au=Gyires-T%C3%B3th%2C+B%C3%A1lint&rft.au=Rossell%C3%B3%2C+Juan+Manuel&rft.au=Heged%C5%B1s%2C+Ferenc&rft.date=2025-04-01&rft.pub=Elsevier&rft.issn=1350-4177&rft.eissn=1873-2828&rft.volume=115&rft_id=info:doi/10.1016%2Fj.ultsonch.2025.107290&rft.externalDocID=PMC11930750 |
| thumbnail_l | http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/lc.gif&issn=1350-4177&client=summon |
| thumbnail_m | http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/mc.gif&issn=1350-4177&client=summon |
| thumbnail_s | http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/sc.gif&issn=1350-4177&client=summon |