publications

all publications

1. Lens Model Accuracy in the Expected LSST Lensed AGN Sample

   Padmavathi Venkatraman, Sydney Erickson, Phil Marshall, Martin Millon, Philip Holloway, Simon Birrer, Steven Dillmann, Xiangyu Huang, Sreevani Jaragula, Ralf Kaehler, Narayan Khadka, Grzegorz Madejski, Ayan Mitra, Kevil Reil, Aaron Roodman, LSST Dark Energy Science Collaboration

   The Astronomical Journal 172 (4), 223 science
   1
   2026
2. OSWorld-Science: A Benchmark of Computer Use Agents for Learning and Using Scientific Software

   Dingyuan Dai, Heli Qi, Lei Liu, Yinxi Li, Baiding Chen, Zijun Dou, Qingcheng Zeng, Qi Kang, Oliver Sun, Eric Wang, Bo Zhou, Haixin Wang, Yufan Du, Shi Bo, Ruihan Lin, Mengqi Yuan, Dunjie Lu, Steven Dillmann, Yiming Shi, Tina Su, Amy Xin, Minghao Liu, Xi Wang, Xu Huang, Ge Zhang, Pengyu Nie, Zhen Yang, Jie Tang, Juanzi Li, Weihao Xuan, Tianyu Liu

   arXiv preprint arXiv:2609.39903 agentsai evaluation
   2026
3. Lens Modeling and Cosmological Inference from an Impure Sample of Galaxy-Galaxy Strong Lenses

   Philip Holloway, Aprajita Verma, Philip J Marshall, Padmavathi Venkatraman, Sydney Erickson, Tian Li, Simon Birrer, Steven Dillmann, Thomas E Collett, LSST Dark Energy Science Collaboration

   arXiv preprint arXiv:2609.21699 science
   2026
4. Harbor Adapters and Harbor-Index: Infrastructure and a Curated Meta-Dataset for Large-Scale Agentic Evaluation

   Lin Shi, Haowei Lin, Zixuan Zhu, Xiaoyue Zhou, Xiang Li, Xiangning Lin, Yaxuan Deng, Han Xu, Yuangang Li, Shanda Li, Zizhao Chen, Hanwen Xing, Harsh Raj, Bo Chen, Quan Shi, Steven Dillmann, Yipeng Gao, Puneesh Khanna, Ruofan Lu, Chao Beyond Zhou, Michael Yang, Robert Zhang, Siyuan Chai, Jiayu Chang, Yizhao Chen, Xiaokun Chen, Yiwei Dai, Wenting Yang, Hange Liu, Minghao Liu, Zihan Wang, Adnan El Assadi, Benedikt Stroebl, E Kelly Buchanan, Han Meng, Junwei He, Longxuan Yu, Radin Shayanfar, Yukyung Lee, Zhikang Dong, Allen G Hart, Anjiang Wei, Anurag Kashyap, Arpandeep Khatua, Audrey Jixin Zheng, Chengrui Ma, David Heineman, Dubing Chen, Hai-Anh Trinh, Haishuo Fang, Hefan Zhang, Hui Shen, Issa Sugiura, Jiankai Sun, Jiechao Gao, Junhong Lin, Junnan Li, Kai Yang, Lei Hsiung, Maoyu Wang, Mengze Tang, Nabil Omi, Negin Raoof, Nicholas Edwards, Octavia Guo, Orfeas Menis Mastromichalakis, Pengliang Ji, PrzemysĹ Hejman, Qi Qi, Qunshu Lin, Richard Zhuang, Rui Yang, Ruichen Zheng, Ryan Marten, Shaghayegh Fazliani, Shizheng Hou, Sicong Jiang, Sijie Li, Song Bian, Terry Yue Zhuo, Tianqing Wu, Tom Tang, Wanjia Zhao, Weihao Xuan, Wenhua Liang, Xian Liu, Xin Lan, Xuan Zhang, Xuandong Zhao, Yanchuan Tang, Yifan Jiang, Yijiang Li, Yitong Guan, Yizhi Li, Yonghui Liu, Yuheng Tang, Yunfei Zhao, Yuxin Wang, Yuxuan Tang, Zhenheng Tang, Zhifei Li, Ziruo Wang, Ziyu She, Kaiyuan Liu, Iheb Chaabane, Yuxin Tang, Xiangyi Li, Andy Konwinski, Boxuan Li, Leon Liangyu Chen, Alex Dimakis, Nicholas Carlini, Soroush Vosoughi, Di He, Etash Guha, Benjamin Feuer, Mike Merrill, Ludwig Schmidt, Alex Shaw

   arXiv preprint arXiv:2609.04298 agentsai evaluation
   1
   2026
5. Bringing analytic rigor to agentic AI for science: The Brain Researcher platform for neuroimaging data analysis

   Zijiao Chen, Nicholas Lu, Xinhui Li, Jocelyn A Ricard, Ce Ju, Huan H Wang, Christian Kindermann, Jeanette A Mumford, Steven Dillmann, James Kent, Alejandro de la Vega, Sanmi Koyejo, Vince D Calhoun, Joshua W Buckholtz, Juan Helen Zhou, Steffen Bollmann, Russell A Poldrack

   arXiv preprint arXiv:2608.19902 agentsai for sciencescience
   2026
6. Measuring AI Scientists: From Exams to Discovery

   Yuanqi Du, Steven Dillmann, Jon Laurent, Peter Jansen, Haojun Jia, Ludwig Schmidt, Andrew White, Kristin Persson, Chenru Duan

   ai evaluationai for science
   2026
7. Early Exploration of the Scientific Discovery Space for the Habitable Worlds Observatory

   Courtney D Dressing, Danica Adams, Evelyne Alecian, Gagandeep Anand, Giada Arney, Sarah Gomes Aroucha Barbosa, Martin Barstow, Joanna K Barstow, Rachael L Beaton, Eduardo Bendek, Svetlana Berdyugina, Julie Biedermann, Sarah Blunt, Sanchayeeta Borthakur, Kara Brugman, Joseph N Burchett, Eric Burns, Jenna M Cann, Ludmila Carone, Cody A Carr, Richard Cartwright, Renyue Cen, Jean-yves Chaufray, Pin Chen, Lígia F Coelho, Kyle Cook, Nicolas B Cowan, Patricio E Cubillos, Alexandre David-Uraz, Tansu Daylan, Jessica E Doppel, Leonardo dos Santos, Meredith Durbin, Rana Ezzeddine, Tara Fetherolf, Theresa Fisher, Leigh N Fletcher, Luca Fossati, Ana I Gómez de Castro, Kaz Gary, Varoujan Gorjian, Yasuhiro Hasegawa, Qiuhan He, Natalie Hinkel, Keri Hoadley, Renyu Hu, Noam Izenberg, Estelle Janin, Mathilde Jauzac, Stephen R Kane, Theodora Karalidi, Émilie Anne Lafléche, David J Lagattuta, Érika Le Bourdais, Mary Anne Limbach, Jacob Lustig-Yaeger, Eric Mamajek, Kathleen Mandt, Frédéric Marin, Taro Matsuo, Stephan R McCandliss, Michael W McElwain, Emma Miles, Michiel Min, Leonidas A Moustakas, Coralie Neiner, Elisabeth Newton, James W Nightingale, Stephanie Olson, Colby Ostberg, Apurva V Oza, Fabio Pacucci, Roberta Paladini, Niki Parenteau, Lynnae C Quick, Ramses Ramirez, Sukrit Ranjan, Isabel Rebollido, Bin B Ren, Kurt D Retherford, Jason Rhodes, Ian U Roederer, Sabina Sagynbayeva, Edward Schwieterman, Adam Smercina, Krista Lynne Smith, Antoine Strugarek, Megan Taylor Tillman, Georgios N Vassilakis, Hannah R Wakeford, Sara Walker, Siyi Xu, Lulu Zhang, Alejandra Aguirre-Santaella, Munazza K Alam, Amirnezam Amiri, Ramya M Anche, Sarah E Anderson, David R Ardila, Karla Z Arellano-Córdova, Natasha E Batalha, Thomas G Beatty, Juliette Becker, Enrica Bellocchi, Mark Booth, Médéric Boquien, Sarah EI Bosman, Jean-Claude Bouret, Vincent Bourrier, Matteo Brogi, Andrew M Buchan, Blakesley Burkhart, Jennifer A Burt, José A Caballero, Sarah L Casewell, Frances H Cashman, Laura Chin, Yumi Choi, Jessie Christiansen, Francesca Civano, Kyle W Cook, Brandon Park Coy, Brendan P Crill, Leroy Cronin, Håkon Dahle, Mario Damiano, William Danchi, Satyapriya Das, Brice-Olivier Demory, Jamie Dietrich, Steven Dillmann, Chuanfei Dong, Dwaipayan Dubey, Patrick Dufour, Arika Egan, Christiana Erba, Steve Ertel, Raissa Estrela, Vincent Van Eylen, Virginie Faramaz-Gorka, Andrzej Fludra, Sophia Flury, Andrew Fox, Kevin France, David M French, Marina Galand, Tianmu Gao, Antonio García Muñoz, Miriam Garcia, Kenneth Gayley

   arXiv preprint arXiv:2608.11294 science
   2026
8. SLSim: Strong lensing simulation pipeline

   Narayan Khadka, Simon Birrer, Henry Best, Paras Sharma, Katsuya T Abe, Xianzhe Tang, Carly Mistick, Felipe Urcelay, Emrecan M Sonmez, Nikki Arendse, Sydney Erickson, Jacob O Hjortlund, Phil Holloway, Alan Huang, Rahul Karthik, Mia Lamontagne, Vibhore Negi, Justin R Pierel, Bruno Sanchez, Aysu Ece Saricaoglu, Anowar Shajib, Yixuan Shao, Padma Venkatraman, Bryce Wedig, Aadya Agrawal, Timo Bessa Anguita, Clecio R Bom, Sofia Castillo, Thomas Collett, Tansu Daylan, Steven Dillmann, Margherita Grespan, Erin E Hayes, Remy Joseph, Richard Kessler, Tian Li, Phil Marshall, Anupreeta More, Veronica Motta, Gautham Narayan, Matt O'Dowd, Masamune Oguri, Graham Smith, Aprajita Verma, Giorgos Vernardos, Strong Lensing Science Collaboration, LSST Dark Energy Science Collaboration

   Astrophysics Source Code Library, ascl: 2608.001 science
   2026
9. OpenThoughts-Agent: Data Recipes for Agentic Models

   Negin Raoof, Richard Zhuang, Marianna Nezhurina, Etash Guha, Atula Tejaswi, Ryan Marten, Charlie F Ruan, Tyler Griggs, Alexander Glenn Shaw, Hritik Bansal, E Kelly Buchanan, Artem Gazizov, Reinhard Heckel, Chinmay Hegde, Sankalp Jajee, Daanish Khazi, Emmanouil Koukoumidis, Xiangyi Li, Hange Liu, Shlok Natarajan, Harsh Raj, Nicholas Roberts, Ethan Shen, Nishad Singhi, Michael Siu, Ashima Suvarna, Hanwen Xing, Patrick Yubeaton, Robert Zhang, Leon Liangyu Chen, Xiaokun Chen, Steven Dillmann, Saadia Gabriel, Xunyi Jiang, Anurag Kashyap, Boxuan Li, Yein Park, Minh Pham, Sujay Sanghavi, Lin Shi, Ke Sun, Yixin Wang, Zhiwei Xu, Erica Zhang, Siyan Zhao, Wanjia Zhao, Jenia Jitsev, Alex Dimakis, Benjamin Feuer, Ludwig Schmidt

   arXiv preprint arXiv:2606.24855 agentsfoundation models
   17
   2026
10. Every eval ever: A unifying schema and community repository for AI evaluation results

    Jan Batzner, Sree Harsha Nelaturu, Damian Stachura, Anastassia Kornilova, Jon Crall, Tommaso Cerruti, Yanan Long, Yifan Mai, Sanchit Ahuja, Asaf Yehudai, Marek Šuppa, John P Lalor, Oluwagbemike Olowe, Jatin Ganhotra, Brian H Hu, Eliya Habba, Andrew M Bean, Chang Liu, Sander Land, Steven Dillmann, Aniketh Garikaparthi, Elron Bandel, Saki Imai, James Edgell, Wm Matthew Kennedy, Jenny Chim, Patrick Meusling, Asteria Kaeberlein, Venkata Ramachandra Karthik Chundi, Manasi Patwardhan, Martin Ku, Austin Meek, Leon Knauer, Brian Wingenroth, Srishti Yadav, Usman Gohar, Felix Friedrich, Michelle Lin, Jennifer Mickel, Arman Cohan, Stella Biderman, Irene Solaiman, Zeerak Talat, Anka Reuel, Mubashara Akhtar, Gjergji Kasneci, Avijit Ghosh, Leshem Choshen

    arXiv preprint arXiv:2606.14516 ai evaluation
    2026
11. SWE-Marathon: Can Agents Autonomously Complete Ultra-Long-Horizon Software Work?

    Rishi Desai, Jesse Hu, Joan Cabezas, Neel Harsola, Pratyush Shukla, Roey Ben Chaim, Adnan El Assadi, Omkaar Mukund Kamath, Fenil Faldu, Prannay Hebbar, Jiankai Sun, Yiyuan Li, Pramod Srinivasan, Ishan Gupta, Christopher Settles, Daniel Wang, Derek Chen, Pranav Raja, Albert Liu, Marek Šuppa, Nevasini Sasikumar, Luyang Kong, Erik Quintanilla, Xiangyi Li, Ivan Bercovich, Steven Dillmann

    arXiv preprint arXiv:2606.07682 agentsai evaluation
    14
    2026
12. Toward decision-aware AI for LSST-scale time-domain astronomy

    CR Bom, A Mahabal, F Bianco, P Darc, B Fraga, R Bonito, S Chaini, MW Coughlin, S Dillmann, F Fontinele Nunes, A Gomboc, N Hernitschek, X Li, FZ Majidi, AI Malz, A Melandri, V Petrecca, S Piranomonte, M Rabus, F Ragosta, O Razim, MC Romão, N Sarin, A Sasli, VA Srećković, A Tramuto, V Vujčić, MJ Vyas, Rubin LSST Transients, Variable Stars Science Collaboration

    arXiv preprint arXiv:2606.05285 ai for sciencescience
    2026
13. Genome modelling and design across all domains of life with Evo 2

    Garyk Brixi, Matthew G Durrant, Jerome Ku, Mohsen Naghipourfar, Michael Poli, Gwanggyu Sun, Greg Brockman, Daniel Chang, Alison Fanton, Gabriel A Gonzalez, Samuel H King, David B Li, Aditi T Merchant, Eric Nguyen, Chiara Ricci-Tam, David W Romero, Jonathan C Schmok, Ali Taghibakhshi, Anton Vorontsov, Brandon Yang, Myra Deng, Liv Gorton, Nam Nguyen, Nicholas K Wang, Michael T Pearce, Elana Simon, Etowah Adams, Zachary J Amador, Euan A Ashley, Stephen A Baccus, Haoyu Dai, Steven Dillmann, Stefano Ermon, Daniel Guo, Michael H Herschl, Rajesh Ilango, Ken Janik, Amy X Lu, Reshma Mehta, Mohammad RK Mofrad, Madelena Y Ng, Jaspreet Pannu, Christopher Ré, John St. John, Jeremy Sullivan, Joseph Tey, Ben Viggiano, Kevin Zhu, Greg Zynda, Daniel Balsam, Patrick Collison, Anthony B Costa, Tina Hernandez-Boussard, Eric Ho, Ming-Yu Liu, Thomas McGrath, Kimberly Powell, Sudarshan Pinglay, Dave P Burke, Hani Goodarzi, Patrick D Hsu, Brian L Hie

    Nature 652 (8112), 1349-1361 ai for sciencefoundation modelsscience
    716
    2026
14. Terminal-bench: Benchmarking agents on hard, realistic tasks in command line interfaces

    Mike Merrill, Alexander Shaw, Nicholas Carlini, Boxuan Li, Harsh Raj, Ivan Bercovich, Lin Shi, Jeong Shin, Thomas Walshe, E Kelly Buchanan, Junhong Shen, Guanghao Ye, Haowei Lin, Jason Poulos, Maoyu Wang, Marianna Nezhurina, Di Lu, Orfeas Menis Mastromichalakis, Zhiwei Xu, Zizhao Chen, Yue Liu, Robert Zhang, Leon Liangyu Chen, Anurag Kashyap, Jan-Lucas Uslu, Jeffrey Li, Jianbo Wu, Minghao Yan, Song Bian, Vedang Sharma, Ke Sun, Steven Dillmann, Akshay Anand, Andrew Lanpouthakoun, Bardia Koopah, Changran Hu, Etash Guha, Gabriel Dreiman, Jiacheng Zhu, Karl Krauth, Li Zhong, Niklas Muennighoff, Robert Amanfu, Shangyin Tan, Shreyas Pimpalgaonkar, Tushar Aggarwal, Xiangning Lin, Xin Lan, Xuandong Zhao, Yiqing Liang, Yuanli Wang, Zilong Ryan Wang, Changzhi Zhou, David Heineman, Hange Liu, Harsh Trivedi, John Yang, Junhong Lin, Manish Shetty, Michael Yang, Nabil Omi, Negin Raoof, Shanda Li, Terry Yue Zhuo, Wuwei Lin, Yiwei Dai, Yuxin Wang, Wenhao Chai, Shang Zhou, Dariush Wahdany, Ziyu She, Jiaming Hu, Zhikang Dong, Yuxuan Zhu, Sasha Cui, Ahson Saiyed, Arinbjörn Kolbeinsson, Christopher Rytting, Ryan Marten, Yixin Wang, Jenia Jitsev, Alex Dimakis, Andy Konwinski, Ludwig Schmidt

    International Conference on Learning Representations 2026, 40903-40986 agentsai evaluation
    563
    2026
15. AsymmetryZero: A Framework for Operationalizing Human Expert Preferences as Semantic Evals

    Tadhg Looram, Lucas Nuzzi, Kyle Waters, Steven Dillmann

    arXiv preprint arXiv:2605.04083 ai evaluation
    2026
16. COMPOSITE-Stem

    Kyle Waters, Lucas Nuzzi, Tadhg Looram, Alessandro Tomasiello, Ariel Ghislain Kemogne Kamdoum, Bikun Li, Damien Sileo, Egor Kretov, Francesco Fournier-Facio, Georgios Soloupis, Haile Kassahun, Hew Wolff, Jiaqi Cai, Lianghui Li, Marc Roth, Mohinder Naiya, Naixu Guo, Qicheng Tang, Richard Wheeler, Samuele Sala, Serguei Popov, Steven Dillmann, Yuqi Li

    arXiv preprint arXiv:2604.09836 ai evaluation
    2
    2026
17. SLSim: a strong lensing population simulation package

    Narayan Khadka, Simon Birrer, Henry Best, Paras Sharma, Katsuya T Abe, Xianzhe Tang, Carly Mistick, Felipe Urcelay, Emrecan M Sonmez, Nikki Arendse, Sydney Erickson, Jacob O Hjortlund, Phil Holloway, Alan Huang, Rahul Karthik, Mia Lamontagne, Vibhore Negi, Justin R Pierel, Bruno Sanchez, Aysu Ece Saricaoglu, Anowar Shajib, Yixuan Shao, Padma Venkatraman, Bryce Wedig, Aadya Agrawal, Timo Anguita, Pedro Bessa, Clecio R Bom, Sofia Castillo, Thomas Collett, Tansu Daylan, Steven Dillmann, Margherita Grespan, Erin E Hayes, Remy Joseph, Richard Kessler, Tian Li, Phil Marshall, Anupreeta More, Veronica Motta, Gautham Narayan, Matt O'Dowd, Masamune Oguri, Graham Smith, Aprajita Verma, Giorgos Vernardos, Strong Lensing Science Collaboration, LSST Dark Energy Science Collaboration

    arXiv preprint arXiv:2603.17138 science
    2026
18. Relating smartphone ‘App-journeys’ to mental health: A novel network analysis approach

    Georgia Turner, Maria Gastelum, Ian Anderson, Zelda Brufal, Steven Dillmann, Luisa Fassi, Lukas Gunschera, Ivonne Monarca, Oscar Ramirez, Monica Tentori

    OSF science
    3
    2026
19. SkillsBench: Benchmarking how well agent skills work across diverse tasks

    Xiangyi Li, Yimin Liu, Wenbo Chen, Bingran You, Zonglin Di, Yifeng He, Shenghan Zheng, Kyoung Whan Choe, Jiankai Sun, Shuyi Wang, Chujun Tao, Binxu Li, Xuandong Zhao, Hejia Geng, Xiaojun Wu, Junwei Zhou, Xiaokun Chen, Hanwen Xing, Yubo Li, Qunhong Zeng, Di Wang, Yuanli Wang, Roey Ben Chaim, Penghao Jiang, Haotian Shen, Luyang Kong, Xinyi Liu, Runhui Wang, Xuanqing Liu, Jiachen Li, Xin Lan, Yueqian Lin, Wengao Ye, Junwei He, Songlin Li, Yue Zhang, Yipeng Gao, Yijiang Li, Ze Ma, Liqiang Jing, Tianyu Wang, Kaixin Li, Yiqi Xue, Haoran Lyu, Yizhuo He, Yuchen Tian, Shutong Wu, Bowei Wang, Yixuan Gao, Bo Chen, Litong Liu, Sikai Cheng, Jiajun Bao, Shuaicheng Tong, Shuwen Xu, Terry Yue Zhuo, Tinghan Ye, Qi Qi, Miao Li, Longtai Liao, Zelin Tan, Chang Shi, Xilin Tang, Srinath Tankasala, Boqin Yuan, Yaoyao Qian, Jianhong Tu, Chenguang Wang, Yizhou Sun, Wei Wang, Aaron Taylor, Ziyue Yang, Changkun Guan, Zhikang Dong, Xinyu Zhang, Steven Dillmann, Han-chung Lee, Dawn Song

    arXiv preprint arXiv:2602.12670 agentsai evaluation
    246
    2026
20. Opportunities in AI/ML for the Rubin LSST Dark Energy Science Collaboration

    Eric Aubourg, Camille Avestruz, Matthew R Becker, Biswajit Biswas, Rahul Biswas, Boris Bolliet, Adam S Bolton, Clecio R Bom, Raphaël Bonnet-Guerrini, Alexandre Boucaud, Jean-Eric Campagne, Chihway Chang, Aleksandra Ćiprijanović, Johann Cohen-Tanugi, Michael W Coughlin, John Franklin Crenshaw, Juan C Cuevas-Tello, Juan de Vicente, Seth W Digel, Steven Dillmann, Mariano Javier de León Dominguez Romero, Alex Drlica-Wagner, Sydney Erickson, Alexander T Gagliano, Christos Georgiou, Aritra Ghosh, Matthew Grayling, Kirill A Grishin, Alan Heavens, Lindsay R House, Mustapha Ishak, Wassim Kabalan, Arun Kannawadi, François Lanusse, C Danielle Leonard, Pierre-François Léget, Michelle Lochner, Yao-Yuan Mao, Peter Melchior, Grant Merz, Martin Millon, Anais Möller, Gautham Narayan, Yuuki Omori, Hiranya Peiris, Laurence Perreault-Levasseur, Andrés A Plazas Malagón, Nesar Ramachandra, Benjamin Remy, Cécile Roucelle, Jaime Ruiz-Zapatero, Stefan Schuldt, Ignacio Sevilla-Noarbe, Ved G Shah, Tjitske Starkenburg, Stephen Thorp, Laura Toribio San Cipriano, Tilman Tröster, Roberto Trotta, Padma Venkatraman, Amanda Wasserman, Tim White, Justine Zeghal, Tianqing Zhang, Yuanyuan Zhang, LSST Dark Energy Science Collaboration

    arXiv preprint arXiv:2601.14235 ai for sciencescience
    2026
21. Harbor: A framework for evaluating and optimizing agents and models in container environments, 2026

    Harbor Framework Team

    URL https://doi.org/10.5281/zenodo 20953922 agentsai evaluation
    95
    2026
22. Investigating the Dark Energy Constraint from Strongly Lensed AGN at LSST-Scale

    Sydney Erickson, Martin Millon, Padmavathi Venkatraman, Tian Li, Philip Holloway, Phil Marshall, Anowar Shajib, Simon Birrer, Xiang-Yu Huang, Timo Anguita, Steven Dillmann, Narayan Khadka, Kate Napier, Aaron Roodman, LSST Dark Energy Science Collaboration

    arXiv preprint arXiv:2511.13669 science
    1
    2025
23. ReplicationBench: Can AI Agents Replicate Astrophysics Research Papers?

    Christine Ye, Sihan Yuan, Suchetha Cooray, Steven Dillmann, Ian LV Roque, Dalya Baron, Philipp Frank, Sergio Martin-Alvarez, Nolan Koblischke, Frank J Qu, Diyi Yang, Risa Wechsler, Ioana Ciuca

    arXiv preprint arXiv:2510.24591 agentsai evaluationai for sciencescience
    28
    2025
24. The Advanced X-ray Imaging Satellite Community Science Book

    Michael Koss, Nafisa Aftab, Steven W Allen, Roberta Amato, Hongjun An, Igor Andreoni, Timo Anguita, Riccardo Arcodia, Thomas Ayres, Matteo Bachetti, Maria Cristina Baglio, Arash Bahramian, Marco Balboni, Ranieri D Baldi, Solen Balman, Aya Bamba, Eduardo Banados, Tong Bao, Iacopo Bartalucci, Antara Basu-Zych, Rebeca Batalha, Lorenzo Battistini, Franz Erik Bauer, Andy Beardmore, Werner Becker, Ehud Behar, Andrea Belfiore, Paz Beniamini, Elena Bertola, Vinicius Bessa, Henry Best, Stefano Bianchi, N Biava, Breanna A Binder, Elizabeth L Blanton, Arash Bodaghee, Tamara Bogdanovic, David Bogensberger, A Bonafede, Matteo Bonetti, Pol Bordas, Alice Borghese, Andrea Botteon, Stella Boula, Enrico Bozzo, Marica Branchesi, William Nielsen Brandt, Joel Bregman, Fabrizio Brighenti, Ettore Bronzini, Giulia Brunelli, Marcella Brusa, Esra Bulbul, Kevin Burdge, Alessandro Caccianiga, Michael Calzadilla, Sergio Campana, Milvia Capalbi, Fiamma Capitanio, Nico Cappelluti, Jonathan Carney, Sabrina Casanova, Daniel Castro, S Bradley Cenko, Joheen Chakraborty, Priyanka Chakraborty, George Chartas, Arka Chatterjee, Prakriti Pal Choudhury, Raven Cilley, Francesca Civano, Andrea Comastri, Thomas Connor, Michael F Corcoran, Lia Corrales, Francesco Coti Zelati, Weiguang Cui, Filippo D'Ammando, Kristen Dage, Tansu Daylan, Sabrina De Grandi, Alessandra De Rosa, Roberto Decarli, Anne Decourchelle, Nathalie Degenaar, Antonino Del Popolo, Alessandro Di Marco, Tiziana Di Salvo, Simone Dichiara, Stephen DiKerby, Steven Dillmann, Neil Doerksen, Paul Draghis, Jeremy J Drake, Lorenzo Ducci, Renato Dupke, Joseph Durbak, Girish M Duvvuri, Hannah Dykaar, Dominique Eckert, Martin Elvis, Catherine Espaillat, Paolo Esposito, Felix Furst, Giuseppina Fabbiano, Joshua Fagin, Abraham Falcone, Elena Fedorova, Adina Feinstein, Jorge Fernandez Fernandez, Gilles Ferrand, Anthony M Flores, N Foo, Nicholas Foo, Adi Foord, Alessia Franchini, Federico Fraschetti, Brenda L Frye, James D Lowenthal, Chris Fryer, Shin-ichiro Fujimoto, Seth Gagnon, Luigi Gallo, Carlos Garcia Diaz, Massimo Gaspari, Fabio Gastaldello, Joseph D Gelfand, Suvi Gezari, Simona Ghizzardi, Simona Giacintucci, A Gill, Roberto Gilli, Myriam Gitti, Margherita Giustini, Andrea Gnarini, Paola Grandi, Arran Gross, Liyi Gu, Sean Gunderson, Hans Moritz Gunther, Daryl Haggard, Kenji Hamaguchi, Jeremy Hare, Kevin C Harrington, Craig Heinke, Sebastian Heinz, Julie Hlavacek-Larrondo, Wynn CG Ho, Edmund Hodges-Kluck, Jeroen Homan

    arXiv e-prints, arXiv: 2511.00253 science
    2
    2025
25. The Platonic Universe: Do Foundation Models See the Same Sky?

    Trinidad Borrell, Steven Dillmann, Kshitij Duraphe, Furkan Eris, Kartheik Iyer, Ashod Khederlarian, Aman Kumar, Giovanni Marraffini, Michael J Smith, Shashwat Sourav, Rocco Di Tella, John F Wu

    arXiv preprint arXiv:2509.19453 ai for sciencefoundation modelsscience
    3
    2025
26. A Poisson Process AutoDecoder for X-Ray Sources

    Yanke Song, V Ashley Villar, Rafael Martínez-Galarza, Steven Dillmann

    The Astrophysical Journal 988 (1), 143 ai for sciencefoundation modelsscience
    8
    2025
27. Hyperluminous Supersoft X-Ray Sources in the Chandra Catalog

    Andrea Sacchi, Kevin Paggeot, Steven Dillmann, Juan Rafael Martínez-Galarza, Peter Kosec

    The Astrophysical Journal 983 (2), 124 science
    2
    2025
28. Building machine learning challenges for anomaly detection in science

    Elizabeth G Campolongo, Yuan-Tang Chou, Ekaterina Govorkova, Wahid Bhimji, Wei-Lun Chao, Chris Harris, Shih-Chieh Hsu, Hilmar Lapp, Mark S Neubauer, Josephine Namayanja, Aneesh Subramanian, Philip Harris, Advaith Anand, David E Carlyn, Subhankar Ghosh, Christopher Lawrence, Eric Moreno, Ryan Raikman, Jiaman Wu, Ziheng Zhang, Bayu Adhi, Mohammad Ahmadi Gharehtoragh, Saúl Alonso Monsalve, Marta Babicz, Furqan Baig, Namrata Banerji, William Bardon, Tyler Barna, Tanya Berger-Wolf, Adji Bousso Dieng, Micah Brachman, Quentin Buat, David CY Hui, Phuong Cao, Franco Cerino, Yi-Chun Chang, Shivaji Chaulagain, An-Kai Chen, Deming Chen, Eric Chen, Chia-Jui Chou, Zih-Chen Ciou, Miles Cochran-Branson, Artur Cordeiro Oudot Choi, Michael Coughlin, Matteo Cremonesi, Maria Dadarlat, Peter Darch, Malina Desai, Daniel Diaz, Steven Dillmann, Javier Duarte, Isla Duporge, Urbas Ekka, Saba Entezari Heravi, Hao Fang, Rian Flynn, Geoffrey Fox, Emily Freed, Hang Gao, Jing Gao, Julia Gonski, Matthew Graham, Abolfazl Hashemi, Scott Hauck, James Hazelden, Joshua Henry Peterson, Duc Hoang, Wei Hu, Mirco Huennefeld, David Hyde, Vandana Janeja, Nattapon Jaroenchai, Haoyi Jia, Yunfan Kang, Maksim Kholiavchenko, Elham E Khoda, Sangin Kim, Aditya Kumar, Bo-Cheng Lai, Trung Le, Chi-Wei Lee, JangHyeon Lee, Shaocheng Lee, Suzan van der Lee, Charles Lewis, Haitong Li, Haoyang Li, Henry Liao, Mia Liu, Xiaolin Liu, Xiulong Liu, Vladimir Loncar, Fangzheng Lyu, Ilya Makarov, Abhishikth Mallampalli, Chen-Yu Mao, Alexander Michels, Alexander Migala, Farouk Mokhtar, Mathieu Morlighem, Min Namgung, Andrzej Novak, Andrew Novick, Amy Orsborn, Anand Padmanabhan, Jia-Cheng Pan, Sneh Pandya, Zhiyuan Pei, Ana Peixoto, George Percivall, Alex Po Leung, Sanjay Purushotham, Zhiqiang Que, Melissa Quinnan, Arghya Ranjan, Dylan Rankin, Christina Reissel, Benedikt Riedel, Dan Rubenstein, Argyro Sasli, Eli Shlizerman, Arushi Singh, Kim Singh, Eric R Sokol, Arturo Sorensen, Yu Su, Mitra Taheri, Vaibhav Thakkar, Ann Mariam Thomas, Eric Toberer, Chenghan Tsai, Rebecca Vandewalle, Arjun Verma, Ricco C Venterea, He Wang, Jianwu Wang, Sam Wang, Shaowen Wang, Gordon Watts, Jason Weitz, Andrew Wildridge, Rebecca Williams, Scott Wolf, Yue Xu, Jianqi Yan, Jai Yu, Yulei Zhang, Haoran Zhao, Ying Zhao

    arXiv preprint arXiv:2503.02112 ai evaluationai for science
    7
    2025
29. Representation learning for time-domain high-energy astrophysics: Discovery of extragalactic fast X-ray transient XRT 200515

    Steven Dillmann, Juan Rafael Martínez-Galarza, Roberto Soria, Rosanne Di Stefano, Vinay L Kashyap

    Monthly Notices of the Royal Astronomical Society 537 (2), 931-955 ai for sciencefoundation modelsscience
    28
    2025
30. AI/ML Models and Tools for Processing and Analysis of Observational Data from the Habitable Worlds Observatory

    Megan Ansdell, Ehsan Gharib-Nezhad, Virisha Timmaraju, Bruce Dean, Aquib Moin, Cecilia Garraffo, Mark Moussa, Gioia Rau, Mario Damiano, Gautier Bardi, Victoria Da Poian, Hamed Valizadegan, Mahdi Habibi, Emily Mader, Miguel Martinho, Wenli Mo, Niki Parenteau, Steven Dillmann

    Annual American Geophysical Union (AGU) Meeting ai for sciencescience
    2
    2024
31. The Cloudspotting on Mars citizen science project: Seasonal and spatial cloud distributions observed by the Mars Climate Sounder

    Marek Slipski, Armin Kleinböhl, Steven Dillmann, David M Kass, Jason Reimuller, Mark Wronkiewicz, Gary Doran

    Icarus 419, 115777 science
    6
    2024
32. The impact of satellite trails on Hubble Space Telescope observations

    Sandor Kruk, Pablo García-Martín, Marcel Popescu, Ben Aussel, Steven Dillmann, Megan E Perks, Tamina Lund, Bruno Merín, Ross Thomson, Samet Karadag, Mark J McCaughrean

    Nature Astronomy 7 (3), 262-268 science
    79
    2023
33. Replication Data for Cloudspotting on Mars Citizen Science Cloud Centroids for Mars Year 29

    Marek Slipski, Armin Kleinböhl, Steven Dillmann, David Kass, Jason Reimuller, Mark Wronkiewicz, Gary Doran

    Jet Propulsion Laboratory Data Set, 363 science
    2023
34. Terminal-Bench-Science: Evaluating AI agents on research workflows across scientific domains

    Terminal-Bench-Science Team

    agentsai evaluationai for science
    2
35. VeriBench: An End-to-End Formal Verification Benchmark for AI Coding Agents in Lean 4

    Brando Miranda, Srivatsava Daruru, Ethan S Hersch, Zhanke Zhou, Allen Nie, Daneshvar Amrollahi, Leni Aniva, Iddah Mlauzi, Kirill Acharya, Elyas Obbad, Dilara Soylu, Weston Kirk, Zixiao Jolene Wang, Kai Fronsdal, Ying Li, Donald Poindexter Jr, Rakshit Kaushik, Shurui Liu, Yegor Denisov-Blanch, Steven Dillmann, Simon Obstbaum, Santiago Cuellar, John Sarracino, Rylan Schaeffer, Mo Tiwari, Donghyun Lee, Bo Han, Sanmi Koyejo

    3rd AI for Math Workshop: Toward Self-Evolving Scientific Agents, 0 agentsai evaluation
36. Certifying the Judge: Falsifiable Properties for LLM-Based Evaluation of Formal Code

    Ethan S Hersch, Brando Miranda, Elyas Obbad, Srivatsava Daruru, Kirill Acharya, Zixiao Jolene Wang, Steven Dillmann, Yegor Denisov-Blanch, Sanmi Koyejo

    Deep Learning for Code: Towards Human-Centered Coding Agents, 0 agentsai evaluation
37. ResearchBench: Evaluating AI Agents on End-To-End Astrophysics Research Paper Replication

    Christine Ye, Sihan Yuan, Suchetha Cooray, Steven Dillmann, Ian LV Roque, Dalya Baron, Philipp Frank, Sergio Martin-Alvarez, Nolan Koblischke, Frank J Qu, Diyi Yang, Risa Wechsler, Ioana Ciuca

    agentsai evaluationai for sciencescience

No publications match.