Deep Learning for Automated Experimentation in Scanning Transmission Electron Microscopy
Sergei V Kalinin, Debangshu Mukherjee, Kevin M Roccapriore, Ben Blaiszik, Ayana Ghosh, Maxim A Ziatdinov, A Al-Najjar, Christina Doty, Sarah Akers, Nageswara S Rao, …
Machine learning (ML) has become critical for post-acquisition data analysis
in (scanning) transmission electron microscopy, (S)TEM, imaging and
spectroscopy. An emerging trend is the transition to real-time analysis and
closed-loop microscope operation. The effective use of ML in electron
microscopy now requires the development of strategies for microscopy-centered
experiment workflow design and optimization. Here, we discuss the associated
challenges with the transition to active ML, including sequential data analysis
and out-of-distribution drift effects, the requirements for the edge operation,
local and cloud data storage, and theory in the loop operations. Specifically,
we discuss the relative contributions of human scientists and ML agents in the
ideation, orchestration, and execution of experimental workflows and the need
to develop universal hyper languages that can apply across multiple platforms.
These considerations will collectively inform the operationalization of ML in
next-generation experimentation.
Metrics
14 Record Views
Details
Title
Deep Learning for Automated Experimentation in Scanning Transmission Electron Microscopy